-
Duality Principle and Biologically Plausible Learning: Connecting the Representer Theorem and Hebbian Learning
Authors:
Yanis Bahroun,
Dmitri B. Chklovskii,
Anirvan M. Sengupta
Abstract:
A normative approach called Similarity Matching was recently introduced for deriving and understanding the algorithmic basis of neural computation focused on unsupervised problems. It involves deriving algorithms from computational objectives and evaluating their compatibility with anatomical and physiological observations. In particular, it introduces neural architectures by considering dual alte…
▽ More
A normative approach called Similarity Matching was recently introduced for deriving and understanding the algorithmic basis of neural computation focused on unsupervised problems. It involves deriving algorithms from computational objectives and evaluating their compatibility with anatomical and physiological observations. In particular, it introduces neural architectures by considering dual alternatives instead of primal formulations of popular models such as PCA. However, its connection to the Representer theorem remains unexplored. In this work, we propose to use teachings from this approach to explore supervised learning algorithms and clarify the notion of Hebbian learning. We examine regularized supervised learning and elucidate the emergence of neural architecture and additive versus multiplicative update rules. In this work, we focus not on develo** new algorithms but on showing that the Representer theorem offers the perfect lens to study biologically plausible learning algorithms. We argue that many past and current advancements in the field rely on some form of dual formulation to introduce biological plausibility. In short, as long as a dual formulation exists, it is possible to derive biologically plausible algorithms. Our work sheds light on the pivotal role of the Representer theorem in advancing our comprehension of neural computation.
△ Less
Submitted 2 August, 2023;
originally announced September 2023.
-
Unlocking the Potential of Similarity Matching: Scalability, Supervision and Pre-training
Authors:
Yanis Bahroun,
Shagesh Sridharan,
Atithi Acharya,
Dmitri B. Chklovskii,
Anirvan M. Sengupta
Abstract:
While effective, the backpropagation (BP) algorithm exhibits limitations in terms of biological plausibility, computational cost, and suitability for online learning. As a result, there has been a growing interest in develo** alternative biologically plausible learning approaches that rely on local learning rules. This study focuses on the primarily unsupervised similarity matching (SM) framewor…
▽ More
While effective, the backpropagation (BP) algorithm exhibits limitations in terms of biological plausibility, computational cost, and suitability for online learning. As a result, there has been a growing interest in develo** alternative biologically plausible learning approaches that rely on local learning rules. This study focuses on the primarily unsupervised similarity matching (SM) framework, which aligns with observed mechanisms in biological systems and offers online, localized, and biologically plausible algorithms. i) To scale SM to large datasets, we propose an implementation of Convolutional Nonnegative SM using PyTorch. ii) We introduce a localized supervised SM objective reminiscent of canonical correlation analysis, facilitating stacking SM layers. iii) We leverage the PyTorch implementation for pre-training architectures such as LeNet and compare the evaluation of features against BP-trained models. This work combines biologically plausible algorithms with computational efficiency opening multiple avenues for further explorations.
△ Less
Submitted 2 August, 2023;
originally announced August 2023.
-
Normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticity
Authors:
David Lipshutz,
Yanis Bahroun,
Siavash Golkar,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
An established normative approach for understanding the algorithmic basis of neural computation is to derive online algorithms from principled computational objectives and evaluate their compatibility with anatomical and physiological observations. Similarity matching objectives have served as successful starting points for deriving online algorithms that map onto neural networks (NNs) with point…
▽ More
An established normative approach for understanding the algorithmic basis of neural computation is to derive online algorithms from principled computational objectives and evaluate their compatibility with anatomical and physiological observations. Similarity matching objectives have served as successful starting points for deriving online algorithms that map onto neural networks (NNs) with point neurons and Hebbian/anti-Hebbian plasticity. These NN models account for many anatomical and physiological observations; however, the objectives have limited computational power and the derived NNs do not explain multi-compartmental neuronal structures and non-Hebbian forms of plasticity that are prevalent throughout the brain. In this article, we unify and generalize recent extensions of the similarity matching approach to address more complex objectives, including a large class of unsupervised and self-supervised learning tasks that can be formulated as symmetric generalized eigenvalue problems or nonnegative matrix factorization problems. Interestingly, the online algorithms derived from these objectives naturally map onto NNs with multi-compartmental neurons and local, non-Hebbian learning rules. Therefore, this unified extension of the similarity matching approach provides a normative framework that facilitates understanding multi-compartmental neuronal structures and non-Hebbian plasticity found throughout the brain.
△ Less
Submitted 3 August, 2023; v1 submitted 20 February, 2023;
originally announced February 2023.
-
Constrained Predictive Coding as a Biologically Plausible Model of the Cortical Hierarchy
Authors:
Siavash Golkar,
Tiberiu Tesileanu,
Yanis Bahroun,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into map** PC faithfully onto the cortex, but there are issues that remain unresolved or controversial. In particular, current implementations often involve separate value and error neurons and require symmetric forward and backward w…
▽ More
Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into map** PC faithfully onto the cortex, but there are issues that remain unresolved or controversial. In particular, current implementations often involve separate value and error neurons and require symmetric forward and backward weights across different brain regions. These features have not been experimentally confirmed. In this work, we show that the PC framework in the linear regime can be modified to map faithfully onto the cortical hierarchy in a manner compatible with empirical observations. By employing a disentangling-inspired constraint on hidden-layer neural activities, we derive an upper bound for the PC objective. Optimization of this upper bound leads to an algorithm that shows the same performance as the original objective and maps onto a biologically plausible network. The units of this network can be interpreted as multi-compartmental neurons with non-Hebbian learning rules, with a remarkable resemblance to recent experimental findings. There exist prior models which also capture these features, but they are phenomenological, while our work is a normative derivation. The network we derive does not involve one-to-one connectivity or signal multiplexing, which the phenomenological models required, indicating that these features are not necessary for learning in the cortex. The normative nature of our algorithm in the simplified linear case allows us to prove interesting properties of the framework and analytically understand the computational role of our network's components. The parameters of our network have natural interpretations as physiological quantities in a multi-compartmental model of pyramidal neurons, providing a concrete link between PC and experimental measurements carried out in the cortex.
△ Less
Submitted 4 March, 2023; v1 submitted 27 October, 2022;
originally announced October 2022.
-
A Normative and Biologically Plausible Algorithm for Independent Component Analysis
Authors:
Yanis Bahroun,
Dmitri B Chklovskii,
Anirvan M Sengupta
Abstract:
The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a biological circuit, the ICA neural network (NN) must satisfy at least the following requirements: 1. The algorithm must operate in the online setting where data s…
▽ More
The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a biological circuit, the ICA neural network (NN) must satisfy at least the following requirements: 1. The algorithm must operate in the online setting where data samples are streamed one at a time, and the NN computes the sources on the fly without storing any significant fraction of the data in memory. 2. The synaptic weight update is local, i.e., it depends only on the biophysical variables present in the vicinity of a synapse. Here, we propose a novel objective function for ICA from which we derive a biologically plausible NN, including both the neural architecture and the synaptic learning rules. Interestingly, our algorithm relies on modulating synaptic plasticity by the total activity of the output neurons. In the brain, this could be accomplished by neuromodulators, extracellular calcium, local field potential, or nitric oxide.
△ Less
Submitted 16 November, 2021;
originally announced November 2021.
-
Neural optimal feedback control with local learning rules
Authors:
Johannes Friedrich,
Siavash Golkar,
Shiva Farashahi,
Alexander Genkin,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
A major problem in motor control is understanding how the brain plans and executes proper movements in the face of delayed and noisy stimuli. A prominent framework for addressing such control problems is Optimal Feedback Control (OFC). OFC generates control actions that optimize behaviorally relevant criteria by integrating noisy sensory stimuli and the predictions of an internal model using the K…
▽ More
A major problem in motor control is understanding how the brain plans and executes proper movements in the face of delayed and noisy stimuli. A prominent framework for addressing such control problems is Optimal Feedback Control (OFC). OFC generates control actions that optimize behaviorally relevant criteria by integrating noisy sensory stimuli and the predictions of an internal model using the Kalman filter or its extensions. However, a satisfactory neural model of Kalman filtering and control is lacking because existing proposals have the following limitations: not considering the delay of sensory feedback, training in alternating phases, and requiring knowledge of the noise covariance matrices, as well as that of systems dynamics. Moreover, the majority of these studies considered Kalman filtering in isolation, and not jointly with control. To address these shortcomings, we introduce a novel online algorithm which combines adaptive Kalman filtering with a model free control approach (i.e., policy gradient algorithm). We implement this algorithm in a biologically plausible neural network with local synaptic plasticity rules. This network performs system identification and Kalman filtering, without the need for multiple phases with distinct update rules or the knowledge of the noise covariances. It can perform state estimation with delayed sensory feedback, with the help of an internal model. It learns the control policy without requiring any knowledge of the dynamics, thus avoiding the need for weight transport. In this way, our implementation of OFC solves the credit assignment problem needed to produce the appropriate sensory-motor control in the presence of stimulus delay.
△ Less
Submitted 12 November, 2021;
originally announced November 2021.
-
Neural circuits for dynamics-based segmentation of time series
Authors:
Tiberiu Tesileanu,
Siavash Golkar,
Samaneh Nasiri,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
The brain must extract behaviorally relevant latent variables from the signals streamed by the sensory organs. Such latent variables are often encoded in the dynamics that generated the signal rather than in the specific realization of the waveform. Therefore, one problem faced by the brain is to segment time series based on underlying dynamics. We present two algorithms for performing this segmen…
▽ More
The brain must extract behaviorally relevant latent variables from the signals streamed by the sensory organs. Such latent variables are often encoded in the dynamics that generated the signal rather than in the specific realization of the waveform. Therefore, one problem faced by the brain is to segment time series based on underlying dynamics. We present two algorithms for performing this segmentation task that are biologically plausible, which we define as acting in a streaming setting and all learning rules being local. One algorithm is model-based and can be derived from an optimization problem involving a mixture of autoregressive processes. This algorithm relies on feedback in the form of a prediction error, and can also be used for forecasting future samples. In some brain regions, such as the retina, the feedback connections necessary to use the prediction error for learning are absent. For this case, we propose a second, model-free algorithm that uses a running estimate of the autocorrelation structure of the signal to perform the segmentation. We show that both algorithms do well when tasked with segmenting signals drawn from autoregressive models with piecewise-constant parameters. In particular, the segmentation accuracy is similar to that obtained from oracle-like methods in which the ground-truth parameters of the autoregressive models are known. We also test our methods on datasets generated by alternating snippets of voice recordings. We provide implementations of our algorithms at https://github.com/ttesileanu/bio-time-series.
△ Less
Submitted 5 October, 2021; v1 submitted 23 April, 2021;
originally announced April 2021.
-
A Similarity-preserving Neural Network Trained on Transformed Images Recapitulates Salient Features of the Fly Motion Detection Circuit
Authors:
Yanis Bahroun,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
Learning to detect content-independent transformations from data is one of the central problems in biological and artificial intelligence. An example of such problem is unsupervised learning of a visual motion detector from pairs of consecutive video frames. Rao and Ruderman formulated this problem in terms of learning infinitesimal transformation operators (Lie group generators) via minimizing im…
▽ More
Learning to detect content-independent transformations from data is one of the central problems in biological and artificial intelligence. An example of such problem is unsupervised learning of a visual motion detector from pairs of consecutive video frames. Rao and Ruderman formulated this problem in terms of learning infinitesimal transformation operators (Lie group generators) via minimizing image reconstruction error. Unfortunately, it is difficult to map their model onto a biologically plausible neural network (NN) with local learning rules. Here we propose a biologically plausible model of motion detection. We also adopt the transformation-operator approach but, instead of reconstruction-error minimization, start with a similarity-preserving objective function. An online algorithm that optimizes such an objective function naturally maps onto an NN with biologically plausible learning rules. The trained NN recapitulates major features of the well-studied motion detector in the fly. In particular, it is consistent with the experimental observation that local motion detectors combine information from at least three adjacent pixels, something that contradicts the celebrated Hassenstein-Reichardt model.
△ Less
Submitted 10 February, 2021;
originally announced February 2021.
-
A biologically plausible neural network for local supervision in cortical microcircuits
Authors:
Siavash Golkar,
David Lipshutz,
Yanis Bahroun,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
The backpropagation algorithm is an invaluable tool for training artificial neural networks; however, because of a weight sharing requirement, it does not provide a plausible model of brain function. Here, in the context of a two-layer network, we derive an algorithm for training a neural network which avoids this problem by not requiring explicit error computation and backpropagation. Furthermore…
▽ More
The backpropagation algorithm is an invaluable tool for training artificial neural networks; however, because of a weight sharing requirement, it does not provide a plausible model of brain function. Here, in the context of a two-layer network, we derive an algorithm for training a neural network which avoids this problem by not requiring explicit error computation and backpropagation. Furthermore, our algorithm maps onto a neural network that bears a remarkable resemblance to the connectivity structure and learning rules of the cortex. We find that our algorithm empirically performs comparably to backprop on a number of datasets.
△ Less
Submitted 30 November, 2020;
originally announced November 2020.
-
A simple normative network approximates local non-Hebbian learning in the cortex
Authors:
Siavash Golkar,
David Lipshutz,
Yanis Bahroun,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
To guide behavior, the brain extracts relevant features from high-dimensional data streamed by sensory organs. Neuroscience experiments demonstrate that the processing of sensory inputs by cortical neurons is modulated by instructive signals which provide context and task-relevant information. Here, adopting a normative approach, we model these instructive signals as supervisory inputs guiding the…
▽ More
To guide behavior, the brain extracts relevant features from high-dimensional data streamed by sensory organs. Neuroscience experiments demonstrate that the processing of sensory inputs by cortical neurons is modulated by instructive signals which provide context and task-relevant information. Here, adopting a normative approach, we model these instructive signals as supervisory inputs guiding the projection of the feedforward data. Mathematically, we start with a family of Reduced-Rank Regression (RRR) objective functions which include Reduced Rank (minimum) Mean Square Error (RRMSE) and Canonical Correlation Analysis (CCA), and derive novel offline and online optimization algorithms, which we call Bio-RRR. The online algorithms can be implemented by neural networks whose synaptic learning rules resemble calcium plateau potential dependent plasticity observed in the cortex. We detail how, in our model, the calcium plateau potential can be interpreted as a backpropagating error signal. We demonstrate that, despite relying exclusively on biologically plausible local learning rules, our algorithms perform competitively with existing implementations of RRMSE and CCA.
△ Less
Submitted 23 October, 2020;
originally announced October 2020.
-
A biologically plausible neural network for multi-channel Canonical Correlation Analysis
Authors:
David Lipshutz,
Yanis Bahroun,
Siavash Golkar,
Anirvan M. Sengupta,
Dmitri B. Chklovskii
Abstract:
Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonical Correlation Analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this en…
▽ More
Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonical Correlation Analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this end, we seek a multi-channel CCA algorithm that can be implemented in a biologically plausible neural network. For biological plausibility, we require that the network operates in the online setting and its synaptic update rules are local. Starting from a novel CCA objective function, we derive an online optimization algorithm whose optimization steps can be implemented in a single-layer neural network with multi-compartmental neurons and local non-Hebbian learning rules. We also derive an extension of our online CCA algorithm with adaptive output rank and output whitening. Interestingly, the extension maps onto a neural network whose neural architecture and synaptic updates resemble neural circuitry and synaptic plasticity observed experimentally in cortical pyramidal neurons.
△ Less
Submitted 26 March, 2021; v1 submitted 1 October, 2020;
originally announced October 2020.
-
Emulation of Astrocyte Induced Neural Phase Synchrony in Spin-Orbit Torque Oscillator Neurons
Authors:
Umang Garg,
Kezhou Yang,
Abhronil Sengupta
Abstract:
Astrocytes play a central role in inducing concerted phase synchronized neural-wave patterns inside the brain. In this article, we demonstrate that injected radio-frequency signal in underlying heavy metal layer of spin-orbit torque oscillator neurons mimic the neuron phase synchronization effect realized by glial cells. Potential application of such phase coupling effects is illustrated in the co…
▽ More
Astrocytes play a central role in inducing concerted phase synchronized neural-wave patterns inside the brain. In this article, we demonstrate that injected radio-frequency signal in underlying heavy metal layer of spin-orbit torque oscillator neurons mimic the neuron phase synchronization effect realized by glial cells. Potential application of such phase coupling effects is illustrated in the context of a temporal "binding problem". We also present the design of a coupled neuron-synapse-astrocyte network enabled by compact neuromimetic devices by combining the concepts of local spike-timing dependent plasticity and astrocyte induced neural phase synchrony.
△ Less
Submitted 16 September, 2021; v1 submitted 1 July, 2020;
originally announced July 2020.
-
Sewage Pooling Test for SARS-CoV-2
Authors:
Ritam Guha,
Anik Sengupta,
Ankan Dutta
Abstract:
CoVID-19 is currently one of the biggest threats to mankind. To date, it is the reason for infections of over 35 lakhs and the death of over 2 lakh human beings. We propose a procedure to detect CoVID-19 affected localities using a sewage mass testing and pooling mechanism which has gained ground in recent times. The proposed method named Sewage Pooling Algorithm tests wastewater samples from sewa…
▽ More
CoVID-19 is currently one of the biggest threats to mankind. To date, it is the reason for infections of over 35 lakhs and the death of over 2 lakh human beings. We propose a procedure to detect CoVID-19 affected localities using a sewage mass testing and pooling mechanism which has gained ground in recent times. The proposed method named Sewage Pooling Algorithm tests wastewater samples from sewage systems to pinpoint the regions which are affected by maximum chances of the virus spread. The algorithm also uses a priority-based backtracking procedure to perform testing in sewage links depending on the probability of infection in the sub-areas. For places with very rare CoVID cases, we present a gradient-based search method to prune those areas. The proposed method has less human intervention and increases the effective tests/million people over current in-place methods.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Optogenetic vision restoration with high resolution
Authors:
Ulisse Ferrari,
Stéphane Deny,
Abhishek Sengupta,
Romain Caplette,
José-Alain Sahel,
Deniz Dalkara,
Serge Picaud,
Jens Duebel,
Olivier Marre
Abstract:
The majority of inherited retinal degenerations are due to photoreceptor cell death. In many cases ganglion cells are spared making it possible to stimulate them to restore visual function. Several studies (Bi et al., 2006; Lin et al., 2008; Sengupta et al., 2016; Caporale et al., 2011; Berry et al., 2017) have shown that it is possible to express an optogenetic protein in ganglion cells and make…
▽ More
The majority of inherited retinal degenerations are due to photoreceptor cell death. In many cases ganglion cells are spared making it possible to stimulate them to restore visual function. Several studies (Bi et al., 2006; Lin et al., 2008; Sengupta et al., 2016; Caporale et al., 2011; Berry et al., 2017) have shown that it is possible to express an optogenetic protein in ganglion cells and make them light sensitive. This is a promising strategy to restore vision since optical targeting may be more precise than electrical stimulation with a retinal prothesis. However the spatial resolution of optogenetically-reactivated retinas has not been measured with fine-grained stimulation patterns. Since the optogenetic protein is also expressed in axons, it is unclear if these neurons will only be sensitive to the stimulation of a small region covering their somas and dendrites, or if they will also respond to any stimulation overlap** with their axon, dramatically impairing spatial resolution. Here we recorded responses of mouse and macaque retinas to random checkerboard patterns following an in vivo optogenetic therapy. We show that optogenetically activated ganglion cells are each sensitive to a small region of visual space. A simple model based on this small receptive field predicted accurately their responses to complex stimuli. From this model, we simulated how the entire population of light sensitive ganglion cells would respond to letters of different sizes. We then estimated the maximal acuity expected by a patient, assuming it could make an optimal use of the information delivered by this reactivated retina. The obtained acuity is above the limit of legal blindness. This high spatial resolution is a promising result for future clinical studies.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
-
Why do similarity matching objectives lead to Hebbian/anti-Hebbian networks?
Authors:
Cengiz Pehlevan,
Anirvan Sengupta,
Dmitri B. Chklovskii
Abstract:
Modeling self-organization of neural networks for unsupervised learning using Hebbian and anti-Hebbian plasticity has a long history in neuroscience. Yet, derivations of single-layer networks with such local learning rules from principled optimization objectives became possible only recently, with the introduction of similarity matching objectives. What explains the success of similarity matching…
▽ More
Modeling self-organization of neural networks for unsupervised learning using Hebbian and anti-Hebbian plasticity has a long history in neuroscience. Yet, derivations of single-layer networks with such local learning rules from principled optimization objectives became possible only recently, with the introduction of similarity matching objectives. What explains the success of similarity matching objectives in deriving neural networks with local learning rules? Here, using dimensionality reduction as an example, we introduce several variable substitutions that illuminate the success of similarity matching. We show that the full network objective may be optimized separately for each synapse using local learning rules both in the offline and online settings. We formalize the long-standing intuition of the rivalry between Hebbian and anti-Hebbian rules by formulating a min-max optimization problem. We introduce a novel dimensionality reduction objective using fractional matrix exponents. To illustrate the generality of our approach, we apply it to a novel formulation of dimensionality reduction combined with whitening. We confirm numerically that the networks with learning rules derived from principled objectives perform better than those with heuristic learning rules.
△ Less
Submitted 11 July, 2017; v1 submitted 22 March, 2017;
originally announced March 2017.
-
Understanding Functional Protein-Protein Interactions Of ABCB11 And ADA In Human And Mouse
Authors:
Antara Sengupta,
Sk. Sarif Hassan,
Pabitra Pal Choudhury
Abstract:
Proteins are macromolecules which hardly act alone; they need to make interactions with some other proteins to do so. Numerous factors are there which can regulate the interactions between proteins [4]. Here in this present study we aim to understand Protein -Protein Interactions (PPIs) of two proteins ABCB11 and ADA from quantitative point of view. One of our major aims also is to study the facto…
▽ More
Proteins are macromolecules which hardly act alone; they need to make interactions with some other proteins to do so. Numerous factors are there which can regulate the interactions between proteins [4]. Here in this present study we aim to understand Protein -Protein Interactions (PPIs) of two proteins ABCB11 and ADA from quantitative point of view. One of our major aims also is to study the factors that regulate the PPIs and thus to distinguish these PPIs with proper quantification across the two species Homo Sapiens and Mus Musculus respectively to know how one protein interacts with different set of proteins in different species.
△ Less
Submitted 2 December, 2015;
originally announced December 2015.
-
Blue Emission in Proteins
Authors:
Sohini Sarkar,
Abhigyan Sengupta,
Partha Hazra,
Pankaj Mandal
Abstract:
Recent literatures reported blue-green emission from amyloid fibril as exclusive signature of fibril formation. This unusual visible luminescence is regularly used to monitor fibril growth. Blue-green emission has also been observed in crystalline protein and in solution. However, the origin of this emission is not known exactly. Our spectroscopic study of serum proteins reveals that the blue-gree…
▽ More
Recent literatures reported blue-green emission from amyloid fibril as exclusive signature of fibril formation. This unusual visible luminescence is regularly used to monitor fibril growth. Blue-green emission has also been observed in crystalline protein and in solution. However, the origin of this emission is not known exactly. Our spectroscopic study of serum proteins reveals that the blue-green emission is a property of protein monomer. Evidences suggest that semiconductor-like band structure of proteins with the optical band-gap in the visible region is possibly the origin of this phenomenon. We show here that the band structure of proteins is primarily the result of electron delocalization through the peptide chain, rather than through the hydrogen bond network in secondary structure.
△ Less
Submitted 10 May, 2014; v1 submitted 27 April, 2014;
originally announced April 2014.
-
Titration and hysteresis in epigenetic chromatin silencing
Authors:
Adel Dayarian,
Anirvan M. Sengupta
Abstract:
Epigenetic mechanisms of silencing via heritable chromatin modifications play a major role in gene regulation and cell fate specification. We consider a model of epigenetic chromatin silencing in budding yeast and study the bifurcation diagram and characterize the bistable and the monostable regimes. The main focus of this paper is to examine how the perturbations altering the activity of histone…
▽ More
Epigenetic mechanisms of silencing via heritable chromatin modifications play a major role in gene regulation and cell fate specification. We consider a model of epigenetic chromatin silencing in budding yeast and study the bifurcation diagram and characterize the bistable and the monostable regimes. The main focus of this paper is to examine how the perturbations altering the activity of histone modifying enzymes affect the epigenetic states. We analyze the implications of having the total number of silencing proteins given by the sum of proteins bound to the nucleosomes and the ones available in the ambient to be constant. This constraint couples different regions of chromatin through the shared reservoir of ambient silencing proteins. We show that the response of the system to perturbations depends dramatically on the titration effect caused by the above constraint. In particular, for a certain range of overall abundance of silencing proteins, the hysteresis loop changes qualitatively with certain jump replaced by continuous merger of different states. In addition, we find a nonmonotonic dependence of gene expression on the rate of histone deacetylation activity of Sir2. We discuss how these qualitative predictions of our model could be compared with experimental studies of the yeast system under anti-silencing drugs.
△ Less
Submitted 14 February, 2013; v1 submitted 17 September, 2012;
originally announced September 2012.
-
A Quantitative Understanding of Human Sex Chromosomal Genes
Authors:
Sk. Sarif Hassan,
Pabitra Pal Choudhury,
Antara Sengupta,
Binayak Sahu,
Rojalin Mishra,
Devendra Kumar Yadav,
Saswatee Panda,
Dharamveer Pradhan,
Shrusti Dash,
Gourav Pradhan
Abstract:
In the last few decades, the human allosomes are engrossed in an intensive attention among researchers. The allosomes are now already been sequenced and found there are about 2000 and 78 genes in human X and Y chromosomes respectively. The hemizygosity of the human X chromosome in males exposes recessive disease alleles, and this phenomenon has prompted decades of intensive study of X-linked disor…
▽ More
In the last few decades, the human allosomes are engrossed in an intensive attention among researchers. The allosomes are now already been sequenced and found there are about 2000 and 78 genes in human X and Y chromosomes respectively. The hemizygosity of the human X chromosome in males exposes recessive disease alleles, and this phenomenon has prompted decades of intensive study of X-linked disorders. By contrast, the small size of the human Y chromosome, and its prominent long-arm heterochromatic region suggested absence of function beyond sex determination. But the present problem is to accomplish whether a given sequence of nucleotides i.e. a DNA is a Human X or Y chromosomal genes or not, without any biological experimental support. In our perspective, a proper quantitative understanding of these genes is required to justify or nullify whether a given sequence is a Human X or Y chromosomal gene. In this paper, some of the X and Y chromosomal genes have been quantified in genomic and proteomic level through Fractal Geometric and Mathematical Morphometric analysis. Using the proposed quantitative model, one can easily make probable justification or deterministic nullification whether a given sequence of nucleotides is a probable Human X or Y chromosomal gene or not, without seeking any biological experiment. Of course, a further biological experiment is essential to validate it as the probable Human X or Y chromosomal gene homologue. This study would enable Biologists to understand these genes in more quantitative manner instead of their qualitative features.
△ Less
Submitted 1 December, 2013; v1 submitted 23 July, 2012;
originally announced July 2012.
-
What does the Allen Gene Expression Atlas tell us about mouse brain evolution?
Authors:
Swagatam Mukhopadhyay,
Pascal Grange,
Anirvan M. Sengupta,
Partha P. Mitra
Abstract:
We use the Allen Gene Expression Atlas (AGEA) and the OMA ortholog dataset to investigate the evolution of mouse-brain neuroanatomy from the standpoint of the molecular evolution of brain-specific genes. For each such gene, using the phylogenetic tree for all fully sequenced species and the presence of orthologs of the gene in these species, we construct and assign a discrete measure of evolutiona…
▽ More
We use the Allen Gene Expression Atlas (AGEA) and the OMA ortholog dataset to investigate the evolution of mouse-brain neuroanatomy from the standpoint of the molecular evolution of brain-specific genes. For each such gene, using the phylogenetic tree for all fully sequenced species and the presence of orthologs of the gene in these species, we construct and assign a discrete measure of evolutionary age. The gene expression profile of all gene of similar age, relative to the average gene expression profile, distinguish regions of the brain that are over-represented in the corresponding evolutionary timescale. We argue that the conclusions one can draw on evolution of twelve major brain regions from such a molecular level analysis supplements existing knowledge of mouse brain evolution and introduces new quantitative tools, especially for comparative studies, when AGEA-like data sets for other species become available. Using the functional role of the genes representational of a certain evolutionary timescale and brain region we compare and contrast, wherever possible, our observations with existing knowledge in evolutionary neuroanatomy.
△ Less
Submitted 1 June, 2012;
originally announced June 2012.
-
The role of multiple marks in epigenetic silencing and the emergence of a stable bivalent chromatin state
Authors:
Swagatam Mukhopadhyay,
Anirvan M. Sengupta
Abstract:
We introduce and analyze a minimal model of epigenetic silencing in budding yeast, built upon known biomolecular interactions in the system. Doing so, we identify the epigenetic marks essential for the bistability of epigenetic states. The model explicitly incorporates two key chromatin marks, namely H4K16 acetylation and H3K79 methylation, and explores whether the presence of multiple marks lead…
▽ More
We introduce and analyze a minimal model of epigenetic silencing in budding yeast, built upon known biomolecular interactions in the system. Doing so, we identify the epigenetic marks essential for the bistability of epigenetic states. The model explicitly incorporates two key chromatin marks, namely H4K16 acetylation and H3K79 methylation, and explores whether the presence of multiple marks lead to a qualitatively different systems behavior. We find that having both modifications is important for the robustness of epigenetic silencing. Besides the silenced and transcriptionally active fate of chromatin, our model leads to a novel state with bivalent (i.e., both active and silencing) marks under certain perturbations (knock-out mutations, inhibition or enhancement of enzymatic activity). The bivalent state appears under several perturbations and is shown to result in patchy silencing. We also show that the titration effect, owing to a limited supply of silencing proteins, can result in counter-intuitive responses. The design principles of the silencing system is systematically investigated and disparate experimental observations are assessed within a single theoretical framework. Specifically, we discuss the behavior of Sir protein recruitment, spreading and stability of silenced regions in commonly-studied mutants (e.g., sas2, dot1) illuminating the controversial role of Dot1 in the systems biology of yeast silencing.
△ Less
Submitted 5 October, 2013; v1 submitted 11 May, 2012;
originally announced May 2012.
-
SLIQ: Simple Linear Inequalities for Efficient Contig Scaffolding
Authors:
Rajat S. Roy,
Kevin C. Chen,
Anirvan M. Sengupta,
Alexander Schliep
Abstract:
Scaffolding is an important subproblem in "de novo" genome assembly in which mate pair data are used to construct a linear sequence of contigs separated by gaps. Here we present SLIQ, a set of simple linear inequalities derived from the geometry of contigs on the line that can be used to predict the relative positions and orientations of contigs from individual mate pair reads and thus produce a c…
▽ More
Scaffolding is an important subproblem in "de novo" genome assembly in which mate pair data are used to construct a linear sequence of contigs separated by gaps. Here we present SLIQ, a set of simple linear inequalities derived from the geometry of contigs on the line that can be used to predict the relative positions and orientations of contigs from individual mate pair reads and thus produce a contig digraph. The SLIQ inequalities can also filter out unreliable mate pairs and can be used as a preprocessing step for any scaffolding algorithm. We tested the SLIQ inequalities on five real data sets ranging in complexity from simple bacterial genomes to complex mammalian genomes and compared the results to the majority voting procedure used by many other scaffolding algorithms. SLIQ predicted the relative positions and orientations of the contigs with high accuracy in all cases and gave more accurate position predictions than majority voting for complex genomes, in particular the human genome. Finally, we present a simple scaffolding algorithm that produces linear scaffolds given a contig digraph. We show that our algorithm is very efficient compared to other scaffolding algorithms while maintaining high accuracy in predicting both contig positions and orientations for real data sets.
△ Less
Submitted 9 November, 2011; v1 submitted 6 November, 2011;
originally announced November 2011.
-
Theoretical analysis of the role of chromatin interactions in long-range action of enhancers and insulators
Authors:
Swagatam Mukhopadhyay,
Paul D. Schedl,
Vasily M. Studitsky,
Anirvan M. Sengupta
Abstract:
Long-distance regulatory interactions between enhancers and their target genes are commonplace in higher eukaryotes. Interposed boundaries or insulators are able to block these long distance regulatory interactions. The mechanistic basis for insulator activity and how it relates to enhancer action-at-a-distance remains unclear. Here we explore the idea that topological loops could simultaneously a…
▽ More
Long-distance regulatory interactions between enhancers and their target genes are commonplace in higher eukaryotes. Interposed boundaries or insulators are able to block these long distance regulatory interactions. The mechanistic basis for insulator activity and how it relates to enhancer action-at-a-distance remains unclear. Here we explore the idea that topological loops could simultaneously account for regulatory interactions of distal enhancers and the insulating activity of boundary elements. We show that while loop formation is not in itself sufficient to explain action at a distance, incorporating transient non-specific and moderate attractive interactions between the chromatin fibers strongly enhances long-distance regulatory interactions and is sufficient to generate a euchromatin-like state. Under these same conditions, the subdivision of the loop into two topologically independent loops by insulators inhibits inter-domain interactions. The underlying cause of this effect is a suppression of crossings in the contact map at intermediate distances. Thus our model simultaneously accounts for regulatory interactions at a distance and the insulator activity of boundary elements. This unified model of the regulatory roles of chromatin loops makes several testable predictions that could be confronted with \emph{in vitro} experiments, as well as genomic chromatin conformation capture and fluorescent microscopic approaches.
△ Less
Submitted 14 March, 2011;
originally announced March 2011.
-
Chemotactic predator-prey dynamics
Authors:
Ankush Sengupta,
Tobias Kruppa,
Hartmut Löwen
Abstract:
A discrete chemotactic predator-prey model is proposed in which the prey secrets a diffusing chemical which is sensed by the predator and vice versa. Two dynamical states corresponding to catching and esca** are identified and it is shown that steady hunting is unstable. For the escape process, the predator-prey distance is diffusive for short times but exhibits a transient subdiffusive behavior…
▽ More
A discrete chemotactic predator-prey model is proposed in which the prey secrets a diffusing chemical which is sensed by the predator and vice versa. Two dynamical states corresponding to catching and esca** are identified and it is shown that steady hunting is unstable. For the escape process, the predator-prey distance is diffusive for short times but exhibits a transient subdiffusive behavior which scales as a power law $t^{1/3}$ with time $t$ and ultimately crosses over to diffusion again. This allows to classify the motility and dynamics of various predatory bacteria and phagocytes. In particular, there is a distinct region in the parameter space where they prove to be infallible predators.
△ Less
Submitted 28 September, 2010;
originally announced September 2010.
-
Statistical mechanics of transcription-factor binding site discovery using Hidden Markov Models
Authors:
Pankaj Mehta,
David Schwab,
Anirvan M. Sengupta
Abstract:
Hidden Markov Models (HMMs) are a commonly used tool for inference of transcription factor (TF) binding sites from DNA sequence data. We exploit the mathematical equivalence between HMMs for TF binding and the "inverse" statistical mechanics of hard rods in a one-dimensional disordered potential to investigate learning in HMMs. We derive analytic expressions for the Fisher information, a commonly…
▽ More
Hidden Markov Models (HMMs) are a commonly used tool for inference of transcription factor (TF) binding sites from DNA sequence data. We exploit the mathematical equivalence between HMMs for TF binding and the "inverse" statistical mechanics of hard rods in a one-dimensional disordered potential to investigate learning in HMMs. We derive analytic expressions for the Fisher information, a commonly employed measure of confidence in learned parameters, in the biologically relevant limit where the density of binding sites is low. We then use techniques from statistical mechanics to derive a scaling principle relating the specificity (binding energy) of a TF to the minimum amount of training data necessary to learn it.
△ Less
Submitted 27 October, 2010; v1 submitted 18 August, 2010;
originally announced August 2010.
-
Dynamics of a microorganism moving by chemotaxis in its own secretion
Authors:
Ankush Sengupta,
Sven van Teeffelen,
Hartmut Löwen
Abstract:
The Brownian dynamics of a single microorganism coupled by chemotaxis to a diffusing concentration field which is secreted by the microorganism itself is studied by computer simulations in spatial dimensions $d=1,2,3$. Both cases of a chemoattractant and a chemorepellent are discussed. For a chemoattractant, we find a transient dynamical arrest until the microorganism diffuses for long times. Fo…
▽ More
The Brownian dynamics of a single microorganism coupled by chemotaxis to a diffusing concentration field which is secreted by the microorganism itself is studied by computer simulations in spatial dimensions $d=1,2,3$. Both cases of a chemoattractant and a chemorepellent are discussed. For a chemoattractant, we find a transient dynamical arrest until the microorganism diffuses for long times. For a chemorepellent, there is a transient ballistic motion in all dimensions and a long-time diffusion. These results are interpreted with the help of a theoretical analysis.
△ Less
Submitted 3 September, 2009; v1 submitted 8 May, 2009;
originally announced May 2009.
-
Shape, size and robustness: feasible regions in the parameter space of biochemical networks
Authors:
Madalena Chave,
Eduardo D. Sontag,
Anirvan M. Sengupta
Abstract:
The concept of robustness of regulatory networks has been closely related to the nature of the interactions among genes, and the capability of pattern maintenance or reproducibility. Defining this robustness property is a challenging task, but mathematical models have often associated it to the volume of the space of admissible parameters. Not only the volume of the space but also its topology a…
▽ More
The concept of robustness of regulatory networks has been closely related to the nature of the interactions among genes, and the capability of pattern maintenance or reproducibility. Defining this robustness property is a challenging task, but mathematical models have often associated it to the volume of the space of admissible parameters. Not only the volume of the space but also its topology and geometry contain information on essential aspects of the network, including feasible pathways, switching between two parallel pathways or distinct/disconnected active regions of parameters. A general method is presented here to characterize the space of admissible parameters, by writing it as a semi-algebraic set, and then theoretically analyzing its topology and geometry, as well as volume. This method provides a more objective and complete measure of the robustness of a developmental module. As an illustration, the segment polarity gene network is analyzed.
△ Less
Submitted 23 October, 2007;
originally announced October 2007.
-
Epigenetic Chromatin Silencing: Bistability and Front Propagation
Authors:
Mohammad Sedighi,
Anirvan M. Sengupta
Abstract:
The role of post-translational modification of histones in eukaryotic gene regulation is well recognized. Epigenetic silencing of genes via heritable chromatin modifications plays a major role in cell fate specification in higher organisms. We formulate a coarse-grained model of chromatin silencing in yeast and study the conditions under which the system becomes bistable, allowing for different…
▽ More
The role of post-translational modification of histones in eukaryotic gene regulation is well recognized. Epigenetic silencing of genes via heritable chromatin modifications plays a major role in cell fate specification in higher organisms. We formulate a coarse-grained model of chromatin silencing in yeast and study the conditions under which the system becomes bistable, allowing for different epigenetic states. We also study the dynamics of the boundary between the two locally stable states of chromatin: silenced and unsilenced. The model could be of use in guiding the discussion on chromatin silencing in general. In the context of silencing in budding yeast, it helps us understand the phenotype of various mutants, some of which may be non-trivial to see without the help of a mathematical model. One such example is a mutation that reduces the rate of background acetylation of particular histone side-chains that competes with the deacetylation by Sir2p. The resulting negative feedback due to a Sir protein depletion effect gives rise to interesting counter-intuitive consequences. Our mathematical analysis brings forth the different dynamical behaviors possible within the same molecular model and guides the formulation of more refined hypotheses that could be addressed experimentally.
△ Less
Submitted 22 October, 2007;
originally announced October 2007.
-
Quantitative modeling and data analysis of SELEX experiments
Authors:
Marko Djordjevic,
Anirvan M. Sengupta
Abstract:
SELEX (Systematic Evolution of Ligands by Exponential Enrichment) is an experimental procedure that allows extracting, from an initially random pool of DNA, those oligomers with high affinity for a given DNA-binding protein. We address what is a suitable experimental and computational procedure to infer parameters of transcription factor-DNA interaction from SELEX experiments. To answer this, we…
▽ More
SELEX (Systematic Evolution of Ligands by Exponential Enrichment) is an experimental procedure that allows extracting, from an initially random pool of DNA, those oligomers with high affinity for a given DNA-binding protein. We address what is a suitable experimental and computational procedure to infer parameters of transcription factor-DNA interaction from SELEX experiments. To answer this, we use a biophysical model of transcription factor-DNA interactions to quantitatively model SELEX. We show that a standard procedure is unsuitable for obtaining accurate interaction parameters. However, we theoretically show that a modified experiment in which chemical potential is fixed through different rounds of the experiment allows robust generation of an appropriate data set. Based on our quantitative model, we propose a novel bioinformatic method of data analysis for such modified experiment and apply it to extract the interaction parameters for a mammalian transcription factor CTF/NFI. From a practical point of view, our method results in a significantly improved false positive/false negative trade-off, as compared to both the standard information theory based method and a widely used empirically formulated procedure.
△ Less
Submitted 30 November, 2005;
originally announced December 2005.
-
Optimal Path to Epigenetic Switching
Authors:
David Marin Roma,
Ruadhan A. O'Flanagan,
Andrei E. Ruckenstein,
Anirvan M. Sengupta,
Ranjan Mukhopadhyay
Abstract:
We use large deviation methods to calculate rates of noise-induced transitions between states in multistable genetic networks. We analyze a synthetic biochemical circuit, the toggle switch, and compare the results to those obtained from a numerical solution of the master equation.
We use large deviation methods to calculate rates of noise-induced transitions between states in multistable genetic networks. We analyze a synthetic biochemical circuit, the toggle switch, and compare the results to those obtained from a numerical solution of the master equation.
△ Less
Submitted 22 November, 2004; v1 submitted 2 June, 2004;
originally announced June 2004.