Showing 1–36 of 36 results for author: Lim, W

Functions of Direct and Indirect Pathways for Action Selection Are Quantitatively Analyzed in A Spiking Neural Network of The Basal Ganglia

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We are concerned about action selection in the basal ganglia (BG). We quantitatively analyze functions of direct pathway (DP) and indirect pathway (IP) for action selection in a spiking neural network with 3 competing channels. For such quantitative analysis, in each channel, we obtain the competition degree ${\cal C}_d$, given by the ratio of strength of DP (${\cal S}_{DP}$) to strength of IP (… ▽ More We are concerned about action selection in the basal ganglia (BG). We quantitatively analyze functions of direct pathway (DP) and indirect pathway (IP) for action selection in a spiking neural network with 3 competing channels. For such quantitative analysis, in each channel, we obtain the competition degree ${\cal C}_d$, given by the ratio of strength of DP (${\cal S}_{DP}$) to strength of IP (${\cal S}_{IP}$) (i.e., ${\cal C}_d = {\cal S}_{DP} / {\cal S}_{IP}$). Then, a desired action is selected in the channel with the largest ${\cal C}_d$. Desired action selection is made mainly due to strong focused inhibitory projection to the output nucleus, SNr (substantia nigra pars reticulata) via the DP in the corresponding channel. Unlike the case of DP, there are two types of IPs; intra-channel IP and inter-channel IP, due to widespread diffusive excitation from the STN (subthalamic nucleus). The intra-channel IP serves a function of brake to suppress the desired action selection. In contrast, the inter-channel IP to the SNr in the neighboring channels suppresses competing actions, leading to highlight the desired action selection. In this way, function of the inter-channel IP is opposite to that of the intra-channel IP. However, to the best of our knowledge, no quantitative analysis for such functions of the DP and the two IPs was made. Here, through direct calculations of the DP and the intra- and the inter-channel IP presynaptic currents into the SNr in each channel, we obtain the competition degree of each channel to determine a desired action, and then functions of the DP and the intra- and inter-channel IPs are quantitatively made clear. △ Less

Submitted 3 July, 2024; v1 submitted 22 April, 2024; originally announced April 2024.

Break-up and Recovery of Harmony between Direct and Indirect Pathways in The Basal Ganglia; Huntington's Disease and Treatment

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, co… ▽ More The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, cognition, and psychiatry. In this paper, we are concerned about the Huntington's disease (HD), which is a genetic neurodegenerative disorder causing involuntary movement and severe cognitive and psychiatric symptoms. For the HD, the number of D2 SPNs ($N_{\rm D2}$) is decreased due to degenerative loss, and hence, by decreasing $x_{\rm D2}$ (fraction of $N_{\rm D2}$), we investigate break-up of harmony between DP and IP in terms of their competition degree ${\cal C}_d$, given by the ratio of strength of DP (${\cal S}_{DP}$) to strength of IP (${\cal S}_{IP}$) (i.e., ${\cal C}_d = {\cal S}_{DP} / {\cal S}_{IP}$). In the case of HD, the IP is under-active, in contrast to the case of Parkinson's disease with over-active IP, which results in increase in ${\cal C}_d$ (from the normal value). Thus, hyperkinetic dyskinesia such as chorea (involuntary jerky movement) occurs. We also investigate treatment of HD, based on optogenetics and GP ablation, by increasing strength of IP, resulting in recovery of harmony between DP and IP. Finally, we study effect of loss of healthy synapses of all the BG cells on HD. Due to loss of healthy synapses, disharmony between DP and IP increases, leading to worsen symptoms of the HD. △ Less

Submitted 18 April, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2309.12540

Quantifying Harmony between Direct and Indirect Pathways in The Basal Ganglia; Healthy and Parkinsonian States

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: The basal ganglia (BG) show a variety of functions for motor and cognition. There are two competitive pathways in the BG; direct pathway (DP) which facilitates movement and indirect pathway (IP) which suppresses movement. It is well known that diverse functions of the BG may be made through "balance" between DP and IP. But, to the best of our knowledge, so far no quantitative analysis for such bal… ▽ More The basal ganglia (BG) show a variety of functions for motor and cognition. There are two competitive pathways in the BG; direct pathway (DP) which facilitates movement and indirect pathway (IP) which suppresses movement. It is well known that diverse functions of the BG may be made through "balance" between DP and IP. But, to the best of our knowledge, so far no quantitative analysis for such balance was done. In this paper, as a first time, we introduce the competition degree ${\cal C}_d$ between DP and IP. Then, by employing ${\cal C}_d$, we quantify their competitive harmony (i.e., competition and cooperative interplay), which could lead to improving our understanding of the traditional "balance" so clearly and quantitatively. We first consider the case of normal dopamine (DA) level of $φ^*=0.3$. In the case of phasic cortical input (10 Hz), a healthy state with ${\cal C}_d^* = 2.82$ (i.e., DP is 2.82 times stronger than IP) appears. In this case, normal movement occurs via harmony between DP and IP. Next, we consider the case of decreased DA level, $φ= φ^*(=0.3)~x_{DA}$ ($1 > x_{DA} \geq 0$). With decreasing $x_{DA}$ from 1, the competition degree ${\cal C}_d$ between DP and IP decreases monotonically from ${\cal C}_d^*$, which results in appearance of a pathological Parkinsonian state with reduced ${\cal C}_d$. In this Parkinsonian state, strength of IP is much increased than that in the case of normal healthy state, leading to disharmony between DP and IP. Due to such break-up of harmony between DP and IP, impaired movement occurs. Finally, we also study treatment of the pathological Parkinsonian state via recovery of harmony between DP and IP. △ Less

Submitted 12 April, 2024; v1 submitted 21 September, 2023; originally announced September 2023.

Effect of Adult Neurogenesis on Sparsely Synchronized Rhythms of The Granule Cells in The Hippocampal Dentate Gyrus

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We are concerned about the main encoding granule cells (GCs) in the hippocampal dentate gyrus (DG). Young immature GCs (imGCs) appear through adult neurogenesis. In comparison to the mature GCs (mGCs) (born during development), the imGCs show high activation due to lower firing threshold. On the other hand, they receive low excitatory drive from the entorhinal cortex via perforant paths and from t… ▽ More We are concerned about the main encoding granule cells (GCs) in the hippocampal dentate gyrus (DG). Young immature GCs (imGCs) appear through adult neurogenesis. In comparison to the mature GCs (mGCs) (born during development), the imGCs show high activation due to lower firing threshold. On the other hand, they receive low excitatory drive from the entorhinal cortex via perforant paths and from the hilar mossy cells with lower connection probability $p_c~(=20~x~\%)$ ($x:$ synaptic connectivity fraction; $ 0 \leq x \leq 1$) than the mGCs with the connection probability $p_c~(=20~\%)$. Thus, the effect of low excitatory innervation (reducing activation degree) for the imGCs counteracts the effect of their high excitability. We consider a spiking neural network for the DG, incorporating both the mGCs and the imGCs. With decreasing $x$ from 1 to 0, we investigate the effect of young adult-born imGCs on the sparsely synchronized rhythms (SSRs) of the GCs (mGCs, imGC, and whole GCs). For each $x$, population and individual firing behaviors in the SSRs are characterized in terms of the amplitude measure ${\cal M}_a^{(X)}$ ($X=m,~im,~w$ for the mGCs, the imGCs, and the whole GCs, respectively) (representing the population synchronization degree) and the random phase-locking degree ${\cal L}_d^{(X)}$ (characterizing the regularity of individual single-cell discharges), respectively. We also note that, for $0 \leq x \leq 1,$ the mGCs and the imGCs exhibit pattern separation (i.e., a process of transforming similar input patterns into less similar output patterns) and pattern integration (making association between patterns), respectively. Quantitative relationship between SSRs and pattern separation and integration is also discussed. △ Less

Submitted 7 March, 2023; originally announced March 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2301.05387

Effect of Adult-Born Immature Granule Cells on Pattern Separation in The Hippocampal Dentate Gyrus

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: Young immature granule cells (imGCs) appear via adult neurogenesis in the hippocampal dentate gyrus (DG). In comparison to mature GCs (mGCs) (born during development), the imGCs exhibit two competing distinct properties such as high excitability and low excitatory innervation. We develop a spiking neural network for the DG, incorporating the imGCs, and investigate their effect on pattern separatio… ▽ More Young immature granule cells (imGCs) appear via adult neurogenesis in the hippocampal dentate gyrus (DG). In comparison to mature GCs (mGCs) (born during development), the imGCs exhibit two competing distinct properties such as high excitability and low excitatory innervation. We develop a spiking neural network for the DG, incorporating the imGCs, and investigate their effect on pattern separation. We first consider the effect of high excitability. The imGCs become very highly active due to their low firing threshold. Then, strong pattern correlation occurs, which results in pattern integration. On the other hand, the mGCs exhibit very sparse firing activity due to strongly increased feedback inhibition. As a result of high sparsity, the pattern separation efficacy (PSE) of the mGCs becomes very high. Thus, the whole population of GCs becomes a heterogeneous one, composed of a (major) subpopulation of mGCs (i.e., pattern separators) with very low activation degree and a (minor) subpopulation of imGCs (i.e., pattern integrators) with very high activation degree. In the whole heterogeneous population, the overall activation degree of all the GCs is a little reduced in comparison to the activation degree in the presence of only mGCs without imGCs. However, no pattern separation occurs, due to heterogeneous sparsity, in contrast to the usual intuitive thought that sparsity could improve PSE. Next, we consider the effect of low excitatory innervation for the imGCs. In this case, the imGCs perform pattern integration. The PSE of the mGCs decreases from a high value to a limit value. In the whole population of all the GCs, when passing through a threshold, pattern separation starts, the overall PSE increases and approaches that of the mGCs. However, due to heterogeneity caused by the imGCs, the overall PSE becomes deteriorated, in comparison with that in the presence of only mGCs. △ Less

Submitted 12 January, 2023; originally announced January 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2109.12731

Disynaptic Effect of Hilar Cells on Pattern Separation in A Spiking Neural Network of Hippocampal Dentate Gyrus

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We investigate disynaptic effect of the hilar cells on pattern separation in a spiking neural network of the hippocampal dentate gyrus (DG). The principal granule cells (GCs) in the DG perform pattern separation, transforming similar input patterns into less-similar output patterns. The hilus consists of excitatory mossy cells (MCs) and inhibitory HIPP (hilar perforant path-associated) cells. Here… ▽ More We investigate disynaptic effect of the hilar cells on pattern separation in a spiking neural network of the hippocampal dentate gyrus (DG). The principal granule cells (GCs) in the DG perform pattern separation, transforming similar input patterns into less-similar output patterns. The hilus consists of excitatory mossy cells (MCs) and inhibitory HIPP (hilar perforant path-associated) cells. Here, we consider the disynaptic effects of the MCs and the HIPP cells on the GCs, mediated by the inhibitory basket cells (BCs); MC $\rightarrow$ BC $\rightarrow$ GC and HIPP $\rightarrow$ BC $\rightarrow$ GC. By changing synaptic strength $K^{\rm (BC, X)}$ ( X = MC or HIPP) from the default value ${K^{\rm (BC, X)}}^*$, we study the change in the pattern separation degree ${\cal S}_d$. When decreasing $K^{\rm (BC, MC)}$ or independently increasing $K^{\rm (BC, HIPP)}$ from their default values, ${\cal S}_d$ is found to decrease (i.e., pattern separation is reduced). On the other hand, as $K^{\rm (BC, MC)}$ is increased or independently $K^{\rm (BC, HIPP)}$ is decreased from their default values, pattern separation becomes enhanced (i.e., ${\cal S}_d$ increases). In this way, the disynaptic effects of the MCs and the HIPP cells on the pattern separation are opposite ones. Thus, when simultaneously varying both $K^{\rm (BC, MC)}$ and $K^{\rm (BC, HIPP)}$, as a result of balance between the two competing disynaptic effects of the MCs and the HIPP cells, ${\cal S}_d$ forms a bell-shaped curve with an optimal maximum at their default values. Moreover, the population and individual behaviors of the sparsely synchronized rhythm of the GCs are found to be strongly correlated with the pattern separation degree ${\cal S}_d$. Consequently, the larger the synchronization and the random phase-locking degrees of the sparsely synchronized rhythm is, the more the pattern separation becomes enhanced. △ Less

Submitted 26 September, 2021; originally announced September 2021.

Comments: arXiv admin note: text overlap with arXiv:2106.00172, arXiv:2105.06057

Population and Individual Firing Behaviors in Sparsely Synchronized Rhythms in The Hippocampal Dentate Gyrus

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We investigate population and individual firing behaviors in sparsely synchronized rhythms (SSRs) in a spiking neural network of the hippocampal dentate gyrus (DG). The main encoding granule cells (GCs) are grouped into lamellar clusters. In each GC cluster, there is one inhibitory (I) basket cell (BC) along with excitatory (E) GCs, and they form the E-I loop. Winner-take-all competition, leading… ▽ More We investigate population and individual firing behaviors in sparsely synchronized rhythms (SSRs) in a spiking neural network of the hippocampal dentate gyrus (DG). The main encoding granule cells (GCs) are grouped into lamellar clusters. In each GC cluster, there is one inhibitory (I) basket cell (BC) along with excitatory (E) GCs, and they form the E-I loop. Winner-take-all competition, leading to sparse activation of the GCs, occurs in each GC cluster. Such sparsity has been thought to enhance pattern separation performed in the DG. During the winner-take-all competition, SSRs are found to appear in each population of the GCs and the BCs through interaction of excitation of the GCs with inhibition of the BCs. Sparsely synchronized spiking stripes appear successively with the population frequency $f_p~ (= 13$ Hz) in the raster plots of spikes. We also note that excitatory hilar mossy cells (MCs) control the firing activity of the GC-BC loop by providing excitation to both the GCs and the BCs. SSR also appears in the population of MCs via interaction with the GCs (i.e., GC-MC loop). Population behaviors in the SSRs are quantitatively characterized in terms of the synchronization measures. In addition, we investigate individual firing activity of GCs, BCs, and MCs in the SSRs. Individual GCs exhibit random spike skip**, leading to a multi-peaked inter-spike-interval histogram, which is well characterized in terms of the random phase-locking degree. On the other hand, both BCs and MCs show "intrastripe" burstings within stripes, together with "interstripe" random spike skip**. MC loss may occur during epileptogenesis. With decreasing the fraction of the MCs, changes in the population and individual firings in the SSRs are also studied. Finally, quantitative association between the population/individual firing behaviors in the SSRs and the winner-take-all competition is discussed. △ Less

Submitted 31 May, 2021; originally announced June 2021.

Comments: arXiv admin note: text overlap with arXiv:2105.06057

Dynamical Origin for Winner-Take-All Competition in A Biological Network of The Hippocampal Dentate Gyrus

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider a biological network of the hippocampal dentate gyrus (DG). The DG is a pre-processor for pattern separation which facilitates pattern storage and retrieval in the CA3 area of the hippocampus. The main encoding cells in the DG are the granule cells (GCs) which receive the input from the entorhinal cortex (EC) and send their output to the CA3. The activation degree of GCs is so low (~ 5… ▽ More We consider a biological network of the hippocampal dentate gyrus (DG). The DG is a pre-processor for pattern separation which facilitates pattern storage and retrieval in the CA3 area of the hippocampus. The main encoding cells in the DG are the granule cells (GCs) which receive the input from the entorhinal cortex (EC) and send their output to the CA3. The activation degree of GCs is so low (~ 5%). This sparsity has been thought to enhance the pattern separation. We investigate the dynamical origin for winner-take-all (WTA) competition which leads to sparse activation of the GCs. The whole GCs are grouped into lamellar clusters. In each GC cluster, there is one inhibitory (I) basket cell (BC) along with excitatory (E) GCs. There are three kinds of external inputs into the GCs; the direct excitatory EC input, the indirect inhibitory EC input, mediated by the HIPP (hilar perforant path-associated) cells, and the excitatory input from the hilar mossy cells (MCs). The firing activities of the GCs are determined via competition between the external E and I inputs. The E-I conductance ratio ${\cal{R}}_{\rm E-I}^{\rm (con)*}$ (given by the time average of the external E to I conductances) may represents well the degree of such external E-I input competition. GCs become active when their $\cal{R}_{\rm E-I}^{\rm (con)*}$ is larger than a threshold ${\cal{R}}_{th}^*$, and then the mean firing rates of the active GCs are strongly correlated with $\cal{R}_{\rm E-I}^{\rm (con)*}$. In each GC cluster, the feedback inhibition of the BC may select the winner GCs. GCs with larger $\cal{R}_{\rm E-I}^{\rm (con)*}$ than the threshold ${\cal{R}}_{th}^*$ survive, and they become winners; all the other GCs with smaller $\cal{R}_{\rm E-I}^{\rm (con)*}$ become silent. The WTA competition occurs via competition between the firing activity of the GCs and the feedback inhibition from the BC in each GC cluster. △ Less

Submitted 12 May, 2021; originally announced May 2021.

RNA Alternative Splicing Prediction with Discrete Compositional Energy Network

Authors: Alvin Chan, Anna Korsakova, Yew-Soon Ong, Fernaldo Richtia Winnerdy, Kah Wai Lim, Anh Tuan Phan

Abstract: A single gene can encode for different protein versions through a process called alternative splicing. Since proteins play major roles in cellular functions, aberrant splicing profiles can result in a variety of diseases, including cancers. Alternative splicing is determined by the gene's primary sequence and other regulatory factors such as RNA-binding protein levels. With these as input, we form… ▽ More A single gene can encode for different protein versions through a process called alternative splicing. Since proteins play major roles in cellular functions, aberrant splicing profiles can result in a variety of diseases, including cancers. Alternative splicing is determined by the gene's primary sequence and other regulatory factors such as RNA-binding protein levels. With these as input, we formulate the prediction of RNA splicing as a regression task and build a new training dataset (CAPD) to benchmark learned models. We propose discrete compositional energy network (DCEN) which leverages the hierarchical relationships between splice sites, junctions and transcripts to approach this task. In the case of alternative splicing prediction, DCEN models mRNA transcript probabilities through its constituent splice junctions' energy values. These transcript probabilities are subsequently mapped to relative abundance values of key nucleotides and trained with ground-truth experimental measurements. Through our experiments on CAPD, we show that DCEN outperforms baselines and ablation variants. △ Less

Submitted 6 March, 2021; originally announced March 2021.

Comments: ACM CHIL 2021 Camera-Ready

Explaining Chemical Toxicity using Missing Features

Authors: Kar Wai Lim, Bhanushee Sharma, Payel Das, Vijil Chenthamarakshan, Jonathan S. Dordick

Abstract: Chemical toxicity prediction using machine learning is important in drug development to reduce repeated animal and human testing, thus saving cost and time. It is highly recommended that the predictions of computational toxicology models are mechanistically explainable. Current state of the art machine learning classifiers are based on deep neural networks, which tend to be complex and harder to i… ▽ More Chemical toxicity prediction using machine learning is important in drug development to reduce repeated animal and human testing, thus saving cost and time. It is highly recommended that the predictions of computational toxicology models are mechanistically explainable. Current state of the art machine learning classifiers are based on deep neural networks, which tend to be complex and harder to interpret. In this paper, we apply a recently developed method named contrastive explanations method (CEM) to explain why a chemical or molecule is predicted to be toxic or not. In contrast to popular methods that provide explanations based on what features are present in the molecule, the CEM provides additional explanation on what features are missing from the molecule that is crucial for the prediction, known as the pertinent negative. The CEM does this by optimizing for the minimum perturbation to the model using a projected fast iterative shrinkage-thresholding algorithm (FISTA). We verified that the explanation from CEM matches known toxicophores and findings from other work. △ Less

Submitted 23 September, 2020; originally announced September 2020.

Influence of Various Temporal Recoding on Pavlovian Eyeblink Conditioning in The Cerebellum

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider the Pavlovian eyeblink conditioning (EBC) via repeated presentation of paired conditioned stimulus (tone) and unconditioned stimulus (airpuff). The influence of various temporal recoding of granule cells on the EBC is investigated in a cerebellar network where the connection probability $p_c$ from Golgi to granule cells is changed. In an optimal case of $p_c^*~(=0.029)$, individual gra… ▽ More We consider the Pavlovian eyeblink conditioning (EBC) via repeated presentation of paired conditioned stimulus (tone) and unconditioned stimulus (airpuff). The influence of various temporal recoding of granule cells on the EBC is investigated in a cerebellar network where the connection probability $p_c$ from Golgi to granule cells is changed. In an optimal case of $p_c^*~(=0.029)$, individual granule cells show various well- and ill-matched firing patterns relative to the unconditioned stimulus. Then, these variously-recoded signals are fed into the Purkinje cells (PCs) through parallel-fibers (PFs). In the case of well-matched PF-PC synapses, their synaptic weights are strongly depressed through strong long-term depression (LTD). On the other hand, practically no LTD occurs for the ill-matched PF-PC synapses. This type of "effective" depression at the PF-PC synapses coordinates firings of PCs effectively, which then make effective inhibitory coordination on cerebellar nucleus neuron [which elicits conditioned response (CR; eyeblink)]. When the learning trial passes a threshold, acquisition of CR begins. In this case, the timing degree ${\cal T}_d$ of CR becomes good due to presence of the ill-matched firing group which plays a role of protection barrier for the timing. With further increase in the trial, strength $\cal S$ of CR (corresponding to the amplitude of eyelid closure) increases due to strong LTD in the well-matched firing group. Thus, with increasing the learning trial, the (overall) learning efficiency degree ${\cal L}_e$ (taking into consideration both timing and strength of CR) for the CR is increased, and eventually it becomes saturated. By changing $p_c$ from $p_c^*$, we also investigate the influence of various temporal recoding on the EBC. It is thus found that, the more various in temporal recoding, the more effective in learning for the Pavlovian EBC. △ Less

Submitted 8 July, 2020; v1 submitted 24 June, 2020; originally announced June 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:2003.11325

A Two-Phase Dynamic Contagion Model for COVID-19

Authors: Zezhun Chen, Angelos Dassios, Valerie Kuan, Jia Wei Lim, Yan Qu, Budhi Surya, Hongbiao Zhao

Abstract: In this paper, we propose a continuous-time stochastic intensity model, namely, two-phase dynamic contagion process(2P-DCP), for modelling the epidemic contagion of COVID-19 and investigating the lockdown effect based on the dynamic contagion model introduced by Dassios and Zhao (2011). It allows randomness to the infectivity of individuals rather than a constant reproduction number as assumed by… ▽ More In this paper, we propose a continuous-time stochastic intensity model, namely, two-phase dynamic contagion process(2P-DCP), for modelling the epidemic contagion of COVID-19 and investigating the lockdown effect based on the dynamic contagion model introduced by Dassios and Zhao (2011). It allows randomness to the infectivity of individuals rather than a constant reproduction number as assumed by standard models. Key epidemiological quantities, such as the distribution of final epidemic size and expected epidemic duration, are derived and estimated based on real data for various regions and countries. The associated time lag of the effect of intervention in each country or region is estimated. Our results are consistent with the incubation time of COVID-19 found by recent medical study. We demonstrate that our model could potentially be a valuable tool in the modeling of COVID-19. More importantly, the proposed model of 2P-DCP could also be used as an important tool in epidemiological modelling as this type of contagion models with very simple structures is adequate to describe the evolution of regional epidemic and worldwide pandemic. △ Less

Submitted 11 June, 2020; originally announced June 2020.

Comments: 29 pages, 14 figures

MSC Class: 60G55(Primary); 60J75(Secondary)

CogMol: Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative Models

Authors: Vijil Chenthamarakshan, Payel Das, Samuel C. Hoffman, Hendrik Strobelt, Inkit Padhi, Kar Wai Lim, Benjamin Hoover, Matteo Manica, Jannis Born, Teodoro Laino, Aleksandra Mojsilovic

Abstract: The novel nature of SARS-CoV-2 calls for the development of efficient de novo drug design approaches. In this study, we propose an end-to-end framework, named CogMol (Controlled Generation of Molecules), for designing new drug-like small molecules targeting novel viral proteins with high affinity and off-target selectivity. CogMol combines adaptive pre-training of a molecular SMILES Variational Au… ▽ More The novel nature of SARS-CoV-2 calls for the development of efficient de novo drug design approaches. In this study, we propose an end-to-end framework, named CogMol (Controlled Generation of Molecules), for designing new drug-like small molecules targeting novel viral proteins with high affinity and off-target selectivity. CogMol combines adaptive pre-training of a molecular SMILES Variational Autoencoder (VAE) and an efficient multi-attribute controlled sampling scheme that uses guidance from attribute predictors trained on latent features. To generate novel and optimal drug-like molecules for unseen viral targets, CogMol leverages a protein-molecule binding affinity predictor that is trained using SMILES VAE embeddings and protein sequence embeddings learned unsupervised from a large corpus. CogMol framework is applied to three SARS-CoV-2 target proteins: main protease, receptor-binding domain of the spike protein, and non-structural protein 9 replicase. The generated candidates are novel at both molecular and chemical scaffold levels when compared to the training data. CogMol also includes insilico screening for assessing toxicity of parent molecules and their metabolites with a multi-task toxicity classifier, synthetic feasibility with a chemical retrosynthesis predictor, and target structure binding with docking simulations. Docking reveals favorable binding of generated molecules to the target protein structure, where 87-95 % of high affinity molecules showed docking free energy < -6 kcal/mol. When compared to approved drugs, the majority of designed compounds show low parent molecule and metabolite toxicity and high synthetic feasibility. In summary, CogMol handles multi-constraint design of synthesizable, low-toxic, drug-like molecules with high target specificity and selectivity, and does not need target-dependent fine-tuning of the framework or target structure information. △ Less

Submitted 23 June, 2020; v1 submitted 2 April, 2020; originally announced April 2020.

Effect of Diverse Recoding of Granule Cells on Optokinetic Response in A Cerebellar Ring Network with Synaptic Plasticity

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider a cerebellar ring network for the optokinetic response (OKR), and investigate the effect of diverse recoding of granule (GR) cells on OKR by varying the connection probability $p_c$ from Golgi to GR cells. For an optimal value of $p_c^*~(=0.06)$, individual GR cells exhibit diverse spiking patterns which are in-phase, anti-phase, or complex out-of-phase with respect to their population… ▽ More We consider a cerebellar ring network for the optokinetic response (OKR), and investigate the effect of diverse recoding of granule (GR) cells on OKR by varying the connection probability $p_c$ from Golgi to GR cells. For an optimal value of $p_c^*~(=0.06)$, individual GR cells exhibit diverse spiking patterns which are in-phase, anti-phase, or complex out-of-phase with respect to their population-averaged firing activity. Then, these diversely-recoded signals via parallel fibers (PFs) from GR cells are effectively depressed by the error-teaching signals via climbing fibers from the inferior olive which are also in-phase ones. Synaptic weights at in-phase PF-Purkinje cell (PC) synapses of active GR cells are strongly depressed via strong long-term depression (LTD), while those at anti-phase and complex out-of-phase PF-PC synapses are weakly depressed through weak LTD. This kind of "effective" depression (i.e., strong/weak LTD) at the PF-PC synapses causes a big modulation in firings of PCs, which then exert effective inhibitory coordination on the vestibular nucleus (VN) neuron (which evokes OKR). For the firing of the VN neuron, the learning gain degree ${\cal{L}}_g$, corresponding to the modulation gain ratio, increases with increasing the learning cycle, and it saturates at about the 300th cycle. By varying $p_c$ from $p_c^*$, we find that a plot of saturated learning gain degree ${\cal L}_g^*$ versus $p_c$ forms a bell-shaped curve with a peak at $p_c^*$ (where the diversity degree in spiking patterns of GR cells is also maximum). Consequently, the more diverse in recoding of GR cells, the more effective in motor learning for the OKR adaptation. △ Less

Submitted 10 August, 2020; v1 submitted 25 March, 2020; originally announced March 2020.

Effect of Interpopulation Spike-Timing-Dependent Plasticity on Synchronized Rhythms in Neuronal Networks with Inhibitory and Excitatory Populations

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider clustered small-world networks with both inhibitory (I) and excitatory (E) populations. This I-E neuronal network has adaptive dynamic I to E and E to I interpopulation synaptic strengths, governed by interpopulation spike-timing-dependent plasticity (STDP). In previous works without STDPs, fast sparsely synchronized rhythms, related to diverse cognitive functions, were found to appear… ▽ More We consider clustered small-world networks with both inhibitory (I) and excitatory (E) populations. This I-E neuronal network has adaptive dynamic I to E and E to I interpopulation synaptic strengths, governed by interpopulation spike-timing-dependent plasticity (STDP). In previous works without STDPs, fast sparsely synchronized rhythms, related to diverse cognitive functions, were found to appear in a range of noise intensity $D$ for static synaptic strengths. By varying $D$, we investigate the effect of interpopulation STDPs on diverse population and individual properties of fast sparsely synchronized rhythms that emerge in both the I- and the E-populations. Depending on values of $D$, long-term potentiation (LTP) and long-term depression (LTD) for population-averaged values of saturated interpopulation synaptic strengths are found to occur, and they make effects on the degree of fast sparse synchronization. In a broad region of intermediate $D$, the degree of good synchronization (with higher spiking measure) becomes decreased, while in a region of large $D$, the degree of bad synchronization (with lower spiking measure) gets increased. Consequently, in each I- or E-population, the synchronization degree becomes nearly the same in a wide range of $D$. This kind of "equalization effect" is found to occur via cooperative interplay between the average occupation and pacing degrees of fast sparsely synchronized rhythms. We note that the equalization effect in interpopulation synaptic plasticity is distinctly in contrast to the Matthew (bipolarization) effect in intrapopulation (I to I and E to E) synaptic plasticity where good (bad) synchronization gets better (worse). Finally, emergences of LTP and LTD of interpopulation synaptic strengths are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic spike times. △ Less

Submitted 11 February, 2020; v1 submitted 12 March, 2019; originally announced March 2019.

Cluster Burst Synchronization in A Scale-Free Network of Inhibitory Bursting Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider a scale-free network of inhibitory Hindmarsh-Rose (HR) bursting neurons, and investigate coupling-induced cluster burst synchronization by varying the average coupling strength $J_0$. For sufficiently small $J_0$, non-cluster desynchronized states exist. However, when passing a critical point $J^*_c~(\simeq 0.16)$, the whole population is segregated into 3 clusters via a constructive r… ▽ More We consider a scale-free network of inhibitory Hindmarsh-Rose (HR) bursting neurons, and investigate coupling-induced cluster burst synchronization by varying the average coupling strength $J_0$. For sufficiently small $J_0$, non-cluster desynchronized states exist. However, when passing a critical point $J^*_c~(\simeq 0.16)$, the whole population is segregated into 3 clusters via a constructive role of synaptic inhibition to stimulate dynamical clustering between individual burstings, and thus 3-cluster desynchronized states appear. As $J_0$ is further increased and passes a lower threshold $J^*_l~(\simeq 0.78)$, a transition to 3-cluster burst synchronization occurs due to another constructive role of synaptic inhibition to favor population synchronization. In this case, HR neurons in each cluster exhibit burst synchronization. However, as $J_0$ passes an intermediate threshold $J^*_m~(\simeq 5.2)$, HR neurons begin to make intermittent hop**s between the 3 clusters. Due to the intermittent intercluster hop**s, the 3 clusters are integrated into a single one. In spite of break-up of the 3 clusters, (non-cluster) burst synchronization persists in the whole population, which is well visualized in the raster plot of burst onset times where bursting stripes (composed of burst onset times and indicating burst synchronization) appear successively. With further increase in $J_0$, intercluster hop**s are intensified, and bursting stripes also become smeared more and more due to a destructive role of synaptic inhibition to spoil the burst synchronization. Eventually, when passing a higher threshold $J^*_h~(\simeq 17.8)$ a transition to desynchronization occurs via complete overlap between the bursting stripes. Finally, we also investigate the effects of stochastic noise on both 3-cluster burst synchronization and intercluster hop**s. △ Less

Submitted 1 April, 2019; v1 submitted 11 September, 2018; originally announced September 2018.

Comments: arXiv admin note: text overlap with arXiv:1803.07256, arXiv:1708.04543

Burst Synchronization in A Scale-Free Neuronal Network with Inhibitory Spike-Timing-Dependent Plasticity

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We are concerned about burst synchronization (BS), related to neural information processes in health and disease, in the Barabási-Albert scale-free network (SFN) composed of inhibitory bursting Hindmarsh-Rose neurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without considerin… ▽ More We are concerned about burst synchronization (BS), related to neural information processes in health and disease, in the Barabási-Albert scale-free network (SFN) composed of inhibitory bursting Hindmarsh-Rose neurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without considering iSTDP, BS was found to appear in a range of noise intensities for fixed synaptic inhibition strengths. In contrast, in our present work, we take into consideration iSTDP and investigate its effect on BS by varying the noise intensity. Our new main result is to find occurrence of a Matthew effect in inhibitory synaptic plasticity: good BS gets better via LTD, while bad BS get worse via LTP. This kind of Matthew effect in inhibitory synaptic plasticity is in contrast to that in excitatory synaptic plasticity where good (bad) synchronization gets better (worse) via LTP (LTD). We note that, due to inhibition, the roles of LTD and LTP in inhibitory synaptic plasticity are reversed in comparison with those in excitatory synaptic plasticity. Moreover, emergences of LTD and LTP of synaptic inhibition strengths are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic burst onset times. Finally, in the presence of iSTDP we investigate the effects of network architecture on BS by varying the symmetric attachment degree $l^*$ and the asymmetry parameter $Δl$ in the SFN. △ Less

Submitted 20 August, 2018; v1 submitted 20 March, 2018; originally announced March 2018.

Comments: arXiv admin note: substantial text overlap with arXiv:1708.04543, arXiv:1801.01385

Effect of Inhibitory Spike-Timing-Dependent Plasticity on Fast Sparsely Synchronized Rhythms in A Small-World Neuronal Network

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider the Watts-Strogatz small-world network (SWN) consisting of inhibitory fast spiking Izhikevich interneurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without iSTDP, fast sparsely synchronized rhythms, associated with diverse cognitive functions, were found to appear… ▽ More We consider the Watts-Strogatz small-world network (SWN) consisting of inhibitory fast spiking Izhikevich interneurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without iSTDP, fast sparsely synchronized rhythms, associated with diverse cognitive functions, were found to appear in a range of large noise intensities for fixed strong synaptic inhibition strengths. Here, we investigate the effect of iSTDP on fast sparse synchronization (FSS) by varying the noise intensity $D$. We employ an asymmetric anti-Hebbian time window for the iSTDP update rule [which is in contrast to the Hebbian time window for the excitatory STDP (eSTDP)]. Depending on values of $D$, population-averaged values of saturated synaptic inhibition strengths are potentiated [long-term potentiation (LTP)] or depressed [long-term depression (LTD)] in comparison with the initial mean value, and dispersions from the mean values of LTP/LTD are much increased when compared with the initial dispersion, independently of $D$. In most cases of LTD where the effect of mean LTD is dominant in comparison with the effect of dispersion, good FSS (with higher spiking measure) is found to get better via LTD, while bad FSS (with lower spiking measure) is found to get worse via LTP. This kind of Matthew effect in inhibitory synaptic plasticity is in contrast to that in excitatory synaptic plasticity where good (bad) synchronization gets better (worse) via LTP (LTD). Emergences of LTD and LTP of synaptic inhibition strengths are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic spike times. Furthermore, we also investigate the effects of network architecture on FSS by changing the rewiring probability $p$ of the SWN in the presence of iSTDP. △ Less

Submitted 14 May, 2018; v1 submitted 2 January, 2018; originally announced January 2018.

Comments: arXiv admin note: text overlap with arXiv:1704.03150

Effect of Spike-Timing-Dependent Plasticity on Stochastic Burst Synchronization in A Scale-Free Neuronal Network

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider an excitatory population of subthreshold Izhikevich neurons which cannot fire spontaneously without noise. As the coupling strength passes a threshold, individual neurons exhibit noise-induced burstings. This neuronal population has adaptive dynamic synaptic strengths governed by the spike-timing-dependent plasticity (STDP). In the absence of STDP, stochastic burst synchronization (SBS… ▽ More We consider an excitatory population of subthreshold Izhikevich neurons which cannot fire spontaneously without noise. As the coupling strength passes a threshold, individual neurons exhibit noise-induced burstings. This neuronal population has adaptive dynamic synaptic strengths governed by the spike-timing-dependent plasticity (STDP). In the absence of STDP, stochastic burst synchronization (SBS) between noise-induced burstings of subthreshold neurons was previously found to occur over a large range of intermediate noise intensities. Here, we study the effect of additive STDP on the SBS by varying the noise intensity $D$ in the Barabási-Albert scale-free network (SFN) for the case of symmetric preferential attachment. This type of SFN exhibits a power-law degree distribution, and hence it becomes an inhomogeneous one with a few "hubs" (i.e., super-connected nodes). Occurrence of a "Matthew" effect in synaptic plasticity is found to occur due to a positive feedback process. Good burst synchronization gets better via long-term potentiation (LTP) of synaptic strengths, while bad burst synchronization gets worse via long-term depression (LTD). Consequently, a step-like rapid transition to SBS occurs by changing $D$, in contrast to a relatively smooth transition in the absence of STDP. In the presence of additive STDP, we also investigate the effects of network architecture on the SBS for a fixed $D$. Emergences of LTP and LTD of synaptic strengths are investigated in details via microscopic studies based on both the distributions of time delays between the burst onset times of the pre- and the post-synaptic neurons and the pair-correlations between the pre- and the post-synaptic IIBRs (instantaneous individual burst rates). Finally, a multiplicative STDP case (depending on states) is also investigated in comparison with the additive STDP case (independent of states). △ Less

Submitted 27 November, 2017; v1 submitted 14 August, 2017; originally announced August 2017.

Comments: arXiv admin note: substantial text overlap with arXiv:1704.03150

Stochastic Spike Synchronization in A Small-World Neural Network with Spike-Timing-Dependent Plasticity

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider the Watts-Strogatz small-world network consisting of subthreshold neurons which exhibit noise-induced spikings. This neuronal network has adaptive dynamic synaptic strengths governed by the spike-timing-dependent plasticity (STDP). In previous works without STDP, stochastic spike synchronization (SSS) between noise-induced spikings of subthreshold neurons was found to occur in a range… ▽ More We consider the Watts-Strogatz small-world network consisting of subthreshold neurons which exhibit noise-induced spikings. This neuronal network has adaptive dynamic synaptic strengths governed by the spike-timing-dependent plasticity (STDP). In previous works without STDP, stochastic spike synchronization (SSS) between noise-induced spikings of subthreshold neurons was found to occur in a range of intermediate noise intensities through competition between the constructive and the destructive roles of noise. Here, we investigate the effect of additive STDP on the SSS by varying the noise intensity. Occurrence of a "Matthew" effect in synaptic plasticity is found due to a positive feedback process. As a result, good synchronization gets better via long-term potentiation (LTP) of synaptic strengths, while bad synchronization gets worse via long-term depression (LTD). Emergence of LTP and LTD of synaptic strengths are intensively investigated via microscopic studies based on the pair-correlations between the pre- and the post-synaptic IISRs (instantaneous individual spike rates) as well as the distributions of time delays between the pre- and the post-synaptic spike times. Furthermore, the effects of multiplicative STDP (which depends on the states) on the SSS are also studied and discussed in comparison with the case of additive STDP. △ Less

Submitted 14 August, 2017; v1 submitted 11 April, 2017; originally announced April 2017.

Dynamical Responses to External Stimuli for Both Cases of Excitatory and Inhibitory Synchronization in A Complex Neuronal Network

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: For studying how dynamical responses to external stimuli depend on the synaptic-coupling type, we consider two types of excitatory and inhibitory synchronization (i.e., synchronization via synaptic excitation and inhibition) in complex small-world networks of excitatory regular spiking (RS) pyramidal neurons and inhibitory fast spiking (FS) interneurons. For both cases of excitatory and inhibitory… ▽ More For studying how dynamical responses to external stimuli depend on the synaptic-coupling type, we consider two types of excitatory and inhibitory synchronization (i.e., synchronization via synaptic excitation and inhibition) in complex small-world networks of excitatory regular spiking (RS) pyramidal neurons and inhibitory fast spiking (FS) interneurons. For both cases of excitatory and inhibitory synchronization, effects of synaptic couplings on dynamical responses to external time-periodic stimuli $S(t)$ (applied to a fraction of neurons) are investigated by varying the driving amplitude $A$ of $S(t)$. Stimulated neurons are phase-locked to external stimuli for both cases of excitatory and inhibitory couplings. On the other hand, the stimulation effect on non-stimulated neurons depends on the type of synaptic coupling. The external stimulus $S(t)$ makes a constructive effect on excitatory non-stimulated RS neurons (i.e., it causes external phase lockings in the non-stimulated sub-population), while $S(t)$ makes a destructive effect on inhibitory non-stimulated FS interneurons (i.e., it breaks up original inhibitory synchronization in the non-stimulated sub-population). As results of these different effects of $S(t)$, the type and degree of dynamical response (e.g., synchronization enhancement or suppression), characterized by the dynamical response factor $D_f$ (given by the ratio of synchronization degree in the presence and absence of stimulus), are found to vary in a distinctly different way, depending on the synaptic-coupling type. Furthermore, we also measure the matching degree between the dynamics of the two sub-populations of stimulated and non-stimulated neurons in terms of a "cross-correlation" measure $M_c$. With increasing $A$, based on $M_c$, we discuss the cross-correlations between the two sub-populations, affecting the dynamical responses to $S(t)$. △ Less

Submitted 28 November, 2016; originally announced November 2016.

Emergence of Sparsely Synchronized Rhythms and Their Responses to External Stimuli in An Inhomogeneous Small-World Complex Neuronal Network

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider an inhomogeneous small-world network (SWN) composed of inhibitory short-range (SR) and long-range (LR) interneurons. By varying the fraction of LR interneurons $p_{long}$, we investigate the effect of network architecture on emergence of sparsely synchronized rhythms, and make comparison with that in the Watts-Strogatz SWN. Although SR and LR interneurons have the same average in- and… ▽ More We consider an inhomogeneous small-world network (SWN) composed of inhibitory short-range (SR) and long-range (LR) interneurons. By varying the fraction of LR interneurons $p_{long}$, we investigate the effect of network architecture on emergence of sparsely synchronized rhythms, and make comparison with that in the Watts-Strogatz SWN. Although SR and LR interneurons have the same average in- and out-degrees, their betweenness centralities (characterizing the potentiality in controlling communication between other interneurons) are distinctly different. Hence, in view of the betweenness, SWNs we consider are inhomogeneous, unlike the "canonical" Watts-Strogatz SWN with nearly same betweenness centralities. As $p_{long}$ is increased, the average path length becomes shorter, and the load of communication traffic is less concentrated on LR interneurons, which leads to better efficiency of global communication between interneurons. Eventually, when passing a critical value $p_{long}^{(c)}$ $(\simeq 0.16)$, sparsely synchronized rhythms are found to emerge. We also consider two cases of external time-periodic stimuli applied to sub-groups of LR and SR interneurons, respectively. Dynamical responses (such as synchronization suppression and enhancement) to these two cases of stimuli are studied and discussed in relation to the betweenness centralities of stimulated interneurons, representing the effectiveness for transfer of stimulation effect in the whole network. △ Less

Submitted 15 August, 2016; v1 submitted 24 July, 2016; originally announced July 2016.

Comments: arXiv admin note: text overlap with arXiv:1504.03063

Effect of Network Architecture on Burst and Spike Synchronization in A Scale-Free Network of Bursting Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We investigate the effect of network architecture on burst and spike synchronization in a directed scale-free network (SFN) of bursting neurons, evolved via two independent $α-$ and $β-$processes. The $α-$process corresponds to a directed version of the Barabási-Albert SFN model with growth and preferential attachment, while for the $β-$process only preferential attachments between pre-existing no… ▽ More We investigate the effect of network architecture on burst and spike synchronization in a directed scale-free network (SFN) of bursting neurons, evolved via two independent $α-$ and $β-$processes. The $α-$process corresponds to a directed version of the Barabási-Albert SFN model with growth and preferential attachment, while for the $β-$process only preferential attachments between pre-existing nodes are made without addition of new nodes. We first consider the "pure" $α-$process of symmetric preferential attachment (with the same in- and out-degrees), and study emergence of burst and spike synchronization by varying the coupling strength $J$ and the noise intensity $D$ for a fixed attachment degree. Characterizations of burst and spike synchronization are also made by employing realistic order parameters and statistical-mechanical measures. Next, we choose appropriate values of $J$ and $D$ where only the burst synchronization occurs, and investigate the effect of the scale-free connectivity on the burst synchronization by varying (1) the symmetric attachment degree and (2) the asymmetry parameter (representing deviation from the symmetric case) in the $α-$process, and (3) the occurrence probability of the $β-$process. In all these three cases, changes in the type and the degree of population synchronization are studied in connection with the network topology such as the degree distribution, the average path length $L_p$, and the betweenness centralization $B_c$. It is thus found that not only $L_p$ and $B_c$ (affecting global communication between nodes) but also the in-degree distribution (affecting individual dynamics) are important network factors for effective population synchronization in SFNs. △ Less

Submitted 1 October, 2015; v1 submitted 30 September, 2015; originally announced October 2015.

Comments: arXiv admin note: text overlap with arXiv:1504.03063

Effect of Inter-Modular Connection on Fast Sparse Synchronization in Clustered Small-World Neural Networks

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider a clustered network with small-world sub-networks of inhibitory fast spiking interneurons, and investigate the effect of inter-modular connection on emergence of fast sparsely synchronized rhythms by varying both the inter-modular coupling strength $J_{inter}$ and the average number of inter-modular links per interneuron $M_{syn}^{(inter)}$. In contrast to the case of non-clustered net… ▽ More We consider a clustered network with small-world sub-networks of inhibitory fast spiking interneurons, and investigate the effect of inter-modular connection on emergence of fast sparsely synchronized rhythms by varying both the inter-modular coupling strength $J_{inter}$ and the average number of inter-modular links per interneuron $M_{syn}^{(inter)}$. In contrast to the case of non-clustered networks, two kinds of sparsely synchronized states such as modular and global synchronization are found. For the case of modular sparse synchronization, the population behavior reveals the modular structure, because the intra-modular dynamics of sub-networks make some mismatching. On the other hand, in the case of global sparse synchronization, the population behavior is globally identical, independently of the cluster structure, because the intra-modular dynamics of sub-networks make perfect matching. We introduce a realistic cross-correlation modularity measure, representing the matching-degree between the instantaneous sub-population spike rates of the sub-networks, and examine whether the sparse synchronization is global or modular. Furthermore, we characterize the modular and global sparse synchronization by employing the realistic sub- and whole-population order parameters and statistical-mechanical measures. The roles of $J_{inter}$ and $M_{syn}^{(inter)}$ are thus found as follows. For large $J_{inter}$, due to strong inhibition it plays a destructive role to "spoil" the pacing between spikes, while for small $J_{inter}$ it plays a constructive role to "favor" the pacing between spikes. In contrast, $M_{syn}^{(inter)}$ seems to play a role just to favor the pacing between spikes. With increasing $M_{syn}^{(inter)}$, the pacing degree between spikes increases monotonically thanks to the increase in the degree of effectiveness of global communication between spikes. △ Less

Submitted 22 September, 2015; v1 submitted 12 July, 2015; originally announced July 2015.

Journal ref: Phys. Rev. E 92, 052716 (2015)

Fast Sparsely Synchronized Brain Rhythms in A Scale-Free Neural Network

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider a directed Barabási-Albert scale-free network model with symmetric preferential attachment with the same in- and out-degrees, and study emergence of sparsely synchronized rhythms for a fixed attachment degree in an inhibitory population of fast spiking Izhikevich interneurons. For a study on the fast sparsely synchronized rhythms, we fix $J$ (synaptic inhibition strength) at a sufficie… ▽ More We consider a directed Barabási-Albert scale-free network model with symmetric preferential attachment with the same in- and out-degrees, and study emergence of sparsely synchronized rhythms for a fixed attachment degree in an inhibitory population of fast spiking Izhikevich interneurons. For a study on the fast sparsely synchronized rhythms, we fix $J$ (synaptic inhibition strength) at a sufficiently large value, and investigate the population states by increasing $D$ (noise intensity). For small $D$, full synchronization with the same population-rhythm frequency $f_p$ and mean firing rate (MFR) $f_i$ of individual neurons occurs, while for sufficiently large $D$ partial synchronization with $f_p > {\langle f_i \rangle}$ ($\langle f_i \rangle$: ensemble-averaged MFR) appears due to intermittent discharge of individual neurons; particularly, the case of $f_p > 4 {\langle f_i \rangle}$ is referred to as sparse synchronization. Only for the partial and sparse synchronization, MFRs and contributions of individual neuronal dynamics to population synchronization change depending on their degrees, unlike the case of full synchronization. Consequently, dynamics of individual neurons reveal the inhomogeneous network structure for the case of partial and sparse synchronization, which is in contrast to the case of statistically homogeneous random graphs and small-world networks. Finally, we investigate the effect of network architecture on sparse synchronization in the following three cases: (1) variation in the degree of symmetric attachment (2) asymmetric preferential attachment of new nodes with different in- and out-degrees (3) preferential attachment between pre-existing nodes (without addition of new nodes). In these three cases, both relation between network topology and sparse synchronization and contributions of individual dynamics to the sparse synchronization are discussed. △ Less

Submitted 13 April, 2015; originally announced April 2015.

Comments: 54 pages, 13 figures. arXiv admin note: text overlap with arXiv:1403.1034

Noise-Induced Burst and Spike Synchronizations in An Inhibitory Small-World Network of Subthreshold Bursting Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: For modeling complex synaptic connectivity, we consider the Watts-Strogatz small-world network which interpolates between regular lattice and random network via rewiring, and investigate the effect of small-world connectivity on emergence of noise-induced population synchronization in an inhibitory population of subthreshold bursting Hindmarsh-Rose neurons. Thus, noise-induced slow burst synchroni… ▽ More For modeling complex synaptic connectivity, we consider the Watts-Strogatz small-world network which interpolates between regular lattice and random network via rewiring, and investigate the effect of small-world connectivity on emergence of noise-induced population synchronization in an inhibitory population of subthreshold bursting Hindmarsh-Rose neurons. Thus, noise-induced slow burst synchronization and fasg spike synchronization are found to appear in a synchronized region of the $J-D$ plane. As the rewiring probability $p$ is decreased from 1 (random network) to 0 (regular lattice), the region of spike synchronization shrinks rapidly in the $J-D$ plane, while the region of the burst synchronization decreases slowly. Population synchronization may be well visualized in the raster plot of neural spikes which can be obtained in experiments. Instantaneous population firing rate, $R(t)$, which is directly obtained from the raster plot of spikes, is a realistic population quantity exhibiting collective behaviors with both the slow bursting and the fast spiking timescales. Through frequency filtering, we separate $R(t)$ into $R_b(t)$ (describing the slow bursting behavior) and $R_s(t)$ (describing the fast intraburst spiking behavior). Then, we develop thermodynamic order parameters and statistical-mechanical measures, based on $R_b (t)$ and $R_s (t)$, for characterization of the burst and spike synchronizations of the bursting neurons and show their usefulness in explicit examples. With increase in $p$, both the degrees of the burst and spike synchronizations are found to increase because more long-range connections appear. However, they become saturated for some maximal values of $p$ because long-range short-cuts which appear up to the maximal values of $p$ play sufficient role to get maximal degrees of the burst and spike synchronizations. △ Less

Submitted 10 July, 2014; v1 submitted 11 June, 2014; originally announced June 2014.

Comments: arXiv admin note: substantial text overlap with arXiv:1403.3994

Frequency-Domain Order Parameters for the Burst And Spike Synchronization Transitions of Bursting Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We are interested in characterization of synchronization transitions of bursting neurons in the frequency domain. Instantaneous population firing rate (IPFR) $R(t)$, which is directly obtained from the raster plot of neural spikes, is often used as a realistic collective quantity describing population activities in both the computational and the experimental neuroscience. For the case of spiking n… ▽ More We are interested in characterization of synchronization transitions of bursting neurons in the frequency domain. Instantaneous population firing rate (IPFR) $R(t)$, which is directly obtained from the raster plot of neural spikes, is often used as a realistic collective quantity describing population activities in both the computational and the experimental neuroscience. For the case of spiking neurons, a realistic time-domain order parameter, based on $R(t)$, was introduced in our recent work to characterize the spike synchronization transition. Unlike the case of spiking neurons, the IPFR $R(t)$ of bursting neurons exhibits population behaviors with both the slow bursting and the fast spiking timescales. For our aim, we decompose the IPFR $R(t)$ into the instantaneous population bursting rate $R_b(t)$ (describing the bursting behavior) and the instantaneous population spike rate $R_s(t)$ (describing the spiking behavior) via frequency filtering, and extend the realistic order parameter to the case of bursting neurons. Thus, we develop the frequency-domain bursting and spiking order parameters which are just the bursting and spiking "coherence factors" $β_b$ and $β_s$ of the bursting and spiking peaks in the power spectral densities of $R_b$ and $R_s$ (i.e., "signal to noise" ratio of the spectral peak height and its relative width). Through calculation of $β_b$ and $β_s$, we obtain the bursting and spiking thresholds beyond which the burst and spike synchronizations break up, respectively. Consequently, it is shown in explicit examples that the frequency-domain bursting and spiking order parameters may be usefully used for characterization of the bursting and the spiking transitions, respectively. △ Less

Submitted 6 October, 2014; v1 submitted 19 March, 2014; originally announced March 2014.

Comments: arXiv admin note: substantial text overlap with arXiv:1403.3994

Thermodynamic Order Parameters and Statistical-Mechanical Measures for Characterization of the Burst and Spike Synchronizations of Bursting Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We are interested in characterization of population synchronization of bursting neurons which exhibit both the slow bursting and the fast spiking timescales, in contrast to spiking neurons. Population synchronization may be well visualized in the raster plot of neural spikes which can be obtained in experiments. The instantaneous population firing rate (IPFR) $R(t)$, which may be directly obtained… ▽ More We are interested in characterization of population synchronization of bursting neurons which exhibit both the slow bursting and the fast spiking timescales, in contrast to spiking neurons. Population synchronization may be well visualized in the raster plot of neural spikes which can be obtained in experiments. The instantaneous population firing rate (IPFR) $R(t)$, which may be directly obtained from the raster plot of spikes, is often used as a realistic collective quantity describing population behaviors in both the computational and the experimental neuroscience. For the case of spiking neurons, realistic thermodynamic order parameter and statistical-mechanical spiking measure, based on $R(t)$, were introduced in our recent work to make practical characterization of spike synchronization. Here, we separate the slow bursting and the fast spiking timescales via frequency filtering, and extend the thermodynamic order parameter and the statistical-mechanical measure to the case of bursting neurons. Consequently, it is shown in explicit examples that both the order parameters and the statistical-mechanical measures may be effectively used to characterize the burst and spike synchronizations of bursting neurons. △ Less

Submitted 6 October, 2014; v1 submitted 17 March, 2014; originally announced March 2014.

Comments: arXiv admin note: text overlap with arXiv:1403.1255

Realistic Thermodynamic and Statistical-Mechanical Measures for Neural Synchronization

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: Synchronized brain rhythms, associated with diverse cognitive functions, have been observed in electrical recordings of brain activity. Neural synchronization may be well described by using the population-averaged global potential $V_G$ in computational neuroscience. The time-averaged fluctuation of $V_G$ plays the role of a "thermodynamic" order parameter $\cal {O}$ used for describing the synchr… ▽ More Synchronized brain rhythms, associated with diverse cognitive functions, have been observed in electrical recordings of brain activity. Neural synchronization may be well described by using the population-averaged global potential $V_G$ in computational neuroscience. The time-averaged fluctuation of $V_G$ plays the role of a "thermodynamic" order parameter $\cal {O}$ used for describing the synchrony-asynchrony transition in neural systems. Population spike synchronization may be well visualized in the raster plot of neural spikes. The degree of neural synchronization seen in the raster plot is well measured in terms of a "statistical-mechanical" spike-based measure $M_s$ introduced by considering the occupation and the pacing patterns of spikes. The global potential $V_G$ is also used to give a reference global cycle for the calculation of $M_s$. Hence, $V_G$ becomes an important collective quantity because it is associated with calculation of both $\cal {O}$ and $M_s$. However, it is practically difficult to directly get $V_G$ in real experiments. To overcome this difficulty, instead of $V_G$, we employ the instantaneous population spike rate (IPSR) which can be obtained in experiments, and develop realistic thermodynamic and statistical-mechanical measures, based on IPSR, to make practical characterization of the neural synchronization in both computational and experimental neuroscience. Particularly, more accurate characterization of weak sparse spike synchronization can be achieved in terms of realistic statistical-mechanical IPSR-based measure, in comparison with the conventional measure based on $V_G$. △ Less

Submitted 5 March, 2014; originally announced March 2014.

Comments: arXiv admin note: substantial text overlap with arXiv:1110.6927, arXiv:1403.1034

Journal ref: Journal of Neuroscience Methods 226, 161-170 (2014)

Coupling-Induced Population Synchronization in An Excitatory Population of Subthreshold Izhikevich Neurons

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: We consider an excitatory population of subthreshold Izhikevich neurons which exhibit noise-induced firings. By varying the coupling strength $J$, we investigate population synchronization between the noise-induced firings which may be used for efficient cognitive processing such as sensory perception, multisensory binding, selective attention, and memory formation. As $J$ is increased, rich types… ▽ More We consider an excitatory population of subthreshold Izhikevich neurons which exhibit noise-induced firings. By varying the coupling strength $J$, we investigate population synchronization between the noise-induced firings which may be used for efficient cognitive processing such as sensory perception, multisensory binding, selective attention, and memory formation. As $J$ is increased, rich types of population synchronization (e.g., spike, burst, and fast spike synchronization) are found to occur. Transitions between population synchronization and incoherence are well described in terms of an order parameter $\cal{O}$. As a final step, the coupling induces oscillator death (quenching of noise-induced spikings) because each neuron is attracted to a noisy equilibrium state. The oscillator death leads to a transition from firing to non-firing states at the population level, which may be well described in terms of the time-averaged population spike rate $\overline{R}$. In addition to the statistical-mechanical analysis using $\cal{O}$ and $\overline{R}$, each population and individual state are also characterized by using the techniques of nonlinear dynamics such as the raster plot of neural spikes, the time series of the membrane potential, and the phase portrait. We note that population synchronization of noise-induced firings may lead to emergence of synchronous brain rhythms in a noisy environment, associated with diverse cognitive functions. △ Less

Submitted 5 March, 2014; originally announced March 2014.

Journal ref: Cognitive Neurodynamics, 7, 495-503 (2013)

Effect of Small-World Connectivity on Fast Sparsely Synchronized Cortical Rhythms

Authors: Sang-Yoon Kim, Woochang Lim

Abstract: Fast cortical rhythms with stochastic and intermittent neural discharges have been observed in electric recordings of brain activity. Recently, Brunel et al. developed a framework to describe this kind of fast sparse synchronization in both random and globally-coupled networks of suprathreshold spiking neurons. However, in a real cortical circuit, synaptic connections are known to have complex top… ▽ More Fast cortical rhythms with stochastic and intermittent neural discharges have been observed in electric recordings of brain activity. Recently, Brunel et al. developed a framework to describe this kind of fast sparse synchronization in both random and globally-coupled networks of suprathreshold spiking neurons. However, in a real cortical circuit, synaptic connections are known to have complex topology which is neither regular nor random. Hence, in order to extend the works of Brunel et al. to realistic neural networks, we study the effect of network architecture on these fast sparsely synchronized rhythms in an inhibitory population of suprathreshold fast spiking (FS) Izhikevich interneurons. We first employ the conventional Erdös-Renyi random graph of suprathreshold FS Izhikevich interneurons for modeling the complex connectivity in neural systems, and study emergence of the population synchronized states by varying both the synaptic inhibition strength $J$ and the noise intensity $D$. Thus, fast sparsely synchronized states of relatively high degree are found to appear for large values of $J$ and $D$. Second, for fixed values of $J$ and $D$ where fast sparse synchronization occurs in the random network, we consider the Watts-Strogatz small-world network of suprathreshold FS Izhikevich interneurons which interpolates between regular lattice and random graph via rewiring, and investigate the effect of small-world synaptic connectivity on emergence of fast sparsely synchronized rhythms by varying the rewiring probability $p$ from short-range to long-range connection. When passing a small critical value $p^*_c$ $(\simeq 0.12)$, fast sparsely synchronized population rhythms are found to emerge in small-world networks with predominantly local connections and rare long-range connections. △ Less

Submitted 1 September, 2014; v1 submitted 5 March, 2014; originally announced March 2014.

Strange Nonchaotic Oscillations in The Quasiperiodically Forced Hodgkin-Huxley Neuron

Authors: Woochang Lim, Sang-Yoon Kim

Abstract: We numerically study dynamical behaviors of the quasiperiodically forced Hodgkin-Huxley neuron and compare the dynamical responses with those for the case of periodic stimulus. In the periodically forced case, a transition from a periodic to a chaotic oscillation was found to occur via period doublings in previous numerical and experimental works. We investigate the effect of the quasiperiodic for… ▽ More We numerically study dynamical behaviors of the quasiperiodically forced Hodgkin-Huxley neuron and compare the dynamical responses with those for the case of periodic stimulus. In the periodically forced case, a transition from a periodic to a chaotic oscillation was found to occur via period doublings in previous numerical and experimental works. We investigate the effect of the quasiperiodic forcing on this period-doubling route to chaotic oscillation. In contrast to the case of periodic forcing, new type of strange nonchaotic (SN) oscillating states (that are geometrically strange but have no positive Lyapunov exponents) are found to exist between the regular and chaotic oscillating states as intermediate ones. Their strange fractal geometry leads to aperiodic "complex" spikings. Various dynamical routes to SN oscillations are identified, as in the quasiperiodically forced logistic map. These SN spikings are expected to be observed in experiments of the quasiperiodically forced squid giant axon. △ Less

Submitted 2 November, 2011; originally announced November 2011.

Comments: 20 pages, 6 figures

Journal ref: J. Phys. A 42, 265103 (2009)

Statistical-Mechanical Measure of Stochastic Spiking Coherence in A Population of Inhibitory Subthreshold Neurons

Authors: Woochang Lim, Sang-Yoon Kim

Abstract: By varying the noise intensity, we study stochastic spiking coherence (i.e., collective coherence between noise-induced neural spikings) in an inhibitory population of subthreshold neurons (which cannot fire spontaneously without noise). This stochastic spiking coherence may be well visualized in the raster plot of neural spikes. For a coherent case, partially-occupied "stripes" (composed of spike… ▽ More By varying the noise intensity, we study stochastic spiking coherence (i.e., collective coherence between noise-induced neural spikings) in an inhibitory population of subthreshold neurons (which cannot fire spontaneously without noise). This stochastic spiking coherence may be well visualized in the raster plot of neural spikes. For a coherent case, partially-occupied "stripes" (composed of spikes and indicating collective coherence) are formed in the raster plot. This partial occupation occurs due to "stochastic spike skip**" which is well shown in the multi-peaked interspike interval histogram. The main purpose of our work is to quantitatively measure the degree of stochastic spiking coherence seen in the raster plot. We introduce a new spike-based coherence measure $M_s$ by considering the occupation pattern and the pacing pattern of spikes in the stripes. In particular, the pacing degree between spikes is determined in a statistical-mechanical way by quantifying the average contribution of (microscopic) individual spikes to the (macroscopic) ensemble-averaged global potential. This "statistical-mechanical" measure $M_s$ is in contrast to the conventional measures such as the "thermodynamic" order parameter (which concerns the time-averaged fluctuations of the macroscopic global potential), the "microscopic" correlation-based measure (based on the cross-correlation between the microscopic individual potentials), and the measures of precise spike timing (based on the peri-stimulus time histogram). In terms of $M_s$, we quantitatively characterize the stochastic spiking coherence, and find that $M_s$ reflects the degree of collective spiking coherence seen in the raster plot very well. Hence, the "statistical-mechanical" spike-based measure $M_s$ may be used usefully to quantify the degree of stochastic spiking coherence in a statistical-mechanical way. △ Less

Submitted 31 October, 2011; originally announced October 2011.

Comments: 16 pages, 5 figures, to appear in the J. Comput. Neurosci

Strange Nonchaotic Bursting in A Quasiperiodially-Forced Hindmarsh-Rose Neuron

Authors: Woochang Lim, Sang-Yoon Kim

Abstract: We study the transition from a silent state to a bursting state by varying the dc stimulus in the Hindmarsh-Rose neuron under quasiperiodic stimulation. For this quasiperiodically forced case, a new type of strange nonchaotic (SN) bursting state is found to occur between the silent state and the chaotic bursting state. This is in contrast to the periodically forced case where the silent state tran… ▽ More We study the transition from a silent state to a bursting state by varying the dc stimulus in the Hindmarsh-Rose neuron under quasiperiodic stimulation. For this quasiperiodically forced case, a new type of strange nonchaotic (SN) bursting state is found to occur between the silent state and the chaotic bursting state. This is in contrast to the periodically forced case where the silent state transforms directly to a chaotic bursting state. Using a rational approximation to the quasiperiodic forcing, the mechanism for the appearance of such an SN bursting state is investigated. Thus, a smooth torus (corresponding to a silent state) is found to transform to an SN bursting attractor through a phase-dependent subcritical period-doubling bifurcation. These SN bursting states, together with chaotic bursting states, are characterized in terms of the interburst interval, the bursting length, and the number of spikes in each burst. Both bursting states are found to be aperiodic complex ones. Consequently, aperiodic complex burstings may result from two dynamically different states with strange geometry (one is chaotic and the other one is nonchaotic). Thus, in addition to chaotic burstings, SN burstings may become a dynamical origin for complex physiological rhythms which are ubiquitous in organisms. △ Less

Submitted 29 October, 2011; originally announced October 2011.

Comments: 7 pages, 5 figures

Journal ref: J. Korean Phys. Soc. 57, 1356 (2010)

Heterogeneity-Induced Inhibitory Coherence in An Ensemble of Subthreshold and Suprathreshold Type-I Neurons

Authors: Duk-Geun Hong, Sang-Yoon Kim, Woochang Lim

Abstract: We study inhibitory coherence (i.e., collective coherence by synaptic inhibition) in an ensemble of globally-coupled type-I neurons which can fire at arbitrarily low frequencies. No inhibitory coherence is observed in a homogeneous ensemble composed of only subthreshold neurons (which cannot fire spontaneously without noise). By increasing the fraction of (spontaneously firing) suprathreshold neur… ▽ More We study inhibitory coherence (i.e., collective coherence by synaptic inhibition) in an ensemble of globally-coupled type-I neurons which can fire at arbitrarily low frequencies. No inhibitory coherence is observed in a homogeneous ensemble composed of only subthreshold neurons (which cannot fire spontaneously without noise). By increasing the fraction of (spontaneously firing) suprathreshold neurons $P_{supra}$, heterogeneity-induced inhibitory coherence is investigated in a heterogeneous ensemble of subthreshold and suprathreshold neurons. As $P_{supra}$ passes a threshold $P_{supra}^*$, suprathreshold neurons begin to synchronize and play the role of coherent inhibitors for the emergence of inhibitory coherence. Thus, regularly-oscillating ensemble-averaged global potential appears for $P_{supra} > P_{supra}^*$. For this coherent case suprathreshold neurons exhibit coherent mixed-mode oscillations with a fast subthreshold (small-amplitude) hop** frequency and a lower spiking frequency. By virtue of their coherent inhibition, sparsely synchronized suprathreshold neurons suppress noisy activities of subthreshold neurons. Thus, only coherent subthreshold hop**s appear in the individual potentials of subthreshold neurons. We also characterize the inhibitory coherence in terms of the "statistical-mechanical" spike-based and correlation-based measures and find that the degree of inhibitory coherence increases with increasing $P_{supra}$ for $P_{supra} > P_{supra}^*$. Finally, effect of sparse randomness of synaptic connectivity on the inhibitory coherence and universality of the heterogeneity-induced inhibitory coherence are briefly discussed. △ Less

Submitted 29 October, 2011; originally announced October 2011.

Comments: 12 pages, 7 figures

Echinocyte Shapes: Bending, Stretching and Shear Determine Spicule Shape and Spacing

Authors: Ranjan Mukhopadhyay, Gerald H. W. Lim, Michael Wortis

Abstract: We study the shapes of human red blood cells using continuum mechanics. In particular, we model the crenated, echinocytic shapes and show how they may arise from a competition between the bending energy of the plasma membrane and the stretching/shear elastic energies of the membrane skeleton. In contrast to earlier work, we calculate spicule shapes exactly by solving the equations of continuum m… ▽ More We study the shapes of human red blood cells using continuum mechanics. In particular, we model the crenated, echinocytic shapes and show how they may arise from a competition between the bending energy of the plasma membrane and the stretching/shear elastic energies of the membrane skeleton. In contrast to earlier work, we calculate spicule shapes exactly by solving the equations of continuum mechanics subject to appropriate boundary conditions. A simple scaling analysis of this competition reveals an elastic length which sets the length scale for the spicules and is, thus, related to the number of spicules experimentally observed on the fully developed echinocyte. △ Less

Submitted 27 August, 2001; v1 submitted 7 August, 2001; originally announced August 2001.

Comments: Revtex, 27 pages, 8 figures; some minor changes