Showing 1–12 of 12 results for author: Zeng, T

Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks

Authors: Feng-Lei Fan, Yingxin Li, Hanchuan Peng, Tieyong Zeng, Fei Wang

Abstract: Throughout history, the development of artificial intelligence, particularly artificial neural networks, has been open to and constantly inspired by the increasingly deepened understanding of the brain, such as the inspiration of neocognitron, which is the pioneering work of convolutional neural networks. Per the motives of the emerging field: NeuroAI, a great amount of neuroscience knowledge can… ▽ More Throughout history, the development of artificial intelligence, particularly artificial neural networks, has been open to and constantly inspired by the increasingly deepened understanding of the brain, such as the inspiration of neocognitron, which is the pioneering work of convolutional neural networks. Per the motives of the emerging field: NeuroAI, a great amount of neuroscience knowledge can help catalyze the next generation of AI by endowing a network with more powerful capabilities. As we know, the human brain has numerous morphologically and functionally different neurons, while artificial neural networks are almost exclusively built on a single neuron type. In the human brain, neuronal diversity is an enabling factor for all kinds of biological intelligent behaviors. Since an artificial network is a miniature of the human brain, introducing neuronal diversity should be valuable in terms of addressing those essential problems of artificial networks such as efficiency, interpretability, and memory. In this Primer, we first discuss the preliminaries of biological neuronal diversity and the characteristics of information transmission and processing in a biological neuron. Then, we review studies of designing new neurons for artificial networks. Next, we discuss what gains can neuronal diversity bring into artificial networks and exemplary applications in several important fields. Lastly, we discuss the challenges and future directions of neuronal diversity to explore the potential of NeuroAI. △ Less

Submitted 10 March, 2023; v1 submitted 22 January, 2023; originally announced January 2023.

BioNavi-NP: Biosynthesis Navigator for Natural Products

Authors: Shuangjia Zheng, Tao Zeng, Chengtao Li, Binghong Chen, Connor W. Coley, Yuedong Yang, Ruibo Wu

Abstract: Nature, a synthetic master, creates more than 300,000 natural products (NPs) which are the major constituents of FDA-proved drugs owing to the vast chemical space of NPs. To date, there are fewer than 30,000 validated NPs compounds involved in about 33,000 known enzyme catalytic reactions, and even fewer biosynthetic pathways are known with complete cascade-connected enzyme catalysis. Therefore, i… ▽ More Nature, a synthetic master, creates more than 300,000 natural products (NPs) which are the major constituents of FDA-proved drugs owing to the vast chemical space of NPs. To date, there are fewer than 30,000 validated NPs compounds involved in about 33,000 known enzyme catalytic reactions, and even fewer biosynthetic pathways are known with complete cascade-connected enzyme catalysis. Therefore, it is valuable to make computer-aided bio-retrosynthesis predictions. Here, we develop BioNavi-NP, a navigable and user-friendly toolkit, which is capable of predicting the biosynthetic pathways for NPs and NP-like compounds through a novel (AND-OR Tree)-based planning algorithm, an enhanced molecular Transformer neural network, and a training set that combines general organic transformations and biosynthetic steps. Extensive evaluations reveal that BioNavi-NP generalizes well to identifying the reported biosynthetic pathways for 90% of test compounds and recovering the verified building blocks for 73%, significantly outperforming conventional rule-based approaches. Moreover, BioNavi-NP also shows an outstanding capacity of biologically plausible pathways enumeration. In this sense, BioNavi-NP is a leading-edge toolkit to redesign complex biosynthetic pathways of natural products with applications to total or semi-synthesis and pathway elucidation or reconstruction. △ Less

Submitted 26 May, 2021; originally announced May 2021.

Comments: 14 pages

Ontology-based systematic classification and analysis of coronaviruses, hosts, and host-coronavirus interactions towards deep understanding of COVID-19

Authors: Hong Yu, Li Li, Hsin-hui Huang, Yang Wang, Yingtong Liu, Edison Ong, Anthony Huffman, Tao Zeng, **gsong Zhang, Pengpai Li, Zhi** Liu, Xiangyan Zhang, Xianwei Ye, Samuel K. Handelman, Gerry Higgins, Gilbert S. Omenn, Brian Athey, Junguk Hur, Luonan Chen, Yongqun He

Abstract: Given the existing COVID-19 pandemic worldwide, it is critical to systematically study the interactions between hosts and coronaviruses including SARS-Cov, MERS-Cov, and SARS-CoV-2 (cause of COVID-19). We first created four host-pathogen interaction (HPI)-Outcome postulates, and generated a HPI-Outcome model as the basis for understanding host-coronavirus interactions (HCI) and their relations wit… ▽ More Given the existing COVID-19 pandemic worldwide, it is critical to systematically study the interactions between hosts and coronaviruses including SARS-Cov, MERS-Cov, and SARS-CoV-2 (cause of COVID-19). We first created four host-pathogen interaction (HPI)-Outcome postulates, and generated a HPI-Outcome model as the basis for understanding host-coronavirus interactions (HCI) and their relations with the disease outcomes. We hypothesized that ontology can be used as an integrative platform to classify and analyze HCI and disease outcomes. Accordingly, we annotated and categorized different coronaviruses, hosts, and phenotypes using ontologies and identified their relations. Various COVID-19 phenotypes are hypothesized to be caused by the backend HCI mechanisms. To further identify the causal HCI-outcome relations, we collected 35 experimentally-verified HCI protein-protein interactions (PPIs), and applied literature mining to identify additional host PPIs in response to coronavirus infections. The results were formulated in a logical ontology representation for integrative HCI-outcome understanding. Using known PPIs as baits, we also developed and applied a domain-inferred prediction method to predict new PPIs and identified their pathological targets on multiple organs. Overall, our proposed ontology-based integrative framework combined with computational predictions can be used to support fundamental understanding of the intricate interactions between human patients and coronaviruses (including SARS-CoV-2) and their association with various disease outcomes. △ Less

Submitted 31 May, 2020; originally announced June 2020.

Comments: 32 pages, 1 table, 6 figures

StereoNeuroBayesSLAM: A Neurobiologically Inspired Stereo Visual SLAM System Based on Direct Sparse Method

Authors: Tai** Zeng, Xiaoli Li, Bailu Si

Abstract: We propose a neurobiologically inspired visual simultaneous localization and map** (SLAM) system based on direction sparse method to real-time build cognitive maps of large-scale environments from a moving stereo camera. The core SLAM system mainly comprises a Bayesian attractor network, which utilizes neural responses of head direction (HD) cells in the hippocampus and grid cells in the medial… ▽ More We propose a neurobiologically inspired visual simultaneous localization and map** (SLAM) system based on direction sparse method to real-time build cognitive maps of large-scale environments from a moving stereo camera. The core SLAM system mainly comprises a Bayesian attractor network, which utilizes neural responses of head direction (HD) cells in the hippocampus and grid cells in the medial entorhinal cortex (MEC) to represent the head direction and the position of the robot in the environment, respectively. Direct sparse method is employed to accurately and robustly estimate velocity information from a stereo camera. Input rotational and translational velocities are integrated by the HD cell and grid cell networks, respectively. We demonstrated our neurobiologically inspired stereo visual SLAM system on the KITTI odometry benchmark datasets. Our proposed SLAM system is robust to real-time build a coherent semi-metric topological map from a stereo camera. Qualitative evaluation on cognitive maps shows that our proposed neurobiologically inspired stereo visual SLAM system outperforms our previous brain-inspired algorithms and the neurobiologically inspired monocular visual SLAM system both in terms of tracking accuracy and robustness, which is closer to the traditional state-of-the-art one. △ Less

Submitted 6 March, 2020; originally announced March 2020.

Predictions of 2019-nCoV Transmission Ending via Comprehensive Methods

Authors: Tianyu Zeng, Yunong Zhang, Zhenyu Li, Xiao Liu, Binbin Qiu

Abstract: Since the SARS outbreak in 2003, a lot of predictive epidemiological models have been proposed. At the end of 2019, a novel coronavirus, termed as 2019-nCoV, has broken out and is propagating in China and the world. Here we propose a multi-model ordinary differential equation set neural network (MMODEs-NN) and model-free methods to predict the interprovincial transmissions in mainland China, espec… ▽ More Since the SARS outbreak in 2003, a lot of predictive epidemiological models have been proposed. At the end of 2019, a novel coronavirus, termed as 2019-nCoV, has broken out and is propagating in China and the world. Here we propose a multi-model ordinary differential equation set neural network (MMODEs-NN) and model-free methods to predict the interprovincial transmissions in mainland China, especially those from Hubei Province. Compared with the previously proposed epidemiological models, the proposed network can simulate the transportations with the ODEs activation method, while the model-free methods based on the sigmoid function, Gaussian function, and Poisson distribution are linear and fast to generate reasonable predictions. According to the numerical experiments and the realities, the special policies for controlling the disease are successful in some provinces, and the transmission of the epidemic, whose outbreak time is close to the beginning of China Spring Festival travel rush, is more likely to decelerate before February 18 and to end before April 2020. The proposed mathematical and artificial intelligence methods can give consistent and reasonable predictions of the 2019-nCoV ending. We anticipate our work to be a starting point for comprehensive prediction researches of the 2019-nCoV. △ Less

Submitted 20 February, 2020; v1 submitted 12 February, 2020; originally announced February 2020.

Bayesian Integration of Multi-resolutional Grid Codes for Spatial Cognition

Authors: Tai** Zeng, XiaoLi Li, Bailu Si

Abstract: Fourier-like summation of several grid cell modules with different spatial frequencies in the medial entorhinal cortex (MEC) has long been proposed to form the contours of place firing fields. Recent experiments largely, but not completely, support this theory. Place fields are obviously expanded by inactivation of dorsal MEC, which fits the hypothesis. However, contrary to the prediction, inactiv… ▽ More Fourier-like summation of several grid cell modules with different spatial frequencies in the medial entorhinal cortex (MEC) has long been proposed to form the contours of place firing fields. Recent experiments largely, but not completely, support this theory. Place fields are obviously expanded by inactivation of dorsal MEC, which fits the hypothesis. However, contrary to the prediction, inactivation of ventral MEC is also weakly broaden the spatial place firing patterns. In this study, we derive the model from grid spatial frequencies represented by Gaussian profiles to a 1D place field by Bayesian inference, and further provide completely theoretical explanations for expansion of place fields and predictions for alignments of grid components. To understand the information transform across between neocortex, entorhinal cortex, and hippocampus, we propose spatial memory indexing theory from hippocampal indexing theory to investigate how neural dynamics work in the entorhinal-hippocampal circuit. The inputs of place cells in CA3 are converged from three grid modules with different grid spacings layer II of MEC by Bayesian mechanism. We resort to the robot system to test Fourier hypothesis and spatial memory indexing theory, and validate our proposed entorhinal-hippocampal model. And then we demonstrate its cognitive map** capability on the KITTI odometry benchmark dataset. Results suggest that our model provides a rational theoretical explanation for the biological experimental results. Results also show that the proposed model is robust for simultaneous localization and map** (SLAM) in the large-scale environment. Our proposed model theoretically supports for Fourier hypothesis in a general Bayesian mechanism, which may pertain to other neural systems in addition to spatial cognition. △ Less

Submitted 13 October, 2019; originally announced October 2019.

Comments: arXiv admin note: text overlap with arXiv:1910.04590

Learning Sparse Spatial Codes for Cognitive Map** Inspired by Entorhinal-Hippocampal Neurocircuit

Authors: Tai** Zeng, XiaoLi Li, Bailu Si

Abstract: The entorhinal-hippocampal circuit plays a critical role in higher brain functions, especially spatial cognition. Grid cells in the medial entorhinal cortex (MEC) periodically fire with different grid spacing and orientation, which makes a contribution that place cells in the hippocampus can uniquely encode locations in an environment. But how sparse firing granule cells in the dentate gyrus are f… ▽ More The entorhinal-hippocampal circuit plays a critical role in higher brain functions, especially spatial cognition. Grid cells in the medial entorhinal cortex (MEC) periodically fire with different grid spacing and orientation, which makes a contribution that place cells in the hippocampus can uniquely encode locations in an environment. But how sparse firing granule cells in the dentate gyrus are formed from grid cells in the MEC remains to be determined. Recently, the fruit fly olfactory circuit provides a variant algorithm (called locality-sensitive hashing) to solve this problem. To investigate how the sparse place firing generates in the dentate gyrus can help animals to break the perception ambiguity during environment exploration, we build a biologically relevant, computational model from grid cells to place cells. The weight from grid cells to dentate gyrus granule cells is learned by competitive Hebbian learning. We resorted to the robot system for demonstrating our cognitive map** model on the KITTI odometry benchmark dataset. The experimental results show that our model is able to stably, robustly build a coherent semi-metric topological map in the large-scale outdoor environment. The experimental results suggest that the entorhinal-hippocampal circuit as a variant locality-sensitive hashing algorithm is capable of generating sparse encoding for easily distinguishing different locations in the environment. Our experiments also provide theoretical supports that this analogous hashing algorithm may be a general principle of computation in different brain regions and species. △ Less

Submitted 10 October, 2019; originally announced October 2019.

Experience Dependent Formation of Global Coherent Representation of Environment by Grid Cells and Head Direction Cells

Authors: Tai** Zeng, XiaoLi Li, Bailu Si

Abstract: The grid firing patterns are thought to provide an efficient intrinsic metric capable of supporting universal spatial metric for mammalian spatial navigation in all environments. However, whether spatial representations of grid cells in the entorhinal cortex are determined by local environment cues or form globally coherent patterns remains undetermined. To explore this underlying mechanism, here… ▽ More The grid firing patterns are thought to provide an efficient intrinsic metric capable of supporting universal spatial metric for mammalian spatial navigation in all environments. However, whether spatial representations of grid cells in the entorhinal cortex are determined by local environment cues or form globally coherent patterns remains undetermined. To explore this underlying mechanism, here we proposed a possible theoretical explanation to describe connection between the neural space and the physical environment and transition from a local anchored to a global coherent representation according to relationship between grid phase distance between physical distance in the physical environment, and tested our method based on simultaneous localization and map** (SLAM) system on a iRat rodent-sized robot platform in a rat-like maze. Our robotic exploration experiments show that the grid firing firstly is determined by local environment cues, and after self-correction with experience-dependence, the regular, continuous grid firing patterns tessellate the explored space. Head direction (HD) cells also show global patterns in our experimental results. Our results support that grid firing patterns do provide a universal spatial metric for mammalian spatial navigation in complex environments. The results in this study also provide insights into experience-dependent interactions between path integrative calculation of location in the entorhinal cortex and learned associations to the external sensory cues in the hippocampus, which is likely to be critical understanding spatial memory, even episodic memory. △ Less

Submitted 10 October, 2019; v1 submitted 10 October, 2019; originally announced October 2019.

A Brain-Inspired Compact Cognitive Map** System

Authors: Tai** Zeng, Bailu Si

Abstract: As the robot explores the environment, the map grows over time in the simultaneous localization and map** (SLAM) system, especially for the large scale environment. The ever-growing map prevents long-term map**. In this paper, we developed a compact cognitive map** approach inspired by neurobiological experiments. Inspired from neighborhood cells, neighborhood fields determined by movement i… ▽ More As the robot explores the environment, the map grows over time in the simultaneous localization and map** (SLAM) system, especially for the large scale environment. The ever-growing map prevents long-term map**. In this paper, we developed a compact cognitive map** approach inspired by neurobiological experiments. Inspired from neighborhood cells, neighborhood fields determined by movement information, i.e. translation and rotation, are proposed to describe one of distinct segments of the explored environment. The vertices and edges with movement information below the threshold of the neighborhood fields are avoided adding to the cognitive map. The optimization of the cognitive map is formulated as a robust non-linear least squares problem, which can be efficiently solved by the fast open linear solvers as a general problem. According to the cognitive decision-making of familiar environments, loop closure edges are clustered depending on time intervals, and then parallel computing is applied to perform batch global optimization of the cognitive map for ensuring the efficiency of computation and real-time performance. After the loop closure process, scene integration is performed, in which revisited vertices are removed subsequently to further reduce the size of the cognitive map. A monocular visual SLAM system is developed to test our approach in a rat-like maze environment. Our results suggest that the method largely restricts the growth of the size of the cognitive map over time, and meanwhile, the compact cognitive map correctly represents the overall layer of the environment as the standard one. Experiments demonstrate that our method is very suited for compact cognitive map** to support long-term robot map**. Our approach is simple, but pragmatic and efficient for achieving the compact cognitive map. △ Less

Submitted 9 October, 2019; originally announced October 2019.

Theoretical Analysis of Subthreshold Oscillatory Behaviors in Nonlinear Autonomous Systems

Authors: Shenbing Kuang, Jiafu Wang, Ting Zeng, Aiyin Cao

Abstract: We have developed a linearization method to investigate the subthreshold oscillatory behaviors in nonlinear autonomous systems. By considering firstly the neuronal system as an example, we show that this theoretical approach can predict quantitatively the subthreshold oscillatory activities, including the dam** coefficients and the oscillatory frequencies which are in good agreement with those… ▽ More We have developed a linearization method to investigate the subthreshold oscillatory behaviors in nonlinear autonomous systems. By considering firstly the neuronal system as an example, we show that this theoretical approach can predict quantitatively the subthreshold oscillatory activities, including the dam** coefficients and the oscillatory frequencies which are in good agreement with those observed in experiments. Then we generalize the linearization method to an arbitrary autonomous nonlinear system. The detailed extension of this theoretical approach is also presented and further discussed. △ Less

Submitted 7 May, 2007; originally announced May 2007.

Comments: 4 pages, 2 figures

Thermal Impact on Spiking Properties in Hodgkin-Huxley Neuron with Synaptic Stimulus

Authors: Shenbing Kuang, Jiafu Wang, Ting Zeng, Aiyin Cao

Abstract: The effect of environmental temperature on neuronal spiking behaviors is investigated by numerically simulating the temperature dependence of spiking threshold of the Hodgkin-Huxley neuron subject to synaptic stimulus. We find that the spiking threshold exhibits a global minimum in a "comfortable temperature" range where spike initiation needs weakest synaptic strength, indicating the occurrence… ▽ More The effect of environmental temperature on neuronal spiking behaviors is investigated by numerically simulating the temperature dependence of spiking threshold of the Hodgkin-Huxley neuron subject to synaptic stimulus. We find that the spiking threshold exhibits a global minimum in a "comfortable temperature" range where spike initiation needs weakest synaptic strength, indicating the occurrence of optimal use of synaptic transmission in neural system. We further explore the biophysical origin of this phenomenon in ion channel gating kinetics and also discuss its possible biological relevance in information processing in neural systems. △ Less

Submitted 15 August, 2007; v1 submitted 7 March, 2007; originally announced March 2007.

Comments: 10 pages, 4 figures

Influence of Temperature on Neuronal Excitability in Cochlear Nucleus

Authors: Ting Zeng, Jiafu Wang, Shenbing Kuang

Abstract: The influence of temperature on neuronal excitability is studied by numerical simulations on the spiking threshold characteristics of bushy cells in cochlear nucleus periodically stimulated by synaptic currents. The results reveal that there is a cut-off frequency for the spiking of bushy cell in a specific temperature environment, corresponding to the existence of a critical temperature for the… ▽ More The influence of temperature on neuronal excitability is studied by numerical simulations on the spiking threshold characteristics of bushy cells in cochlear nucleus periodically stimulated by synaptic currents. The results reveal that there is a cut-off frequency for the spiking of bushy cell in a specific temperature environment, corresponding to the existence of a critical temperature for the neuron to respond with real spikes to the synaptic stimulus of a given frequency, due to the finiteness of spike width. An optimal temperature range for neuronal spiking is also found for a specific stimulus frequency, and the temperature range span decreases with increasing stimulus frequency. These findings imply that there is a physiological temperature range which is beneficial for the information processing in auditory system. △ Less

Submitted 7 February, 2007; originally announced February 2007.

Comments: 5 pages, 4 figures