-
Transformer-based Model for Oral Epithelial Dysplasia Segmentation
Authors:
Adam J Shephard,
Hanya Mahmood,
Shan E Ahmed Raza,
Anna Luiza Damaceno Araujo,
Alan Roger Santos-Silva,
Marcio Ajudarte Lopes,
Pablo Agustin Vargas,
Kris McCombe,
Stephanie Craig,
Jacqueline James,
Jill Brooks,
Paul Nankivell,
Hisham Mehanna,
Syed Ali Khurram,
Nasir M Rajpoot
Abstract:
Oral epithelial dysplasia (OED) is a premalignant histopathological diagnosis given to lesions of the oral cavity. OED grading is subject to large inter/intra-rater variability, resulting in the under/over-treatment of patients. We developed a new Transformer-based pipeline to improve detection and segmentation of OED in haematoxylin and eosin (H&E) stained whole slide images (WSIs). Our model was…
▽ More
Oral epithelial dysplasia (OED) is a premalignant histopathological diagnosis given to lesions of the oral cavity. OED grading is subject to large inter/intra-rater variability, resulting in the under/over-treatment of patients. We developed a new Transformer-based pipeline to improve detection and segmentation of OED in haematoxylin and eosin (H&E) stained whole slide images (WSIs). Our model was trained on OED cases (n = 260) and controls (n = 105) collected using three different scanners, and validated on test data from three external centres in the United Kingdom and Brazil (n = 78). Our internal experiments yield a mean F1-score of 0.81 for OED segmentation, which reduced slightly to 0.71 on external testing, showing good generalisability, and gaining state-of-the-art results. This is the first externally validated study to use Transformers for segmentation in precancerous histology images. Our publicly available model shows great promise to be the first step of a fully-integrated pipeline, allowing earlier and more efficient OED diagnosis, ultimately benefiting patient outcomes.
△ Less
Submitted 9 November, 2023;
originally announced November 2023.
-
A Biomedical Entity Extraction Pipeline for Oncology Health Records in Portuguese
Authors:
Hugo Sousa,
Arian Pasquali,
Alípio Jorge,
Catarina Sousa Santos,
Mário Amorim Lopes
Abstract:
Textual health records of cancer patients are usually protracted and highly unstructured, making it very time-consuming for health professionals to get a complete overview of the patient's therapeutic course. As such limitations can lead to suboptimal and/or inefficient treatment procedures, healthcare providers would greatly benefit from a system that effectively summarizes the information of tho…
▽ More
Textual health records of cancer patients are usually protracted and highly unstructured, making it very time-consuming for health professionals to get a complete overview of the patient's therapeutic course. As such limitations can lead to suboptimal and/or inefficient treatment procedures, healthcare providers would greatly benefit from a system that effectively summarizes the information of those records. With the advent of deep neural models, this objective has been partially attained for English clinical texts, however, the research community still lacks an effective solution for languages with limited resources. In this paper, we present the approach we developed to extract procedures, drugs, and diseases from oncology health records written in European Portuguese. This project was conducted in collaboration with the Portuguese Institute for Oncology which, besides holding over $10$ years of duly protected medical records, also provided oncologist expertise throughout the development of the project. Since there is no annotated corpus for biomedical entity extraction in Portuguese, we also present the strategy we followed in annotating the corpus for the development of the models. The final models, which combined a neural architecture with entity linking, achieved $F_1$ scores of $88.6$, $95.0$, and $55.8$ per cent in the mention extraction of procedures, drugs, and diseases, respectively.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
Recurrence Quantification Analysis of Dynamic Brain Networks
Authors:
Marinho A. Lopes,
Jiaxiang Zhang,
Dominik Krzemiński,
Khalid Hamandi,
Qi Chen,
Lorenzo Livi,
Naoki Masuda
Abstract:
Evidence suggests that brain network dynamics is a key determinant of brain function and dysfunction. Here we propose a new framework to assess the dynamics of brain networks based on recurrence analysis. Our framework uses recurrence plots and recurrence quantification analysis to characterize dynamic networks. For resting-state magnetoencephalographic dynamic functional networks (dFNs), we have…
▽ More
Evidence suggests that brain network dynamics is a key determinant of brain function and dysfunction. Here we propose a new framework to assess the dynamics of brain networks based on recurrence analysis. Our framework uses recurrence plots and recurrence quantification analysis to characterize dynamic networks. For resting-state magnetoencephalographic dynamic functional networks (dFNs), we have found that functional networks recur more quickly in people with epilepsy than healthy controls. This suggests that recurrence of dFNs may be used as a biomarker of epilepsy. For stereo electroencephalography data, we have found that dFNs involved in epileptic seizures emerge before seizure onset, and recurrence analysis allows us to detect seizures. We further observe distinct dFNs before and after seizures, which may inform neurostimulation strategies to prevent seizures. Our framework can also be used for understanding dFNs in healthy brain function and in other neurological disorders besides epilepsy.
△ Less
Submitted 16 September, 2020; v1 submitted 11 January, 2020;
originally announced January 2020.
-
Distinct dynamical behavior in Erdős-Rényi networks, regular random networks, ring lattices, and all-to-all neuronal networks
Authors:
Marinho A. Lopes,
Alexander V. Goltsev
Abstract:
Neuronal network dynamics depends on network structure. In this paper we study how network topology underpins the emergence of different dynamical behaviors in neuronal networks. In particular, we consider neuronal network dynamics on Erdős-Rényi (ER) networks, regular random (RR) networks, ring lattices, and all-to-all networks. We solve analytically a neuronal network model with stochastic binar…
▽ More
Neuronal network dynamics depends on network structure. In this paper we study how network topology underpins the emergence of different dynamical behaviors in neuronal networks. In particular, we consider neuronal network dynamics on Erdős-Rényi (ER) networks, regular random (RR) networks, ring lattices, and all-to-all networks. We solve analytically a neuronal network model with stochastic binary-state neurons in all the network topologies, except ring lattices. Given that apart from network structure, all four models are equivalent, this allows us to understand the role of network structure in neuronal network dynamics. Whilst ER and RR networks are characterized by similar phase diagrams, we find strikingly different phase diagrams in the all-to-all network. Neuronal network dynamics is not only different within certain parameter ranges, but it also undergoes different bifurcations (with a richer repertoire of bifurcations in ER and RR compared to all-to-all networks). This suggests that local heterogeneity in the ratio between excitation and inhibition plays a crucial role on emergent dynamics. Furthermore, we also observe one subtle discrepancy between ER and RR networks, namely ER networks undergo a neuronal activity jump at lower noise levels compared to RR networks, presumably due to the degree heterogeneity in ER networks that is absent in RR networks. Finally, a comparison between network oscillations in RR networks and ring lattices shows the importance of small-world properties in sustaining stable network oscillations.
△ Less
Submitted 5 February, 2019; v1 submitted 21 July, 2018;
originally announced July 2018.
-
A neuronal network model of interictal and recurrent ictal activity
Authors:
Marinho A. Lopes,
KyoungEun Lee,
Alexander V. Goltsev
Abstract:
We propose a neuronal network model which undergoes a saddle-node bifurcation on an invariant circle as the mechanism of the transition from the interictal to the ictal (seizure) state. In the vicinity of this transition, the model captures important dynamical features of both interictal and ictal states. We study the nature of interictal spikes and early warnings of the transition predicted by th…
▽ More
We propose a neuronal network model which undergoes a saddle-node bifurcation on an invariant circle as the mechanism of the transition from the interictal to the ictal (seizure) state. In the vicinity of this transition, the model captures important dynamical features of both interictal and ictal states. We study the nature of interictal spikes and early warnings of the transition predicted by this model. We further demonstrate that recurrent seizures emerge due to the interaction between two networks.
△ Less
Submitted 11 September, 2017;
originally announced September 2017.
-
Synchronization in the random field Kuramoto model on complex networks
Authors:
M. A. Lopes,
E. M. Lopes,
S. Yoon,
J. F. F. Mendes,
A. V. Goltsev
Abstract:
We study the impact of random pinning fields on the emergence of synchrony in the Kuramoto model on complete graphs and uncorrelated random complex networks. We consider random fields with uniformly distributed directions and homogeneous and heterogeneous (Gaussian) field magnitude distribution. In our analysis we apply the Ott-Antonsen method and the annealed-network approximation to find the cri…
▽ More
We study the impact of random pinning fields on the emergence of synchrony in the Kuramoto model on complete graphs and uncorrelated random complex networks. We consider random fields with uniformly distributed directions and homogeneous and heterogeneous (Gaussian) field magnitude distribution. In our analysis we apply the Ott-Antonsen method and the annealed-network approximation to find the critical behavior of the order parameter. In the case of homogeneous fields, we find a tricritical point above which a second-order phase transition gives place to a first-order phase transition when the network is either fully connected, or scale-free with the degree exponent $γ>5$. Interestingly, for scale-free networks with $2<γ\leq 5$, the phase transition is of second-order at any field magnitude, except for degree distributions with $γ=3$ when the transition is of infinite order at $K_c=0$ independently on the random fields. Contrarily to the Ising model, even strong Gaussian random fields do not suppress the second-order phase transition in both complete graphs and scale-free networks though the fields increase the critical coupling for $γ> 3$. Our simulations support these analytical results.
△ Less
Submitted 19 May, 2016; v1 submitted 16 May, 2016;
originally announced May 2016.
-
Noise-enhanced nonlinear response and the role of modular structure for signal detection in neuronal networks
Authors:
M. A. Lopes,
K. -E. Lee,
A. V. Goltsev,
J. F. F. Mendes
Abstract:
We find that sensory noise delivered together with a weak periodic signal not only enhances nonlinear response of neuronal networks, but also improves the synchronization of the response to the signal. We reveal this phenomenon in neuronal networks that are in a dynamical state near a saddle-node bifurcation corresponding to appearance of sustained network oscillations. In this state, even a weak…
▽ More
We find that sensory noise delivered together with a weak periodic signal not only enhances nonlinear response of neuronal networks, but also improves the synchronization of the response to the signal. We reveal this phenomenon in neuronal networks that are in a dynamical state near a saddle-node bifurcation corresponding to appearance of sustained network oscillations. In this state, even a weak periodic signal can evoke sharp nonlinear oscillations of neuronal activity. These sharp network oscillations have a deterministic form and amplitude determined by nonlinear dynamical equations. The signal-to-noise ratio reaches a maximum at an optimum level of sensory noise, manifesting stochastic resonance (SR) at the population level. We demonstrate SR by use of simulations and numerical integration of rate equations in a cortical model with stochastic neurons. Using this model, we mimic the experiments of Gluckman et al. [B. J. Gluckman et al, Phys. Rev. Lett., v. 77, 4098 (1996)] that have given evidence of SR in mammalian brain. We also study neuronal networks in which neurons are grouped in modules and every module works in the regime of SR. We find that even a few modules can strongly enhance the reliability of signal detection in comparison with the case when a modular organization is absent.
△ Less
Submitted 26 February, 2014;
originally announced February 2014.
-
Critical phenomena and noise-induced phase transitions in neuronal networks
Authors:
K. -E. Lee,
M. A. Lopes,
J. F. F. Mendes,
A. V. Goltsev
Abstract:
We study numerically and analytically first- and second-order phase transitions in neuronal networks stimulated by shot noise (a flow of random spikes bombarding neurons). Using an exactly solvable cortical model of neuronal networks on classical random networks, we find critical phenomena accompanying the transitions and their dependence on the shot noise intensity. We show that a pattern of spon…
▽ More
We study numerically and analytically first- and second-order phase transitions in neuronal networks stimulated by shot noise (a flow of random spikes bombarding neurons). Using an exactly solvable cortical model of neuronal networks on classical random networks, we find critical phenomena accompanying the transitions and their dependence on the shot noise intensity. We show that a pattern of spontaneous neuronal activity near a critical point of a phase transition is a characteristic property that can be used to identify the bifurcation mechanism of the transition. We demonstrate that bursts and avalanches are precursors of a first-order phase transition, paroxysmal-like spikes of activity precede a second-order phase transition caused by a saddle-node bifurcation, while irregular spindle oscillations represent spontaneous activity near a second-order phase transition caused by a supercritical Hopf bifurcation. Our most interesting result is the observation of the paroxysmal-like spikes. We show that a paroxysmal-like spike is a single nonlinear event that appears instantly from a low background activity with a rapid onset, reaches a large amplitude, and ends up with an abrupt return to lower activity. These spikes are similar to single paroxysmal spikes and sharp waves observed in EEG measurements. Our analysis shows that above the saddle-node bifurcation, sustained network oscillations appear with a large amplitude but a small frequency in contrast to network oscillations near the Hopf bifurcation that have a small amplitude but a large frequency. We discuss an amazing similarity between excitability of the cortical model stimulated by shot noise and excitability of the Morris-Lecar neuron stimulated by an applied current.
△ Less
Submitted 15 October, 2013;
originally announced October 2013.
-
Noise-induced phase transitions in neuronal networks
Authors:
K. -E. Lee,
M. A. Lopes,
A. V. Goltsev
Abstract:
Using an exactly solvable cortical model of a neuronal network, we show that, by increasing the intensity of shot noise (flow of random spikes bombarding neurons), the network undergoes first- and second-order non-equilibrium phase transitions. We study the nature of the transitions, bursts and avalanches of neuronal activity. Saddle-node and supercritical Hopf bifurcations are the mechanisms of e…
▽ More
Using an exactly solvable cortical model of a neuronal network, we show that, by increasing the intensity of shot noise (flow of random spikes bombarding neurons), the network undergoes first- and second-order non-equilibrium phase transitions. We study the nature of the transitions, bursts and avalanches of neuronal activity. Saddle-node and supercritical Hopf bifurcations are the mechanisms of emergence of sustained network oscillations. We show that the network stimulated by shot noise behaves similar to the Morris-Lecar model of a biological neuron stimulated by an applied current.
△ Less
Submitted 11 April, 2013;
originally announced April 2013.
-
Neural networks with dynamical synapses: from mixed-mode oscillations and spindles to chaos
Authors:
K. -E. Lee,
A. V. Goltsev,
M. A. Lopes,
J. F. F. Mendes
Abstract:
Understanding of short-term synaptic depression (STSD) and other forms of synaptic plasticity is a topical problem in neuroscience. Here we study the role of STSD in the formation of complex patterns of brain rhythms. We use a cortical circuit model of neural networks composed of irregular spiking excitatory and inhibitory neurons having type 1 and 2 excitability and stochastic dynamics. In the mo…
▽ More
Understanding of short-term synaptic depression (STSD) and other forms of synaptic plasticity is a topical problem in neuroscience. Here we study the role of STSD in the formation of complex patterns of brain rhythms. We use a cortical circuit model of neural networks composed of irregular spiking excitatory and inhibitory neurons having type 1 and 2 excitability and stochastic dynamics. In the model, neurons form a sparsely connected network and their spontaneous activity is driven by random spikes representing synaptic noise. Using simulations and analytical calculations, we found that if the STSD is absent, the neural network shows either asynchronous behavior or regular network oscillations depending on the noise level. In networks with STSD, changing parameters of synaptic plasticity and the noise level, we observed transitions to complex patters of collective activity: mixed-mode and spindle oscillations, bursts of collective activity, and chaotic behaviour. Interestingly, these patterns are stable in a certain range of the parameters and separated by critical boundaries. Thus, the parameters of synaptic plasticity can play a role of control parameters or switchers between different network states. However, changes of the parameters caused by a disease may lead to dramatic impairment of ongoing neural activity. We analyze the chaotic neural activity by use of the 0-1 test for chaos (Gottwald, G. & Melbourne, I., 2004) and show that it has a collective nature.
△ Less
Submitted 24 November, 2012;
originally announced November 2012.
-
Critical and resonance phenomena in neural networks
Authors:
A. V. Goltsev,
M. A. Lopes,
K. -E. Lee,
J. F. F. Mendes
Abstract:
Brain rhythms contribute to every aspect of brain function. Here, we study critical and resonance phenomena that precede the emergence of brain rhythms. Using an analytical approach and simulations of a cortical circuit model of neural networks with stochastic neurons in the presence of noise, we show that spontaneous appearance of network oscillations occurs as a dynamical (non-equilibrium) phase…
▽ More
Brain rhythms contribute to every aspect of brain function. Here, we study critical and resonance phenomena that precede the emergence of brain rhythms. Using an analytical approach and simulations of a cortical circuit model of neural networks with stochastic neurons in the presence of noise, we show that spontaneous appearance of network oscillations occurs as a dynamical (non-equilibrium) phase transition at a critical point determined by the noise level, network structure, the balance between excitatory and inhibitory neurons, and other parameters. We find that the relaxation time of neural activity to a steady state, response to periodic stimuli at the frequency of the oscillations, amplitude of damped oscillations, and stochastic fluctuations of neural activity are dramatically increased when approaching the critical point of the transition.
△ Less
Submitted 24 November, 2012;
originally announced November 2012.
