Showing 1–48 of 48 results for author: Siettos, C

RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators

Authors: Gianluca Fabiani, Ioannis G. Kevrekidis, Constantinos Siettos, Athanasios N. Yannacopoulos

Abstract: Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space of parameters and hyperparameters. This fact, along with the requirement of substantial computational resources, poses a barrier to achieving high numerical accu… ▽ More Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space of parameters and hyperparameters. This fact, along with the requirement of substantial computational resources, poses a barrier to achieving high numerical accuracy. Here, inpsired by DeepONets and to address the above challenges, we present Random Projection-based Operator Networks (RandONets): shallow networks with random projections that learn linear and nonlinear operators. The implementation of RandONets involves: (a) incorporating random bases, thus enabling the use of shallow neural networks with a single hidden layer, where the only unknowns are the output weights of the network's weighted inner product; this reduces dramatically the dimensionality of the parameter space; and, based on this, (b) using established least-squares solvers (e.g., Tikhonov regularization and preconditioned QR decomposition) that offer superior numerical approximation properties compared to other optimization techniques used in deep-learning. In this work, we prove the universal approximation accuracy of RandONets for approximating nonlinear operators and demonstrate their efficiency in approximating linear nonlinear evolution operators (right-hand-sides (RHS)) with a focus on PDEs. We show, that for this particular task, RandONets outperform, both in terms of numerical approximation accuracy and computational cost, the ``vanilla" DeepOnets. △ Less

Submitted 8 June, 2024; originally announced June 2024.

MSC Class: 65M32; 65D12; 65J22; 41A35; 68T20; 65D15; 68T07; 68W20; 41A35

A physics-informed neural network method for the approximation of slow invariant manifolds for the general class of stiff systems of ODEs

Authors: Dimitrios G. Patsatzis, Lucia Russo, Constantinos Siettos

Abstract: We present a physics-informed neural network (PINN) approach for the discovery of slow invariant manifolds (SIMs), for the most general class of fast/slow dynamical systems of ODEs. In contrast to other machine learning (ML) approaches that construct reduced order black box surrogate models using simple regression, and/or require a priori knowledge of the fast and slow variables, our approach, sim… ▽ More We present a physics-informed neural network (PINN) approach for the discovery of slow invariant manifolds (SIMs), for the most general class of fast/slow dynamical systems of ODEs. In contrast to other machine learning (ML) approaches that construct reduced order black box surrogate models using simple regression, and/or require a priori knowledge of the fast and slow variables, our approach, simultaneously decomposes the vector field into fast and slow components and provides a functional of the underlying SIM in a closed form. The decomposition is achieved by finding a transformation of the state variables to the fast and slow ones, which enables the derivation of an explicit, in terms of fast variables, SIM functional. The latter is obtained by solving a PDE corresponding to the invariance equation within the Geometric Singular Perturbation Theory (GSPT) using a single-layer feedforward neural network with symbolic differentiation. The performance of the proposed physics-informed ML framework is assessed via three benchmark problems: the Michaelis-Menten, the target mediated drug disposition (TMDD) reaction model and a fully competitive substrate-inhibitor(fCSI) mechanism. We also provide a comparison with other GPST methods, namely the quasi steady state approximation (QSSA), the partial equilibrium approximation (PEA) and CSP with one and two iterations. We show that the proposed PINN scheme provides SIM approximations, of equivalent or even higher accuracy, than those provided by QSSA, PEA and CSP, especially close to the boundaries of the underlying SIMs. △ Less

Submitted 18 March, 2024; originally announced March 2024.

MSC Class: 65P99; 65L04; 37M21; 68T07

Nonlinear Discrete-Time Observers with Physics-Informed Neural Networks

Authors: Hector Vargas Alvarez, Gianluca Fabiani, Ioannis G. Kevrekidis, Nikolaos Kazantzis, Constantinos Siettos

Abstract: We use Physics-Informed Neural Networks (PINNs) to solve the discrete-time nonlinear observer state estimation problem. Integrated within a single-step exact observer linearization framework, the proposed PINN approach aims at learning a nonlinear state transformation map by solving a system of inhomogeneous functional equations. The performance of the proposed PINN approach is assessed via two il… ▽ More We use Physics-Informed Neural Networks (PINNs) to solve the discrete-time nonlinear observer state estimation problem. Integrated within a single-step exact observer linearization framework, the proposed PINN approach aims at learning a nonlinear state transformation map by solving a system of inhomogeneous functional equations. The performance of the proposed PINN approach is assessed via two illustrative case studies for which the observer linearizing transformation map can be derived analytically. We also perform an uncertainty quantification analysis for the proposed PINN scheme and we compare it with conventional power-series numerical implementations, which rely on the computation of a power series solution. △ Less

Submitted 19 February, 2024; originally announced February 2024.

MSC Class: 37N30; 68T05; 93C55; 65D15

Tasks Makyth Models: Machine Learning Assisted Surrogates for Tip** Points

Authors: Gianluca Fabiani, Nikolaos Evangelou, Tianqi Cui, Juan M. Bello-Rivas, Cristina P. Martin-Linares, Constantinos Siettos, Ioannis G. Kevrekidis

Abstract: We present a machine learning (ML)-assisted framework bridging manifold learning, neural networks, Gaussian processes, and Equation-Free multiscale modeling, for (a) detecting tip** points in the emergent behavior of complex systems, and (b) characterizing probabilities of rare events (here, catastrophic shifts) near them. Our illustrative example is an event-driven, stochastic agent-based model… ▽ More We present a machine learning (ML)-assisted framework bridging manifold learning, neural networks, Gaussian processes, and Equation-Free multiscale modeling, for (a) detecting tip** points in the emergent behavior of complex systems, and (b) characterizing probabilities of rare events (here, catastrophic shifts) near them. Our illustrative example is an event-driven, stochastic agent-based model (ABM) describing the mimetic behavior of traders in a simple financial market. Given high-dimensional spatiotemporal data -- generated by the stochastic ABM -- we construct reduced-order models for the emergent dynamics at different scales: (a) mesoscopic Integro-Partial Differential Equations (IPDEs); and (b) mean-field-type Stochastic Differential Equations (SDEs) embedded in a low-dimensional latent space, targeted to the neighborhood of the tip** point. We contrast the uses of the different models and the effort involved in learning them. △ Less

Submitted 25 September, 2023; originally announced September 2023.

Comments: 29 pages, 8 figures, 6 tables

Slow Invariant Manifolds of Singularly Perturbed Systems via Physics-Informed Machine Learning

Authors: Dimitrios G. Patsatzis, Gianluca Fabiani, Lucia Russo, Constantinos Siettos

Abstract: We present a physics-informed machine-learning (PIML) approach for the approximation of slow invariant manifolds (SIMs) of singularly perturbed systems, providing functionals in an explicit form that facilitate the construction and numerical integration of reduced order models (ROMs). The proposed scheme solves a partial differential equation corresponding to the invariance equation (IE) within th… ▽ More We present a physics-informed machine-learning (PIML) approach for the approximation of slow invariant manifolds (SIMs) of singularly perturbed systems, providing functionals in an explicit form that facilitate the construction and numerical integration of reduced order models (ROMs). The proposed scheme solves a partial differential equation corresponding to the invariance equation (IE) within the Geometric Singular Perturbation Theory (GSPT) framework. For the solution of the IE, we used two neural network structures, namely feedforward neural networks (FNNs), and random projection neural networks (RPNNs), with symbolic differentiation for the computation of the gradients required for the learning process. The efficiency of our PIML method is assessed via three benchmark problems, namely the Michaelis-Menten, the target mediated drug disposition reaction mechanism, and the 3D Sel'kov model. We show that the proposed PIML scheme provides approximations, of equivalent or even higher accuracy, than those provided by other traditional GSPT-based methods, and importantly, for any practical purposes, it is not affected by the magnitude of the perturbation parameter. This is of particular importance, as there are many systems for which the gap between the fast and slow timescales is not that big, but still ROMs can be constructed. A comparison of the computational costs between symbolic, automatic and numerical approximation of the required derivatives in the learning process is also provided. △ Less

Submitted 14 September, 2023; originally announced September 2023.

MSC Class: 65L11; 65P99; 34C45; 37N30; 68T05

Tip** points in overturning circulation mediated by ocean mixing and the configuration and magnitude of the hydrological cycle: A simple model

Authors: Anand Gnanadesikan, Gianluca Fabiani, **gwen Liu, Renske Gelderloos, G. Jay Brett, Yannis Kevrekidis, Thomas Haine, Marie-Aude Pradal, Constantinos Siettos, Jennifer Sleeman

Abstract: The current configuration of the ocean overturning involves upwelling predominantly in the Southern Ocean and sinking predominantly in the Atlantic basin. The reasons for this remain unclear, as both models and paleoclimatic observations suggest that sinking can sometimes occur in the Pacific. We present a six-box model of the overturning in which temperature, salinity and low-latitude pycnocline… ▽ More The current configuration of the ocean overturning involves upwelling predominantly in the Southern Ocean and sinking predominantly in the Atlantic basin. The reasons for this remain unclear, as both models and paleoclimatic observations suggest that sinking can sometimes occur in the Pacific. We present a six-box model of the overturning in which temperature, salinity and low-latitude pycnocline depths are allowed to vary prognostically in both the Atlantic and Pacific. The overturning is driven by temperature, winds, and mixing and modulated by the hydrological cycle. In each basin there are three possible flow regimes, depending on whether low-latitude water flowing into northern surface boxes is transformed into dense deep water, somewhat lighter intermediate water, or light water that is returned at the surface. The resulting model combines insights from a number of previous studies and allows for nine possible global flow regimes. For the modern ocean, we find that although the interbasin atmospheric freshwater flux suppresses Pacific sinking, the equator-to-pole flux enhances it. When atmospheric temperatures are held fixed, seven possible flow regimes can be accessed by changing the amplitude and configuration of the modern hydrological cycle . North Pacific overturning can strengthen with either increases or decreases in the hydrological cycle, as well as under reversal of the interbasin freshwater flux. Tip**-point behavior of both transient and equilibrium states is modulated by parameters such as the poorly constrained lateral diffusive mixing. If hydrological cycle amplitude is varied consistently with global temperature, northern polar amplification is necessary for the Atlantic overturning to collapse △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 38 pages, 10 figures, Submitted to Journal of Physical Oceanography

Data-driven modelling of brain activity using neural networks, Diffusion Maps, and the Koopman operator

Authors: Ioannis K. Gallos, Daniel Lehmberg, Felix Dietrich, Constantinos Siettos

Abstract: We propose a machine-learning approach to model long-term out-of-sample dynamics of brain activity from task-dependent fMRI data. Our approach is a three stage one. First, we exploit Diffusion maps (DMs) to discover a set of variables that parametrize the low-dimensional manifold on which the emergent high-dimensional fMRI time series evolve. Then, we construct reduced-order-models (ROMs) on the e… ▽ More We propose a machine-learning approach to model long-term out-of-sample dynamics of brain activity from task-dependent fMRI data. Our approach is a three stage one. First, we exploit Diffusion maps (DMs) to discover a set of variables that parametrize the low-dimensional manifold on which the emergent high-dimensional fMRI time series evolve. Then, we construct reduced-order-models (ROMs) on the embedded manifold via two techniques: Feedforward Neural Networks (FNNs) and the Koopman operator. Finally, for predicting the out-of-sample long-term dynamics of brain activity in the ambient fMRI space, we solve the pre-image problem coupling DMs with Geometric Harmonics (GH) when using FNNs and the Koopman modes per se. For our illustrations, we have assessed the performance of the two proposed schemes using a benchmark fMRI dataset with recordings during a visuo-motor task. The results suggest that just a few (for the particular task, five) non-linear coordinates of the high-dimensional fMRI time series provide a good basis for modelling and out-of-sample prediction of the brain activity. Furthermore, we show that the proposed approaches outperform the one-step ahead predictions of the naive random walk model, which, in contrast to our scheme, relies on the knowledge of the signals in the previous time step. Importantly, we show that the proposed Koopman operator approach provides, for any practical purposes, equivalent results to the FNN-GH approach, thus bypassing the need to train a non-linear map and to use GH to extrapolate predictions in the ambient fMRI space; one can use instead the low-frequency truncation of the DMs function space of L^2-integrable functions, to predict the entire list of coordinate functions in the fMRI space and to solve the pre-image problem. △ Less

Submitted 24 April, 2023; originally announced April 2023.

MSC Class: 65P99; 46T10; 37N30; 68T05; 37M10

Numerical Bifurcation Analysis of Turing and Symmetry Broken Patterns of a Vegetation PDE Model

Authors: Konstantinos Spiliotis, Lucia Russo, Francesco Giannino, Constantinos Siettos

Abstract: We study the mechanisms of pattern formation for vegetation dynamics in water-limited regions. Our analysis is based on a set of two partial differential equations (PDEs) of reaction-diffusion type for the biomass and water and one ordinary differential equation (ODE) describing the dependence of the toxicity on the biomass. We perform a linear stability analysis in the one-dimensional finite spac… ▽ More We study the mechanisms of pattern formation for vegetation dynamics in water-limited regions. Our analysis is based on a set of two partial differential equations (PDEs) of reaction-diffusion type for the biomass and water and one ordinary differential equation (ODE) describing the dependence of the toxicity on the biomass. We perform a linear stability analysis in the one-dimensional finite space, we derive analytically the conditions for the appearance of Turing instability that gives rise to spatio-temporal patterns emanating from the homogeneous solution, and provide its dependence with respect to the size of the domain. Furthermore, we perform a numerical bifurcation analysis in order to study the pattern formation of the inhomogeneous solution, with respect to the precipitation rate, thus analyzing the stability and symmetry properties of the emanating patterns. Based on the numerical bifurcation analysis, we have found new patterns, which form due to the onset of secondary bifurcations from the primary Turing instability, thus giving rise to a multistability of asymmetric solutions. △ Less

Submitted 23 March, 2023; originally announced March 2023.

MSC Class: 37Mxx; 37N30; 65-XX; Numerical bifurcation problems; 35Qxx

Discrete-Time Nonlinear Feedback Linearization via Physics-Informed Machine Learning

Authors: Hector Vargas Alvarez, Gianluca Fabiani, Nikolaos Kazantzis, Constantinos Siettos, Ioannis G. Kevrekidis

Abstract: We present a physics-informed machine learning (PIML) scheme for the feedback linearization of nonlinear discrete-time dynamical systems. The PIML finds the nonlinear transformation law, thus ensuring stability via pole placement, in one step. In order to facilitate convergence in the presence of steep gradients in the nonlinear transformation law, we address a greedy-wise training procedure. We a… ▽ More We present a physics-informed machine learning (PIML) scheme for the feedback linearization of nonlinear discrete-time dynamical systems. The PIML finds the nonlinear transformation law, thus ensuring stability via pole placement, in one step. In order to facilitate convergence in the presence of steep gradients in the nonlinear transformation law, we address a greedy-wise training procedure. We assess the performance of the proposed PIML approach via a benchmark nonlinear discrete map for which the feedback linearization transformation law can be derived analytically; the example is characterized by steep gradients, due to the presence of singularities, in the domain of interest. We show that the proposed PIML outperforms, in terms of numerical approximation accuracy, the traditional numerical implementation, which involves the construction--and the solution in terms of the coefficients of a power-series expansion--of a system of homological equations as well as the implementation of the PIML in the entire domain, thus highlighting the importance of continuation techniques in the training procedure of PIML. △ Less

Submitted 15 March, 2023; originally announced March 2023.

MSC Class: 65Pxx; 93C10; 68T07

Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approach

Authors: Dimitrios G. Patsatzis, Lucia Russo, Ioannis G. Kevrekidis, Constantinos Siettos

Abstract: We present an Equation/Variable free machine learning (EVFML) framework for the control of the collective dynamics of complex/multiscale systems modelled via microscopic/agent-based simulators. The approach obviates the need for construction of surrogate, reduced-order models.~The proposed implementation consists of three steps: (A) from high-dimensional agent-based simulations, machine learning (… ▽ More We present an Equation/Variable free machine learning (EVFML) framework for the control of the collective dynamics of complex/multiscale systems modelled via microscopic/agent-based simulators. The approach obviates the need for construction of surrogate, reduced-order models.~The proposed implementation consists of three steps: (A) from high-dimensional agent-based simulations, machine learning (in particular, non-linear manifold learning (Diffusion Maps (DMs)) helps identify a set of coarse-grained variables that parametrize the low-dimensional manifold on which the emergent/collective dynamics evolve. The out-of-sample extension and pre-image problems, i.e. the construction of non-linear map**s from the high-dimensional input space to the low-dimensional manifold and back, are solved by coupling DMs with the Nystrom extension and Geometric Harmonics, respectively; (B) having identified the manifold and its coordinates, we exploit the Equation-free approach to perform numerical bifurcation analysis of the emergent dynamics; then (C) based on the previous steps, we design data-driven embedded wash-out controllers that drive the agent-based simulators to their intrinsic, imprecisely known, emergent open-loop unstable steady-states, thus demonstrating that the scheme is robust against numerical approximation errors and modelling uncertainty.~The efficiency of the framework is illustrated by controlling emergent unstable (i) traveling waves of a deterministic agent-based model of traffic dynamics, and (ii) equilibria of a stochastic financial market agent model with mimesis. △ Less

Submitted 5 August, 2022; v1 submitted 12 July, 2022; originally announced July 2022.

MSC Class: 37-xx; 65Pxx; 93-XX; 68Txx

Journal ref: Journal of Computational Physics, 478, 111953, 2023

Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data

Authors: Seungjoon Lee, Yorgos M. Psarellis, Constantinos I. Siettos, Ioannis G. Kevrekidis

Abstract: We propose a machine learning framework for the data-driven discovery of macroscopic chemotactic Partial Differential Equations (PDEs) -- and the closures that lead to them -- from high-fidelity, individual-based stochastic simulations of E.coli bacterial motility. The fine scale, detailed, hybrid (continuum - Monte Carlo) simulation model embodies the underlying biophysics, and its parameters are… ▽ More We propose a machine learning framework for the data-driven discovery of macroscopic chemotactic Partial Differential Equations (PDEs) -- and the closures that lead to them -- from high-fidelity, individual-based stochastic simulations of E.coli bacterial motility. The fine scale, detailed, hybrid (continuum - Monte Carlo) simulation model embodies the underlying biophysics, and its parameters are informed from experimental observations of individual cells. We exploit Automatic Relevance Determination (ARD) within a Gaussian Process framework for the identification of a parsimonious set of collective observables that parametrize the law of the effective PDEs. Using these observables, in a second step we learn effective, coarse-grained "Keller-Segel class" chemotactic PDEs using machine learning regressors: (a) (shallow) feedforward neural networks and (b) Gaussian Processes. The learned laws can be black-box (when no prior knowledge about the PDE law structure is assumed) or gray-box when parts of the equation (e.g. the pure diffusion part) is known and "hardwired" in the regression process. We also discuss data-driven corrections (both additive and functional) of analytically known, approximate closures. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Comments: 33 pages, 5 figures, 1 table

Parsimonious Physics-Informed Random Projection Neural Networks for Initial-Value Problems of ODEs and index-1 DAEs

Authors: Gianluca Fabiani, Evangelos Galaris, Lucia Russo, Constantinos Siettos

Abstract: We address a physics-informed neural network based on the concept of random projections for the numerical solution of IVPs of nonlinear ODEs in linear-implicit form and index-1 DAEs, which may also arise from the spatial discretization of PDEs. The scheme has a single hidden layer with appropriately randomly parametrized Gaussian kernels and a linear output layer, while the internal weights are fi… ▽ More We address a physics-informed neural network based on the concept of random projections for the numerical solution of IVPs of nonlinear ODEs in linear-implicit form and index-1 DAEs, which may also arise from the spatial discretization of PDEs. The scheme has a single hidden layer with appropriately randomly parametrized Gaussian kernels and a linear output layer, while the internal weights are fixed to ones. The unknown weights between the hidden and output layer are computed by Newton's iterations, using the Moore-Penrose pseudoinverse for low to medium, and sparse QR decomposition with regularization for medium to large scale systems. To deal with stiffness and sharp gradients, we propose a variable step size scheme for adjusting the interval of integration and address a continuation method for providing good initial guesses for the Newton iterations. Based on previous works on random projections, we prove the approximation capability of the scheme for ODEs in the canonical form and index-1 DAEs in the semiexplicit form. The optimal bounds of the uniform distribution are parsimoniously chosen based on the bias-variance trade-off. The performance of the scheme is assessed through seven benchmark problems: four index-1 DAEs, the Robertson model, a model of five DAEs describing the motion of a bead, a model of six DAEs describing a power discharge control problem, the chemical Akzo Nobel problem and three stiff problems, the Belousov-Zhabotinsky, the Allen-Cahn PDE and the Kuramoto-Sivashinsky PDE. The efficiency of the scheme is compared with three solvers ode23t, ode23s, ode15s of the MATLAB ODE suite. Our results show that the proposed scheme outperforms the stiff solvers in several cases, especially in regimes where high stiffness or sharp gradients arise in terms of numerical accuracy, while the computational costs are for any practical purposes comparable. △ Less

Submitted 11 March, 2022; v1 submitted 10 March, 2022; originally announced March 2022.

Designing Social Distancing Policies for the COVID-19 Pandemic: A probabilistic model predictive control approach

Authors: Antonis Armaou, Bryce Katch, Lucia Russo, Constantinos Siettos

Abstract: The effective control of the COVID-19 pandemic is one the most challenging issues of nowadays. The design of optimal control policies is perplexed from a variety of social, political, economical and epidemiological factors. Here, based on epidemiological data reported in recent studies for the Italian region of Lombardy, which experienced one of the largest and most devastating outbreaks in Europe… ▽ More The effective control of the COVID-19 pandemic is one the most challenging issues of nowadays. The design of optimal control policies is perplexed from a variety of social, political, economical and epidemiological factors. Here, based on epidemiological data reported in recent studies for the Italian region of Lombardy, which experienced one of the largest and most devastating outbreaks in Europe during the first wave of the pandemic, we address a probabilistic model predictive control (PMPC) approach for the modelling and the systematic study of what if scenarios of the social distancing in a retrospective analysis for the first wave of the pandemic in Lombardy. The performance of the proposed PMPC scheme was assessed based on simulations of a compartmental model that was developed to quantify the uncertainty in the level of the asymptomatic cases in the population, and the synergistic effect of social distancing in various activities, and public awareness campaign prompting people to adopt cautious behaviors to reduce the risk of disease transmission. The PMPC scheme takes into account the social mixing effect, i.e. the effect of the various activities in the potential transmission of the disease. The proposed approach demonstrates the utility of a PMPC approach in addressing COVID-19 transmission and implementing public relaxation policies. △ Less

Submitted 2 February, 2022; originally announced February 2022.

Journal ref: Mathematical Biosciences and Engineering, 19, 8804-8832, 2022

Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approach

Authors: Evangelos Galaris, Gianluca Fabiani, Ioannis Gallos, Ioannis Kevrekidis, Constantinos Siettos

Abstract: We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and in particular parsimonious Diffusion Maps using leave-one-out cross-validation (LOOCV) to both identify the intrinsic dimension of the manifold where the emerge… ▽ More We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and in particular parsimonious Diffusion Maps using leave-one-out cross-validation (LOOCV) to both identify the intrinsic dimension of the manifold where the emergent dynamics evolve and for feature selection over the parametric space. In the second step, based on the selected features, we learn the right-hand-side of the effective partial differential equations (PDEs) using two machine learning schemes, namely shallow Feedforward Neural Networks (FNNs) with two hidden layers and single-layer Random Projection Networks(RPNNs) which basis functions are constructed using an appropriate random sampling approach. Finally, based on the learned black-box PDE model, we construct the corresponding bifurcation diagram, thus exploiting the numerical bifurcation analysis toolkit. For our illustrations, we implemented the proposed method to construct the one-parameter bifurcation diagram of the 1D FitzHugh-Nagumo PDEs from data generated by $D1Q3$ Lattice Boltzmann simulations. The proposed method was quite effective in terms of numerical accuracy regarding the construction of the coarse-scale bifurcation diagram. Furthermore, the proposed RPNN scheme was $\sim$ 20 to 30 times less costly regarding the training phase than the traditional shallow FNNs, thus arising as a promising alternative to deep learning for solving the inverse problem for high-dimensional PDEs. △ Less

Submitted 15 February, 2022; v1 submitted 31 January, 2022; originally announced January 2022.

Journal ref: Journal of Scientific Computing, 92, 34, 2022

Time Series Forecasting Using Manifold Learning

Authors: Panagiotis Papaioannou, Ronen Talmon, Ioannis Kevrekidis, Constantinos Siettos

Abstract: We address a three-tier numerical framework based on manifold learning for the forecasting of high-dimensional time series. At the first step, we embed the time series into a reduced low-dimensional space using a nonlinear manifold learning algorithm such as Locally Linear Embedding and Diffusion Maps. At the second step, we construct reduced-order regression models on the manifold, in particular… ▽ More We address a three-tier numerical framework based on manifold learning for the forecasting of high-dimensional time series. At the first step, we embed the time series into a reduced low-dimensional space using a nonlinear manifold learning algorithm such as Locally Linear Embedding and Diffusion Maps. At the second step, we construct reduced-order regression models on the manifold, in particular Multivariate Autoregressive (MVAR) and Gaussian Process Regression (GPR) models, to forecast the embedded dynamics. At the final step, we lift the embedded time series back to the original high-dimensional space using Radial Basis Functions interpolation and Geometric Harmonics. For our illustrations, we test the forecasting performance of the proposed numerical scheme with four sets of time series: three synthetic stochastic ones resembling EEG signals produced from linear and nonlinear stochastic models with different model orders, and one real-world data set containing daily time series of 10 key foreign exchange rates (FOREX) spanning the time period 03/09/2001-29/10/2020. The forecasting performance of the proposed numerical scheme is assessed using the combinations of manifold learning, modelling and lifting approaches. We also provide a comparison with the Principal Component Analysis algorithm as well as with the naive random walk model and the MVAR and GPR models trained and implemented directly in the high-dimensional space. △ Less

Submitted 23 November, 2021; v1 submitted 7 October, 2021; originally announced October 2021.

MSC Class: 37Mxx; 58D30; 60G15; 37C05

Journal ref: Chaos, 32, 083113, 2022

Numerical Solution of Stiff ODEs with Physics-Informed RPNNs

Authors: Evangelos Galaris, Gianluca Fabiani, Francesco Calabrò, Daniela di Serafino, Constantinos Siettos

Abstract: We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme Learning Machine with a single hidden layer with radial basis functions having as widths uniformly distributed random variables, while the values of the weights bet… ▽ More We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme Learning Machine with a single hidden layer with radial basis functions having as widths uniformly distributed random variables, while the values of the weights between the input and the hidden layer are set equal to one. The numerical solution of the IVPs is obtained by constructing a system of nonlinear algebraic equations, which is solved with respect to the output weights by the Gauss-Newton method, using a simple adaptive scheme for adjusting the time interval of integration. To assess its performance, we apply the proposed method for the solution of four benchmark stiff IVPs, namely the Prothero-Robinson, van der Pol, ROBER and HIRES problems. Our method is compared with an adaptive Runge-Kutta method based on the Dormand-Prince pair, and a variable-step variable-order multistep solver based on numerical differentiation formulas, as implemented in the \texttt{ode45} and \texttt{ode15s} MATLAB functions, respectively. We show that the proposed scheme yields good approximation accuracy, thus outperforming \texttt{ode45} and \texttt{ode15s}, especially in the cases where steep gradients arise. Furthermore, the computational times of our approach are comparable with those of the two MATLAB solvers for practical purposes. △ Less

Submitted 24 November, 2021; v1 submitted 3 August, 2021; originally announced August 2021.

MSC Class: 65L04; 68T07; 65D12; 60B20

A biophysical network model reveals the link between deficient inhibitory cognitive control and major neurotransmitter and neural connectivity hypotheses in schizophrenia

Authors: Konstantinos Spiliotis, Giannis Kahramanoglou, Jens Starke, Nikolaos Smyrnis, Constantinos Siettos

Abstract: We address a biophysical network dynamical model to study how the modulation of dopamine (DA) activity and related N-methyl-d-aspartate (NMDA) glutamate receptor activity as well as the emerging Pre-Frontal Cortex (PFC) functional connectivity network (FCN) affect inhibitory cognitive function in schizophrenia in an antisaccade task. The values of the model parameters and the topology of the PFC-F… ▽ More We address a biophysical network dynamical model to study how the modulation of dopamine (DA) activity and related N-methyl-d-aspartate (NMDA) glutamate receptor activity as well as the emerging Pre-Frontal Cortex (PFC) functional connectivity network (FCN) affect inhibitory cognitive function in schizophrenia in an antisaccade task. The values of the model parameters and the topology of the PFC-FCN were estimated by minimizing the differences between simulations and the observed distributions of reaction times (RT) during the performance of the antisaccade task in 30 patients with schizophrenia and 30 healthy controls. We show that the proposed model approximates remarkably well the predicted prefrontal cortical DA hypo-activity and the related NMDA receptor hypo-function as well as the FCN dysconnection pattern that are considered as the major etio-pathological hypotheses to explain cognitive deficits in schizophrenia. △ Less

Submitted 20 July, 2021; originally announced July 2021.

Numerical Solution and Bifurcation Analysis of Nonlinear Partial Differential Equations with Extreme Learning Machines

Authors: Gianluca Fabiani, Francesco Calabrò, Lucia Russo, Constantinos Siettos

Abstract: We address a new numerical scheme based on a class of machine learning methods, the so-called Extreme Learning Machines with both sigmoidal and radial-basis functions, for the computation of steady-state solutions and the construction of (one dimensional) bifurcation diagrams of nonlinear partial differential equations (PDEs). For our illustrations, we considered two benchmark problems, namely (a)… ▽ More We address a new numerical scheme based on a class of machine learning methods, the so-called Extreme Learning Machines with both sigmoidal and radial-basis functions, for the computation of steady-state solutions and the construction of (one dimensional) bifurcation diagrams of nonlinear partial differential equations (PDEs). For our illustrations, we considered two benchmark problems, namely (a) the one-dimensional viscous Burgers with both homogeneous (Dirichlet) and non-homogeneous mixed boundary conditions, and, (b) the one and two-dimensional Liouville-Bratu-Gelfand PDEs with homogeneous Dirichlet boundary conditions. For the one-dimensional Burgers and Bratu PDEs, exact analytical solutions are available and used for comparison purposes against the numerical derived solutions. Furthermore, the numerical efficiency (in terms of accuracy and size of the grid) of the proposed numerical machine learning scheme is compared against central finite differences (FD) and Galerkin weighted-residuals finite-element methods (FEM). We show that the proposed ELM numerical method outperforms both FD and FEM methods for medium to large sized grids, while provides equivalent results with the FEM for low to medium sized grids. △ Less

Submitted 13 April, 2021; originally announced April 2021.

MSC Class: 65-XX; 65Nxx; 65-XX; 65P30

Journal ref: Journal of Scientific Computing 89, 44 (2021)

Extreme learning machine collocation for the numerical solution of elliptic PDEs with sharp gradients

Authors: Francesco Calabrò, Gianluca Fabiani, Constantinos Siettos

Abstract: We introduce a new numerical method based on machine learning to approximate the solution of elliptic partial differential equations with collocation using a set of sigmoidal functions. We show that a feedforward neural network with a single hidden layer with sigmoidal functions and fixed, random, internal weights and biases can be used to compute accurately a collocation solution. The choice to f… ▽ More We introduce a new numerical method based on machine learning to approximate the solution of elliptic partial differential equations with collocation using a set of sigmoidal functions. We show that a feedforward neural network with a single hidden layer with sigmoidal functions and fixed, random, internal weights and biases can be used to compute accurately a collocation solution. The choice to fix internal weights and bias leads to the so-called Extreme Learning Machine network. We discuss how to determine the range for both internal weights and biases in order to obtain a good underlining approximating space, and we explore the required number of collocation points. We demonstrate the efficiency of the proposed method with several one-dimensional diffusion-advection-reaction problems that exhibit steep behaviors, such as boundary layers. The boundary conditions are imposed directly as collocation equations. We point out that there is no need of training the network, as the proposed numerical approach results to a linear problem that can be easily solved using least-squares. Numerical results show that the proposed method achieves a good accuracy. Finally, we compare the proposed method with finite differences and point out the significant improvements in terms of computational cost, thus avoiding the time-consuming training phase. △ Less

Submitted 11 December, 2020; v1 submitted 10 December, 2020; originally announced December 2020.

Journal ref: Computer Methods in Applied Mechanics and Engineering, 387, 2021

Construction of embedded fMRI resting state functional connectivity networks using manifold learning

Authors: Ioannis Gallos, Evangelos Galaris, Constantinos Siettos

Abstract: We construct embedded functional connectivity networks (FCN) from benchmark resting-state functional magnetic resonance imaging (rsfMRI) data acquired from patients with schizophrenia and healthy controls based on linear and nonlinear manifold learning algorithms, namely, Multidimensional Scaling (MDS), Isometric Feature Map** (ISOMAP) and Diffusion Maps. Furthermore, based on key global graph-t… ▽ More We construct embedded functional connectivity networks (FCN) from benchmark resting-state functional magnetic resonance imaging (rsfMRI) data acquired from patients with schizophrenia and healthy controls based on linear and nonlinear manifold learning algorithms, namely, Multidimensional Scaling (MDS), Isometric Feature Map** (ISOMAP) and Diffusion Maps. Furthermore, based on key global graph-theoretical properties of the embedded FCN, we compare their classification potential using machine learning techniques. We also assess the performance of two metrics that are widely used for the construction of FCN from fMRI, namely the Euclidean distance and the lagged cross-correlation metric. We show that the FCN constructed with Diffusion Maps and the lagged cross-correlation metric outperform the other combinations. △ Less

Submitted 25 May, 2020; originally announced May 2020.

Journal ref: Cogn Neurodyn 15, 585-608 (2021)

EEG source localization analysis in epileptic children during a visual working-memory task

Authors: Evangelos Galaris, Ioannis Gallos, Ivan Myatchin, Lieven Lagae, Constantinos Siettos

Abstract: We localize the sources of brain activity of children with epilepsy based on EEG recordings acquired during a visual discrimination working memory task. For the numerical solution of the inverse problem, with the aid of age-specific MRI scans processed from a publicly available database, we use and compare three regularization numerical methods, namely the standarized Low Resolution Electromagneti… ▽ More We localize the sources of brain activity of children with epilepsy based on EEG recordings acquired during a visual discrimination working memory task. For the numerical solution of the inverse problem, with the aid of age-specific MRI scans processed from a publicly available database, we use and compare three regularization numerical methods, namely the standarized Low Resolution Electromagnetic Tomography (sLORETA), the weighted Minimum Norm Estimation (wMNE) and the dynamic Statistical Parametric Map** (dSPM). We show that all three methods provide the same spatio-temporal patterns of differences between epileptic and control children. In particular, our analysis reveals statistically significant differences between the two groups in regions of the Parietal Cortex indicating that these may serve as "biomarkers" for diagnostic purposes and ultimately localized treatment. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Journal ref: International Journal of Numerical Methods in Biomedical Engineering, 36:e3404, 2020

Analytical and Numerical Bifurcation Analysis of a Forest-Grassland Ecosystem Model with Human Interaction

Authors: Konstantinos Spiliotis, Lucia Russo, Francesco Giannino, Constantinos Siettos

Abstract: We perform both analytical and numerical bifurcation analysis of a forest-grassland ecosystem model coupled with human interaction. The model consists of two nonlinear ordinary differential equations incorporating the human perception of forest/grassland value. The system displays multiple steady states corresponding to different forest densities as well as regimes characterized by both stable and… ▽ More We perform both analytical and numerical bifurcation analysis of a forest-grassland ecosystem model coupled with human interaction. The model consists of two nonlinear ordinary differential equations incorporating the human perception of forest/grassland value. The system displays multiple steady states corresponding to different forest densities as well as regimes characterized by both stable and unstable limit cycles. We derive analytically the conditions with respect to the model parameters that give rise to various types of codimension-one criticalities such as transcritical, saddle-node, and Andronov-Hopf bifurcations and codimension-two criticalities such as cusp and Bogdanov-Takens bifurcations. We also perform a numerical continuation of the branches of limit cycles. By doing so, we reveal turning points of limit cycles marking the appearance/disappearance of sustained oscillations. These far-from-equilibrium criticalities that cannot be detected analytically give rise to the abrupt loss of the sustained oscillations, thus leading to another mechanism of catastrophic shifts △ Less

Submitted 27 October, 2019; originally announced October 2019.

Journal ref: ESAIM-Mathematical Modelling and Numerical Analysis, 55, S653-S675, 2021

Coarse-scale PDEs from fine-scale observations via machine learning

Authors: Seungjoon Lee, Mahdi Kooshkbaghi, Konstantinos Spiliotis, Constantinos I. Siettos, Ioannis G. Kevrekidis

Abstract: Complex spatiotemporal dynamics of physicochemical processes are often modeled at a microscopic level (through e.g. atomistic, agent-based or lattice models) based on first principles. Some of these processes can also be successfully modeled at the macroscopic level using e.g. partial differential equations (PDEs) describing the evolution of the right few macroscopic observables (e.g. concentratio… ▽ More Complex spatiotemporal dynamics of physicochemical processes are often modeled at a microscopic level (through e.g. atomistic, agent-based or lattice models) based on first principles. Some of these processes can also be successfully modeled at the macroscopic level using e.g. partial differential equations (PDEs) describing the evolution of the right few macroscopic observables (e.g. concentration and momentum fields). Deriving good macroscopic descriptions (the so-called "closure problem") is often a time-consuming process requiring deep understanding/intuition about the system of interest. Recent developments in data science provide alternative ways to effectively extract/learn accurate macroscopic descriptions approximating the underlying microscopic observations. In this paper, we introduce a data-driven framework for the identification of unavailable coarse-scale PDEs from microscopic observations via machine learning algorithms. Specifically, using Gaussian Processes, Artificial Neural Networks, and/or Diffusion Maps, the proposed framework uncovers the relation between the relevant macroscopic space fields and their time evolution (the right-hand-side of the explicitly unavailable macroscopic PDE). Interestingly, several choices equally representative of the data can be discovered. The framework will be illustrated through the data-driven discovery of macroscopic, concentration-level PDEs resulting from a fine-scale, Lattice Boltzmann level model of a reaction/transport process. Once the coarse evolution law is identified, it can be simulated to produce long-term macroscopic predictions. Different features (pros as well as cons) of alternative machine learning algorithms for performing this task (Gaussian Processes and Artificial Neural Networks), are presented and discussed. △ Less

Submitted 8 January, 2021; v1 submitted 12 September, 2019; originally announced September 2019.

A Numerical Method for the Parametrization of Stable and Unstable Manifolds of Microscopic Simulators

Authors: Constantinos Siettos, Lucia Russo

Abstract: We address a numerical methodology for the computation of coarse-grained stable and unstable manifolds of saddle equilibria/stationary states of multiscale/stochastic systems for which a "good" macroscopic description in the form of Ordinary (ODEs) and/or Partial differential equations (PDEs) does not explicitly/ analytically exists in a closed form. Thus, the assumption is that we have a detailed… ▽ More We address a numerical methodology for the computation of coarse-grained stable and unstable manifolds of saddle equilibria/stationary states of multiscale/stochastic systems for which a "good" macroscopic description in the form of Ordinary (ODEs) and/or Partial differential equations (PDEs) does not explicitly/ analytically exists in a closed form. Thus, the assumption is that we have a detailed microscopic simulator of a complex system in the form of Monte-Carlo, Brownian dynamics, Agent-based models e.t.c. (or a black-box large-scale discrete time simulator) but due to the inherent complexity of the problem, we don't have explicitly an accurate model in the form of ODEs or PDEs. Our numerical scheme is a three-tier one including: (a) the "on demand" detection of the coarse-grained saddle equilibrium, (b) its coarse-grained stability analysis, and (c) the parametrization of the semi-local invariant stable and unstable manifolds by the numerical solution of the homological/functional equations for the coefficients of the truncated series approximation of the manifolds. △ Less

Submitted 7 September, 2019; originally announced September 2019.

Numerical analysis of a mechanotransduction dynamical model reveals homoclinic bifurcations of extracellular matrix mediated oscillations of the mesenchymal stem cell fate

Authors: Katiana Kontolati, Constantinos Siettos

Abstract: We perform one and two-parameter numerical bifurcation analysis of a mechanotransduction model approximating the dynamics of mesenchymal stem cell differentiation into neurons, adipocytes, myocytes and osteoblasts. For our analysis, we use as bifurcation parameters the stiffness of the extracellular matrix and parameters linked with the positive feedback mechanisms that up-regulate the production… ▽ More We perform one and two-parameter numerical bifurcation analysis of a mechanotransduction model approximating the dynamics of mesenchymal stem cell differentiation into neurons, adipocytes, myocytes and osteoblasts. For our analysis, we use as bifurcation parameters the stiffness of the extracellular matrix and parameters linked with the positive feedback mechanisms that up-regulate the production of the YAP/TAZ transcriptional regulators (TRs) and the cell adhesion area. Our analysis reveals a rich nonlinear behaviour of the cell differentiation including regimes of hysteresis and multistability, stable oscillations of the effective adhesion area, the YAP/TAZ TRs and the PPAR$γ$ receptors associated with the adipogenic fate, as well as homoclinic bifurcations that interrupt relatively high-amplitude oscillations abruptly. The two-parameter bifurcation analysis of the Andronov-Hopf points that give birth to the oscillating patterns predicts their existence for soft extracellular substrates ($<1kPa$), a regime that favours the neurogenic and the adipogenic cell fate. Furthermore, in these regimes, the analysis reveals the presence of homoclinic bifurcations that result in the sudden loss of the stable oscillations of the cell-substrate adhesion towards weaker adhesion and high expression levels of the gene encoding Tubulin beta-3 chain, thus favouring the phase transition from the adipogenic to the neurogenic fate. △ Less

Submitted 4 February, 2019; originally announced February 2019.

Journal ref: International Journal of Non-Linear Mechanics, 113, 146-157, 2019

Modelling Lobbying Behaviour and Interdisciplinarity Dynamics in Academia

Authors: Stefano Mazzoleni, Lucia Russo, Francesco Giannino, Gerardo Toraldo, Constantinos Siettos

Abstract: Disciplinary diversity is being recognized today as the key to establish a vibrant academic environment with bigger potential for breakthroughs in research and technology. However, the interaction of several factors including policies, and behavioral attitudes put significant barriers on advancing interdisciplinarity. A "cognitive rigidity" may rise due to reactive academic lobbying favouring inbr… ▽ More Disciplinary diversity is being recognized today as the key to establish a vibrant academic environment with bigger potential for breakthroughs in research and technology. However, the interaction of several factors including policies, and behavioral attitudes put significant barriers on advancing interdisciplinarity. A "cognitive rigidity" may rise due to reactive academic lobbying favouring inbreeding. Here, we address, analyse and discuss a mathematical model of lobbying and interdisciplinarity dynamics in Academia. The model consists of four coupled non-linear Ordinary Differential Equations simulating the interaction between three types of academic individuals and a state reflecting the rate of knowledge advancement which is related to the level of disciplinary diversity. Our model predicts a rich nonlinear behaviour including multiplicity of states and sustained periodic oscillations resembling the everlasting struggle between the "new" and the "old". The effect of a control policy that inhibits lobbying is also studied. By appropriate adjustment of the model parameters we approximated the jump/phase transitions in breakthroughs in mathematical and molecular biological sciences resulted by the increased flow of Russian scientists in the USA after the dissolution of the Soviet Union starting in 1989, the launch of the Human Genome Project in 1992 and the Internet diffusion starting in 2000. △ Less

Submitted 3 February, 2018; originally announced February 2018.

Journal ref: Journal of Computational and Applied Mathematics-Volume 385, 2021, 113194

S&P500 Forecasting and Trading using Convolution Analysis of Major Asset Classes

Authors: Panagiotis Papaioannou, Thomas Dionysopoulos, Dietmar Janetzko, Constantinos Siettos

Abstract: By monitoring the time evolution of the most liquid Futures contracts traded globally as acquired using the Bloomberg API from 03 January 2000 until 15 December 2014 we were able to forecast the S&P 500 index beating the Buy and Hold trading strategy. Our approach is based on convolution computations of 42 of the most liquid Futures contracts of four basic financial asset classes, namely, equities… ▽ More By monitoring the time evolution of the most liquid Futures contracts traded globally as acquired using the Bloomberg API from 03 January 2000 until 15 December 2014 we were able to forecast the S&P 500 index beating the Buy and Hold trading strategy. Our approach is based on convolution computations of 42 of the most liquid Futures contracts of four basic financial asset classes, namely, equities, bonds, commodities and foreign exchange. These key assets were selected on the basis of the global GDP ranking across countries worldwide according to the lists published by the International Monetary Fund (IMF, Report for Selected Country Groups and Subjects, 2015). The main hypothesis is that the shifts between the asset classes are smooth and are shaped by slow dynamics as trading decisions are shaped by several constraints associated with the portfolios allocation, as well as rules restrictions imposed by state financial authorities. This hypothesis is grounded on recent research based on the added value generated by diversification targets of market participants specialized on active asset management, who try to efficiently and smoothly navigate the market's volatility. △ Less

Submitted 13 December, 2016; originally announced December 2016.

To Infinity and Beyond: Some ODE and PDE Case Studies

Authors: P. G. Kevrekidis, C. I. Siettos, I. G. Kevrekidis

Abstract: When mathematical/computational problems reach infinity, extending analysis and/or numerical computation beyond it becomes a notorious challenge. We suggest that, upon suitable singular transformations (that can in principle be computationally detected on the fly) it becomes possible to go beyond infinity to the other side, with the solution becoming again well behaved and the computations continu… ▽ More When mathematical/computational problems reach infinity, extending analysis and/or numerical computation beyond it becomes a notorious challenge. We suggest that, upon suitable singular transformations (that can in principle be computationally detected on the fly) it becomes possible to go beyond infinity to the other side, with the solution becoming again well behaved and the computations continuing normally. In our lumped, Ordinary Differential Equation (ODE) examples this infinity crossing can happen instantaneously; at the spatially distributed, Partial Differential Equation (PDE) level the crossing of infinity may even persist for finite time, necessitating the introduction of conceptual (and computational) buffer zones in which an appropriate singular transformation is continuously (locally) detected and performed. These observations (and associated tools) could set the stage for a systematic approach to bypassing infinity (and thus going beyond it) in a broader range of evolution equations; they also hold the promise of meaningfully and seamlessly performing the relevant computations. Along the path of our analysis, we present a regularization process via complexification and explore its impact on the dynamics; we also discuss a set of compactification transformations and their intuitive implications. △ Less

Submitted 27 September, 2016; originally announced September 2016.

Journal ref: Nature Communications, 8, 1562, 2017

Modeling Heterogeneity in Networks using Uncertainty Quantification Tools

Authors: Karthikeyan Rajendran, Andreas C. Tsoumanis, Constantinos I. Siettos, Carlo R. Laing, Ioannis G. Kevrekidis

Abstract: Using the dynamics of information propagation on a network as our illustrative example, we present and discuss a systematic approach to quantifying heterogeneity and its propagation that borrows established tools from Uncertainty Quantification. The crucial assumption underlying this mathematical and computational "technology transfer" is that the evolving states of the nodes in a network quickly… ▽ More Using the dynamics of information propagation on a network as our illustrative example, we present and discuss a systematic approach to quantifying heterogeneity and its propagation that borrows established tools from Uncertainty Quantification. The crucial assumption underlying this mathematical and computational "technology transfer" is that the evolving states of the nodes in a network quickly become correlated with the corresponding node "identities": features of the nodes imparted by the network structure (e.g. the node degree, the node clustering coefficient). The node dynamics thus depend on heterogeneous (rather than uncertain) parameters, whose distribution over the network results from the network structure. Knowing these distributions allows us to obtain an efficient coarse-grained representation of the network state in terms of the expansion coefficients in suitable orthogonal polynomials. This representation is closely related to mathematical/computational tools for uncertainty quantification (the Polynomial Chaos approach and its associated numerical techniques). The Polynomial Chaos coefficients provide a set of good collective variables for the observation of dynamics on a network, and subsequently, for the implementation of reduced dynamic models of it. We demonstrate this idea by performing coarse-grained computations of the nonlinear dynamics of information propagation on our illustrative network model using the Equation-Free approach △ Less

Submitted 24 November, 2015; originally announced November 2015.

A complex network theory approach for the spatial distribution of fire breaks in heterogeneous forest landscapes for the control of wildland fires

Authors: Lucia Russo, Paola Russo, Constantinos I. Siettos

Abstract: Based on complex network theory, we propose a computational methodology that addresses the spatial distribution of fuel breaks for the inhibition of the spread and size of wildland fires on heterogeneous landscapes. This is a two-tire approach where the dynamics of fire spread are modeled as a random Markov field process on a directed network whose edge weights, are provided by a state-of-the-art… ▽ More Based on complex network theory, we propose a computational methodology that addresses the spatial distribution of fuel breaks for the inhibition of the spread and size of wildland fires on heterogeneous landscapes. This is a two-tire approach where the dynamics of fire spread are modeled as a random Markov field process on a directed network whose edge weights, are provided by a state-of-the-art cellular automata model that integrates detailed GIS, landscape and meteorological data. Within this framework, the spatial distribution of fuel breaks is reduced to the problem of finding the network nodes among which the fire spreads faster, thus their removal favours the inhibition of the fire propagation. Here this is accomplished exploiting the information centrality statistics. We illustrate the proposed approach through (a) an artificial forest of randomly distributed density of vegetation, and (b) a real-world case concerning the island of Rhodes in Greece whose a major part of its forest burned in 2008. Simulation results show that the methodology outperforms significantly the benchmark tactic of random distribution of fuel breaks. △ Less

Submitted 14 September, 2015; originally announced September 2015.

Tuning the average path length of complex networks and its influence to the emergent dynamics of the majority-rule model

Authors: Andreas I. Reppas, Konstantinos Spiliotis, Constantinos I. Siettos

Abstract: We show how appropriate rewiring with the aid of Metropolis Monte Carlo computational experiments can be exploited to create network topologies possessing prescribed values of the average path length (APL) while kee** the same connectivity degree and clustering coefficient distributions. Using the proposed rewiring rules we illustrate how the emergent dynamics of the celebrated majority-rule mod… ▽ More We show how appropriate rewiring with the aid of Metropolis Monte Carlo computational experiments can be exploited to create network topologies possessing prescribed values of the average path length (APL) while kee** the same connectivity degree and clustering coefficient distributions. Using the proposed rewiring rules we illustrate how the emergent dynamics of the celebrated majority-rule model are shaped by the distinct impact of the APL attesting the need for develo** efficient algorithms for tuning such network characteristics. △ Less

Submitted 6 December, 2014; originally announced December 2014.

Comments: 10 figures

Journal ref: Mathematics and Computers in Simulation, 109, 186-196 (2015)

Can social microblogging be used to forecast intraday exchange rates?

Authors: Panagiotis Papaioannnou, Lucia Russo, George Papaioannou, Constantinos Siettos

Abstract: The Efficient Market Hypothesis (EMH) is widely accepted to hold true under certain assumptions. One of its implications is that the prediction of stock prices at least in the short run cannot outperform the random walk model. Yet, recently many studies stressing the psychological and social dimension of financial behavior have challenged the validity of the EMH. Towards this aim, over the last fe… ▽ More The Efficient Market Hypothesis (EMH) is widely accepted to hold true under certain assumptions. One of its implications is that the prediction of stock prices at least in the short run cannot outperform the random walk model. Yet, recently many studies stressing the psychological and social dimension of financial behavior have challenged the validity of the EMH. Towards this aim, over the last few years, internet-based communication platforms and search engines have been used to extract early indicators of social and economic trends. Here, we used Twitter's social networking platform to model and forecast the EUR/USD exchange rate in a high-frequency intradaily trading scale. Using time series and trading simulations analysis, we provide some evidence that the information provided in social microblogging platforms such as Twitter can in certain cases enhance the forecasting efficiency regarding the very short (intradaily) forex. △ Less

Submitted 20 October, 2013; originally announced October 2013.

Comments: This is a prior version of the paper published at NETNOMICS. The final publication is available at http://www.springer.com/economics/economic+theory/journal/11066

Journal ref: Netnomics, 14, 47-68 (2013)

Coarse-graining the dynamics of network evolution: the rise and fall of a networked society

Authors: Andreas C. Tsoumanis, Karthikeyan Rajendran, Constantinos I. Siettos, Ioannis G. Kevrekidis

Abstract: We explore a systematic approach to studying the dynamics of evolving networks at a coarse-grained, system level. We emphasize the importance of finding good observables (network properties) in terms of which coarse grained models can be developed. We illustrate our approach through a particular social network model: the "rise and fall" of a networked society [1]: we implement our low-dimensional… ▽ More We explore a systematic approach to studying the dynamics of evolving networks at a coarse-grained, system level. We emphasize the importance of finding good observables (network properties) in terms of which coarse grained models can be developed. We illustrate our approach through a particular social network model: the "rise and fall" of a networked society [1]: we implement our low-dimensional description computationally using the equation-free approach and show how it can be used to (a) accelerate simulations and (b) extract system-level stability/bifurcation information from the detailed dynamic model. We discuss other system-level tasks that can be enabled through such a computer-assisted coarse graining approach. △ Less

Submitted 25 June, 2012; originally announced June 2012.

Comments: 18 pages, 11 figures

MSC Class: 65Z05

On the effect of the path length and transitivity of small-world networks on epidemic dynamics

Authors: Andreas I. Reppas, Konstantinos Spiliotis, Constantinos Siettos

Abstract: We show how one can trace in a systematic way the coarse-grained solutions of individual-based stochastic epidemic models evolving on heterogeneous complex networks with respect to their topological characteristics. In particular, we have developed algorithms that allow the tuning of the transitivity (clustering coefficient) and the average mean-path length allowing the investigation of the "pure"… ▽ More We show how one can trace in a systematic way the coarse-grained solutions of individual-based stochastic epidemic models evolving on heterogeneous complex networks with respect to their topological characteristics. In particular, we have developed algorithms that allow the tuning of the transitivity (clustering coefficient) and the average mean-path length allowing the investigation of the "pure" impacts of the two characteristics on the emergent behavior of detailed epidemic models. The framework could be used to shed more light into the influence of weak and strong social ties on epidemic spread within small-world network structures, and ultimately to provide novel systematic computational modeling and exploration of better contagion control strategies. △ Less

Submitted 26 February, 2011; originally announced February 2011.

Journal ref: Virulence, 146-153, 2012

Equation-Free Multiscale Computational Analysis of Individual-Based Epidemic Dynamics on Networks

Authors: Constantinos Siettos

Abstract: The surveillance, analysis and ultimately the efficient long-term prediction and control of epidemic dynamics appear to be one of the major challenges nowadays. Detailed atomistic mathematical models play an important role towards this aim. In this work it is shown how one can exploit the Equation Free approach and optimization methods such as Simulated Annealing to bridge detailed individual-base… ▽ More The surveillance, analysis and ultimately the efficient long-term prediction and control of epidemic dynamics appear to be one of the major challenges nowadays. Detailed atomistic mathematical models play an important role towards this aim. In this work it is shown how one can exploit the Equation Free approach and optimization methods such as Simulated Annealing to bridge detailed individual-based epidemic simulation with coarse-grained, systems-level, analysis. The methodology provides a systematic approach for analyzing the parametric behavior of complex/ multi-scale epidemic simulators much more efficiently than simply simulating forward in time. It is shown how steady state and (if required) time-dependent computations, stability computations, as well as continuation and numerical bifurcation analysis can be performed in a straightforward manner. The approach is illustrated through a simple individual-based epidemic model deploying on a random regular connected graph. Using the individual-based microscopic simulator as a black box coarse-grained timestepper and with the aid of Simulated Annealing I compute the coarse-grained equilibrium bifurcation diagram and analyze the stability of the stationary states sidestep** the necessity of obtaining explicit closures at the macroscopic level under a pairwise representation perspective. △ Less

Submitted 19 December, 2010; originally announced December 2010.

Journal ref: Applied Mathematics and Computation, 218, 324-336, 2011

System Level Numerical Analysis of a Monte Carlo Simulation of the E. Coli Chemotaxis

Authors: Constantinos I. Siettos

Abstract: Over the past few years it has been demonstrated that "coarse timesteppers" establish a link between traditional numerical analysis and microscopic/ stochastic simulation. The underlying assumption of the associated lift-run-restrict-estimate procedure is that macroscopic models exist and close in terms of a few governing moments of microscopically evolving distributions, but they are unavailable… ▽ More Over the past few years it has been demonstrated that "coarse timesteppers" establish a link between traditional numerical analysis and microscopic/ stochastic simulation. The underlying assumption of the associated lift-run-restrict-estimate procedure is that macroscopic models exist and close in terms of a few governing moments of microscopically evolving distributions, but they are unavailable in closed form. This leads to a system identification based computational approach that sidesteps the necessity of deriving explicit closures. Two-level codes are constructed; the outer code performs macroscopic, continuum level numerical tasks, while the inner code estimates -through appropriately initialized bursts of microscopic simulation- the quantities required for continuum numerics. Such quantities include residuals, time derivatives, and the action of coarse slow Jacobians. We demonstrate how these coarse timesteppers can be applied to perform equation-free computations of a kinetic Monte Carlo simulation of E. coli chemotaxis. Coarse-grained contraction map**s, system level stability analysis as well as acceleration of the direct simulation, are enabled through this computational multiscale enabling technology. △ Less

Submitted 5 November, 2010; originally announced November 2010.

Journal ref: Applied Mathematics and Computation, 232, 2014, Pages 836-847

Detection of coarse-grained unstable states of microscopic/stochastic systems: a timestepper-based iterative protocol

Authors: A. C. Tsoumanis, C. I. Siettos

Abstract: We address an iterative procedure that can be used to detect coarse-grained hyperbolic unstable equilibria (saddle points) of microscopic simulators when no equations at the macroscopic level are available. The scheme is based on the concept of coarse timestep** [Kevrekidis et al., 2003] incorporating an adaptive mechanism based on the chord method allowing the location of coarse-grained saddle… ▽ More We address an iterative procedure that can be used to detect coarse-grained hyperbolic unstable equilibria (saddle points) of microscopic simulators when no equations at the macroscopic level are available. The scheme is based on the concept of coarse timestep** [Kevrekidis et al., 2003] incorporating an adaptive mechanism based on the chord method allowing the location of coarse-grained saddle points directly. Ultimately, it can be used in a consecutive manner to trace the coarse-grained open-loop saddle-node bifurcation diagrams. We illustrate the procedure through two indicatively examples including (i) a kinetic Monte Carlo simulation (kMC) of simple surface catalytic reactions and (ii) a simple agent-based model, a financial caricature which is used to simulate the dynamics of buying and selling of a large population of interacting individuals in the presence of mimesis. Both models exhibit coarse-grained regular turning points which give rise to branches of saddle points. △ Less

Submitted 25 October, 2010; originally announced October 2010.

Journal ref: Nonlinear Dynamics, 67, 103-117 (2012)

Coarse-Grained Analysis of Microscopic Neuronal Simulators on Networks: Bifurcation and Rare-events computations

Authors: Konstantinos G. Spiliotis, Constantinos I. Siettos

Abstract: We show how the Equation-Free approach for mutliscale computations can be exploited to extract, in a computational strict and systematic way the emergent dynamical attributes, from detailed large-scale microscopic stochastic models, of neurons that interact on complex networks. In particular we show how the Equation-Free approach can be exploited to perform system-level tasks such as bifurcation,… ▽ More We show how the Equation-Free approach for mutliscale computations can be exploited to extract, in a computational strict and systematic way the emergent dynamical attributes, from detailed large-scale microscopic stochastic models, of neurons that interact on complex networks. In particular we show how the Equation-Free approach can be exploited to perform system-level tasks such as bifurcation, stability analysis and estimation of mean appearance times of rare events, bypassing the need for obtaining analytical approximations, providing an "on-demand" model reduction. Using the detailed simulator as a black-box timestepper, we compute the coarse-grained equilibrium bifurcation diagrams, examine the stability of the solution branches and perform a rare-events analysis with respect to certain characteristics of the underlying network topology such as the connectivity degree △ Less

Submitted 25 October, 2010; originally announced October 2010.

Journal ref: Neurocomputing, 74, 3576-3589 (2011)

Equation-Free Multiscale Computations in Social Networks: from Agent-based Modelling to Coarse-grained Stability and Bifurcation Analysis

Authors: A. C. Tsoumanis, C. I. Siettos, I. G. Kevrekidis, G. V. Bafas

Abstract: We focus at the interface between multiscale computations, bifurcation theory and social networks. In particular we address how the Equation-Free approach, a recently developed computational framework, can be exploited to systematically extract coarse-grained, emergent dynamical information by bridging detailed, agent-based models of social interactions on networks, with macroscopic, systems-lev… ▽ More We focus at the interface between multiscale computations, bifurcation theory and social networks. In particular we address how the Equation-Free approach, a recently developed computational framework, can be exploited to systematically extract coarse-grained, emergent dynamical information by bridging detailed, agent-based models of social interactions on networks, with macroscopic, systems-level, continuum numerical analysis tools. For our illustrations we use a simple dynamic agent-based model describing the propagation of information between individuals interacting under mimesis in a social network with private and public information. We describe the rules governing the evolution of the agents emotional state dynamics and discover, through simulation, multiple stable stationary states as a function of the network topology. Using the Equation-Free approach we track the dependence of these stationary solutions on network parameters and quantify their stability in the form of coarse-grained bifurcation diagrams. △ Less

Submitted 15 March, 2009; originally announced March 2009.

Journal ref: Int J. BIfurcation and Chaos, 20 (11), 3673-3688 (2010)

Multiscale Computations on Neural Networks: From the Individual Neuron Interactions to the Macroscopic-Level Analysis

Authors: Konstantinos G. Spiliotis, Constantinos I. Siettos

Abstract: We show how the Equation-Free approach for multi-scale computations can be exploited to systematically study the dynamics of neural interactions on a random regular connected graph under a pairwise representation perspective. Using an individual-based microscopic simulator as a black box coarse-grained timestepper and with the aid of simulated annealing we compute the coarse-grained equilibrium… ▽ More We show how the Equation-Free approach for multi-scale computations can be exploited to systematically study the dynamics of neural interactions on a random regular connected graph under a pairwise representation perspective. Using an individual-based microscopic simulator as a black box coarse-grained timestepper and with the aid of simulated annealing we compute the coarse-grained equilibrium bifurcation diagram and analyze the stability of the stationary states sidestep** the necessity of obtaining explicit closures at the macroscopic level. We also exploit the scheme to perform a rare-events analysis by estimating an effective Fokker-Planck describing the evolving probability density function of the corresponding coarse-grained observables. △ Less

Submitted 15 March, 2009; originally announced March 2009.

Journal ref: Int. J. Bifurcation and Chaos 20 (1) 121-134 (2010)

A timestepper approach for the systematic bifurcation and stability analysis of polymer extrusion dynamics

Authors: M. E. Kavousanakis, L. Russo, C. I. Siettos, A. G. Boudouvis, G. C. Georgiou

Abstract: We discuss how matrix-free/timestepper algorithms can efficiently be used with dynamic non-Newtonian fluid mechanics simulators in performing systematic stability/bifurcation analysis. The timestepper approach to bifurcation analysis of large scale systems is applied to the plane Poiseuille flow of an Oldroyd-B fluid with non-monotonic slip at the wall, in order to further investigate a mechanis… ▽ More We discuss how matrix-free/timestepper algorithms can efficiently be used with dynamic non-Newtonian fluid mechanics simulators in performing systematic stability/bifurcation analysis. The timestepper approach to bifurcation analysis of large scale systems is applied to the plane Poiseuille flow of an Oldroyd-B fluid with non-monotonic slip at the wall, in order to further investigate a mechanism of extrusion instability based on the combination of viscoelasticity and nonmonotonic slip. Due to the nonmonotonicity of the slip equation the resulting steady-state flow curve is nonmonotonic and unstable steady-states appear in the negative-slope regime. It has been known that self-sustained oscillations of the pressure gradient are obtained when an unstable steady-state is perturbed [Fyrillas et al., Polymer Eng. Sci. 39 (1999) 2498-2504]. Treating the simulator of a distributed parameter model describing the dynamics of the above flow as an input-output black-box timestepper of the state variables, stable and unstable branches of both equilibrium and periodic oscillating solutions are computed and their stability is examined. It is shown for the first time how equilibrium solutions lose stability to oscillating ones through a subcritical Hopf bifurcation point which generates a branch of unstable limit cycles and how the stable periodic solutions lose their stability through a critical point which marks the onset of the unstable limit cycles. This implicates the coexistence of stable equilibria with stable and unstable periodic solutions in a narrow range of volumetric flow rates. △ Less

Submitted 25 July, 2007; originally announced July 2007.

Journal ref: J. Non-Newtonian Fluid Mechanics, 151, 59-68 (2008)

A Systems-Based Approach to Multiscale Computation: Equation-Free Detection of Coarse-Grained Bifurcations

Authors: C. I. Siettos, R. Rico-Martinez, I. G. kevrekidis

Abstract: We discuss certain basic features of the equation-free (EF) approach to modeling and computation for complex/multiscale systems. We focus on links between the equation-free approach and tools from systems and control theory (design of experiments, data analysis, estimation, identification and feedback). As our illustrative example, we choose a specific numerical task (the detection of stability… ▽ More We discuss certain basic features of the equation-free (EF) approach to modeling and computation for complex/multiscale systems. We focus on links between the equation-free approach and tools from systems and control theory (design of experiments, data analysis, estimation, identification and feedback). As our illustrative example, we choose a specific numerical task (the detection of stability boundaries in parameter space) for stochastic models of two simplified heterogeneous catalytic reaction mechanisms. In the equation-free framework the stochastic simulator is treated as an experiment (albeit a computational one). Short bursts of fine scale simulation (short computational experiments) are designed, executed, and their results processed and fed back to the process, in integrated protocols aimed at performing the particular coarse-grained task (the detection of a macroscopic instability). Two distinct approaches are presented; one is a direct translation of our previous protocol for adaptive detection of instabilities in laboratory experiments (Rico-Martinez et al., 2003); the second approach is motivated from numerical bifurcation algorithms for critical point detection. A comparison of the two approaches brings forth a key feature of equation-free computation: computational experiments can be easily initialized at will, in contrast to laboratory ones. △ Less

Submitted 4 October, 2005; originally announced October 2005.

Comments: submitted to CPC7, Lake Louise, Canada, January 8-13, 2006

An Equation-Free Approach to Nonlinear Control: Coarse Feedback Linearization With Pole-Placement

Authors: C. I. Siettos, I. G. Kevrekidis, N. Kazantzis

Abstract: We present an application of equation-free computation to the coarse-grained feedback linearization problem of nonlinear systems described by microscopic/stochastic simulators. Feedback linearization with pole placement requires the solution of a functional equation involving the macroscopic (coarse-grained) system model. In the absence of such a closed-form model, short, appropriately initializ… ▽ More We present an application of equation-free computation to the coarse-grained feedback linearization problem of nonlinear systems described by microscopic/stochastic simulators. Feedback linearization with pole placement requires the solution of a functional equation involving the macroscopic (coarse-grained) system model. In the absence of such a closed-form model, short, appropriately initialized bursts of microscopic simulation are designed and performed, and their results used to estimate on demand the quantities required for the numerical solution of the (explicitly unavailable) functional equation. Our illustrative example is a kinetic Monte Carlo realization of a simplified heterogeneous catalytic reaction scheme △ Less

Submitted 1 December, 2004; originally announced December 2004.

Coarse Bifurcation Diagrams via Microscopic Simulators: A State-Feedback Control-Based Approach

Authors: C. I. Siettos, D. Maroudas, I. G. Kevrekidis

Abstract: The arc-length continuation framework is used for the design of state feedback control laws that enable a microscopic simulator trace its own open-loop coarse bifurcation diagram. The steering of the system along solution branches is achieved through the manipulation of the bifurcation parameter, which becomes our actuator. The design approach is based on the assumption that the eigenvalues of t… ▽ More The arc-length continuation framework is used for the design of state feedback control laws that enable a microscopic simulator trace its own open-loop coarse bifurcation diagram. The steering of the system along solution branches is achieved through the manipulation of the bifurcation parameter, which becomes our actuator. The design approach is based on the assumption that the eigenvalues of the linearized system can be decomposed into two well separated clusters: one containing eigenvalues with large negative real parts and one containing (possibly unstable) eigenvalues close to the origin. △ Less

Submitted 3 February, 2003; originally announced February 2003.

Enabling Dynamic Process Simulators to Perform Alternative Tasks: A Time-stepper Based Toolkit for Computer-Aided Analysis

Authors: C. I. Siettos, C. C. Pantelides, I. G. Kevrekidis

Abstract: We discuss computational superstructures that, using repeated, appropriately initialized short calls, enable temporal process simulators to perform alternative tasks such as fixed point computation, stability analysis and projective integration. We illustrate these concepts through the acceleration of a gPROMS-based Rapid Pressure Swing Adsorption simulation, and discuss their scope and possible… ▽ More We discuss computational superstructures that, using repeated, appropriately initialized short calls, enable temporal process simulators to perform alternative tasks such as fixed point computation, stability analysis and projective integration. We illustrate these concepts through the acceleration of a gPROMS-based Rapid Pressure Swing Adsorption simulation, and discuss their scope and possible extensions. △ Less

Submitted 4 February, 2003; originally announced February 2003.

Coarse Brownian Dynamics for Nematic Liquid Crystals: Bifurcation Diagrams via Stochastic Simulation

Authors: C. I. Siettos, M. D. Graham, I. G. Kevrekidis

Abstract: We demonstrate how time-integration of stochastic differential equations (i.e. Brownian dynamics simulations) can be combined with continuum numerical bifurcation analysis techniques to analyze the dynamics of liquid crystalline polymers (LCPs). Sidestep** the necessity of obtaining explicit closures, the approach analyzes the (unavailable in closed form) coarse macroscopic equations, estimati… ▽ More We demonstrate how time-integration of stochastic differential equations (i.e. Brownian dynamics simulations) can be combined with continuum numerical bifurcation analysis techniques to analyze the dynamics of liquid crystalline polymers (LCPs). Sidestep** the necessity of obtaining explicit closures, the approach analyzes the (unavailable in closed form) coarse macroscopic equations, estimating the necessary quantities through appropriately initialized, short bursts of Brownian dynamics simulation. Through this approach, both stable and unstable branches of the equilibrium bifurcation diagram are obtained for the Doi model of LCPs and their coarse stability is estimated. Additional macroscopic computational tasks enabled through this approach, such as coarse projective integration and coarse stabilizing controller design, are also demonstrated. △ Less

Submitted 20 November, 2002; originally announced November 2002.

Microscopic/stochastic timesteppers and coarse control: a kinetic Monte Carlo example

Authors: C. I. Siettos, A. Armaou, A. G. Makeev, I. G. Kevrekidis

Abstract: Coarse timesteppers provide a bridge between microscopic / stochastic system descriptions and macroscopic tasks such as coarse stability/bifurcation computations. Exploiting this computational enabling technology, we present a framework for designing observers and controllers based on microscopic simulations, that can be used for their coarse control. The proposed methodology provides a bridge b… ▽ More Coarse timesteppers provide a bridge between microscopic / stochastic system descriptions and macroscopic tasks such as coarse stability/bifurcation computations. Exploiting this computational enabling technology, we present a framework for designing observers and controllers based on microscopic simulations, that can be used for their coarse control. The proposed methodology provides a bridge between traditional numerical analysis and control theory on the one hand and microscopic simulation on the other. △ Less

Submitted 10 July, 2002; originally announced July 2002.

Focusing Revisited: an MN-dynamics Approach

Authors: C. I. Siettos, I. G. Kevrekidis, P. G. Kevrekidis

Abstract: The nonlinear Schr{ö}dinger (NLS) equation is a ubiquitous example of an envelope wave equation for conservative, dispersive systems. We revisit here the problem of self-similar focusing of waves in the case of the focusing NLS equation through the prism of a dynamic renormalization technique (MN dynamics) that factors out self-similarity and yields a bifurcation view of the onset of focusing. A… ▽ More The nonlinear Schr{ö}dinger (NLS) equation is a ubiquitous example of an envelope wave equation for conservative, dispersive systems. We revisit here the problem of self-similar focusing of waves in the case of the focusing NLS equation through the prism of a dynamic renormalization technique (MN dynamics) that factors out self-similarity and yields a bifurcation view of the onset of focusing. As a result, identifying the focusing self-similar solution becomes a steady state problem. The discretized steady states are subsequently obtained and their linear stability is numerically examined. The calculations are performed in the setting of variable index of refraction, in which the onset of focusing appears as a supercritical bifurcation of a novel type of mixed Hamiltonian-dissipative dynamical system (reminiscent, to some extent, of a pitchfork bifurcation). △ Less

Submitted 15 April, 2002; originally announced April 2002.

Comments: 6 pages, 2 figures