-
Identifying nonlinear dynamical systems with multiple time scales and long-range dependencies
Authors:
Dominik Schmidt,
Georgia Koppe,
Zahra Monfared,
Max Beutelspacher,
Daniel Durstewitz
Abstract:
A main theoretical interest in biology and physics is to identify the nonlinear dynamical system (DS) that generated observed time series. Recurrent Neural Networks (RNNs) are, in principle, powerful enough to approximate any underlying DS, but in their vanilla form suffer from the exploding vs. vanishing gradients problem. Previous attempts to alleviate this problem resulted either in more compli…
▽ More
A main theoretical interest in biology and physics is to identify the nonlinear dynamical system (DS) that generated observed time series. Recurrent Neural Networks (RNNs) are, in principle, powerful enough to approximate any underlying DS, but in their vanilla form suffer from the exploding vs. vanishing gradients problem. Previous attempts to alleviate this problem resulted either in more complicated, mathematically less tractable RNN architectures, or strongly limited the dynamical expressiveness of the RNN. Here we address this issue by suggesting a simple regularization scheme for vanilla RNNs with ReLU activation which enables them to solve long-range dependency problems and express slow time scales, while retaining a simple mathematical structure which makes their DS properties partly analytically accessible. We prove two theorems that establish a tight connection between the regularized RNN dynamics and its gradients, illustrate on DS benchmarks that our regularization approach strongly eases the reconstruction of DS which harbor widely differing time scales, and show that our method is also en par with other long-range architectures like LSTMs on several tasks.
△ Less
Submitted 12 March, 2021; v1 submitted 8 October, 2019;
originally announced October 2019.
-
Enhanced dielectronic recombination of lithium-like Ti19+ ions in external ExB fields
Authors:
Timo Bartsch,
Stefan Schippers,
Michael Beutelspacher,
Sebastian Boehm,
Manfred Grieser,
Gerald Gwinner,
Amir A. Saghiri,
Guido Saathoff,
Reinhold Schuch,
Dirk Schwalm,
Andreas Wolf,
Alfred Mueller
Abstract:
Dielectronic recombination(DR) of lithium-like Ti19+(1s2 2s) ions via 2s->2p core excitations has been measured at the Heidelberg heavy ion storage ring TSR. We find that not only external electric fields (0 <= Ey <= 280 V/cm) but also crossed magnetic fields (30 mT <= Bz <= 80 mT) influence the DR via high-n (2p_j nl)-Rydberg resonances. This result confirms our previous finding for isoelectron…
▽ More
Dielectronic recombination(DR) of lithium-like Ti19+(1s2 2s) ions via 2s->2p core excitations has been measured at the Heidelberg heavy ion storage ring TSR. We find that not only external electric fields (0 <= Ey <= 280 V/cm) but also crossed magnetic fields (30 mT <= Bz <= 80 mT) influence the DR via high-n (2p_j nl)-Rydberg resonances. This result confirms our previous finding for isoelectronic Cl14+ ions [Bartsch T et al, PRL 82, 3779 (1999)] that experimentally established the sensitivity of DR to ExB fields. In the present investigation the larger 2p_{1/2}-2p_{3/2} fine structure splitting of Ti19+ allowed us to study separately the influence of external fields via the two series of Rydberg DR resonances attached to the 2s -> 2p_{1/2} and 2s -> 2p_{3/2} excitations of the Li-like core, extracting initial slopes and saturation fields of the enhancement. We find that for Ey > 80 V/cm the field induced enhancement is about 1.8 times stronger for the 2p_{3/2} series than for the 2p_{1/2} series.
△ Less
Submitted 29 March, 2000; v1 submitted 23 March, 2000;
originally announced March 2000.
-
Dielectronic recombination of lithium-like Ni25+ ions - high resolution rate coefficients and influence of external crossed E and B fields
Authors:
Stefan Schippers,
Timo Bartsch,
Carsten Brandau,
Alfred Mueller,
Gerald Gwinner,
Goetz Wissler,
Michael Beutelspacher,
Manfred Grieser,
Andreas Wolf,
Ronal Phaneuf
Abstract:
Absolute dielectronic recombination (DR) rates for lithium-like Ni$^{25+}$($1s^2 2s$) ions were measured at high-energy resolution at the Heidelberg heavy-ion storage ring TSR. We studied the center-of-mass energy range 0--130 eV which covers all $Δn$=0 core excitations. The influence of external crossed electric (0--300 V/cm) and magnetic (41.8--80.1 mT) fields was investigated. For the measure…
▽ More
Absolute dielectronic recombination (DR) rates for lithium-like Ni$^{25+}$($1s^2 2s$) ions were measured at high-energy resolution at the Heidelberg heavy-ion storage ring TSR. We studied the center-of-mass energy range 0--130 eV which covers all $Δn$=0 core excitations. The influence of external crossed electric (0--300 V/cm) and magnetic (41.8--80.1 mT) fields was investigated. For the measurement at near-zero electric field resonance energies and strengths are given for Rydberg levels up to n$=$32; also Maxwellian plasma rate coefficients for the $Δn$=0 DR at electron temperatures between 0.5 and 200 eV are provided. For increasing electric field strength we find that for both the $2p_{1/2}$ and the $2p_{3/2}$ series of Ni$^{24+}$($1s^2 2p_j n\ell$) Rydberg resonances with n>30 the DR rate coefficient increases approximately linearly by up to a factor of 1.5. The relative increase due to the applied electric field for Ni$^{25+}$ is remarkably lower than that found in previous measurements with lighter isoelectronic Si$^{11+}$, Cl$^{14+}$ and also Ti$^{19+}$ ions, [T. Bartsch et al, Phys. Rev. Lett. {\bf 79}, 2233 (1997); {\bf 82}, 3779 (1999) and to be published] and in contrast to the results for lighter ions no clear dependence of the electric field enhancement on the magnetic field strength is found. The Maxwellian plasma rate coefficients for $Δn$=0 DR of Ni$^{25+}$ are enhanced by at most 11% in the presence of the strongest experimentally applied fields.
△ Less
Submitted 18 February, 2000;
originally announced February 2000.