-
Stationary broken parity states in active matter models
Authors:
Tobias Frohoff-Hülsmann,
Max Philipp Holl,
Edgar Knobloch,
Svetlana V. Gurevich,
Uwe Thiele
Abstract:
We demonstrate that several nonvariational continuum models commonly used to describe active matter as well as other active systems exhibit nongeneric behavior: each model supports asymmetric but stationary localized states even in the absence of pinning at heterogeneities. Moreover, such states only begin to drift following a drift-transcritical bifurcation as the activity increases. Asymmetric s…
▽ More
We demonstrate that several nonvariational continuum models commonly used to describe active matter as well as other active systems exhibit nongeneric behavior: each model supports asymmetric but stationary localized states even in the absence of pinning at heterogeneities. Moreover, such states only begin to drift following a drift-transcritical bifurcation as the activity increases. Asymmetric stationary states should only exist in variational systems, i.e., in models with gradient structure. In other words, such states are expected in passive systems, but not in active systems where the gradient structure of the model is broken by activity. We identify a "spurious" gradient dynamics structure of these models that is responsible for this nongeneric behavior, and determine the types of additional terms that render the models generic, i.e., with asymmetric states that appear via drift-pitchfork bifurcations and are generically moving. We provide detailed illustrations of our results using numerical continuation of resting and steadily drifting states in both generic and nongeneric cases.
△ Less
Submitted 19 June, 2023; v1 submitted 28 May, 2022;
originally announced May 2022.
-
Derivation and analysis of a phase field crystal model for a mixture of active and passive particles
Authors:
Michael te Vrugt,
Max Philipp Holl,
Aron Koch,
Raphael Wittkowski,
Uwe Thiele
Abstract:
We discuss an active phase field crystal (PFC) model that describes a mixture of active and passive particles. First, a microscopic derivation from dynamical density functional theory (DDFT) is presented that includes a systematic treatment of the relevant orientational degrees of freedom. Of particular interest is the construction of the nonlinear and coupling terms. This allows for interesting i…
▽ More
We discuss an active phase field crystal (PFC) model that describes a mixture of active and passive particles. First, a microscopic derivation from dynamical density functional theory (DDFT) is presented that includes a systematic treatment of the relevant orientational degrees of freedom. Of particular interest is the construction of the nonlinear and coupling terms. This allows for interesting insights into the microscopic justification of phenomenological constructions used in PFC models for active particles and mixtures, the approximations required for obtaining them, and possible generalizations. Second, the derived model is investigated using linear stability analysis and nonlinear methods. It is found that the model allows for a rich nonlinear behavior with states ranging from steady periodic and localized states to various time-periodic states. The latter include standing, traveling, and modulated waves corresponding to spatially periodic and localized traveling, wiggling, and alternating peak patterns and their combinations.
△ Less
Submitted 29 April, 2022;
originally announced April 2022.
-
Half-Inverse Gradients for Physical Deep Learning
Authors:
Patrick Schnell,
Philipp Holl,
Nils Thuerey
Abstract:
Recent works in deep learning have shown that integrating differentiable physics simulators into the training process can greatly improve the quality of results. Although this combination represents a more complex optimization task than supervised neural network training, the same gradient-based optimizers are typically employed to minimize the loss function. However, the integrated physics solver…
▽ More
Recent works in deep learning have shown that integrating differentiable physics simulators into the training process can greatly improve the quality of results. Although this combination represents a more complex optimization task than supervised neural network training, the same gradient-based optimizers are typically employed to minimize the loss function. However, the integrated physics solvers have a profound effect on the gradient flow as manipulating scales in magnitude and direction is an inherent property of many physical processes. Consequently, the gradient flow is often highly unbalanced and creates an environment in which existing gradient-based optimizers perform poorly. In this work, we analyze the characteristics of both physical and neural network optimizations to derive a new method that does not suffer from this phenomenon. Our method is based on a half-inversion of the Jacobian and combines principles of both classical network and physics optimizers to solve the combined optimization task. Compared to state-of-the-art neural network optimizers, our method converges more quickly and yields better solutions, which we demonstrate on three complex learning problems involving nonlinear oscillators, the Schroedinger equation and the Poisson problem.
△ Less
Submitted 18 March, 2022;
originally announced March 2022.
-
Simulating Liquids with Graph Networks
Authors:
Jonathan Klimesch,
Philipp Holl,
Nils Thuerey
Abstract:
Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate graph neural networks (GNNs) for learning fluid dynamics and find that their generalization capability is more limited than previous works would suggest. We als…
▽ More
Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate graph neural networks (GNNs) for learning fluid dynamics and find that their generalization capability is more limited than previous works would suggest. We also challenge the current practice of adding random noise to the network inputs in order to improve its generalization capability and simulation stability. We find that inserting the real data distribution, e.g. by unrolling multiple simulation steps, improves accuracy and that hiding all domain-specific features from the learning model improves generalization. Our results indicate that learning models, such as GNNs, fail to learn the exact underlying dynamics unless the training set is devoid of any other problem-specific correlations that could be used as shortcuts.
△ Less
Submitted 14 March, 2022;
originally announced March 2022.
-
Scale-invariant Learning by Physics Inversion
Authors:
Philipp Holl,
Vladlen Koltun,
Nils Thuerey
Abstract:
Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse problems. We find that state-of-the-art training techniques are not well-suited to many problems that involve physical processes. The highly nonlinear behavior, c…
▽ More
Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse problems. We find that state-of-the-art training techniques are not well-suited to many problems that involve physical processes. The highly nonlinear behavior, common in physical processes, results in strongly varying gradients that lead first-order optimizers like SGD or Adam to compute suboptimal optimization directions. We propose a novel hybrid training approach that combines higher-order optimization methods with machine learning techniques. We take updates from a scale-invariant inverse problem solver and embed them into the gradient-descent-based learning pipeline, replacing the regular gradient of the physical process. We demonstrate the capabilities of our method on a variety of canonical physical systems, showing that it yields significant improvements on a wide range of optimization and learning problems.
△ Less
Submitted 13 October, 2022; v1 submitted 30 September, 2021;
originally announced September 2021.
-
Physics-based Deep Learning
Authors:
Nils Thuerey,
Philipp Holl,
Maximilian Mueller,
Patrick Schnell,
Felix Trost,
Kiwon Um
Abstract:
This digital book contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands-on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we'll look at physical loss constraints, more tightly coupled learning algorithms…
▽ More
This digital book contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands-on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we'll look at physical loss constraints, more tightly coupled learning algorithms with differentiable simulations, as well as reinforcement learning and uncertainty modeling. We live in exciting times: these methods have a huge potential to fundamentally change what computer simulations can achieve.
△ Less
Submitted 25 April, 2022; v1 submitted 11 September, 2021;
originally announced September 2021.
-
The 1-Megapixel pnCCD Detector for the Small Quantum Systems Instrument at the European XFEL: System and Operation Aspects
Authors:
Markus Kuster,
Karim Ahmed,
Kai-Erik Ballak,
Cyril Danilevski,
Marko Ekmedžić,
Bruno Fernandes,
Patrick Gessler,
Robert Hartmann,
Steffen Hauf,
Peter Holl,
Michael Meyer,
Jacobo Montaño,
Astrid Münnich,
Yevheniy Ovcharenko,
Nils Rennhack,
Tonn Rüter,
Daniela Rupp,
Dieter Schlosser,
Kiana Setoodehnia,
Rüdiger Schmitt,
Lothar Strüder,
Rico Mayro P. Tanyag,
Anatoli Ulmer,
Hazem Yousef
Abstract:
The X-ray free-electron lasers that became available during the last decade, like the European XFEL (EuXFEL), place high demands on their instrumentation. Especially at low photon energies below $1\,\text{keV}$, detectors with high sensitivity, and consequently low noise and high quantum efficiency, are required to enable facility users to fully exploit the scientific potential of the photon sourc…
▽ More
The X-ray free-electron lasers that became available during the last decade, like the European XFEL (EuXFEL), place high demands on their instrumentation. Especially at low photon energies below $1\,\text{keV}$, detectors with high sensitivity, and consequently low noise and high quantum efficiency, are required to enable facility users to fully exploit the scientific potential of the photon source. A 1-Megapixel pnCCD detector with a $1024\times 1024$ pixel format has been installed and commissioned for imaging applications at the Nano-Sized Quantum System (NQS) station of the Small Quantum System (SQS) instrument at EuXFEL. The instrument is currently operating in the energy range between $0.5$ and $3\,\text{keV}$ and the NQS station is designed for investigations of the interaction of intense FEL pulses with clusters, nano-particles and small bio-molecules, by combining photo-ion and photo-electron spectroscopy with coherent diffraction imaging techniques. The core of the imaging detector is a pn-type charge coupled device (pnCCD) with a pixel pitch of $75\,μ\text{m}\times 75\,μ\text{m}$. Depending on the experimental scenario, the pnCCD enables imaging of single photons thanks to its very low electronic noise of $3$e$^-$ and high quantum efficiency. Here we present an overview on the EuXFEL pnCCD detector and the results from the commissioning and first user operation at the SQS experiment in June 2019. The detailed descriptions of the detector design and capabilities, its implementation at EuXFEL both mechanically and from the controls side as well as important data correction steps aim to provide useful background for users planning and analyzing experiments at EuXFEL and may serve as a benchmark for comparing and planning future endstations at other FELs.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
Localized states in passive and active phase-field-crystal models
Authors:
Max Philipp Holl,
Andrew J. Archer,
Svetlana V. Gurevich,
Edgar Knobloch,
Lukas Ophaus,
Uwe Thiele
Abstract:
The passive conserved Swift-Hohenberg equation (or phase-field-crystal [PFC] model) corresponds to a gradient dynamics for a single order parameter field related to density. It provides a simple microscopic description of the thermodynamic transition between liquid and crystalline states. In addition to spatially extended periodic structures, the model describes a large variety of steady spatially…
▽ More
The passive conserved Swift-Hohenberg equation (or phase-field-crystal [PFC] model) corresponds to a gradient dynamics for a single order parameter field related to density. It provides a simple microscopic description of the thermodynamic transition between liquid and crystalline states. In addition to spatially extended periodic structures, the model describes a large variety of steady spatially localized structures. In appropriate bifurcation diagrams the corresponding solution branches exhibit characteristic slanted homoclinic snaking. In an active PFC model, encoding for instance the active motion of self-propelled colloidal particles, the gradient dynamics structure is broken by a coupling between density and an additional polarization field. Then, resting and traveling localized states are found with transitions characterized by parity-breaking drift bifurcations. Here, we first briefly review the snaking behavior of localized states in passive and active PFC models before discussing the bifurcation behavior of localized states in systems of (i) two coupled passive PFC equations described by common gradient dynamics, (ii) two coupled passive PFC where the coupling breaks the gradient dynamics structure, and (iii) a passive PFC coupled to an active PFC.
△ Less
Submitted 6 October, 2020;
originally announced October 2020.
-
Efficient calculation of phase coexistence and phase diagrams: application to a binary phase-field crystal model
Authors:
Max Philipp Holl,
Andrew J. Archer,
Uwe Thiele
Abstract:
We show that one can employ well-established numerical continuation methods to efficiently calculate the phase diagram for thermodynamic systems. In particular, this involves the determination of lines of phase coexistence related to first order phase transitions and the continuation of triple points. To illustrate the method we apply it to a binary Phase-Field-Crystal model for the crystallisatio…
▽ More
We show that one can employ well-established numerical continuation methods to efficiently calculate the phase diagram for thermodynamic systems. In particular, this involves the determination of lines of phase coexistence related to first order phase transitions and the continuation of triple points. To illustrate the method we apply it to a binary Phase-Field-Crystal model for the crystallisation of a mixture of two types of particles. The resulting phase diagram is determined for one- and two-dimensional domains. In the former case it is compared to the diagram obtained from a one-mode approximation. The various observed liquid and crystalline phases and their stable and metastable coexistence are discussed as well as the temperature-dependence of the phase diagrams. This includes the (dis)appearance of critical points and triple points. We also relate bifurcation diagrams for finite-size systems to the thermodynamics of phase transitions in the infinite-size limit.
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solvers
Authors:
Kiwon Um,
Robert Brand,
Yun,
Fei,
Philipp Holl,
Nils Thuerey
Abstract:
Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting for effects not captured by the discretized PDE. We target the problem of reducing numerical errors of iterative PDE solvers and compare different learning approa…
▽ More
Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting for effects not captured by the discretized PDE. We target the problem of reducing numerical errors of iterative PDE solvers and compare different learning approaches for finding complex correction functions. We find that previously used learning approaches are significantly outperformed by methods that integrate the solver into the training loop and thereby allow the model to interact with the PDE during training. This provides the model with realistic input distributions that take previous corrections into account, yielding improvements in accuracy with stable rollouts of several hundred recurrent evaluation steps and surpassing even tailored supervised variants. We highlight the performance of the differentiable physics networks for a wide variety of PDEs, from non-linear advection-diffusion systems to three-dimensional Navier-Stokes flows.
△ Less
Submitted 5 January, 2021; v1 submitted 30 June, 2020;
originally announced July 2020.
-
Learning to Control PDEs with Differentiable Physics
Authors:
Philipp Holl,
Vladlen Koltun,
Nils Thuerey
Abstract:
Predicting outcomes and planning interactions with the physical world are long-standing goals for machine learning. A variety of such tasks involves continuous physical systems, which can be described by partial differential equations (PDEs) with many degrees of freedom. Existing methods that aim to control the dynamics of such systems are typically limited to relatively short time frames or a sma…
▽ More
Predicting outcomes and planning interactions with the physical world are long-standing goals for machine learning. A variety of such tasks involves continuous physical systems, which can be described by partial differential equations (PDEs) with many degrees of freedom. Existing methods that aim to control the dynamics of such systems are typically limited to relatively short time frames or a small number of interaction parameters. We present a novel hierarchical predictor-corrector scheme which enables neural networks to learn to understand and control complex nonlinear physical systems over long time frames. We propose to split the problem into two distinct tasks: planning and control. To this end, we introduce a predictor network that plans optimal trajectories and a control network that infers the corresponding control parameters. Both stages are trained end-to-end using a differentiable PDE solver. We demonstrate that our method successfully develops an understanding of complex physical systems and learns to control them for tasks involving PDEs such as the incompressible Navier-Stokes equations.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
Deep learning based pulse shape discrimination for germanium detectors
Authors:
P. Holl,
L. Hauertmann,
B. Majorovits,
O. Schulz,
M. Schuster,
A. J. Zsigmond
Abstract:
Experiments searching for rare processes like neutrinoless double beta decay heavily rely on the identification of background events to reduce their background level and increase their sensitivity. We present a novel machine learning based method to recognize one of the most abundant classes of background events in these experiments. By combining a neural network for feature extraction with a smal…
▽ More
Experiments searching for rare processes like neutrinoless double beta decay heavily rely on the identification of background events to reduce their background level and increase their sensitivity. We present a novel machine learning based method to recognize one of the most abundant classes of background events in these experiments. By combining a neural network for feature extraction with a smaller classification network, our method can be trained with only a small number of labeled events. To validate our method, we use signals from a broad-energy germanium detector irradiated with a $^{228}$Th gamma source. We find that it matches the performance of state-of-the-art algorithms commonly used for this detector type. However, it requires less tuning and calibration and shows potential to identify certain types of background events missed by other methods.
△ Less
Submitted 2 June, 2019; v1 submitted 4 March, 2019;
originally announced March 2019.
-
Holography of Wi-Fi radiation
Authors:
Philipp Holl,
Friedemann Reinhard
Abstract:
Wireless data transmission systems such as WiFi or Bluetooth emit coherent light - electromagnetic waves with precisely known amplitude and phase. Propagating in space, this radiation forms a hologram - a two-dimensional wavefront encoding a three-dimensional view of all objects traversed by the light beam. Here we demonstrate a scheme to record this hologram in a phase-coherent fashion across a m…
▽ More
Wireless data transmission systems such as WiFi or Bluetooth emit coherent light - electromagnetic waves with precisely known amplitude and phase. Propagating in space, this radiation forms a hologram - a two-dimensional wavefront encoding a three-dimensional view of all objects traversed by the light beam. Here we demonstrate a scheme to record this hologram in a phase-coherent fashion across a meter-sized imaging region. We recover three-dimensional views of objects and emitters by feeding the resulting data into digital reconstruction algorithms. Employing a digital implementation of dark field propagation to suppress multipath reflection we significantly enhance the quality of the resulting images.
△ Less
Submitted 5 May, 2017; v1 submitted 30 November, 2016;
originally announced December 2016.
-
X-ray diffraction from isolated and strongly aligned gas-phase molecules with a free-electron laser
Authors:
Jochen Küpper,
Stephan Stern,
Lotte Holmegaard,
Frank Filsinger,
Arnaud Rouzée,
Artem Rudenko,
Per Johnsson,
Andrew V. Martin,
Marcus Adolph,
Andrew Aquila,
Saša Bajt,
Anton Barty,
Christoph Bostedt,
John Bozek,
Carl Caleman,
Ryan Coffee,
Nicola Coppola,
Tjark Delmas,
Sascha Epp,
Benjamin Erk,
Lutz Foucar,
Tais Gorkhover,
Lars Gumprecht,
Andreas Hartmann,
Robert Hartmann
, et al. (30 additional authors not shown)
Abstract:
We report experimental results on x-ray diffraction of quantum-state-selected and strongly aligned ensembles of the prototypical asymmetric rotor molecule 2,5-diiodobenzonitrile using the Linac Coherent Light Source. The experiments demonstrate first steps toward a new approach to diffractive imaging of distinct structures of individual, isolated gas-phase molecules. We confirm several key ingredi…
▽ More
We report experimental results on x-ray diffraction of quantum-state-selected and strongly aligned ensembles of the prototypical asymmetric rotor molecule 2,5-diiodobenzonitrile using the Linac Coherent Light Source. The experiments demonstrate first steps toward a new approach to diffractive imaging of distinct structures of individual, isolated gas-phase molecules. We confirm several key ingredients of single molecule diffraction experiments: the abilities to detect and count individual scattered x-ray photons in single shot diffraction data, to deliver state-selected, e. g., structural-isomer-selected, ensembles of molecules to the x-ray interaction volume, and to strongly align the scattering molecules. Our approach, using ultrashort x-ray pulses, is suitable to study ultrafast dynamics of isolated molecules.
△ Less
Submitted 28 January, 2014; v1 submitted 17 July, 2013;
originally announced July 2013.
-
e+e--pair production in Pb-Au collisions at 158 GeV per nucleon
Authors:
G. Agakichiev,
H. Appelshauser,
J. Bielcikova,
R. Baur,
P. Braun-Munzinger,
A. Cherlin,
S. Damjanovic,
A. Drees,
S. Esumi,
U. Faschingbauer,
Z. Fraenkel,
Ch. Fuchs,
E. Gatti,
P. Glassel,
G. Hering,
C. P. de los Heros,
P. Holl,
Ch. Jung,
B. Lenkeit,
A. Marin,
F. Messer,
M. Messer,
D. Miskowiec,
O. Nix,
Yu. Panebrattsev
, et al. (26 additional authors not shown)
Abstract:
We present the combined results on electron-pair production in 158 GeV/n {Pb-Au} ($\sqrt{s}$= 17.2 GeV) collisions taken at the CERN SPS in 1995 and 1996, and give a detailed account of the data analysis. The enhancement over the reference of neutral meson decays amounts to a factor of 2.31$\pm0.19 (stat.)\pm0.55 (syst.)\pm0.69 (decays)$ for semi-central collisions (28% $σ/σ_{geo}$) when yields…
▽ More
We present the combined results on electron-pair production in 158 GeV/n {Pb-Au} ($\sqrt{s}$= 17.2 GeV) collisions taken at the CERN SPS in 1995 and 1996, and give a detailed account of the data analysis. The enhancement over the reference of neutral meson decays amounts to a factor of 2.31$\pm0.19 (stat.)\pm0.55 (syst.)\pm0.69 (decays)$ for semi-central collisions (28% $σ/σ_{geo}$) when yields are integrated over $m>$ 200 MeV/$c^2$ in invariant mass. The measured yield, its stronger-than-linear scaling with $N_{ch}$, and the dominance of low pair $p_t$ strongly suggest an interpretation as {\it thermal radiation} from pion annihilation in the hadronic fireball. The shape of the excess centring at $m\approx$ 500 MeV/$c^2$, however, cannot be described without strong medium modifications of the $ρ$ meson. The results are put into perspective by comparison to predictions from Brown-Rho scaling governed by chiral symmetry restoration, and from the spectral-function many-body treatment in which the approach to the phase boundary is less explicit.
△ Less
Submitted 1 June, 2005;
originally announced June 2005.
-
Test Results on the Silicon Pixel Detector for the TTF-FEL Beam Trajectory Monitor
Authors:
S. Hillert,
R. Ischebeck,
U. C. Müller,
S. Roth,
K. Hansen,
P. Holl,
S. Karstensen,
J. Kemmer,
R. Klanner,
P. Lechner,
M. Leenen,
J. S. T. Ng,
P. Schmüser,
L. Strüder
Abstract:
Test measurements on the silicon pixel detector for the beam trajectory monitor at the free electron laser of the TESLA test facility are presented. To determine the electronic noise of detector and read-out and to calibrate the signal amplitude of different pixels the 6 keV photons of the manganese K line are used. Two different methods determine the spatial accuracy of the detector: In one set…
▽ More
Test measurements on the silicon pixel detector for the beam trajectory monitor at the free electron laser of the TESLA test facility are presented. To determine the electronic noise of detector and read-out and to calibrate the signal amplitude of different pixels the 6 keV photons of the manganese K line are used. Two different methods determine the spatial accuracy of the detector: In one setup a laser beam is focused to a straight line and moved across the pixel structure. In the other the detector is scanned using a low-intensity electron beam of an electron microscope. Both methods show that the symmetry axis of the detector defines a straight line within 0.4 microns. The sensitivity of the detector to low energy X-rays is measured using a vacuum ultraviolet beam at the synchrotron light source HASYLAB. Additionally, the electron microscope is used to study the radiation hardness of the detector.
△ Less
Submitted 25 April, 2000;
originally announced April 2000.
