-
Gyrokinetic particle-in-cell simulations of electromagnetic turbulence in the presence of fast particles and global modes
Authors:
A. Mishchenko,
A. Bottino,
T. Hayward-Schneider,
E. Poli,
X. Wang,
R. Kleiber,
M. Borchardt,
C. Nuehrenberg,
A. Biancalani,
A. Koenies,
E. Lanti,
Ph. Lauber,
R. Hatzky,
F. Vannini,
L. Villard,
F. Widmer
Abstract:
Global simulations of electromagnetic turbulence, collisionless tearing modes, and Alfven Eigenmodes in the presence of fast particles are carried out using the gyrokinetic particle-in-cell codes ORB5 (E. Lanti et al, Comp. Phys. Comm., ${\bf 251}$, 107072 (2020)) and EUTERPE (V. Kornilov et al, Phys. Plasmas, ${\bf 11}$, 3196 (2004)) in tokamak and stellarator geometries. Computational feasibilit…
▽ More
Global simulations of electromagnetic turbulence, collisionless tearing modes, and Alfven Eigenmodes in the presence of fast particles are carried out using the gyrokinetic particle-in-cell codes ORB5 (E. Lanti et al, Comp. Phys. Comm., ${\bf 251}$, 107072 (2020)) and EUTERPE (V. Kornilov et al, Phys. Plasmas, ${\bf 11}$, 3196 (2004)) in tokamak and stellarator geometries. Computational feasibility of simulating such complex coupled systems is demonstrated.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Linear and nonlinear excitation of TAE modes by external electromagnetic perturbations using ORB5
Authors:
Mohsen Sadr,
Alexey Mishchenko,
Thomas Hayward-Schneider,
Axel Koenies,
Alberto Bottino,
Alessandro Biancalani,
Peter Donnel,
Emmanuel Lanti,
Laurent Villard
Abstract:
The excitation of toroidicity induced Alfv{é}n eigenmodes (TAEs) using prescribed external electromagnetic perturbations (hereafter ``antenna") acting on a confined toroidal plasma as well as its nonlinear couplings to other modes in the system is studied. The antenna is described by an electrostatic potential resembling the target TAE mode structure along with its corresponding parallel electroma…
▽ More
The excitation of toroidicity induced Alfv{é}n eigenmodes (TAEs) using prescribed external electromagnetic perturbations (hereafter ``antenna") acting on a confined toroidal plasma as well as its nonlinear couplings to other modes in the system is studied. The antenna is described by an electrostatic potential resembling the target TAE mode structure along with its corresponding parallel electromagnetic potential computed from Ohm's law. Numerically stable long-time linear simulations are achieved by integrating the antenna within the framework of a mixed representation and pullback scheme [A. Mishchenko, et al., Comput. Phys. Commun. \textbf{238} (2019) 194]. By decomposing the plasma electromagnetic potential into symplectic and Hamiltonian parts and using Ohm's law, the destabilizing contribution of the potential gradient parallel to the magnetic field is canceled in the equations of motion. Besides evaluating the frequencies as well as growth/dam** rates of excited modes compared to referenced TAEs, we study the interaction of antenna-driven modes with fast particles and indicate their margins of instability. Furthermore, we show first nonlinear simulations in the presence of a TAE-like antenna exciting other TAE modes, as well as Global Alfvén Eigenmodes (GAE) having different toroidal wave numbers from that of the antenna.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
The GBS code for the self-consistent simulation of plasma turbulence and kinetic neutral dynamics in the tokamak boundary
Authors:
M. Giacomin,
P. Ricci,
A. Coroado,
G. Fourestey,
D. Galassi,
E. Lanti,
D. Mancini,
N. Richart,
L. N. Stenger,
N. Varini
Abstract:
A new version of GBS (Ricci et al. Plasma Phys. Control. Fusion 54, 124047, 2012; Halpern et al. J. Comput. Phys. 315, 388-408, 2016; Paruta et al. Phys. Plasmas 25, 112301, 2018) is described. GBS is a three-dimensional, flux-driven, global, two-fluid turbulence code developed for the self-consistent simulation of plasma turbulence and kinetic neutral dynamics in the tokamak boundary. In the new…
▽ More
A new version of GBS (Ricci et al. Plasma Phys. Control. Fusion 54, 124047, 2012; Halpern et al. J. Comput. Phys. 315, 388-408, 2016; Paruta et al. Phys. Plasmas 25, 112301, 2018) is described. GBS is a three-dimensional, flux-driven, global, two-fluid turbulence code developed for the self-consistent simulation of plasma turbulence and kinetic neutral dynamics in the tokamak boundary. In the new version presented here, the simulation domain is extended to encompass the whole plasma volume, avoiding an artificial boundary with the core, hence retaining the core-edge-SOL interplay. A new toroidal coordinate system is introduced to increase the code flexibility, allowing for the simulation of arbitrary magnetic configurations (e.g. single-null, double-null and snowflake configurations), which can also be the result of the equilibrium reconstruction of an experimental discharge. The implementation of a new iterative solver for the Poisson and Ampère equations is presented, leading to a remarkable speed-up of the code with respect to the use of direct solvers, therefore allowing for efficient electromagnetic simulations that avoid the use of the Boussinesq approximation. The self-consistent kinetic neutral model, initially developed for limited configurations, is ported to the magnetic configurations considered by the present version of GBS and carefully optimized. A new MPI parallelisation is implemented to evolve the plasma and neutral models in parallel, thus improving the code scalability. The numerical implementation of the plasma and neutral models is verified by means of the method of manufactured solutions. As an example of the simulation capabilities of the new version of GBS, a simulation of a TCV tokamak discharge is presented.
△ Less
Submitted 7 December, 2021;
originally announced December 2021.
-
Numerics and computation in gyrokinetic simulations of electromagnetic turbulence with global particle-in-cell codes
Authors:
Alexey Mishchenko,
Alessandro Biancalani,
Alberto Bottino,
Thomas Hayward-Schneider,
Philipp Lauber,
Emmanuel Lanti,
Laurent Villard,
Ralf Kleiber,
Axel Koenies,
Matthias Borchardt
Abstract:
Electromagnetic turbulence is addressed in tokamak and stellarator plasmas with the global gyrokinetic particle-in-cell codes ORB5 [E. Lanti et al, Comp. Phys. Comm, vol. 251, 107072 (2020)] and EUTERPE [V. Kornilov et al, Phys. Plasmas, vol. 11, 3196 (2004)]. The large-aspect-ratio tokamak, down-scaled ITER, and Wendelstein 7-X geometries are considered. The main goal is to increase the plasma be…
▽ More
Electromagnetic turbulence is addressed in tokamak and stellarator plasmas with the global gyrokinetic particle-in-cell codes ORB5 [E. Lanti et al, Comp. Phys. Comm, vol. 251, 107072 (2020)] and EUTERPE [V. Kornilov et al, Phys. Plasmas, vol. 11, 3196 (2004)]. The large-aspect-ratio tokamak, down-scaled ITER, and Wendelstein 7-X geometries are considered. The main goal is to increase the plasma beta, the machine size, the ion-to-electron mass ratio, as well as to include realistic-geometry features in such simulations. The associated numerical requirements and the computational cost for the cases on computer systems with massive GPU deployments are investigated. These are necessary steps to enable electromagnetic turbulence simulations in future reactor plasmas.
△ Less
Submitted 4 May, 2021; v1 submitted 13 April, 2021;
originally announced April 2021.
-
Optimised allgatherv, reduce_scatter and allreduce communication in message-passing systems
Authors:
Andreas Jocksch,
Noe Ohana,
Emmanuel Lanti,
Vasileios Karakasis,
Laurent Villard
Abstract:
Collective communications, namely the patterns allgatherv, reduce_scatter, and allreduce in message-passing systems are optimised based on measurements at the installation time of the library. The algorithms used are set up in an initialisation phase of the communication, similar to the method used in so-called persistent collective communication introduced in the literature. For allgatherv and re…
▽ More
Collective communications, namely the patterns allgatherv, reduce_scatter, and allreduce in message-passing systems are optimised based on measurements at the installation time of the library. The algorithms used are set up in an initialisation phase of the communication, similar to the method used in so-called persistent collective communication introduced in the literature. For allgatherv and reduce_scatter the existing algorithms, recursive multiply/divide and cyclic shift (Bruck's algorithm) are applied with a flexible number of communication ports per node. The algorithms for equal message sizes are used with non-equal message sizes together with a heuristic for rank reordering. The two communication patterns are applied in a plasma physics application that uses a specialised matrix-vector multiplication. For the allreduce pattern the cyclic shift algorithm is applied with a prefix operation. The data is gathered and scattered by the cores within the node and the communication algorithms are applied across the nodes. In general our routines outperform the non-persistent counterparts in established MPI libraries by up to one order of magnitude or show equal performance, with a few exceptions of number of nodes and message sizes.
△ Less
Submitted 23 June, 2020;
originally announced June 2020.
-
Nonlinear dynamics of energetic-particle driven geodesic acoustic modes in ASDEX Upgrade
Authors:
I. Novikau,
A. Biancalani,
A. Bottino,
Ph. Lauber,
E. Poli,
P. Manz,
G. D. Conway,
A. Di Siena,
N. Ohana,
E. Lanti,
L. Villard,
ASDEX Upgrade Team
Abstract:
Turbulence in tokamaks generates radially sheared zonal flows. Their oscillatory counterparts, geodesic acoustic modes (GAMs), appear due to the action of the magnetic field curvature. The GAMs can be driven unstable by an anisotropic energetic particle (EP) population leading to the formation of global radial structures, called EGAMs. The EGAMs can redistribute EP energy to the bulk plasma throug…
▽ More
Turbulence in tokamaks generates radially sheared zonal flows. Their oscillatory counterparts, geodesic acoustic modes (GAMs), appear due to the action of the magnetic field curvature. The GAMs can be driven unstable by an anisotropic energetic particle (EP) population leading to the formation of global radial structures, called EGAMs. The EGAMs can redistribute EP energy to the bulk plasma through collisionless wave-particle interaction. In such a way, the EGAMs might contribute to the plasma heating. Thus, investigation of EGAM properties, especially in the velocity space, is necessary for precise understanding of the transport phenomena in tokamak plasmas.
In this work, the nonlinear dynamics of EGAMs without considering the mode interaction with the turbulence is investigated with the help of a Mode-Particle-Resonance (MPR) diagnostic implemented in the global gyrokinetic particle-in-cell code ORB5. An ASDEX Upgrade discharge is chosen as a reference case for this investigation due to its rich EP nonlinear dynamics. An experimentally relevant magnetic field configuration, thermal species profiles and an EP density profile are taken for EGAM chir** modelling and its comparison with available empirical data. The same magnetic configuration is used to explore energy transfer by the mode from the energetic particles to the thermal plasma including kinetic electron effects. For a given EGAM level the plasma heating by the mode can be significantly enhanced by varying the EP parameters. Electron dynamics decreases the EGAM saturation amplitude and consequently reduces the plasma heating, even though the mode transfers its energy to thermal ions much more than to electrons.
△ Less
Submitted 27 March, 2020; v1 submitted 17 December, 2019;
originally announced December 2019.
-
Gyrokinetic Simulations on Many- and Multi-core Architectures with the Global Electromagnetic Particle-In-Cell Code ORB5
Authors:
Noé Ohana,
Claudio Gheller,
Emmanuel Lanti,
Andreas Jocksch,
Stephan Brunner,
Laurent Villard
Abstract:
Gyrokinetic codes in plasma physics need outstanding computational resources to solve increasingly complex problems, requiring the effective exploitation of cutting-edge HPC architectures. This paper focuses on the enabling of ORB5, a state-of-the-art, first-principles-based gyrokinetic code, on modern parallel hybrid multi-core, multi-GPU systems. ORB5 is a Lagrangian, Particle-In-Cell (PIC), fin…
▽ More
Gyrokinetic codes in plasma physics need outstanding computational resources to solve increasingly complex problems, requiring the effective exploitation of cutting-edge HPC architectures. This paper focuses on the enabling of ORB5, a state-of-the-art, first-principles-based gyrokinetic code, on modern parallel hybrid multi-core, multi-GPU systems. ORB5 is a Lagrangian, Particle-In-Cell (PIC), finite element, global, electromagnetic code, originally implementing distributed parallelism through MPI-based on domain decomposition and domain cloning. In order to support multi/many cores devices, the code has been completely refactored. Data structures have been re-designed to ensure efficient memory access, enhancing data locality. Multi-threading has been introduced through OpenMP on the CPU and adopting OpenACC to support GPU acceleration. MPI can still be used in combination with the two approaches. The performance results obtained using the full production ORB5 code on the Summit system at ORNL, on Piz Daint at CSCS and on the Marconi system at CINECA are presented, showing the effectiveness and performance portability of the adopted solutions: the same source code version was used to produce all results on all architectures.
△ Less
Submitted 14 February, 2020; v1 submitted 6 August, 2019;
originally announced August 2019.
-
Gyrokinetic full-f particle-in-cell simulations on open field lines with PICLS
Authors:
Mathias Helmut Boesl,
Andreas Bergmann,
Alberto Bottino,
David Coster,
Emmanuel Lanti,
Noe Ohana,
Frank Jenko
Abstract:
While in recent years, gyrokinetic simulations have become the workhorse for theoretical turbulence and transport studies in the plasma core, their application to the edge and scrape-off layer (SOL) region presents significant challenges. In particular, steep density and temperature gradients as well as large fluctuation amplitudes call for a "full-f" treatment. To specifically study problems in t…
▽ More
While in recent years, gyrokinetic simulations have become the workhorse for theoretical turbulence and transport studies in the plasma core, their application to the edge and scrape-off layer (SOL) region presents significant challenges. In particular, steep density and temperature gradients as well as large fluctuation amplitudes call for a "full-f" treatment. To specifically study problems in the SOL region, the gyrokinetic particle-in-cell (PIC) code PICLS has been developed. The code is based on an electrostatic full-f model with linearised field equations and uses kinetic electrons. Here, the well-studied parallel transport problem during an edge-localized mode (ELM) in the SOL shall be investigated for one spatial dimension. The results are compared to previous gyrokinetic continuum and fully kinetic PIC simulations and show good agreement.
△ Less
Submitted 7 January, 2020; v1 submitted 1 August, 2019;
originally announced August 2019.
-
ORB5: a global electromagnetic gyrokinetic code using the PIC approach in toroidal geometry
Authors:
E. Lanti,
N. Ohana,
N. Tronko,
T. Hayward-Schneider,
A. Bottino,
B. F. McMillan,
A. Mishchenko,
A. Scheinberg,
A. Biancalani,
P. Angelino,
S. Brunner,
J. Dominski,
P. Donnel,
C. Gheller,
R. Hatzky,
A. Jocksch,
S. Jolliet,
Z. X. Lu,
J. P. Martin Collar,
I. Novikau,
E. Sonnendrücker,
T. Vernay,
L. Villard
Abstract:
This paper presents the current state of the global gyrokinetic code ORB5 as an update of the previous reference [Jolliet et al., Comp. Phys. Commun. 177 409 (2007)]. The ORB5 code solves the electromagnetic Vlasov-Maxwell system of equations using a PIC scheme and also includes collisions and strong flows. The code assumes multiple gyrokinetic ion species at all wavelengths for the polarization d…
▽ More
This paper presents the current state of the global gyrokinetic code ORB5 as an update of the previous reference [Jolliet et al., Comp. Phys. Commun. 177 409 (2007)]. The ORB5 code solves the electromagnetic Vlasov-Maxwell system of equations using a PIC scheme and also includes collisions and strong flows. The code assumes multiple gyrokinetic ion species at all wavelengths for the polarization density and drift-kinetic electrons. Variants of the physical model can be selected for electrons such as assuming an adiabatic response or a ``hybrid'' model in which passing electrons are assumed adiabatic and trapped electrons are drift-kinetic. A Fourier filter as well as various control variates and noise reduction techniques enable simulations with good signal-to-noise ratios at a limited numerical cost. They are completed with different momentum and zonal flow-conserving heat sources allowing for temperature-gradient and flux-driven simulations. The code, which runs on both CPUs and GPUs, is well benchmarked against other similar codes and analytical predictions, and shows good scalability up to thousands of nodes.
△ Less
Submitted 6 May, 2019;
originally announced May 2019.
-
First principles gyrokinetic analysis of electromagnetic plasma instabilities
Authors:
Natalia Tronko,
Alberto Bottino,
Cristel Chandre,
Eric Sonnendrücker,
Emmanuel Lanti,
Noé Ohana,
Stephan Brunner,
Laurent Villard
Abstract:
A two-fold analysis of electromagnetic core tokamak instabilities in the framework of the gyrokinetic theory is presented. First principle theoretical foundations of the gyrokinetic theory are used to explain and justify the numerical results obtained with the global electromagnetic particle-in-cell code Orb5 whose model is derived from the Lagrangian formalism. The energy conservation law corresp…
▽ More
A two-fold analysis of electromagnetic core tokamak instabilities in the framework of the gyrokinetic theory is presented. First principle theoretical foundations of the gyrokinetic theory are used to explain and justify the numerical results obtained with the global electromagnetic particle-in-cell code Orb5 whose model is derived from the Lagrangian formalism. The energy conservation law corresponding to the Orb5 model is derived from the Noether theorem and implemented in the code as a diagnostics for energy balance and conservation verification. An additional Noether theorem based diagnostics is implemented in order to analyse destabilising mechanisms for the electrostatic and the electromagnetic Ion Temperature Gradient (ITG) instabilities in the core region of the tokamak. The transition towards the Kinetic Ballooning Modes (KBM) at high electromagnetic $β$ is also investigated.
△ Less
Submitted 26 March, 2019;
originally announced March 2019.
-
Implementation of energy transfer technique in ORB5 to study collisionless wave-particle interactions in phase-space
Authors:
Ivan Novikau,
Alessandro Biancalani,
Alberto Bottino,
Alessandro Di Siena,
Philipp Lauber,
Emanuele Poli,
Emmanuel Lanti,
Laurent Villard,
Noé Ohana,
Sergio Briguglio
Abstract:
A new diagnostic has been developed to investigate the wave-particle interaction in the phase-space in gyrokinetic particle-in-cell codes. Based on the projection of energy transfer terms onto the velocity space, the technique has been implemented and tested in the global code ORB5 and it gives an opportunity to localise velocity domains of maximum wave-plasma energy exchange for separate species.…
▽ More
A new diagnostic has been developed to investigate the wave-particle interaction in the phase-space in gyrokinetic particle-in-cell codes. Based on the projection of energy transfer terms onto the velocity space, the technique has been implemented and tested in the global code ORB5 and it gives an opportunity to localise velocity domains of maximum wave-plasma energy exchange for separate species. Moreover, contribution of different species and resonances can be estimated as well, by integrating the energy transfer terms in corresponding velocity domains. This Mode-Plasma-Resonance (MPR) diagnostic has been applied to study the dynamics of the Energetic-particle-induced Geodesic Acoustic Modes (EGAMs) in an ASDEX Upgrade shot, by analysing the influence of different species on the mode time evolution. Since the equations on which the diagnostic is based, are valid in both linear and nonlinear cases, this approach can be applied to study nonlinear plasma effects. As a possible future application, the technique can be used, for instance, to investigate the nonlinear EGAM frequency chir**, or the plasma heating due to the dam** of the EGAMs.
△ Less
Submitted 12 March, 2019;
originally announced March 2019.
-
Pullback scheme implementation in ORB5
Authors:
Alexey Mishchenko,
Alberto Bottino,
Alessandro Biancalani,
Roman Hatzky,
Thomas Hayward-Schneider,
Noe Ohana,
Emmanuel Lanti,
Stephan Brunner,
Laurent Villard,
Matthias Borchardt,
Ralf Kleiber,
Axel Koenies
Abstract:
The pullback scheme is implemented in the global gyrokinetic particle-in-cell code ORB5 [S. Jolliet et al, Comp. Phys. Comm., 177, 409 (2007)] to mitigate the cancellation problem in electromagnetic simulations. The equations and the discretisation used by the code are described. Numerical simulations of the Toroidal Alfven Eigenmodes are performed in linear and nonlinear regimes to verify the sch…
▽ More
The pullback scheme is implemented in the global gyrokinetic particle-in-cell code ORB5 [S. Jolliet et al, Comp. Phys. Comm., 177, 409 (2007)] to mitigate the cancellation problem in electromagnetic simulations. The equations and the discretisation used by the code are described. Numerical simulations of the Toroidal Alfven Eigenmodes are performed in linear and nonlinear regimes to verify the scheme. A considerable improvement in the code efficiency is observed. For the internal kink mode, it is shown that the pullback mitigation efficiently cures a numerical instability which would make the simulation more costly otherwise.
△ Less
Submitted 13 November, 2018;
originally announced November 2018.
-
A portable platform for accelerated PIC codes and its application to GPUs using OpenACC
Authors:
F. Hariri,
T. M. Tran,
A. Jocksch,
E. Lanti,
J. Progsch,
P. Messmer,
S. Brunner,
G. Gheller,
L. Villard
Abstract:
We present a portable platform, called PIC_ENGINE, for accelerating Particle-In-Cell (PIC) codes on heterogeneous many-core architectures such as Graphic Processing Units (GPUs). The aim of this development is efficient simulations on future exascale systems by allowing different parallelization strategies depending on the application problem and the specific architecture. To this end, this platfo…
▽ More
We present a portable platform, called PIC_ENGINE, for accelerating Particle-In-Cell (PIC) codes on heterogeneous many-core architectures such as Graphic Processing Units (GPUs). The aim of this development is efficient simulations on future exascale systems by allowing different parallelization strategies depending on the application problem and the specific architecture. To this end, this platform contains the basic steps of the PIC algorithm and has been designed as a test bed for different algorithmic options and data structures. Among the architectures that this engine can explore, particular attention is given here to systems equipped with GPUs. The study demonstrates that our portable PIC implementation based on the OpenACC programming model can achieve performance closely matching theoretical predictions. Using the Cray XC30 system, Piz Daint, at the Swiss National Supercomputing Centre (CSCS), we show that PIC_ENGINE running on an NVIDIA Kepler K20X GPU can outperform the one on an Intel Sandybridge 8-core CPU by a factor of 3.4.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.