Showing 1–25 of 25 results for author: Huebl, A

LASY: LAser manipulations made eaSY

Authors: Maxence Thévenet, Igor A. Andriyash, Luca Fedeli, Ángel Ferran Pousa, Axel Huebl, Sören Jalas, Manuel Kirchen, Remi Lehe, Rob J. Shalloo, Alexander Sinn, Jean-Luc Vay

Abstract: Using realistic laser profiles for simulations of laser-plasma interaction is critical to reproduce experimental measurements, but the interface between experiments and simulations can be challenging. Similarly, start-to-end simulations with different codes may require error-prone manipulations to convert between different representations of a laser pulse. In this work, we propose LASY, an open-so… ▽ More Using realistic laser profiles for simulations of laser-plasma interaction is critical to reproduce experimental measurements, but the interface between experiments and simulations can be challenging. Similarly, start-to-end simulations with different codes may require error-prone manipulations to convert between different representations of a laser pulse. In this work, we propose LASY, an open-source Python library to simplify these workflows. Developed through an international collaboration between experimental, theoretical and computational physicists, LASY can be used to initialize a laser profile from an experimental measurement, from a simulation, or from analytics, manipulate it, and write it into a file in compliance with the openPMD standard. This profile can then be used as an input of a simulation code. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Comments: 6 pages, 4 figures, EAAC2023 conference proceedings

Synthesizing Particle-in-Cell Simulations Through Learning and GPU Computing for Hybrid Particle Accelerator Beamlines

Authors: Ryan T. Sandberg, Remi Lehe, Chad E. Mitchell, Marco Garten, Andrew Myers, Ji Qiang, Jean-Luc Vay, Axel Huebl

Abstract: Particle accelerator modeling is an important field of research and development, essential to investigating, designing and operating some of the most complex scientific devices ever built. Kinetic simulations of relativistic, charged particle beams and advanced plasma accelerator elements are often performed with high-fidelity particle-in-cell simulations, some of which fill the largest GPU superc… ▽ More Particle accelerator modeling is an important field of research and development, essential to investigating, designing and operating some of the most complex scientific devices ever built. Kinetic simulations of relativistic, charged particle beams and advanced plasma accelerator elements are often performed with high-fidelity particle-in-cell simulations, some of which fill the largest GPU supercomputers. Start-to-end modeling of a particle accelerator includes many elements and it is desirable to integrate and model advanced accelerator elements fast, in effective models. Traditionally, analytical and reduced-physics models fill this role. The vast data from high-fidelity simulations and power of GPU-accelerated computation open a new opportunity to complement traditional modeling without approximations: surrogate modeling through machine learning. In this paper, we implement, present and benchmark such a data-driven workflow, synthesising a fully GPU-accelerated, conventional-surrogate simulation for hybrid particle accelerator beamlines. △ Less

Submitted 30 April, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Comments: 11 pages, 10 figures. Accepted to PASC24 proceedings

Journal ref: Proceedings of the Platform for Advanced Scientific Computing Conference PASC24 (2024)

EZ: An Efficient, Charge Conserving Current Deposition Algorithm for Electromagnetic Particle-In-Cell Simulations

Authors: Klaus Steiniger, Rene Widera, Sergei Bastrakov, Michael Bussmann, Sunita Chandrasekaran, Benjamin Hernandez, Kristina Holsapple, Axel Huebl, Guido Juckeland, Jeffrey Kelling, Matt Leinhauser, Richard Pausch, David Rogers, Ulrich Schramm, Jeff Young, Alexander Debus

Abstract: We present EZ, a novel current deposition algorithm for particle-in-cell (PIC) simulations. EZ calculates the current density on the electromagnetic grid due to macro-particle motion within a time step by solving the continuity equation of electrodynamics. Being a charge conserving hybridization of Esirkepov's method and ZigZag, we refer to it as ``EZ'' as shorthand for ``Esirkepov meets ZigZag''.… ▽ More We present EZ, a novel current deposition algorithm for particle-in-cell (PIC) simulations. EZ calculates the current density on the electromagnetic grid due to macro-particle motion within a time step by solving the continuity equation of electrodynamics. Being a charge conserving hybridization of Esirkepov's method and ZigZag, we refer to it as ``EZ'' as shorthand for ``Esirkepov meets ZigZag''. Simulations of a warm, relativistic plasma with PIConGPU show that EZ achieves the same level of charge conservation as the commonly used method by Esirkepov, yet reaches higher performance for macro-particle assignment-functions up to third-order. In addition to a detailed description of the functioning of EZ, reasons for the expected and observed performance increase are given, and guidelines for its implementation aiming at highest performance on GPUs are provided. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Journal ref: Computer Physics Communications 291 (2023) 108849

Laser-Plasma Ion Beam Booster Based on Hollow-Channel Magnetic Vortex Acceleration

Authors: Marco Garten, Stepan S. Bulanov, Sahel Hakimi, Lieselotte Obst-Huebl, Chad E. Mitchell, Carl Schroeder, Eric Esarey, Cameron G. R. Geddes, Jean-Luc Vay, Axel Huebl

Abstract: Laser-driven ion acceleration provides ultra-short, high-charge, low-emittance beams, which are desirable for a wide range of high-impact applications. Yet after decades of research, a significant increase in maximum ion energy is still needed. This work introduces a quality-preserving staging concept for ultra-intense ion bunches that is seamlessly applicable from the non-relativistic plasma sour… ▽ More Laser-driven ion acceleration provides ultra-short, high-charge, low-emittance beams, which are desirable for a wide range of high-impact applications. Yet after decades of research, a significant increase in maximum ion energy is still needed. This work introduces a quality-preserving staging concept for ultra-intense ion bunches that is seamlessly applicable from the non-relativistic plasma source to the relativistic regime. Full 3D particle-in-cell simulations prove robustness and capture of a high-charge proton bunch, suitable for readily available and near-term laser facilities. △ Less

Submitted 5 May, 2024; v1 submitted 9 August, 2023; originally announced August 2023.

Comments: 4 pages, 4 figures, under peer review

Light-Matter Interaction Near the Schwinger Limit Using Tightly Focused Doppler-Boosted Lasers

Authors: Neïl Zaïm, Antonin Sainte-Marie, Luca Fedeli, Pierre Bartoli, Axel Huebl, Jean-Luc Vay, Henri Vincenti

Abstract: The Schwinger limit could be approached by focusing to its diffraction limit the light reflected by a plasma mirror irradiated by a multi-petawatt laser. We explore numerically the interaction between such intense light and matter. We find that the interaction with a relativistic counterpropagative electron beam would enable the exploration of the fully nonperturbative regime of strong-field quant… ▽ More The Schwinger limit could be approached by focusing to its diffraction limit the light reflected by a plasma mirror irradiated by a multi-petawatt laser. We explore numerically the interaction between such intense light and matter. We find that the interaction with a relativistic counterpropagative electron beam would enable the exploration of the fully nonperturbative regime of strong-field quantum electrodynamics (SF-QED), while the interaction with an initially solid target leads to a profusion of SF-QED effects that retroact on the laser-plasma interaction. We observe in both scenarios the formation of relativistic attosecond electron-positron jets with very high densities. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: 7 pages, 3 figures

From Compact Plasma Particle Sources to Advanced Accelerators with Modeling at Exascale

Authors: Axel Huebl, Remi Lehe, Edoardo Zoni, Olga Shapoval, Ryan T. Sandberg, Marco Garten, Arianna Formenti, Revathi Jambunathan, Prabhat Kumar, Kevin Gott, Andrew Myers, Weiqun Zhang, Ann Almgren, Chad E. Mitchell, Ji Qiang, David Grote, Alexander Sinn, Severin Diederichs, Maxence Thevenet, Luca Fedeli, Thomas Clark, Neil Zaim, Henri Vincenti, Jean-Luc Vay

Abstract: Develo** complex, reliable advanced accelerators requires a coordinated, extensible, and comprehensive approach in modeling, from source to the end of beam lifetime. We present highlights in Exascale Computing to scale accelerator modeling software to the requirements set for contemporary science drivers. In particular, we present the first laser-plasma modeling on an exaflop supercomputer using… ▽ More Develo** complex, reliable advanced accelerators requires a coordinated, extensible, and comprehensive approach in modeling, from source to the end of beam lifetime. We present highlights in Exascale Computing to scale accelerator modeling software to the requirements set for contemporary science drivers. In particular, we present the first laser-plasma modeling on an exaflop supercomputer using the US DOE Exascale Computing Project WarpX. Leveraging developments for Exascale, the new DOE SCIDAC-5 Consortium for Advanced Modeling of Particle Accelerators (CAMPA) will advance numerical algorithms and accelerate community modeling codes in a cohesive manner: from beam source, over energy boost, transport, injection, storage, to application or interaction. Such start-to-end modeling will enable the exploration of hybrid accelerators, with conventional and advanced elements, as the next step for advanced accelerator modeling. Following open community standards, we seed an open ecosystem of codes that can be readily combined with each other and machine learning frameworks. These will cover ultrafast to ultraprecise modeling for future hybrid accelerator design, even enabling virtual test stands and twins of accelerators that can be used in operations. △ Less

Submitted 18 April, 2023; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: 4 pages, 3 figures, presented at the 20th Advanced Accelerator Concepts Workshop (AAC22)

Bayesian optimization of laser-plasma accelerators assisted by reduced physical models

Authors: A. Ferran Pousa, S. Jalas, M. Kirchen, A. Martinez de la Ossa, M. Thévenet, S. Hudson, J. Larson, A. Huebl, J. -L. Vay, R. Lehe

Abstract: Particle-in-cell simulations are among the most essential tools for the modeling and optimization of laser-plasma accelerators, since they reproduce the physics from first principles. However, the high computational cost associated with them can severely limit the scope of parameter and design optimization studies. Here, we show that a multitask Bayesian optimization algorithm can be used to mitig… ▽ More Particle-in-cell simulations are among the most essential tools for the modeling and optimization of laser-plasma accelerators, since they reproduce the physics from first principles. However, the high computational cost associated with them can severely limit the scope of parameter and design optimization studies. Here, we show that a multitask Bayesian optimization algorithm can be used to mitigate the need for such high-fidelity simulations by incorporating information from inexpensive evaluations of reduced physical models. In a proof-of-principle study, where a high-fidelity optimization with FBPIC is assisted by reduced-model simulations with Wake-T, the algorithm demonstrates an order-of-magnitude speedup. This opens a path for the cost-effective optimization of laser-plasma accelerators in large parameter spaces, an important step towards fulfilling the high beam quality requirements of future applications. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Next Generation Computational Tools for the Modeling and Design of Particle Accelerators at Exascale

Authors: Axel Huebl, Remi Lehe, Chad E. Mitchell, Ji Qiang, Robert D. Ryne, Ryan T. Sandberg, Jean-Luc Vay

Abstract: Particle accelerators are among the largest, most complex devices. To meet the challenges of increasing energy, intensity, accuracy, compactness, complexity and efficiency, increasingly sophisticated computational tools are required for their design and optimization. It is key that contemporary software take advantage of the latest advances in computer hardware and scientific software engineering… ▽ More Particle accelerators are among the largest, most complex devices. To meet the challenges of increasing energy, intensity, accuracy, compactness, complexity and efficiency, increasingly sophisticated computational tools are required for their design and optimization. It is key that contemporary software take advantage of the latest advances in computer hardware and scientific software engineering practices, delivering speed, reproducibility and feature composability for the aforementioned challenges. A new open source software stack is being developed at the heart of the Beam pLasma Accelerator Simulation Toolkit (BLAST) by LBNL and collaborators, providing new particle-in-cell modeling codes capable of exploiting the power of GPUs on Exascale supercomputers. Combined with advanced numerical techniques, such as mesh-refinement, and intrinsic support for machine learning, these codes are primed to provide ultrafast to ultraprecise modeling for future accelerator design and operations. △ Less

Submitted 9 August, 2022; v1 submitted 3 August, 2022; originally announced August 2022.

Comments: 4 pages, 8 figures; NAPAC22, Invited Oral, TUYE2

MSC Class: 78-10 ACM Class: I.6.0; D.2.12; D.2.13

Journal ref: NAPAC22, 2022

Linear colliders based on laser-plasma accelerators

Authors: C. Benedetti, S. S. Bulanov, E. Esarey, C. G. R. Geddes, A. J. Gonsalves, A. Huebl, R. Lehe, K. Nakamura, C. B. Schroeder, D. Terzani, J. van Tilborg, M. Turner, J. -L. Vay, T. Zhou, F. Albert, J. Bromage, E. M. Campbell, D. H. Froula, J. P. Palastro, J. Zuegel, D. Bruhwiler, N. M. Cook, B. Cros, M. C. Downer, M. Fuchs , et al. (18 additional authors not shown)

Abstract: White paper to the Proceedings of the U.S. Particle Physics Community Planning Exercise (Snowmass 2021): Linear colliders based on laser-plasma accelerators White paper to the Proceedings of the U.S. Particle Physics Community Planning Exercise (Snowmass 2021): Linear colliders based on laser-plasma accelerators △ Less

Submitted 4 July, 2022; v1 submitted 15 March, 2022; originally announced March 2022.

Comments: Contribution to Snowmass 2021, Accelerator Frontier

Snowmass21 Accelerator Modeling Community White Paper

Authors: S. Biedron, L. Brouwer, D. L. Bruhwiler, N. M. Cook, A. L. Edelen, D. Filippetto, C. -K. Huang, A. Huebl, T. Katsouleas, N. Kuklev, R. Lehe, S. Lund, C. Messe, W. Mori, C. -K. Ng, D. Perez, P. Piot, J. Qiang, R. Roussel, D. Sagan, A. Sahai, A. Scheinker, M. Thévenet, F. Tsung, J. -L. Vay , et al. (2 additional authors not shown)

Abstract: After a summary of relevant comments and recommendations from various reports over the last ten years, this paper examines the modeling needs in accelerator physics, from the modeling of single beams and individual accelerator elements, to the realization of virtual twins that replicate all the complexity to model a particle accelerator complex as accurately as possible. We then discuss cutting-ed… ▽ More After a summary of relevant comments and recommendations from various reports over the last ten years, this paper examines the modeling needs in accelerator physics, from the modeling of single beams and individual accelerator elements, to the realization of virtual twins that replicate all the complexity to model a particle accelerator complex as accurately as possible. We then discuss cutting-edge and emerging computing opportunities, such as advanced algorithms, AI/ML and quantum computing, computational needs in hardware, software performance, portability and scalability, and needs for scalable I/O and in-situ analysis. Considerations of reliability, long-term sustainability, user support and training are considered next, before discussing the benefits of ecosystems with integrated workflows based on standardized input and output, and with integrated frameworks and data repositories developed as a community. Last, we highlight how the community can work more collaboratively and efficiently through the development of consortia and centers, and via collaboration with industry. △ Less

Submitted 22 September, 2022; v1 submitted 15 March, 2022; originally announced March 2022.

Comments: contribution to Snowmass 2021

Development of a Virtual EM Detector for the Advanced Particle Accelerator Modeling Code WarpX

Authors: Elisa Rheaume, Lorenzo Giacomel, Jean-Luc Vay, Axel Huebl

Abstract: In physics research particle accelerators are highly valued, and extraordinarily expensive, technical instruments. The high cost of particle accelerators results from the immense lengths required to accelerate particles to high energies, using radio frequency cavities. A current promising field of research, laser-driven particle acceleration has the potential to reduce the size, cost, and energy c… ▽ More In physics research particle accelerators are highly valued, and extraordinarily expensive, technical instruments. The high cost of particle accelerators results from the immense lengths required to accelerate particles to high energies, using radio frequency cavities. A current promising field of research, laser-driven particle acceleration has the potential to reduce the size, cost, and energy consumption of particle accelerators by orders of magnitude. To understand and control particle acceleration in plasmas using ultra-small spatial configurations, researchers have been develo** computational models to simulate the acceleration environment. Within these models, computational scientists have introduced virtual diagnostics to serve as the digital parallel to experimental detectors. Using WarpX\cite{Vay:2021}, an advanced Particle-in-Cell code that simulates laser-driven particle acceleration, we have developed a virtual diagnostic to measure electromagnetic radiation. Such radiation can for instance be produced from scattered and transmitted laser beams. This \textit{FieldProbe} diagnostic measures individual field components for electric and magnetic fields at a point or at all points along a specified geometry (line or plane). This diagnostic is GPU-accelerated and parallelized using the Message Passing Interface (MPI) and can thus run on High Performance Computing Centers such as NERSC. △ Less

Submitted 24 October, 2022; v1 submitted 20 January, 2022; originally announced January 2022.

Comments: Poster based on this paper can be found at https://zenodo.org/record/5750895 (DOI:10.5281/zenodo.5750895) Data set used in the creation of this paper can be found at https://zenodo.org/record/5847120 (DOI:10.5281/zenodo.5847120)

PICSAR-QED: a Monte Carlo module to simulate Strong-Field Quantum Electrodynamics in Particle-In-Cell codes for exascale architectures

Authors: Luca Fedeli, Neïl Zaïm, Antonin Sainte-Marie, Maxence Thévenet, Axel Huebl, Andrew Myers, Jean-Luc Vay, Henri Vincenti

Abstract: Physical scenarios where the electromagnetic fields are so strong that Quantum ElectroDynamics (QED) plays a substantial role are one of the frontiers of contemporary plasma physics research. Investigating those scenarios requires state-of-the-art Particle-In-Cell (PIC) codes able to run on top high-performance computing machines and, at the same time, able to simulate strong-field QED processes.… ▽ More Physical scenarios where the electromagnetic fields are so strong that Quantum ElectroDynamics (QED) plays a substantial role are one of the frontiers of contemporary plasma physics research. Investigating those scenarios requires state-of-the-art Particle-In-Cell (PIC) codes able to run on top high-performance computing machines and, at the same time, able to simulate strong-field QED processes. This work presents the PICSAR-QED library, an open-source, portable implementation of a Monte Carlo module designed to provide modern PIC codes with the capability to simulate such processes, and optimized for high-performance computing. Detailed tests and benchmarks are carried out to validate the physical models in PICSAR-QED, to study how numerical parameters affect such models, and to demonstrate its capability to run on different architectures (CPUs and GPUs). Its integration with WarpX, a state-of-the-art PIC code designed to deliver scalable performance on upcoming exascale supercomputers, is also discussed and validated against results from the existing literature. △ Less

Submitted 1 October, 2021; originally announced October 2021.

Comments: 33 pages, 7 figures, 4 tables

HiPACE++: a portable, 3D quasi-static Particle-in-Cell code

Authors: Severin Diederichs, Carlo Benedetti, Axel Huebl, Rémi Lehe, Andrew Myers, Alexander Sinn, Jean-Luc Vay, Weiqun Zhang, Maxence Thévenet

Abstract: Modeling plasma accelerators is a computationally challenging task and the quasi-static particle-in-cell algorithm is a method of choice in a wide range of situations. In this work, we present the first performance-portable, quasi-static, three-dimensional particle-in-cell code HiPACE++. By decomposing all the computation of a 3D domain in successive 2D transverse operations and choosing appropria… ▽ More Modeling plasma accelerators is a computationally challenging task and the quasi-static particle-in-cell algorithm is a method of choice in a wide range of situations. In this work, we present the first performance-portable, quasi-static, three-dimensional particle-in-cell code HiPACE++. By decomposing all the computation of a 3D domain in successive 2D transverse operations and choosing appropriate memory management, HiPACE++ demonstrates orders-of-magnitude speedups on modern scientific GPUs over CPU-only implementations. The 2D transverse operations are performed on a single GPU, avoiding time-consuming communications. The longitudinal parallelization is done through temporal domain decomposition, enabling near-optimal strong scaling from 1 to 512 GPUs. HiPACE++ is a modular, open-source code enabling efficient modeling of plasma accelerators from laptops to state-of-the-art supercomputers. △ Less

Submitted 21 September, 2021; originally announced September 2021.

Modeling of Advanced Accelerator Concepts

Authors: J. -L. Vay, A. Huebl, R. Lehe, N. M. Cook, R. J. England, U. Niedermayer, P. Piot, F. Tsung, D. Winklehner

Abstract: Computer modeling is essential to research on Advanced Accelerator Concepts (AAC), as well as to their design and operation. This paper summarizes the current status and future needs of AAC systems and reports on several key aspects of (i) high-performance computing (including performance, portability, scalability, advanced algorithms, scalable I/Os and In-Situ analysis), (ii) the benefits of ecos… ▽ More Computer modeling is essential to research on Advanced Accelerator Concepts (AAC), as well as to their design and operation. This paper summarizes the current status and future needs of AAC systems and reports on several key aspects of (i) high-performance computing (including performance, portability, scalability, advanced algorithms, scalable I/Os and In-Situ analysis), (ii) the benefits of ecosystems with integrated workflows based on standardized input and output and with integrated frameworks developed as a community, and (iii) sustainability and reliability (including code robustness and usability). △ Less

Submitted 14 September, 2021; v1 submitted 10 September, 2021; originally announced September 2021.

Simulations of Future Particle Accelerators: Issues and Mitigations

Authors: D. Sagan, M. Berz, N. M. Cook, Y. Hao, G. Hoffstaetter, A. Huebl, C. -K. Huang, M. H. Langston, C. E. Mayes, C. E. Mitchell, C. -K. Ng, J. Qiang, R. D. Ryne, A. Scheinker, E. Stern, J. -L. Vay, D. Winklehner, H. Zhang

Abstract: The ever increasing demands placed upon machine performance have resulted in the need for more comprehensive particle accelerator modeling. Computer simulations are key to the success of particle accelerators. Many aspects of particle accelerators rely on computer modeling at some point, sometimes requiring complex simulation tools and massively parallel supercomputing. Examples include the modeli… ▽ More The ever increasing demands placed upon machine performance have resulted in the need for more comprehensive particle accelerator modeling. Computer simulations are key to the success of particle accelerators. Many aspects of particle accelerators rely on computer modeling at some point, sometimes requiring complex simulation tools and massively parallel supercomputing. Examples include the modeling of beams at extreme intensities and densities (toward the quantum degeneracy limit), and with ultra-fine control (down to the level of individual particles). In the future, adaptively tuned models might also be relied upon to provide beam measurements beyond the resolution of existing diagnostics. Much time and effort has been put into creating accelerator software tools, some of which are highly successful. However, there are also shortcomings such as the general inability of existing software to be easily modified to meet changing simulation needs. In this paper possible mitigating strategies are discussed for issues faced by the accelerator community as it endeavors to produce better and more comprehensive modeling tools. This includes lack of coordination between code developers, lack of standards to make codes portable and/or reusable, lack of documentation, among others. △ Less

Submitted 24 August, 2021; originally announced August 2021.

Comments: 21 pages, 1 figure. To be published in JINST

In-Situ Assessment of Device-Side Compute Work for Dynamic Load Balancing in a GPU-Accelerated PIC Code

Authors: Michael E. Rowan, Axel Huebl, Kevin N. Gott, Jack Deslippe, Maxence Thévenet, Remi Lehe, Jean-Luc Vay

Abstract: Maintaining computational load balance is important to the performant behavior of codes which operate under a distributed computing model. This is especially true for GPU architectures, which can suffer from memory oversubscription if improperly load balanced. We present enhancements to traditional load balancing approaches and explicitly target GPU architectures, exploring the resulting performan… ▽ More Maintaining computational load balance is important to the performant behavior of codes which operate under a distributed computing model. This is especially true for GPU architectures, which can suffer from memory oversubscription if improperly load balanced. We present enhancements to traditional load balancing approaches and explicitly target GPU architectures, exploring the resulting performance. A key component of our enhancements is the introduction of several GPU-amenable strategies for assessing compute work. These strategies are implemented and benchmarked to find the most optimal data collection methodology for in-situ assessment of GPU compute work. For the fully kinetic particle-in-cell code WarpX, which supports MPI+CUDA parallelism, we investigate the performance of the improved dynamic load balancing via a strong scaling-based performance model and show that, for a laser-ion acceleration test problem run with up to 6144 GPUs on Summit, the enhanced dynamic load balancing achieves from 62%--74% (88% when running on 6 GPUs) of the theoretically predicted maximum speedup; for the 96-GPU case, we find that dynamic load balancing improves performance relative to baselines without load balancing (3.8x speedup) and with static load balancing (1.2x speedup). Our results provide important insights into dynamic load balancing and performance assessment, and are particularly relevant in the context of distributed memory applications ran on GPUs. △ Less

Submitted 22 April, 2021; originally announced April 2021.

Comments: 11 pages, 8 figures. Paper accepted in the Platform for Advanced Scientific Computing Conference (PASC '21), July 5 to 9, 2021, Geneva, Switzerland

Journal ref: PASC 2021: Proceedings of the Platform for Advanced Scientific Computing Conference

Porting WarpX to GPU-accelerated platforms

Authors: A. Myers, A. Almgren, L. D. Amorim, J. Bell, L. Fedeli, L. Ge, K. Gott, D. P. Grote, M. Hogan, A. Huebl, R. Jambunathan, R. Lehe, C. Ng, M. Rowan, O. Shapoval, M. Thévenet, J. -L. Vay, H. Vincenti, E. Yang, N. Zaïm, W. Zhang, Y. Zhao, E. Zoni

Abstract: WarpX is a general purpose electromagnetic particle-in-cell code that was originally designed to run on many-core CPU architectures. We describe the strategy followed to allow WarpX to use the GPU-accelerated nodes on OLCF's Summit supercomputer, a strategy we believe will extend to the upcoming machines Frontier and Aurora. We summarize the challenges encountered, lessons learned, and give curren… ▽ More WarpX is a general purpose electromagnetic particle-in-cell code that was originally designed to run on many-core CPU architectures. We describe the strategy followed to allow WarpX to use the GPU-accelerated nodes on OLCF's Summit supercomputer, a strategy we believe will extend to the upcoming machines Frontier and Aurora. We summarize the challenges encountered, lessons learned, and give current performance results on a series of relevant benchmark problems. △ Less

Submitted 2 September, 2021; v1 submitted 28 January, 2021; originally announced January 2021.

Comments: 11 pages, 5 figures, accepted by Parallel Computing. Minor revisions, results unchanged

Journal ref: Parallel Computing, Volume 108, 2021, 102833

Femtosecond laser produced periodic plasma in a colloidal crystal probed by XFEL radiation

Authors: Nastasia Mukharamova, Sergey Lazarev, Janne-Mieke Meijer, Oleg Yu. Gorobtsov, Andrej Singer, Matthieu Chollet, Michael Bussmann, Dmitry Dzhigaev, Yi** Feng, Marco Garten, Axel Huebl, Thomas Kluge, Ruslan P. Kurta, Vladimir Lipp, Robin Santra, Marcin Sikorski, Sanghoon Song, Garth Williams, Diling Zhu, Beata Ziaja-Motyka, Thomas Cowan, Andrei V. Petukhov, Ivan A. Vartanyants

Abstract: With the rapid development of short-pulse intense laser sources, studies of matter under extreme irradiation conditions enter further unexplored regimes. In addition, an application of X-ray Free- Electron Lasers (XFELs), delivering intense femtosecond X-ray pulses allows to investigate sample evolution in IR pump - X-ray probe experiments with an unprecedented time resolution. Here we present the… ▽ More With the rapid development of short-pulse intense laser sources, studies of matter under extreme irradiation conditions enter further unexplored regimes. In addition, an application of X-ray Free- Electron Lasers (XFELs), delivering intense femtosecond X-ray pulses allows to investigate sample evolution in IR pump - X-ray probe experiments with an unprecedented time resolution. Here we present the detailed study of periodic plasma created from the colloidal crystal. Both experimental data and theory modeling show that the periodicity in the sample survives to a large extent the extreme excitation and shock wave propagation inside the colloidal crystal. This feature enables probing the excited crystal, using the powerful Bragg peak analysis, in contrast to the conventional studies of dense plasma created from bulk samples for which probing with Bragg diffraction technique is not possible. X-ray diffraction measurements of excited colloidal crystals may then lead towards a better understanding of matter phase transitions under extreme irradiation conditions. △ Less

Submitted 9 November, 2019; originally announced November 2019.

Comments: 52 pages, 22 figures, 64 references

Journal ref: Scientific Reports 10, 10780 (2020)

Spectral Control via Multi-Species Effects in PW-Class Laser-Ion Acceleration

Authors: Axel Huebl, Martin Rehwald, Lieselotte Obst-Huebl, Tim Ziegler, Marco Garten, René Widera, Karl Zeil, Thomas E. Cowan, Michael Bussmann, Ulrich Schramm, Thomas Kluge

Abstract: Laser-ion acceleration with ultra-short pulse, PW-class lasers is dominated by non-thermal, intra-pulse plasma dynamics. The presence of multiple ion species or multiple charge states in targets leads to characteristic modulations and even mono-energetic features, depending on the choice of target material. As spectral signatures of generated ion beams are frequently used to characterize underlyin… ▽ More Laser-ion acceleration with ultra-short pulse, PW-class lasers is dominated by non-thermal, intra-pulse plasma dynamics. The presence of multiple ion species or multiple charge states in targets leads to characteristic modulations and even mono-energetic features, depending on the choice of target material. As spectral signatures of generated ion beams are frequently used to characterize underlying acceleration mechanisms, thermal, multi-fluid descriptions require a revision for predictive capabilities and control in next-generation particle beam sources. We present an analytical model with explicit inter-species interactions, supported by extensive ab initio simulations. This enables us to derive important ensemble properties from the spectral distribution resulting from those multi-species effects for arbitrary mixtures. We further propose a potential experimental implementation with a novel cryogenic target, delivering jets with variable mixtures of hydrogen and deuterium. Free from contaminants and without strong influence of hardly controllable processes such as ionization dynamics, this would allow a systematic realization of our predictions for the multi-species effect. △ Less

Submitted 12 May, 2020; v1 submitted 15 March, 2019; originally announced March 2019.

Comments: 4 pages plus appendix, 11 figures, paper submitted to a journal of the American Physical Society

Journal ref: Plasma Phys. Control. Fusion 62 124003, 2020

Extreme Narrow Escape: shortest paths for the first particles to escape through a small window

Authors: Kanishka Basnayake, Akim Hubl, Zeev Schuss, David Holcman

Abstract: What is the path associated with the fastest Brownian particle that reaches a narrow window located on the boundary of a domain? Although the distribution of the fastest arrival times has been well studied in dimension 1, much less is known in higher dimensions. Based on the Wiener path-integral, we derive a variational principle for the path associated with the fastest arrival particle. Specifica… ▽ More What is the path associated with the fastest Brownian particle that reaches a narrow window located on the boundary of a domain? Although the distribution of the fastest arrival times has been well studied in dimension 1, much less is known in higher dimensions. Based on the Wiener path-integral, we derive a variational principle for the path associated with the fastest arrival particle. Specifically, we show that in a large ensemble of independent Brownian trajectories, the first moment of the shortest arrival time is associated with the minimization of the energy-action and the optimal trajectories are geodesics. Escape trajectories concentrate along these geodesics, as confirmed by stochastic simulations when an obstacle is positioned in front of the narrow window. To conclude paths in stochastic dynamics and their time scale can differ significantly from the mean properties, usually at the basis of the Smoluchowski's theory of chemical reactions. △ Less

Submitted 28 April, 2018; originally announced April 2018.

Comments: After Narrow Escape, Here is Extreme Narrow Escape

MSC Class: 60G40 ACM Class: G.3

Quantitatively consistent computation of coherent and incoherent radiation in particle-in-cell codes - a general form factor formalism for macro-particles

Authors: Richard Pausch, Alexander Debus, Axel Huebl, Ulrich Schramm, Klaus Steiniger, René Widera, Michael Bussmann

Abstract: Quantitative predictions from synthetic radiation diagnostics often have to consider all accelerated particles. For particle-in-cell (PIC) codes, this not only means including all macro-particles but also taking into account the discrete electron distribution associated with them. This paper presents a general form factor formalism that allows to determine the radiation from this discrete electron… ▽ More Quantitative predictions from synthetic radiation diagnostics often have to consider all accelerated particles. For particle-in-cell (PIC) codes, this not only means including all macro-particles but also taking into account the discrete electron distribution associated with them. This paper presents a general form factor formalism that allows to determine the radiation from this discrete electron distribution in order to compute the coherent and incoherent radiation self-consistently. Furthermore, we discuss a memory-efficient implementation that allows PIC simulations with billions of macro-particles. The impact on the radiation spectra is demonstrated on a large scale LWFA simulation. △ Less

Submitted 12 February, 2018; originally announced February 2018.

Comments: Proceedings of the EAAC 2017, This manuscript version is made available under the CC-BY-NC-ND 4.0 license

Efficient proton acceleration from laser-driven cryogenic hydrogen target of various shapes

Authors: A. Sharma, A. Huebl, A. Andreev

Abstract: We theoretically investigate high energy, collimated proton beam with three dimensional particle in cell simulations of ultrashort petawatt laser interaction with cryogenic hydrogen target of various shapes. Here we show that under appropriate conditions between the laser and target parameters, the protons are accelerated to high energies mainly due to collisionless shock acceleration mechanism co… ▽ More We theoretically investigate high energy, collimated proton beam with three dimensional particle in cell simulations of ultrashort petawatt laser interaction with cryogenic hydrogen target of various shapes. Here we show that under appropriate conditions between the laser and target parameters, the protons are accelerated to high energies mainly due to collisionless shock acceleration mechanism combined with TNSA. The dependence of the protonic energy on the laser field, target shape and thickness is reported. It is demonstrated that the irradiation of intense laser (20fs, 2PW) with cryogenic hydrogen target at optimal thickness allows the efficient generation of high energy proton beam (100 MeV) of small divergence. Our results also indicate that diffracted laser field strongly affects the collimation of ions as it passes beside the mass limited target. This approach predicts a possible pathway to control laser driven ion sources. △ Less

Submitted 22 January, 2018; v1 submitted 19 September, 2017; originally announced September 2017.

Comments: arXiv admin note: text overlap with arXiv:1301.4262 by other authors

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective

Authors: Axel Huebl, Rene Widera, Felix Schmitt, Alexander Matthes, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, Michael Bussmann

Abstract: We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today's and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threa… ▽ More We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today's and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threaded data-transformations for the I/O library ADIOS as a feasible way to trade underutilized host-side compute potential on heterogeneous systems for reduced I/O latency. △ Less

Submitted 1 June, 2017; originally announced June 2017.

Comments: 15 pages, 5 figures, accepted for DRBSD-1 in conjunction with ISC'17

ACM Class: D.4.8; B.4.3; I.6.6

Journal ref: J.M. Kunkel et al. (Eds.): ISC High Performance Workshops 2017, LNCS 10524, pp. 15-29, 2017

SIMEX: Simulation of Experiments at Advanced Light Sources

Authors: C Fortmann-Grote, A A Andreev, R Briggs, M Bussmann, A Buzmakov, M Garten, A Grund, A Hübl, S Hauff, A Joy, Z Jurek, N D Loh, T Rüter, L Samoylova, R Santra, E A Schneidmiller, A Sharma, M Wing, S Yakubov, C H Yoon, M V Yurkov, B Ziaja, A P Mancuso

Abstract: Realistic simulations of experiments at large scale photon facilities, such as optical laser laboratories, synchrotrons, and free electron lasers, are of vital importance for the successful preparation, execution, and analysis of these experiments investigating ever more complex physical systems, e.g. biomolecules, complex materials, and ultra-short lived states of highly excited matter. Tradition… ▽ More Realistic simulations of experiments at large scale photon facilities, such as optical laser laboratories, synchrotrons, and free electron lasers, are of vital importance for the successful preparation, execution, and analysis of these experiments investigating ever more complex physical systems, e.g. biomolecules, complex materials, and ultra-short lived states of highly excited matter. Traditional photon science modelling takes into account only isolated aspects of an experiment, such as the beam propagation, the photon-matter interaction, or the scattering process, making idealized assumptions about the remaining parts, e.g.\ the source spectrum, temporal structure and coherence properties of the photon beam, or the detector response. In SIMEX, we have implemented a platform for complete start-to-end simulations, following the radiation from the source, through the beam transport optics to the sample or target under investigation, its interaction with and scattering from the sample, and its registration in a photon detector, including a realistic model of the detector response to the radiation. Data analysis tools can be hooked up to the modelling pipeline easily. This allows researchers and facility operators to simulate their experiments and instruments in real life scenarios, identify promising and unattainable regions of the parameter space and ultimately make better use of valuable beamtime. This work is licensed under the Creative Commons Attribution 3.0 Unported License: http://creativecommons.org/licenses/by/3.0/. △ Less

Submitted 17 November, 2016; v1 submitted 19 October, 2016; originally announced October 2016.

Comments: Presented at the 11th NOBUGS conference, Copenhagen, on Oct. 17th 2016. 7 pages, 3 figures, 29 references

Visualizing the Radiation of the Kelvin-Helmholtz Instability

Authors: Axel Huebl, David Pugmire, Felix Schmitt, Richard Pausch, Michael Bussmann

Abstract: Emerging new technologies in plasma simulations allow tracking billions of particles while computing their radiative spectra. We present a visualization of the relativistic Kelvin-Helmholtz Instability from a simulation performed with the fully relativistic particle-in-cell code PIConGPU powered by 18,000 GPUs on the USA's fastest supercomputer Titan [1]. Emerging new technologies in plasma simulations allow tracking billions of particles while computing their radiative spectra. We present a visualization of the relativistic Kelvin-Helmholtz Instability from a simulation performed with the fully relativistic particle-in-cell code PIConGPU powered by 18,000 GPUs on the USA's fastest supercomputer Titan [1]. △ Less

Submitted 4 April, 2014; originally announced April 2014.

Comments: 2 pages, 1 figure. This paper is submitted to the 7th Triennial Special Issue of the IEEE Transactions on Plasma Science, Images in Plasma Science for possible publication. The IEEE copyright notice applies

MSC Class: 85-08