Showing 1–50 of 57 results for author: Bussmann, M

The importance of temperature-dependent collision frequency in PIC simulation on nanometric density evolution of highly-collisional strongly-coupled dense plasmas

Authors: Mohammadreza Banjafar, Lisa Randolph, Lingen Huang, S. V. Rahul, Thomas R. Preston, Toshinori Yabuuchi, Mikako Makita, Nicholas P. Dover, Sebastian Göde, Akira Kon, James K. Koga, Mamiko Nishiuchi, Michael Paulus, Christian Rödel, Michael Bussmann, Thomas E. Cowan, Christian Gutt, Adrian P. Mancuso, Thomas Kluge, Motoaki Nakatsutsumi

Abstract: Particle-in-Cell (PIC) method is a powerful plasma simulation tool for investigating high-intensity femtosecond laser-matter interaction. However, its simulation capability at high-density plasmas around the Fermi temperature is considered to be inadequate due, among others, to the necessity of implementing atomic-scale collisions. Here, we performed a one-dimensional with three-velocity space (1D… ▽ More Particle-in-Cell (PIC) method is a powerful plasma simulation tool for investigating high-intensity femtosecond laser-matter interaction. However, its simulation capability at high-density plasmas around the Fermi temperature is considered to be inadequate due, among others, to the necessity of implementing atomic-scale collisions. Here, we performed a one-dimensional with three-velocity space (1D3V) PIC simulation that features the realistic collision frequency around the Fermi temperature and atomic-scale cell size. The results are compared with state-of-the-art experimental results as well as with hydrodynamic simulation. We found that the PIC simulation is capable of simulating the nanoscale dynamics of solid-density plasmas around the Fermi temperature up to $\sim$2~ps driven by a laser pulse at the moderate intensity of $10^{14-15}$~$\mathrm{W/cm^{2}}$, by comparing with the state-of-the-art experimental results. The reliability of the simulation can be further improved in the future by implementing multi-dimensional kinetics and radiation transport. △ Less

Submitted 24 April, 2024; originally announced April 2024.

(Sub-)picosecond surface correlations of femtosecond laser excited Al-coated multilayers observed by grazing-incidence x-ray scattering

Authors: Lisa Randolph, Mohammadreza Banjafar, Toshinori Yabuuchi, Carsten Baehtz, Michael Bussmann, Nick P. Dover, Lingen Huang, Yuichi Inubushi, Gerhard Jakob, Mathias Kläui, Dmitriy Ksenzov, Mikako Makita, Kohei Miyanishi, Mamiko Nishiushi, Özgül Öztürk, Michael Paulus, Alexander Pelka, Thomas R. Preston, Jan-Patrick Schwinkendorf, Keiichi Sueda, Tadashi Togashi, Thomas E. Cowan, Thomas Kluge, Christian Gutt, Motoaki Nakatsutsumi

Abstract: Femtosecond high-intensity laser pulses at intensities surpassing $10^{14} \,\text{W}/\text{cm}^2$ can generate a diverse range of functional surface nanostructures. Achieving precise control over the production of these functional structures necessitates a thorough understanding of the surface morphology dynamics with nanometer-scale spatial resolution and picosecond-scale temporal resolution. In… ▽ More Femtosecond high-intensity laser pulses at intensities surpassing $10^{14} \,\text{W}/\text{cm}^2$ can generate a diverse range of functional surface nanostructures. Achieving precise control over the production of these functional structures necessitates a thorough understanding of the surface morphology dynamics with nanometer-scale spatial resolution and picosecond-scale temporal resolution. In this study, we show that individual XFEL pulses can elucidate structural changes on surfaces induced by laser-generated plasmas, employing grazing-incidence small-angle x-ray scattering (GISAXS). Using aluminum-coated multilayer samples we can differentiate between ultrafast surface morphology dynamics and subsequent subsurface density dynamics, achieving nanometer-depth sensitivity and subpicosecond temporal resolution. The observed subsurface density dynamics serve to validate advanced simulation models depicting matter under extreme conditions. Our findings promise to unveil novel avenues for laser material nanoprocessing and high-energy-density science. △ Less

Submitted 26 April, 2024; v1 submitted 23 April, 2024; originally announced April 2024.

Comments: 11 pages, 5 figures. This is the version of the article before peer review

EZ: An Efficient, Charge Conserving Current Deposition Algorithm for Electromagnetic Particle-In-Cell Simulations

Authors: Klaus Steiniger, Rene Widera, Sergei Bastrakov, Michael Bussmann, Sunita Chandrasekaran, Benjamin Hernandez, Kristina Holsapple, Axel Huebl, Guido Juckeland, Jeffrey Kelling, Matt Leinhauser, Richard Pausch, David Rogers, Ulrich Schramm, Jeff Young, Alexander Debus

Abstract: We present EZ, a novel current deposition algorithm for particle-in-cell (PIC) simulations. EZ calculates the current density on the electromagnetic grid due to macro-particle motion within a time step by solving the continuity equation of electrodynamics. Being a charge conserving hybridization of Esirkepov's method and ZigZag, we refer to it as ``EZ'' as shorthand for ``Esirkepov meets ZigZag''.… ▽ More We present EZ, a novel current deposition algorithm for particle-in-cell (PIC) simulations. EZ calculates the current density on the electromagnetic grid due to macro-particle motion within a time step by solving the continuity equation of electrodynamics. Being a charge conserving hybridization of Esirkepov's method and ZigZag, we refer to it as ``EZ'' as shorthand for ``Esirkepov meets ZigZag''. Simulations of a warm, relativistic plasma with PIConGPU show that EZ achieves the same level of charge conservation as the commonly used method by Esirkepov, yet reaches higher performance for macro-particle assignment-functions up to third-order. In addition to a detailed description of the functioning of EZ, reasons for the expected and observed performance increase are given, and guidelines for its implementation aiming at highest performance on GPUs are provided. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Journal ref: Computer Physics Communications 291 (2023) 108849

Live Iterative Ptychography

Authors: Dieter Weber, Simeon Ehrig, Andreas Schropp, Alexander Clausen, Silvio Achilles, Nico Hoffmann, Michael Bussmann, Rafal Dunin-Borkowski, Christian G. Schroer

Abstract: We demonstrate live-updating ptychographic reconstruction with ePIE, an iterative ptychography method, during ongoing data acquisition. The reconstruction starts with a small subset of the total data, and as the acquisition proceeds the data used for reconstruction is extended. This creates a live-updating view of object and illumination that allows monitoring the ongoing experiment and adjusting… ▽ More We demonstrate live-updating ptychographic reconstruction with ePIE, an iterative ptychography method, during ongoing data acquisition. The reconstruction starts with a small subset of the total data, and as the acquisition proceeds the data used for reconstruction is extended. This creates a live-updating view of object and illumination that allows monitoring the ongoing experiment and adjusting parameters with quick turn-around. This is particularly advantageous for long-running acquisitions. We show that such a gradual reconstruction yields interpretable results already with a small subset of the data. We show simulated live processing with various scan patterns, parallelized reconstruction, and real-world live processing at the hard X-ray ptychographic nanoanalytical microscope PtyNAMi at the PETRA III beamline. △ Less

Submitted 5 February, 2024; v1 submitted 21 August, 2023; originally announced August 2023.

Kidnap** Deep Learning-based Multirotors using Optimized Flying Adversarial Patches

Authors: Pia Hanfeld, Khaled Wahba, Marina M. -C. Höhne, Michael Bussmann, Wolfgang Hönig

Abstract: Autonomous flying robots, such as multirotors, often rely on deep learning models that make predictions based on a camera image, e.g. for pose estimation. These models can predict surprising results if applied to input images outside the training domain. This fault can be exploited by adversarial attacks, for example, by computing small images, so-called adversarial patches, that can be placed in… ▽ More Autonomous flying robots, such as multirotors, often rely on deep learning models that make predictions based on a camera image, e.g. for pose estimation. These models can predict surprising results if applied to input images outside the training domain. This fault can be exploited by adversarial attacks, for example, by computing small images, so-called adversarial patches, that can be placed in the environment to manipulate the neural network's prediction. We introduce flying adversarial patches, where multiple images are mounted on at least one other flying robot and therefore can be placed anywhere in the field of view of a victim multirotor. By introducing the attacker robots, the system is extended to an adversarial multi-robot system. For an effective attack, we compare three methods that simultaneously optimize multiple adversarial patches and their position in the input image. We show that our methods scale well with the number of adversarial patches. Moreover, we demonstrate physical flights with two robots, where we employ a novel attack policy that uses the computed adversarial patches to kidnap a robot that was supposed to follow a human. △ Less

Submitted 23 October, 2023; v1 submitted 1 August, 2023; originally announced August 2023.

Comments: Accepted at MRS 2023, 7 pages, 5 figures. arXiv admin note: substantial text overlap with arXiv:2305.12859

Flying Adversarial Patches: Manipulating the Behavior of Deep Learning-based Autonomous Multirotors

Authors: Pia Hanfeld, Marina M. -C. Höhne, Michael Bussmann, Wolfgang Hönig

Abstract: Autonomous flying robots, e.g. multirotors, often rely on a neural network that makes predictions based on a camera image. These deep learning (DL) models can compute surprising results if applied to input images outside the training domain. Adversarial attacks exploit this fault, for example, by computing small images, so-called adversarial patches, that can be placed in the environment to manipu… ▽ More Autonomous flying robots, e.g. multirotors, often rely on a neural network that makes predictions based on a camera image. These deep learning (DL) models can compute surprising results if applied to input images outside the training domain. Adversarial attacks exploit this fault, for example, by computing small images, so-called adversarial patches, that can be placed in the environment to manipulate the neural network's prediction. We introduce flying adversarial patches, where an image is mounted on another flying robot and therefore can be placed anywhere in the field of view of a victim multirotor. For an effective attack, we compare three methods that simultaneously optimize the adversarial patch and its position in the input image. We perform an empirical validation on a publicly available DL model and dataset for autonomous multirotors. Ultimately, our attacking multirotor would be able to gain full control over the motions of the victim multirotor. △ Less

Submitted 31 July, 2023; v1 submitted 22 May, 2023; originally announced May 2023.

Comments: 6 pages, 5 figures, Workshop on Multi-Robot Learning, International Conference on Robotics and Automation (ICRA)

Visualizing Plasmons and Ultrafast Kinetic Instabilities in Laser-Driven Solids using X-ray Scattering

Authors: Paweł Ordyna, Carsten Bähtz, Erik Brambrink, Michael Bussmann, Alejandro Laso Garcia, Marco Garten, Lennart Gaus, Jörg Grenzer, Christian Gutt, Hauke Höppner, Lingen Huang, Oliver Humphries, Brian Edward Marré, Josefine Metzkes-Ng, Motoaki Nakatsutsumi, Özgül Öztürk, Xiayun Pan, Franziska Paschke-Brühl, Alexander Pelka, Irene Prencipe, Lisa Randolph, Hans-Peter Schlenvoigt, Michal Šmíd, Radka Stefanikova, Erik Thiessenhusen , et al. (5 additional authors not shown)

Abstract: Ultra-intense lasers that ionize and accelerate electrons in solids to near the speed of light can lead to kinetic instabilities that alter the laser absorption and subsequent electron transport, isochoric heating, and ion acceleration. These instabilities can be difficult to characterize, but a novel approach using X-ray scattering at keV energies allows for their visualization with femtosecond t… ▽ More Ultra-intense lasers that ionize and accelerate electrons in solids to near the speed of light can lead to kinetic instabilities that alter the laser absorption and subsequent electron transport, isochoric heating, and ion acceleration. These instabilities can be difficult to characterize, but a novel approach using X-ray scattering at keV energies allows for their visualization with femtosecond temporal resolution on the few nanometer mesoscale. Our experiments on laser-driven flat silicon membranes show the development of structure with a dominant scale of $~60\unit{nm}$ in the plane of the laser axis and laser polarization, and $~95\unit{nm}$ in the vertical direction with a growth rate faster than $0.1/\mathrm{fs}$. Combining the XFEL experiments with simulations provides a complete picture of the structural evolution of ultra-fast laser-induced instability development, indicating the excitation of surface plasmons and the growth of a new type of filamentation instability. These findings provide new insight into the ultra-fast instability processes in solids under extreme conditions at the nanometer level with important implications for inertial confinement fusion and laboratory astrophysics. △ Less

Submitted 22 January, 2024; v1 submitted 21 April, 2023; originally announced April 2023.

Learning Electron Bunch Distribution along a FEL Beamline by Normalising Flows

Authors: Anna Willmann, Jurjen Couperus Cabadağ, Yen-Yu Chang, Richard Pausch, Amin Ghaith, Alexander Debus, Arie Irman, Michael Bussmann, Ulrich Schramm, Nico Hoffmann

Abstract: Understanding and control of Laser-driven Free Electron Lasers remain to be difficult problems that require highly intensive experimental and theoretical research. The gap between simulated and experimentally collected data might complicate studies and interpretation of obtained results. In this work we developed a deep learning based surrogate that could help to fill in this gap. We introduce a s… ▽ More Understanding and control of Laser-driven Free Electron Lasers remain to be difficult problems that require highly intensive experimental and theoretical research. The gap between simulated and experimentally collected data might complicate studies and interpretation of obtained results. In this work we developed a deep learning based surrogate that could help to fill in this gap. We introduce a surrogate model based on normalising flows for conditional phase-space representation of electron clouds in a FEL beamline. Achieved results let us discuss further benefits and limitations in exploitability of the models to gain deeper understanding of fundamental processes within a beamline. △ Less

Submitted 27 February, 2023; originally announced March 2023.

Comments: 7 pages, 5 figures

Journal ref: Machine Learning and the Physical Sciences 2022 workshop, NeurIPS

Probing the dynamics of solid density micro-wire targets after ultra-intense laser irradiation using a free-electron laser

Authors: Thomas Kluge, Michael Bussmann, Eric Galtier, Siegfried Glenzer, Jörg Grenzer, Christian Gutt, Nicholas J. Hartley, Lingen Huang, Alejandro Laso Garcia, Hae Ja Lee, Emma E. McBride, Josefine Metzkes-Ng, Motoaki Nakatsutsumi, Inhyuk Nam, Alexander Pelka, Irene Prencipe, Lisa Randolph, Martin Rehwald, Christian Rödel, Melanie Rödel, Toma Toncian, Long Yang, Karl Zeil, Ulrich Schramm, Thomas E. Cowan

Abstract: In this paper, we present an experiment that explores the plasma dynamics of a 7 micron diameter carbon wire after being irradiated with a near-relativistic-intensity short pulse laser. Using an X-ray Free Electron Laser pulse to measure the small angle X-ray scattering signal, we observe that the scattering surface is bent and prone to instability over tens of picoseconds. The dynamics of this pr… ▽ More In this paper, we present an experiment that explores the plasma dynamics of a 7 micron diameter carbon wire after being irradiated with a near-relativistic-intensity short pulse laser. Using an X-ray Free Electron Laser pulse to measure the small angle X-ray scattering signal, we observe that the scattering surface is bent and prone to instability over tens of picoseconds. The dynamics of this process are consistent with the presence of a sharp, propagating shock front inside the wire, moving at a speed close to the hole boring velocity. △ Less

Submitted 6 February, 2023; originally announced February 2023.

Continual learning autoencoder training for a particle-in-cell simulation via streaming

Authors: Patrick Stiller, Varun Makdani, Franz Pöschel, Richard Pausch, Alexander Debus, Michael Bussmann, Nico Hoffmann

Abstract: The upcoming exascale era will provide a new generation of physics simulations. These simulations will have a high spatiotemporal resolution, which will impact the training of machine learning models since storing a high amount of simulation data on disk is nearly impossible. Therefore, we need to rethink the training of machine learning models for simulations for the upcoming exascale era. This w… ▽ More The upcoming exascale era will provide a new generation of physics simulations. These simulations will have a high spatiotemporal resolution, which will impact the training of machine learning models since storing a high amount of simulation data on disk is nearly impossible. Therefore, we need to rethink the training of machine learning models for simulations for the upcoming exascale era. This work presents an approach that trains a neural network concurrently to a running simulation without storing data on a disk. The training pipeline accesses the training data by in-memory streaming. Furthermore, we apply methods from the domain of continual learning to enhance the generalization of the model. We tested our pipeline on the training of a 3d autoencoder trained concurrently to laser wakefield acceleration particle-in-cell simulation. Furthermore, we experimented with various continual learning methods and their effect on the generalization. △ Less

Submitted 9 November, 2022; originally announced November 2022.

Application Experiences on a GPU-Accelerated Arm-based HPC Testbed

Authors: Wael Elwasif, William Godoy, Nick Hagerty, J. Austin Harris, Oscar Hernandez, Balint Joo, Paul Kent, Damien Lebrun-Grandie, Elijah Maccarthy, Veronica G. Melesse Vergara, Bronson Messer, Ross Miller, Sarp Opal, Sergei Bastrakov, Michael Bussmann, Alexander Debus, Klaus Steinger, Jan Stephan, Rene Widera, Spencer H. Bryngelson, Henry Le Berre, Anand Radhakrishnan, Jefferey Young, Sunita Chandrasekaran, Florina Ciorba , et al. (6 additional authors not shown)

Abstract: This paper assesses and reports the experience of ten teams working to port,validate, and benchmark several High Performance Computing applications on a novel GPU-accelerated Arm testbed system. The testbed consists of eight NVIDIA Arm HPC Developer Kit systems built by GIGABYTE, each one equipped with a server-class Arm CPU from Ampere Computing and A100 data center GPU from NVIDIA Corp. The syst… ▽ More This paper assesses and reports the experience of ten teams working to port,validate, and benchmark several High Performance Computing applications on a novel GPU-accelerated Arm testbed system. The testbed consists of eight NVIDIA Arm HPC Developer Kit systems built by GIGABYTE, each one equipped with a server-class Arm CPU from Ampere Computing and A100 data center GPU from NVIDIA Corp. The systems are connected together using Infiniband high-bandwidth low-latency interconnect. The selected applications and mini-apps are written using several programming languages and use multiple accelerator-based programming models for GPUs such as CUDA, OpenACC, and OpenMP offloading. Working on application porting requires a robust and easy-to-access programming environment, including a variety of compilers and optimized scientific libraries. The goal of this work is to evaluate platform readiness and assess the effort required from developers to deploy well-established scientific workloads on current and future generation Arm-based GPU-accelerated HPC systems. The reported case studies demonstrate that the current level of maturity and diversity of software and tools is already adequate for large-scale production deployments. △ Less

Submitted 19 December, 2022; v1 submitted 20 September, 2022; originally announced September 2022.

Challenges Porting a C++ Template-Metaprogramming Abstraction Layer to Directive-based Offloading

Authors: Jeffrey Kelling, Sergei Bastrakov, Alexander Debus, Thomas Kluge, Matt Leinhauser, Richard Pausch, Klaus Steiniger, Jan Stephan, René Widera, Jeff Young, Michael Bussmann, Sunita Chandrasekaran, Guido Juckeland

Abstract: HPC systems employ a growing variety of compute accelerators with different architectures and from different vendors. Large scientific applications are required to run efficiently across these systems but need to retain a single code-base in order to not stifle development. Directive-based offloading programming models set out to provide the required portability, but, to existing codes, they thems… ▽ More HPC systems employ a growing variety of compute accelerators with different architectures and from different vendors. Large scientific applications are required to run efficiently across these systems but need to retain a single code-base in order to not stifle development. Directive-based offloading programming models set out to provide the required portability, but, to existing codes, they themselves represent yet another API to port to. Here, we present our approach of porting the GPU-accelerated particle-in-cell code PIConGPU to OpenACC and OpenMP target by adding two new backends to its existing C++-template metaprogramming-based offloading abstraction layer alpaka and avoiding other modifications to the application code. We introduce our approach in the face of conflicts between requirements and available features in the standards as well as practical hurdles posed by immature compiler support. △ Less

Submitted 24 January, 2022; v1 submitted 16 October, 2021; originally announced October 2021.

Comments: 20 pages, 1 figure, 3 tables, WACCPD@SC21

ACM Class: D.1.3; D.2.1; D.3.3

Metrics and Design of an Instruction Roofline Model for AMD GPUs

Authors: Matthew Leinhauser, René Widera, Sergei Bastrakov, Alexander Debus, Michael Bussmann, Sunita Chandrasekaran

Abstract: Due to the recent announcement of the Frontier supercomputer, many scientific application developers are working to make their applications compatible with AMD architectures (CPU-GPU), which means moving away from the traditional CPU and NVIDIA-GPU systems. Due to the current limitations of profiling tools for AMD GPUs, this shift leaves a void in how to measure application performance on AMD GPUs… ▽ More Due to the recent announcement of the Frontier supercomputer, many scientific application developers are working to make their applications compatible with AMD architectures (CPU-GPU), which means moving away from the traditional CPU and NVIDIA-GPU systems. Due to the current limitations of profiling tools for AMD GPUs, this shift leaves a void in how to measure application performance on AMD GPUs. In this paper, we design an instruction roofline model for AMD GPUs using AMD's ROCProfiler and a benchmarking tool, BabelStream (the HIP implementation), as a way to measure an application's performance in instructions and memory transactions on new AMD hardware. Specifically, we create instruction roofline models for a case study scientific application, PIConGPU, an open source particle-in-cell (PIC) simulations application used for plasma and laser-plasma physics on the NVIDIA V100, AMD Radeon Instinct MI60, and AMD Instinct MI100 GPUs. When looking at the performance of multiple kernels of interest in PIConGPU we find that although the AMD MI100 GPU achieves a similar, or better, execution time compared to the NVIDIA V100 GPU, profiling tool differences make comparing performance of these two architectures hard. When looking at execution time, GIPS, and instruction intensity, the AMD MI60 achieves the worst performance out of the three GPUs used in this work. △ Less

Submitted 10 November, 2021; v1 submitted 15 October, 2021; originally announced October 2021.

Comments: 14 pages, 7 figures, 2 tables, 4 equations, explains how to create an instruction roofline model for an AMD GPU as of Oct. 2021

Optimized laser ion acceleration at the relativistic critical density surface

Authors: Ilja Göthel, Constantin Bernert, Michael Bussmann, Marco Garten, Thomas Miethlinger, Martin Rehwald, Karl Zeil, Tim Ziegler, Thomas E. Cowan, Ulrich Schramm, Thomas Kluge

Abstract: In the effort of achieving high-energetic ion beams from the interaction of ultrashort laser pulses with a plasma, volumetric acceleration mechanisms beyond Target Normal Sheath Acceleration have gained attention. A relativisticly intense laser can turn a near critical density plasma slowly transparent, facilitating a synchronized acceleration of ions at the moving relativistic critical density fr… ▽ More In the effort of achieving high-energetic ion beams from the interaction of ultrashort laser pulses with a plasma, volumetric acceleration mechanisms beyond Target Normal Sheath Acceleration have gained attention. A relativisticly intense laser can turn a near critical density plasma slowly transparent, facilitating a synchronized acceleration of ions at the moving relativistic critical density front. While simulations promise extremely high ion energies in in this regime, the challenge resides in the realization of a synchronized movement of the ultra-relativistic laser pulse ($a_0\gtrsim 30$) driven reflective relativistic electron front and the fastest ions, which imposes a narrow parameter range on the laser and plasma parameters. We present an analytic model for the relevant processes, confirmed by a broad parameter simulation study in 1D- and 3D-geometry. By tayloring the pulse length plasma density profile at the front side, we can optimize the proton acceleration performance and extend the regions in parameter space of efficient ion acceleration at the relativistic relativistic density surface. △ Less

Submitted 24 January, 2022; v1 submitted 4 October, 2021; originally announced October 2021.

A Deep Dive into Machine Learning Density Functional Theory for Materials Science and Chemistry

Authors: Lenz Fiedler, Karan Shah, Michael Bussmann, Attila Cangi

Abstract: With the growth of computational resources, the scope of electronic structure simulations has increased greatly. Artificial intelligence and robust data analysis hold the promise to accelerate large-scale simulations and their analysis to hitherto unattainable scales. Machine learning is a rapidly growing field for the processing of such complex datasets. It has recently gained traction in the dom… ▽ More With the growth of computational resources, the scope of electronic structure simulations has increased greatly. Artificial intelligence and robust data analysis hold the promise to accelerate large-scale simulations and their analysis to hitherto unattainable scales. Machine learning is a rapidly growing field for the processing of such complex datasets. It has recently gained traction in the domain of electronic structure simulations, where density functional theory takes the prominent role of the most widely used electronic structure method. Thus, DFT calculations represent one of the largest loads on academic high-performance computing systems across the world. Accelerating these with machine learning can reduce the resources required and enables simulations of larger systems. Hence, the combination of density functional theory and machine learning has the potential to rapidly advance electronic structure applications such as in-silico materials discovery and the search for new chemical reaction pathways. We provide the theoretical background of both density functional theory and machine learning on a generally accessible level. This serves as the basis of our comprehensive review including research articles up to December 2020 in chemistry and materials science that employ machine-learning techniques. In our analysis, we categorize the body of research into main threads and extract impactful results. We conclude our review with an outlook on exciting research directions in terms of a citation analysis. △ Less

Submitted 25 February, 2022; v1 submitted 3 October, 2021; originally announced October 2021.

A Deep Learning Algorithm for Piecewise Linear Interface Construction (PLIC)

Authors: Mohammadmehdi Ataei, Erfan Pirmorad, Franco Costa, Se** Han, Chul B Park, Markus Bussmann

Abstract: Piecewise Linear Interface Construction (PLIC) is frequently used to geometrically reconstruct fluid interfaces in Computational Fluid Dynamics (CFD) modeling of two-phase flows. PLIC reconstructs interfaces from a scalar field that represents the volume fraction of each phase in each computational cell. Given the volume fraction and interface normal, the location of a linear interface is uniquely… ▽ More Piecewise Linear Interface Construction (PLIC) is frequently used to geometrically reconstruct fluid interfaces in Computational Fluid Dynamics (CFD) modeling of two-phase flows. PLIC reconstructs interfaces from a scalar field that represents the volume fraction of each phase in each computational cell. Given the volume fraction and interface normal, the location of a linear interface is uniquely defined. For a cubic computational cell (3D), the position of the planar interface is determined by intersecting the cube with a plane, such that the volume of the resulting truncated polyhedron cell is equal to the volume fraction. Yet it is geometrically complex to find the exact position of the plane, and it involves calculations that can be a computational bottleneck of many CFD models. However, while the forward problem of 3D PLIC is challenging, the inverse problem, of finding the volume of the truncated polyhedron cell given a defined plane, is simple. In this work, we propose a deep learning model for the solution to the forward problem of PLIC by only making use of its inverse problem. The proposed model is up to several orders of magnitude faster than traditional schemes, which significantly reduces the computational bottleneck of PLIC in CFD simulations. △ Less

Submitted 27 July, 2021; originally announced July 2021.

MSC Class: 65Dxx

Transitioning from file-based HPC workflows to streaming data pipelines with openPMD and ADIOS2

Authors: Franz Poeschel, Juncheng E, William F. Godoy, Norbert Podhorszki, Scott Klasky, Greg Eisenhauer, Philip E. Davis, Lipeng Wan, Ana Gainaru, Junmin Gu, Fabian Koller, René Widera, Michael Bussmann, Axel Huebl

Abstract: This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mes… ▽ More This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks. △ Less

Submitted 19 January, 2022; v1 submitted 13 July, 2021; originally announced July 2021.

Comments: 18 pages, 9 figures, SMC2021, supplementary material at https://zenodo.org/record/4906276

InFlow: Robust outlier detection utilizing Normalizing Flows

Authors: Nishant Kumar, Pia Hanfeld, Michael Hecht, Michael Bussmann, Stefan Gumhold, Nico Hoffmann

Abstract: Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly encode the local features of the input representations in their latent space. In this paper, we solve this overconfidence issue of normalizing flows by demonst… ▽ More Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly encode the local features of the input representations in their latent space. In this paper, we solve this overconfidence issue of normalizing flows by demonstrating that flows, if extended by an attention mechanism, can reliably detect outliers including adversarial attacks. Our approach does not require outlier data for training and we showcase the efficiency of our method for OOD detection by reporting state-of-the-art performance in diverse experimental settings. Code available at https://github.com/ComputationalRadiationPhysics/InFlow . △ Less

Submitted 16 November, 2021; v1 submitted 10 June, 2021; originally announced June 2021.

LLAMA: The Low-Level Abstraction For Memory Access

Authors: Bernhard Manfred Gruber, Guilherme Amadio, Jakob Blomer, Alexander Matthes, René Widera, Michael Bussmann

Abstract: The performance gap between CPU and memory widens continuously. Choosing the best memory layout for each hardware architecture is increasingly important as more and more programs become memory bound. For portable codes that run across heterogeneous hardware architectures, the choice of the memory layout for data structures is ideally decoupled from the rest of a program. This can be accomplished v… ▽ More The performance gap between CPU and memory widens continuously. Choosing the best memory layout for each hardware architecture is increasingly important as more and more programs become memory bound. For portable codes that run across heterogeneous hardware architectures, the choice of the memory layout for data structures is ideally decoupled from the rest of a program. This can be accomplished via a zero-runtime-overhead abstraction layer, underneath which memory layouts can be freely exchanged. We present the Low-Level Abstraction of Memory Access (LLAMA), a C++ library that provides such a data structure abstraction layer with example implementations for multidimensional arrays of nested, structured data. LLAMA provides fully C++ compliant methods for defining and switching custom memory layouts for user-defined data types. The library is extensible with third-party allocators. Providing two close-to-life examples, we show that the LLAMA-generated AoS (Array of Structs) and SoA (Struct of Arrays) layouts produce identical code with the same performance characteristics as manually written data structures. Integrations into the SPEC CPU\textsuperscript{\textregistered} lbm benchmark and the particle-in-cell simulation PIConGPU demonstrate LLAMA's abilities in real-world applications. LLAMA's layout-aware copy routines can significantly speed up transfer and reshuffling of data between layouts compared with naive element-wise copying. LLAMA provides a novel tool for the development of high-performance C++ applications in a heterogeneous environment. △ Less

Submitted 9 March, 2022; v1 submitted 8 June, 2021; originally announced June 2021.

Comments: 39 pages, 10 figures, 11 listings

Journal ref: Softw Pract Exper. 2022; 1- 27

Invertible Surrogate Models: Joint surrogate modelling and reconstruction of Laser-Wakefield Acceleration by invertible neural networks

Authors: Friedrich Bethke, Richard Pausch, Patrick Stiller, Alexander Debus, Michael Bussmann, Nico Hoffmann

Abstract: Invertible neural networks are a recent technique in machine learning promising neural network architectures that can be run in forward and reverse mode. In this paper, we will be introducing invertible surrogate models that approximate complex forward simulation of the physics involved in laser plasma accelerators: iLWFA. The bijective design of the surrogate model also provides all means for rec… ▽ More Invertible neural networks are a recent technique in machine learning promising neural network architectures that can be run in forward and reverse mode. In this paper, we will be introducing invertible surrogate models that approximate complex forward simulation of the physics involved in laser plasma accelerators: iLWFA. The bijective design of the surrogate model also provides all means for reconstruction of experimentally acquired diagnostics. The quality of our invertible laser wakefield acceleration network will be verified on a large set of numerical LWFA simulations. △ Less

Submitted 1 June, 2021; originally announced June 2021.

Data-Driven Shadowgraph Simulation of a 3D Object

Authors: Anna Willmann, Patrick Stiller, Alexander Debus, Arie Irman, Richard Pausch, Yen-Yu Chang, Michael Bussmann, Nico Hoffmann

Abstract: In this work we propose a deep neural network based surrogate model for a plasma shadowgraph - a technique for visualization of perturbations in a transparent medium. We are substituting the numerical code by a computationally cheaper projection based surrogate model that is able to approximate the electric fields at a given time without computing all preceding electric fields as required by numer… ▽ More In this work we propose a deep neural network based surrogate model for a plasma shadowgraph - a technique for visualization of perturbations in a transparent medium. We are substituting the numerical code by a computationally cheaper projection based surrogate model that is able to approximate the electric fields at a given time without computing all preceding electric fields as required by numerical methods. This means that the projection based surrogate model allows to recover the solution of the governing 3D partial differential equation, 3D wave equation, at any point of a given compute domain and configuration without the need to run a full simulation. This model has shown a good quality of reconstruction in a problem of interpolation of data within a narrow range of simulation parameters and can be used for input data of large size. △ Less

Submitted 1 June, 2021; originally announced June 2021.

Comments: 9 pages, 9 figures. Published as a workshop paper at ICLR 2021 SimDL Workshop

Multi-octave high-dynamic range optical spectrometer for single-pulse diagnostic applications

Authors: Omid Zarini, Jurjen Couperus Cabadağ, Yen-Yu Chang, Alexander Köhler, Thomas Kurz, Susanne Schöbel, Wolfgang Seidel, Michael Bussmann, Ulrich Schramm, Alexander Debus

Abstract: We present design and realization of an ultra-broadband optical spectrometer capable of measuring the spectral intensity of multi-octave-spanning light sources on a single-pulse basis with a dynamic range of up to 8 orders of magnitude. The instrument is optimized for the characterization of the temporal structure of femtosecond long electron bunches by analyzing the emitted coherent transition ra… ▽ More We present design and realization of an ultra-broadband optical spectrometer capable of measuring the spectral intensity of multi-octave-spanning light sources on a single-pulse basis with a dynamic range of up to 8 orders of magnitude. The instrument is optimized for the characterization of the temporal structure of femtosecond long electron bunches by analyzing the emitted coherent transition radiation (CTR) spectra. The spectrometer operates within the spectral range of 250nm to 11.35$μ$m, corresponding to 5.5 optical octaves. This is achieved by dividing the signal beam into three spectral groups, each analyzed by a dedicated spectrometer and detector unit. The complete instrument was characterized with regard to wavelength, relative spectral sensitivity, and absolute photo-metric sensitivity, always accounting for the light polarization and comparing different calibration methods. Finally, the capability of the spectrometer is demonstrated with a CTR measurement of a laser wakefield accelerated electron bunch, enabling to determine temporal pulse structures at unprecedented resolution. △ Less

Submitted 17 April, 2021; originally announced April 2021.

Nanoscale subsurface dynamics of solids upon high-intensity laser irradiation observed by femtosecond grazing-incidence x-ray scattering

Authors: Lisa Randolph, Mohammadreza Banjafar, Thomas R. Preston, Toshinori Yabuuchi, Mikako Makita, Nicholas P. Dover, Christian Rödel, Sebastian Göde, Yuichi Inubushi, Gerhard Jakob, Johannes Kaa, Akira Kon, James K. Koga, Dmitriy Ksenzov, Takeshi Matsuoka, Mamiko Nishiuchi, Michael Paulus, Frederic Schon, Keiichi Sueda, Yasuhiko Sentoku, Tadashi Togashi, Mehran Vafaee-Khanjani, Michael Bussmann, Thomas E. Cowan, Mathias Kläui , et al. (6 additional authors not shown)

Abstract: Observing ultrafast laser-induced structural changes in nanoscale systems is essential for understanding the dynamics of intense light-matter interactions. For laser intensities on the order of $10^{14} \, \rm W/cm^2$, highly-collisional plasmas are generated at and below the surface. Subsequent transport processes such as heat conduction, electron-ion thermalization, surface ablation and resolidi… ▽ More Observing ultrafast laser-induced structural changes in nanoscale systems is essential for understanding the dynamics of intense light-matter interactions. For laser intensities on the order of $10^{14} \, \rm W/cm^2$, highly-collisional plasmas are generated at and below the surface. Subsequent transport processes such as heat conduction, electron-ion thermalization, surface ablation and resolidification occur at picosecond and nanosecond time scales. Imaging methods, e.g. using x-ray free-electron lasers (XFEL), were hitherto unable to measure the depth-resolved subsurface dynamics of laser-solid interactions with appropriate temporal and spatial resolution. Here we demonstrate picosecond grazing-incidence small-angle x-ray scattering (GISAXS) from laser-produced plasmas using XFEL pulses. Using multi-layer (ML) samples, both the surface ablation and subsurface density dynamics are measured with nanometer depth resolution. Our experimental data challenges the state-of-the-art modeling of matter under extreme conditions and opens new perspectives for laser material processing and high-energy-density science. △ Less

Submitted 8 October, 2021; v1 submitted 30 December, 2020; originally announced December 2020.

Comments: 16 pages, 4 figures. This is the version of the article before peer review, as submitted by authors. There is a Supplementary Information file in the Ancillary files directory

Probing ultrafast laser plasma processes inside solids with resonant small-angle X-ray scattering

Authors: Lennart Gaus, Lothar Bischoff, Michael Bussmann, Eric Cunningham, Chandra B. Curry, Eric Galtier, Maxence Gauthier, Alejandro Laso García, Marco Garten, Siegfried Glenzer, Jörg Grenzer, Christian Gutt, Nicholas J. Hartley, Lingen Huang, Uwe Hübner, Dominik Kraus, Hae Ja Lee, Emma E. McBride, Josefine Metzkes-Ng, Bob Nagler, Motoaki Nakatsutsumi, Jan Nikl, Masato Ota, Alexander Pelka, Irene Prencipe , et al. (11 additional authors not shown)

Abstract: Extreme states of matter exist throughout the universe e.g. inside planetary cores, stars or astrophysical jets. Such conditions are generated in the laboratory in the interaction of powerful lasers with solids, and their evolution can be probed with femtosecond precision using ultra-short X-ray pulses to study laboratory astrophysics, laser-fusion research or compact particle acceleration. X-ray… ▽ More Extreme states of matter exist throughout the universe e.g. inside planetary cores, stars or astrophysical jets. Such conditions are generated in the laboratory in the interaction of powerful lasers with solids, and their evolution can be probed with femtosecond precision using ultra-short X-ray pulses to study laboratory astrophysics, laser-fusion research or compact particle acceleration. X-ray scattering (SAXS) patterns and their asymmetries occurring at X-ray energies of atomic bound-bound transitions contain information on the volumetric nanoscopic distribution of density, ionization and temperature. Buried heavy ion structures in high intensity laser irradiated solids expand on the nanometer scale following heat diffusion, and are heated to more than 2 million Kelvin. These experiments demonstrate resonant SAXS with the aim to better characterize dynamic processes in extreme laboratory plasmas. △ Less

Submitted 14 December, 2020; originally announced December 2020.

On the observability of field-assisted birefringent Delbrück scattering

Authors: N. Ahmadiniaz, M. Bussmann, T. E. Cowan, A. Debus, T. Kluge, R. Schützhold

Abstract: We consider the scattering of an x-ray free-electron laser (XFEL) beam on the superposition of a strong magnetic field $\bf{B}_{\rm ext}$ with the Coulomb field $\bf{E}_{\rm ext}$ of a nucleus with charge number $Z$. In contrast to pure Delbrück scattering (Coulomb field only), the magnetic field $\bf{B}_{\rm ext}$ introduces an asymmetry (i.e., polarization dependence) and renders the effective i… ▽ More We consider the scattering of an x-ray free-electron laser (XFEL) beam on the superposition of a strong magnetic field $\bf{B}_{\rm ext}$ with the Coulomb field $\bf{E}_{\rm ext}$ of a nucleus with charge number $Z$. In contrast to pure Delbrück scattering (Coulomb field only), the magnetic field $\bf{B}_{\rm ext}$ introduces an asymmetry (i.e., polarization dependence) and renders the effective interaction volume quite large, while the nuclear Coulomb field facilitates a significant momentum transfer $Δ\bf k$. For a field strength of $B_{\rm ext}=10^6~\rm T$ (corresponding to an intensity of order $10^{22}~\rm W/cm^2$) and an XFEL frequency of 24 keV, we find a differential cross section $dσ/dΩ\sim10^{-25}~Z^2/(Δ{\bf k})^2$ in forward direction for one nucleus. Thus, this effect might be observable in the near future at facilities such as the Helmholtz International Beamline for Extreme Fields (HIBEF) at the European XFEL. △ Less

Submitted 3 December, 2020; originally announced December 2020.

Comments: 10 pages, 4 figures

Journal ref: Phys. Rev. D 104, 011902 (2021)

Laser spectroscopy of the $^2S_{1/2} - ^2P_{1/2}$, $^2P_{3/2}$ transitions in stored and cooled relativistic C$^{3+}$ ions

Authors: D. Winzen, V. Hannen, M. Bussmann, A. Buß, C. Egelkamp, L. Eidam, Z. Huang, D. Kiefer, S. Klammes, T. Kühl, M. Loeser, X. Ma, W. Nörtershäuser, H. -W. Ortjohann, R. Sánchez, M. Siebold, T. Stöhlker, J. Ullmann, J. Vollbrecht, T. Walther, H. Wang, C. Weinheimer, D. F. A. Winters

Abstract: The $^2S_{1/2} - ^2P_{1/2}$ and $^2S_{1/2} - ^2P_{3/2}$ transitions in Li-like carbon ions stored and cooled at a velocity of $β\approx 0.47$ in the Experimental Storage Ring (ESR) at the GSI Helmholtz Centre in Darmstadt have been investigated in a laser spectroscopy experiment. Resonance wavelengths were obtained using a new continuous-wave UV laser system and a novel extreme UV (XUV) detection… ▽ More The $^2S_{1/2} - ^2P_{1/2}$ and $^2S_{1/2} - ^2P_{3/2}$ transitions in Li-like carbon ions stored and cooled at a velocity of $β\approx 0.47$ in the Experimental Storage Ring (ESR) at the GSI Helmholtz Centre in Darmstadt have been investigated in a laser spectroscopy experiment. Resonance wavelengths were obtained using a new continuous-wave UV laser system and a novel extreme UV (XUV) detection system to detect forward emitted fluorescence photons. The results obtained for the two transitions are compared to existing experimental and theoretical data. A discrepancy found in an earlier laser spectroscopy measurement at the ESR with results from plasma spectroscopy and interferometry has been resolved and agreement between experiment and theory is confirmed. △ Less

Submitted 6 May, 2021; v1 submitted 27 October, 2020; originally announced October 2020.

Comments: 12 pages, 6 figures

Journal ref: Scientific Reports 11 (2021) 9370

Large-scale Neural Solvers for Partial Differential Equations

Authors: Patrick Stiller, Friedrich Bethke, Maximilian Böhme, Richard Pausch, Sunna Torge, Alexander Debus, Jan Vorberger, Michael Bussmann, Nico Hoffmann

Abstract: Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation as well as sophisticated, tailored code for distributed computing. Scanning the parameters of the underlying model significantly increases the runtime as the s… ▽ More Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation as well as sophisticated, tailored code for distributed computing. Scanning the parameters of the underlying model significantly increases the runtime as the simulations have to be cold-started for each parameter configuration. Machine Learning based surrogate models denote promising ways for learning complex relationship among input, parameter and solution. However, recent generative neural networks require lots of training data, i.e. full simulation runs making them costly. In contrast, we examine the applicability of continuous, mesh-free neural solvers for partial differential equations, physics-informed neural networks (PINNs) solely requiring initial/boundary values and validation points for training but no simulation data. The induced curse of dimensionality is approached by learning a domain decomposition that steers the number of neurons per unit volume and significantly improves runtime. Distributed training on large-scale cluster systems also promises great utilization of large quantities of GPUs which we assess by a comprehensive evaluation study. Finally, we discuss the accuracy of GatedPINN with respect to analytical solutions -- as well as state-of-the-art numerical solvers, such as spectral solvers. △ Less

Submitted 8 September, 2020; originally announced September 2020.

NPLIC: A Machine Learning Approach to Piecewise Linear Interface Construction

Authors: Mohammadmehdi Ataei, Markus Bussmann, Vahid Shaayegan, Franco Costa, Se** Han, Chul B. Park

Abstract: Volume of fluid (VOF) methods are extensively used to track fluid interfaces in numerical simulations, and many VOF algorithms require that the interface be reconstructed geometrically. For this purpose, the Piecewise Linear Interface Construction (PLIC) technique is most frequently used, which for reasons of geometric complexity can be slow and difficult to implement. Here, we propose an alternat… ▽ More Volume of fluid (VOF) methods are extensively used to track fluid interfaces in numerical simulations, and many VOF algorithms require that the interface be reconstructed geometrically. For this purpose, the Piecewise Linear Interface Construction (PLIC) technique is most frequently used, which for reasons of geometric complexity can be slow and difficult to implement. Here, we propose an alternative neural network based method called NPLIC to perform PLIC calculations. The model is trained on a large synthetic dataset of PLIC solutions for square, cubic, triangular, and tetrahedral meshes. We show that this data-driven approach results in accurate calculations at a fraction of the usual computational cost, and a single neural network system can be used for interface reconstruction of different mesh types. △ Less

Submitted 24 January, 2021; v1 submitted 26 June, 2020; originally announced July 2020.

ACM Class: I.2; I.3; G.0

Broadband holography-assisted coherent imaging -- towards attosecond imaging at the nanoscale

Authors: Wilhelm Eschen, Sici Wang, Chang Liu, Michael Steinert, Sergiy Yulin, Heide Meissner, Michael Bussmann, Thomas Pertsch, Jens Limpert, Jan Rothhardt

Abstract: In recent years nanoscale coherent imaging has emerged as an indispensable imaging modality allowing to surpass the resolution limit given by classical imaging optics. At the same time, attosecond science has experienced enormous progress and has revealed the ultrafast dynamics in atoms, molecules, and complex materials. Combining attosecond temporal resolution of pump-probe experiments with nanom… ▽ More In recent years nanoscale coherent imaging has emerged as an indispensable imaging modality allowing to surpass the resolution limit given by classical imaging optics. At the same time, attosecond science has experienced enormous progress and has revealed the ultrafast dynamics in atoms, molecules, and complex materials. Combining attosecond temporal resolution of pump-probe experiments with nanometer spatial resolution would allow studying ultrafast dynamics on the smallest spatio-temporal scales but has not been demonstrated yet. Unfortunately, the large bandwidth of attosecond pulses usually hinders high-resolution coherent imaging. Here we present a robust holography-enhanced coherent imaging method, which allows combining high quality and high spatial resolution coherent imaging with a large spectral bandwidth. By implementing our method at a high harmonic source we demonstrate, for the first time, a spatial resolution of 34 nm (2.5 λ) in combination with a spectral bandwidth supporting a Fourier limited pulse duration of only 380 as. The method is single-shot capable, additionally retrieves the spectrum from the measured diffraction pattern, and is thus immune against shot-to-shot fluctuations. This paves the way for an ultrafast view on nanoscale dynamics e.g. ultrafast charge transfer or ultrafast spin currents being relevant for Petahertz electronics and future data storage. △ Less

Submitted 2 December, 2020; v1 submitted 25 June, 2020; originally announced June 2020.

Femtosecond laser produced periodic plasma in a colloidal crystal probed by XFEL radiation

Authors: Nastasia Mukharamova, Sergey Lazarev, Janne-Mieke Meijer, Oleg Yu. Gorobtsov, Andrej Singer, Matthieu Chollet, Michael Bussmann, Dmitry Dzhigaev, Yi** Feng, Marco Garten, Axel Huebl, Thomas Kluge, Ruslan P. Kurta, Vladimir Lipp, Robin Santra, Marcin Sikorski, Sanghoon Song, Garth Williams, Diling Zhu, Beata Ziaja-Motyka, Thomas Cowan, Andrei V. Petukhov, Ivan A. Vartanyants

Abstract: With the rapid development of short-pulse intense laser sources, studies of matter under extreme irradiation conditions enter further unexplored regimes. In addition, an application of X-ray Free- Electron Lasers (XFELs), delivering intense femtosecond X-ray pulses allows to investigate sample evolution in IR pump - X-ray probe experiments with an unprecedented time resolution. Here we present the… ▽ More With the rapid development of short-pulse intense laser sources, studies of matter under extreme irradiation conditions enter further unexplored regimes. In addition, an application of X-ray Free- Electron Lasers (XFELs), delivering intense femtosecond X-ray pulses allows to investigate sample evolution in IR pump - X-ray probe experiments with an unprecedented time resolution. Here we present the detailed study of periodic plasma created from the colloidal crystal. Both experimental data and theory modeling show that the periodicity in the sample survives to a large extent the extreme excitation and shock wave propagation inside the colloidal crystal. This feature enables probing the excited crystal, using the powerful Bragg peak analysis, in contrast to the conventional studies of dense plasma created from bulk samples for which probing with Bragg diffraction technique is not possible. X-ray diffraction measurements of excited colloidal crystals may then lead towards a better understanding of matter phase transitions under extreme irradiation conditions. △ Less

Submitted 9 November, 2019; originally announced November 2019.

Comments: 52 pages, 22 figures, 64 references

Journal ref: Scientific Reports 10, 10780 (2020)

Demonstration of a compact plasma accelerator powered by laser-accelerated electron beams

Authors: T. Kurz, T. Heinemann, M. F. Gilljohann, Y. Y. Chang, J. P. Couperus Cabadağ, A. Debus, O. Kononenko, R. Pausch, S. Schöbel, R. W. Assmann, M. Bussmann, H. Ding, J. Götzfried, A. Köhler, G. Raj, S. Schindler, K. Steiniger, O. Zarini, S. Corde, A. Döpp, B. Hidding, S. Karsch, U. Schramm, A. Martinez de la Ossa, A. Irman

Abstract: Plasma wakefield accelerators are capable of sustaining gigavolt-per-centimeter accelerating fields, surpassing the electric breakdown threshold in state-of-the-art accelerator modules by 3-4 orders of magnitude. Beam-driven wakefields offer particularly attractive conditions for the generation and acceleration of high-quality beams. However, this scheme relies on kilometer-scale accelerators. Her… ▽ More Plasma wakefield accelerators are capable of sustaining gigavolt-per-centimeter accelerating fields, surpassing the electric breakdown threshold in state-of-the-art accelerator modules by 3-4 orders of magnitude. Beam-driven wakefields offer particularly attractive conditions for the generation and acceleration of high-quality beams. However, this scheme relies on kilometer-scale accelerators. Here, we report on the demonstration of a millimeter-scale plasma accelerator powered by laser-accelerated electron beams. We showcase the acceleration of electron beams to 130 MeV, consistent with simulations exhibiting accelerating gradients exceeding 100 GV/m. This miniaturized accelerator is further explored by employing a controlled pair of drive and witness electron bunches, where a fraction of the driver energy is transferred to the accelerated witness through the plasma. Such a hybrid approach allows fundamental studies of beam-driven plasma accelerator concepts at widely accessible high-power laser facilities. It is anticipated to provide compact sources of energetic high-brightness electron beams for quality-demanding applications such as free-electron lasers. △ Less

Submitted 14 September, 2019; originally announced September 2019.

LBfoam: An open-source software package for the simulation of foaming using the Lattice Boltzmann Method

Authors: Mohammadmehdi Ataei, Vahid Shaayegan, Franco Costa, Se** Han, Chul B. Park, Markus Bussmann

Abstract: This paper presents a 2D/3D Free Surface Lattice Boltzmann Method simulation package called LBfoam for the simulation of foaming processes. The model incorporates the essential physics of foaming phenomena: gas diffusion into nucleated bubbles, bubble dynamics and coalescence, surface tension, the stabilizing disjoining pressure between bubbles, and Newtonian and non-Newtonian rheological models.… ▽ More This paper presents a 2D/3D Free Surface Lattice Boltzmann Method simulation package called LBfoam for the simulation of foaming processes. The model incorporates the essential physics of foaming phenomena: gas diffusion into nucleated bubbles, bubble dynamics and coalescence, surface tension, the stabilizing disjoining pressure between bubbles, and Newtonian and non-Newtonian rheological models. The software can simulate the growth and interaction of bubbles, and predict final foam structures. The implementation is based on the Palabos library (in C++), which enables large-scale parallel simulations. The software is freely available under the GNU Affero General Public License version 3 at: https://github.com/mehdiataei/LBfoam △ Less

Submitted 19 May, 2020; v1 submitted 8 August, 2019; originally announced August 2019.

Comments: 33 pages, 17 figures

MSC Class: 65-04

Journal ref: Computer Physics Communications 259 (2021) 107698

Pore-scale direct numerical simulation of Haines jumps in a porous media model

Authors: Adam O'Brien, Shahriar Afkhami, Markus Bussmann

Abstract: Direct numerical simulations are presented for a porous media model consisting of two immiscible fluids, an invading and defending phase, in a two-dimensional micro-geometry filled with randomly sized and randomly distributed cylinders. First, interface instability and penetration modes are studied when varying the wetting features of a single pore in the porous medium. It is found that the displa… ▽ More Direct numerical simulations are presented for a porous media model consisting of two immiscible fluids, an invading and defending phase, in a two-dimensional micro-geometry filled with randomly sized and randomly distributed cylinders. First, interface instability and penetration modes are studied when varying the wetting features of a single pore in the porous medium. It is found that the displacement patterns not only change with the capillary number, as previously observed, but also are a function of the contact angle, even for a viscosity ratio of unity. This is an important conclusion suggesting that capillary number and viscosity ratio alone cannot completely describe the pore-scale displacement. Second, rapid pore-scale displacement is considered, where the displacements are accompanied by sudden interface jumps from one site to another, known as Haines jumps. The characteristic time and length scales of a Haines jump are examined to better understand the transient dynamics of the jump. We then focus on analyzing the Haines jump in a simple pore configuration where cylinders of equal size are placed at the vertices of equilateral triangles. We use this geometry to provide more insight into the effect of the contact angle at which the Haines jump is predicted. △ Less

Submitted 13 May, 2020; v1 submitted 17 May, 2019; originally announced May 2019.

Restoring betatron phase coherence in a beam-loaded laser-wakefield accelerator

Authors: A. Köhler, R. Pausch, M. Bussmann, J. P. Couperus Cabadağ, A. Debus, J. M. Krämer, S. Schöbel, O. Zarini, U. Schramm, A. Irman

Abstract: Matched beam loading in laser wakefield acceleration (LWFA), characterizing the state of flattening of the acceleration electric field along the bunch, leads to the minimization of energy spread at high bunch charges. Here, we demonstrate by independently controlling injected charge and acceleration gradients, using the self-truncated ionization injection scheme, that minimal energy spread coincid… ▽ More Matched beam loading in laser wakefield acceleration (LWFA), characterizing the state of flattening of the acceleration electric field along the bunch, leads to the minimization of energy spread at high bunch charges. Here, we demonstrate by independently controlling injected charge and acceleration gradients, using the self-truncated ionization injection scheme, that minimal energy spread coincides with a reduction of the normalized beam divergence. With the simultaneous confirmation of a constant beam radius at the plasma exit, deduced from betatron radiation spectroscopy, we attribute this effect to the reduction of chromatic betatron decoherence. Thus, beam loaded LWFA enables highest longitudinal and transverse phase space densities. △ Less

Submitted 9 June, 2021; v1 submitted 6 May, 2019; originally announced May 2019.

Journal ref: Phys. Rev. Accel. Beams 24, 091302 (2021)

Spectral Control via Multi-Species Effects in PW-Class Laser-Ion Acceleration

Authors: Axel Huebl, Martin Rehwald, Lieselotte Obst-Huebl, Tim Ziegler, Marco Garten, René Widera, Karl Zeil, Thomas E. Cowan, Michael Bussmann, Ulrich Schramm, Thomas Kluge

Abstract: Laser-ion acceleration with ultra-short pulse, PW-class lasers is dominated by non-thermal, intra-pulse plasma dynamics. The presence of multiple ion species or multiple charge states in targets leads to characteristic modulations and even mono-energetic features, depending on the choice of target material. As spectral signatures of generated ion beams are frequently used to characterize underlyin… ▽ More Laser-ion acceleration with ultra-short pulse, PW-class lasers is dominated by non-thermal, intra-pulse plasma dynamics. The presence of multiple ion species or multiple charge states in targets leads to characteristic modulations and even mono-energetic features, depending on the choice of target material. As spectral signatures of generated ion beams are frequently used to characterize underlying acceleration mechanisms, thermal, multi-fluid descriptions require a revision for predictive capabilities and control in next-generation particle beam sources. We present an analytical model with explicit inter-species interactions, supported by extensive ab initio simulations. This enables us to derive important ensemble properties from the spectral distribution resulting from those multi-species effects for arbitrary mixtures. We further propose a potential experimental implementation with a novel cryogenic target, delivering jets with variable mixtures of hydrogen and deuterium. Free from contaminants and without strong influence of hardly controllable processes such as ionization dynamics, this would allow a systematic realization of our predictions for the multi-species effect. △ Less

Submitted 12 May, 2020; v1 submitted 15 March, 2019; originally announced March 2019.

Comments: 4 pages plus appendix, 11 figures, paper submitted to a journal of the American Physical Society

Journal ref: Plasma Phys. Control. Fusion 62 124003, 2020

Quantitatively consistent computation of coherent and incoherent radiation in particle-in-cell codes - a general form factor formalism for macro-particles

Authors: Richard Pausch, Alexander Debus, Axel Huebl, Ulrich Schramm, Klaus Steiniger, René Widera, Michael Bussmann

Abstract: Quantitative predictions from synthetic radiation diagnostics often have to consider all accelerated particles. For particle-in-cell (PIC) codes, this not only means including all macro-particles but also taking into account the discrete electron distribution associated with them. This paper presents a general form factor formalism that allows to determine the radiation from this discrete electron… ▽ More Quantitative predictions from synthetic radiation diagnostics often have to consider all accelerated particles. For particle-in-cell (PIC) codes, this not only means including all macro-particles but also taking into account the discrete electron distribution associated with them. This paper presents a general form factor formalism that allows to determine the radiation from this discrete electron distribution in order to compute the coherent and incoherent radiation self-consistently. Furthermore, we discuss a memory-efficient implementation that allows PIC simulations with billions of macro-particles. The impact on the radiation spectra is demonstrated on a large scale LWFA simulation. △ Less

Submitted 12 February, 2018; originally announced February 2018.

Comments: Proceedings of the EAAC 2017, This manuscript version is made available under the CC-BY-NC-ND 4.0 license

Observation of ultrafast solid-density plasma dynamics using femtosecond X-ray pulses from a free-electron laser

Authors: Thomas Kluge, Melanie Rödel, Josefine Metzkes, Alexander Pelka, Alejandro Laso Garcia, Irene Prencipe, Martin Rehwald, Motoaki Nakatsutsumi, Emma E. McBride, Tommy Schönherr, Marco Garten, Nicholas J. Hartley, Malte Zacharias, Arthur Erbe, Yordan M. Georgiev, Eric Galtier, Inhyuk Nam, Hae Ja Lee, Siegfried Glenzer, Michael Bussmann, Christian Gutt, Karl Zeil, Christian Rödel, Uwe Hübner, Ulrich Schramm , et al. (1 additional authors not shown)

Abstract: The complex physics of the interaction between short pulse high intensity lasers and solids is so far hardly accessible by experiments. As a result of missing experimental capabilities to probe the complex electron dynamics and competing instabilities, this impedes the development of compact laser-based next generation secondary radiation sources, e.g. for tumor therapy [Bulanov2002,ledingham2007]… ▽ More The complex physics of the interaction between short pulse high intensity lasers and solids is so far hardly accessible by experiments. As a result of missing experimental capabilities to probe the complex electron dynamics and competing instabilities, this impedes the development of compact laser-based next generation secondary radiation sources, e.g. for tumor therapy [Bulanov2002,ledingham2007], laboratory-astrophysics [Remington1999,Bulanov2015], and fusion [Tabak2014]. At present, the fundamental plasma dynamics that occur at the nanometer and femtosecond scales during the laser-solid interaction can only be elucidated by simulations. Here we show experimentally that small angle X-ray scattering of femtosecond X-ray free-electron laser pulses facilitates new capabilities for direct in-situ characterization of intense short-pulse laser plasma interaction at solid density that allows simultaneous nanometer spatial and femtosecond temporal resolution, directly verifying numerical simulations of the electron density dynamics during the short pulse high intensity laser irradiation of a solid density target. For laser-driven grating targets, we measure the solid density plasma expansion and observe the generation of a transient grating structure in front of the pre-inscribed grating, due to plasma expansion, which is an hitherto unknown effect. We expect that our results will pave the way for novel time-resolved studies, guiding the development of future laser-driven particle and photon sources from solid targets. △ Less

Submitted 25 January, 2018; originally announced January 2018.

Journal ref: Phys. Rev. X 8, 031068 (2018)

Dosimetric evidence confirms computational model for magnetic field induced dose distortions of therapeutic proton beams

Authors: Sonja M Schellhammer, Sebastian Gantz, Armin Lühr, Bradley M Oborn, Michael Bussmann, Aswin L Hoffmann

Abstract: Given the sensitivity of proton therapy to anatomical variations, this cancer treatment modality is expected to benefit greatly from integration with magnetic resonance (MR) imaging. One of the obstacles hindering such an integration are strong magnetic field induced dose distortions. These have been predicted in simulation studies, but no experimental validation has been performed so far. Here we… ▽ More Given the sensitivity of proton therapy to anatomical variations, this cancer treatment modality is expected to benefit greatly from integration with magnetic resonance (MR) imaging. One of the obstacles hindering such an integration are strong magnetic field induced dose distortions. These have been predicted in simulation studies, but no experimental validation has been performed so far. Here we show the first measurement of planar distributions of dose deposited by therapeutic proton pencil beams traversing a one-Tesla transversal magnetic field while depositing energy in a tissue-like phantom using film dosimetry. The lateral beam deflection ranges from one millimeter to one centimeter for 80 to 180 MeV beams. Simulated and measured deflection agree within one millimeter for all studied energies. These results proof that the magnetic field induced proton beam deflection is both measurable and accurately predictable. This demonstrates the feasibility of accurate dose measurement and hence validates dose predictions for the framework of MR-integrated proton therapy. △ Less

Submitted 6 September, 2017; v1 submitted 1 September, 2017; originally announced September 2017.

Tuning and optimization for a variety of many-core architectures without changing a single line of implementation code using the Alpaka library

Authors: Alexander Matthes, René Widera, Erik Zenker, Benjamin Worpitz, Axel Huebl, Michael Bussmann

Abstract: We present an analysis on optimizing performance of a single C++11 source code using the Alpaka hardware abstraction library. For this we use the general matrix multiplication (GEMM) algorithm in order to show that compilers can optimize Alpaka code effectively when tuning key parameters of the algorithm. We do not intend to rival existing, highly optimized DGEMM versions, but merely choose this e… ▽ More We present an analysis on optimizing performance of a single C++11 source code using the Alpaka hardware abstraction library. For this we use the general matrix multiplication (GEMM) algorithm in order to show that compilers can optimize Alpaka code effectively when tuning key parameters of the algorithm. We do not intend to rival existing, highly optimized DGEMM versions, but merely choose this example to prove that Alpaka allows for platform-specific tuning with a single source code. In addition we analyze the optimization potential available with vendor-specific compilers when confronted with the heavily templated abstractions of Alpaka. We specifically test the code for bleeding edge architectures such as Nvidia's Tesla P100, Intel's Knights Landing (KNL) and Haswell architecture as well as IBM's Power8 system. On some of these we are able to reach almost 50\% of the peak floating point operation performance using the aforementioned means. When adding compiler-specific #pragmas we are able to reach 5 TFLOPS/s on a P100 and over 1 TFLOPS/s on a KNL system. △ Less

Submitted 30 June, 2017; originally announced June 2017.

Comments: Accepted paper for the P\^{}3MA workshop at the ISC 2017 in Frankfurt

Journal ref: J.M. Kunkel et al. (Eds.): ISC High Performance Workshops 2017, LNCS 10524, pp. 496-514, 2017

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective

Authors: Axel Huebl, Rene Widera, Felix Schmitt, Alexander Matthes, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, Michael Bussmann

Abstract: We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today's and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threa… ▽ More We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today's and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threaded data-transformations for the I/O library ADIOS as a feasible way to trade underutilized host-side compute potential on heterogeneous systems for reduced I/O latency. △ Less

Submitted 1 June, 2017; originally announced June 2017.

Comments: 15 pages, 5 figures, accepted for DRBSD-1 in conjunction with ISC'17

ACM Class: D.4.8; B.4.3; I.6.6

Journal ref: J.M. Kunkel et al. (Eds.): ISC High Performance Workshops 2017, LNCS 10524, pp. 15-29, 2017

Nonlinear enthalpy transformation for transient convective phase change in Smoothed Particle Hydrodynamics (SPH)

Authors: Amirsaman Farrokhpanah, Javad Mostaghimi, Markus Bussmann

Abstract: A three-dimensional model is presented for the prediction of solidification behavior using a nonlinear transformation of the enthalpy equation in a Smoothed Particle Hydrodynamics (SPH) discretization. The effect of phase change in the form of release and absorption of latent heat is implemented implicitly as variable source terms in the enthalpy calculation. The developed model is validated again… ▽ More A three-dimensional model is presented for the prediction of solidification behavior using a nonlinear transformation of the enthalpy equation in a Smoothed Particle Hydrodynamics (SPH) discretization. The effect of phase change in the form of release and absorption of latent heat is implemented implicitly as variable source terms in the enthalpy calculation. The developed model is validated against various experimental, analytical, and numerical results from the literature. Results confirm accuracy and robustness of the new procedure. Finally, the SPH model is applied to a study of suspension plasma spraying (SPS) by predicting the impact and solidification behavior of molten ceramic droplets on a substrate. △ Less

Submitted 28 May, 2022; v1 submitted 2 January, 2017; originally announced January 2017.

Journal ref: Numerical Heat Transfer, Part B: Fundamentals, 2021, 79(5-6), pp. 255-277

In situ, steerable, hardware-independent and data-structure agnostic visualization with ISAAC

Authors: Alexander Matthes, Axel Huebl, René Widera, Sebastian Grottel, Stefan Gumhold, Michael Bussmann

Abstract: The computation power of supercomputers grows faster than the bandwidth of their storage and network. Especially applications using hardware accelerators like Nvidia GPUs cannot save enough data to be analyzed in a later step. There is a high risk of loosing important scientific information. We introduce the in situ template library ISAAC which enables arbitrary applications like scientific simula… ▽ More The computation power of supercomputers grows faster than the bandwidth of their storage and network. Especially applications using hardware accelerators like Nvidia GPUs cannot save enough data to be analyzed in a later step. There is a high risk of loosing important scientific information. We introduce the in situ template library ISAAC which enables arbitrary applications like scientific simulations to live visualize their data without the need of deep copy operations or data transformation using the very same compute node and hardware accelerator the data is already residing on. Arbitrary meta data can be added to the renderings and user defined steering commands can be asynchronously sent back to the running application. Using an aggregating server, ISAAC streams the interactive visualization video and enables user to access their applications from everywhere. △ Less

Submitted 28 November, 2016; originally announced November 2016.

Journal ref: Supercomputing Frontiers and Innovations, [S.l.], v. 3, n. 4, p. 30-48, oct. 2016

SIMEX: Simulation of Experiments at Advanced Light Sources

Authors: C Fortmann-Grote, A A Andreev, R Briggs, M Bussmann, A Buzmakov, M Garten, A Grund, A Hübl, S Hauff, A Joy, Z Jurek, N D Loh, T Rüter, L Samoylova, R Santra, E A Schneidmiller, A Sharma, M Wing, S Yakubov, C H Yoon, M V Yurkov, B Ziaja, A P Mancuso

Abstract: Realistic simulations of experiments at large scale photon facilities, such as optical laser laboratories, synchrotrons, and free electron lasers, are of vital importance for the successful preparation, execution, and analysis of these experiments investigating ever more complex physical systems, e.g. biomolecules, complex materials, and ultra-short lived states of highly excited matter. Tradition… ▽ More Realistic simulations of experiments at large scale photon facilities, such as optical laser laboratories, synchrotrons, and free electron lasers, are of vital importance for the successful preparation, execution, and analysis of these experiments investigating ever more complex physical systems, e.g. biomolecules, complex materials, and ultra-short lived states of highly excited matter. Traditional photon science modelling takes into account only isolated aspects of an experiment, such as the beam propagation, the photon-matter interaction, or the scattering process, making idealized assumptions about the remaining parts, e.g.\ the source spectrum, temporal structure and coherence properties of the photon beam, or the detector response. In SIMEX, we have implemented a platform for complete start-to-end simulations, following the radiation from the source, through the beam transport optics to the sample or target under investigation, its interaction with and scattering from the sample, and its registration in a photon detector, including a realistic model of the detector response to the radiation. Data analysis tools can be hooked up to the modelling pipeline easily. This allows researchers and facility operators to simulate their experiments and instruments in real life scenarios, identify promising and unattainable regions of the parameter space and ultimately make better use of valuable beamtime. This work is licensed under the Creative Commons Attribution 3.0 Unported License: http://creativecommons.org/licenses/by/3.0/. △ Less

Submitted 17 November, 2016; v1 submitted 19 October, 2016; originally announced October 2016.

Comments: Presented at the 11th NOBUGS conference, Copenhagen, on Oct. 17th 2016. 7 pages, 3 figures, 29 references

New smoothed particle hydrodynamics (SPH) formulation for modeling heat conduction with solidification and melting

Authors: Amirsaman Farrokhpanah, Markus Bussmann, Javad Mostaghimi

Abstract: When modelling phase change, the latent heat released (absorbed) during solidification (melting) must be included in the heat transfer equation. In this paper, different SPH methods for the implementation of latent heat, in the context of transient heat conduction, are derived and tested. First, SPH discretizations of two finite element methods are presented, but these prove to be computationally… ▽ More When modelling phase change, the latent heat released (absorbed) during solidification (melting) must be included in the heat transfer equation. In this paper, different SPH methods for the implementation of latent heat, in the context of transient heat conduction, are derived and tested. First, SPH discretizations of two finite element methods are presented, but these prove to be computationally expensive. Then, by starting from a simple approximation and enhancing accuracy using different numerical treatments, a new SPH method is introduced, that is fast and easy to implement. An evaluation of this new method on various analytical and numerical results confirms its accuracy and robustness. △ Less

Submitted 20 February, 2018; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 21 pages, 14 figures

Journal ref: Numerical Heat Transfer, Part B: Fundamentals (2017) 71(4), pp. 299-312

Drop tower setup for dynamic light scattering in dense gas-fluidized granular media

Authors: Philip Born, Johannes Schmitz, Michael Bussmann, Matthias Sperl

Abstract: Investigation of dynamics in dense granular media is challenging. Here we present a setup that facilitates gas fluidization of dense granular media in microgravity. The dynamics is characterized using diffusing wave spectroscopy. We demonstrate that agitated granular media reach a steady state within fractions of a second in drop tower flights. The intensity autocorrelation functions obtained in m… ▽ More Investigation of dynamics in dense granular media is challenging. Here we present a setup that facilitates gas fluidization of dense granular media in microgravity. The dynamics is characterized using diffusing wave spectroscopy. We demonstrate that agitated granular media reach a steady state within fractions of a second in drop tower flights. The intensity autocorrelation functions obtained in microgravity show a remarkable dependence on sample volume fraction and driving strength. A plateau in correlation merges at low volume fractions and strong driving, while correlation decays only very slowly but continuously at high packing fractions. The setup allows to independently set sample volume fraction and driving strength, and thus extends the possibilities for investigations on dynamics in dense granular on ground. △ Less

Submitted 10 June, 2016; originally announced June 2016.

Comments: 8 pages, 7 figures

Journal ref: Microgravity Science and Technology, 28, 413 (2016)

Performance-Portable Many-Core Plasma Simulations: Porting PIConGPU to OpenPower and Beyond

Authors: Erik Zenker, René Widera, Axel Huebl, Guido Juckeland, Andreas Knüpfer, Wolfgang E. Nagel, Michael Bussmann

Abstract: With the appearance of the heterogeneous platform OpenPower,many-core accelerator devices have been coupled with Power host processors for the first time. Towards utilizing their full potential, it is worth investigating performance portable algorithms that allow to choose the best-fitting hardware for each domain-specific compute task. Suiting even the high level of parallelism on modern GPGPUs,… ▽ More With the appearance of the heterogeneous platform OpenPower,many-core accelerator devices have been coupled with Power host processors for the first time. Towards utilizing their full potential, it is worth investigating performance portable algorithms that allow to choose the best-fitting hardware for each domain-specific compute task. Suiting even the high level of parallelism on modern GPGPUs, our presented approach relies heavily on abstract meta-programming techniques, which are essential to focus on fine-grained tuning rather than code porting. With this in mind, the CUDA-based open-source plasma simulation code PIConGPU is currently being abstracted to support the heterogeneous OpenPower platform using our fast porting interface cupla, which wraps the abstract parallel C++11 kernel acceleration library Alpaka. We demonstrate how PIConGPU can benefit from the tunable kernel execution strategies of the Alpaka library, achieving portability and performance with single-source kernels on conventional CPUs, Power8 CPUs and NVIDIA GPUs. △ Less

Submitted 12 June, 2016; v1 submitted 9 June, 2016; originally announced June 2016.

Comments: 9 pages, 3 figures, accepted on IWOPH 2016

Journal ref: Lecture Notes in Computer Science, 9945, pp 293-301, 2016

Alpaka - An Abstraction Library for Parallel Kernel Acceleration

Authors: Erik Zenker, Benjamin Worpitz, René Widera, Axel Huebl, Guido Juckeland, Andreas Knüpfer, Wolfgang E. Nagel, Michael Bussmann

Abstract: Porting applications to new hardware or programming models is a tedious and error prone process. Every help that eases these burdens is saving developer time that can then be invested into the advancement of the application itself instead of preserving the status-quo on a new platform. The Alpaka library defines and implements an abstract hierarchical redundant parallelism model. The model explo… ▽ More Porting applications to new hardware or programming models is a tedious and error prone process. Every help that eases these burdens is saving developer time that can then be invested into the advancement of the application itself instead of preserving the status-quo on a new platform. The Alpaka library defines and implements an abstract hierarchical redundant parallelism model. The model exploits parallelism and memory hierarchies on a node at all levels available in current hardware. By doing so, it allows to achieve platform and performance portability across various types of accelerators by ignoring specific unsupported levels and utilizing only the ones supported on a specific accelerator. All hardware types (multi- and many-core CPUs, GPUs and other accelerators) are supported for and can be programmed in the same way. The Alpaka C++ template interface allows for straightforward extension of the library to support other accelerators and specialization of its internals for optimization. Running Alpaka applications on a new (and supported) platform requires the change of only one source code line instead of a lot of \#ifdefs. △ Less

Submitted 26 February, 2016; originally announced February 2016.

Comments: 10 pages, 10 figures

Simple scaling equations for electron spectra, currents and bulk heating in ultra-intense short-pulse laser-solid interaction

Authors: Thomas Kluge, Michael Bussmann, Thomas E. Cowan, Ulrich Schramm

Abstract: Intense and energetic electron currents can be generated by ultra-intense lasers interacting with solid density targets. Especially for ultra-short laser pulses their temporal evolution needs to be taken into account for many non-linear processes as instantaneous currents may differ significantly from the average. Hence, a dynamic model including the temporal variation of the electron currents whi… ▽ More Intense and energetic electron currents can be generated by ultra-intense lasers interacting with solid density targets. Especially for ultra-short laser pulses their temporal evolution needs to be taken into account for many non-linear processes as instantaneous currents may differ significantly from the average. Hence, a dynamic model including the temporal variation of the electron currents which goes beyond a simple bunching with twice the laser frequency but otherwise constant current is needed. Here we present a new time-dependent model to describe the laser generated currents and obtain simple expressions for the temporal evolution and resulting corrections of averages. To exemplify the model and its predictive capabilities we show the impact of temporal evolution, spectral distribution and spatial modulations on Ohmic heating of the bulk target material. △ Less

Submitted 2 July, 2018; v1 submitted 2 November, 2015; originally announced November 2015.

Nanoscale femtosecond imaging of transient hot solid density plasmas with elemental and charge state sensitivity using resonant coherent diffraction

Authors: Thomas Kluge, M. Bussmann, H. -K. Chung, C. Gutt, L. G. Huang, M. Zacharias, U. Schramm, T. E. Cowan

Abstract: Here we propose to exploit the low energy bandwidth, small wavelength and penetration power of ultrashort pulses from XFELs for resonant Small Angle Scattering (SAXS) on plasma structures in laser excited plasmas. Small angle scattering allows to detect nanoscale density fluctuations in forward scattering direction. Typically, the SAXS signal from laser excited plasmas is expected to be dominated… ▽ More Here we propose to exploit the low energy bandwidth, small wavelength and penetration power of ultrashort pulses from XFELs for resonant Small Angle Scattering (SAXS) on plasma structures in laser excited plasmas. Small angle scattering allows to detect nanoscale density fluctuations in forward scattering direction. Typically, the SAXS signal from laser excited plasmas is expected to be dominated by the free electron distribution. We propose that the ionic scattering signal becomes visible when the X-ray energy is in resonance with an electron transition between two bound states (Resonant coherent X-ray diffraction, RCXD). In this case the scattering cross-section dramatically increases so that the signal of X-ray scattering from ions silhouettes against the free electron scattering background which allows to measure the opacity and derived quantities with high spatial and temporal resolution, being fundamentally limited only by the X-ray wavelength and timing. Deriving quantities such as ion spatial distribution, charge state distribution and plasma temperature with such high spatial and temporal resolution will make a vast number of processes in shortpulse laser-solid interaction accessible for direct experimental observation e.g. hole-boring and shock propagation, filamentation and instability dynamics, electron transport, heating and ultrafast ionization dynamics. △ Less

Submitted 17 August, 2015; originally announced August 2015.

Two surface plasmon decay of plasma oscillations

Authors: Thomas Kluge, Josefine Metzkes, Karl Zeil, Michael Bussmann, Ulrich Schramm, Thomas E. Cowan

Abstract: The interaction of ultra-intense lasers with solid foils can be used to accelerate ions to high energies well exceeding 60 MeV. The non-linear relativistic motion of electrons in the intense laser radiation leads to their acceleration and later to the acceleration of ions. Ions can be accelerated from the front surface, the foil interior region, and the foil rear surface (TNSA, most widely used),… ▽ More The interaction of ultra-intense lasers with solid foils can be used to accelerate ions to high energies well exceeding 60 MeV. The non-linear relativistic motion of electrons in the intense laser radiation leads to their acceleration and later to the acceleration of ions. Ions can be accelerated from the front surface, the foil interior region, and the foil rear surface (TNSA, most widely used), or the foil may be accelerated as a whole if sufficiently thin (RPA). Here, we focus on the most widely used mechanism for laser ion-acceleration of TNSA. Starting from perfectly flat foils we show by simulations how electron filamentation at or inside the solid leads to a spatial modulations in the ions. The exact dynamics depend very sensitively on the chosen initial parameters which has a tremendous effect on electron dynamics. In the case of step-like density gradients we find evidence that suggests a two-surface-plasmon decay of plasma oscillations triggering a Raileigh-Taylor-like instability. △ Less

Submitted 20 March, 2015; v1 submitted 28 January, 2015; originally announced January 2015.