-
Efficient Forward-Mode Algorithmic Derivatives of Geant4
Authors:
Max Aehle,
Xuan Tung Nguyen,
Mihály Novák,
Tommaso Dorigo,
Nicolas R. Gauger,
Jan Kieseler,
Markus Klute,
Vassil Vassilev
Abstract:
We have applied an operator-overloading forward-mode algorithmic differentiation tool to the Monte-Carlo particle simulation toolkit Geant4. Our differentiated version of Geant4 allows computing mean pathwise derivatives of user-defined outputs of Geant4 applications with respect to user-defined inputs. This constitutes a major step towards enabling gradient-based optimization techniques in high-e…
▽ More
We have applied an operator-overloading forward-mode algorithmic differentiation tool to the Monte-Carlo particle simulation toolkit Geant4. Our differentiated version of Geant4 allows computing mean pathwise derivatives of user-defined outputs of Geant4 applications with respect to user-defined inputs. This constitutes a major step towards enabling gradient-based optimization techniques in high-energy physics, as well as other application domains of Geant4.
This is a preliminary report on the technical aspects of applying operator-overloading AD to Geant4, as well as a first analysis of some results obtained by our differentiated Geant4 prototype. We plan to follow up with a more refined analysis.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Optimization Using Pathwise Algorithmic Derivatives of Electromagnetic Shower Simulations
Authors:
Max Aehle,
Mihály Novák,
Vassil Vassilev,
Nicolas R. Gauger,
Lukas Heinrich,
Michael Kagan,
David Lange
Abstract:
Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy ph…
▽ More
Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy physics. However, the pathwise derivative estimator can be biased if there are discontinuities in the program, which may diminish its value for applications.
This work integrates algorithmic differentiation into the electromagnetic shower simulation code HepEmShow based on G4HepEm, allowing us to study how well pathwise derivatives approximate derivatives of energy depositions in a sampling calorimeter with respect to parameters of the beam and geometry. We found that when multiple scattering is disabled in the simulation, means of pathwise derivatives converge quickly to their expected values, and these are close to the actual derivatives of the energy deposition. Additionally, we demonstrate the applicability of this novel gradient estimator for stochastic gradient-based optimization in a model example.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Performance of the electromagnetic and hadronic prototype segments of the ALICE Forward Calorimeter
Authors:
M. Aehle,
J. Alme,
C. Arata,
I. Arsene,
I. Bearden,
T. Bodova,
V. Borshchov,
O. Bourrion,
M. Bregant,
A. van den Brink,
V. Buchakchiev,
A. Buhl,
T. Chujo,
L. Dufke,
V. Eikeland,
M. Fasel,
N. Gauger,
A. Gautam,
A. Ghimouz,
Y. Goto,
R. Guernane,
T. Hachiya,
H. Hassan,
L. He,
H. Helstrup
, et al. (50 additional authors not shown)
Abstract:
We present the performance of a full-length prototype of the ALICE Forward Calorimeter (FoCal). The detector is composed of a silicon-tungsten electromagnetic sampling calorimeter with longitudinal and transverse segmentation (FoCal-E) of about 20$X_0$ and a hadronic copper-scintillating-fiber calorimeter (FoCal-H) of about 5$λ_{\rm int}$. The data were taken between 2021 and 2023 at the CERN PS a…
▽ More
We present the performance of a full-length prototype of the ALICE Forward Calorimeter (FoCal). The detector is composed of a silicon-tungsten electromagnetic sampling calorimeter with longitudinal and transverse segmentation (FoCal-E) of about 20$X_0$ and a hadronic copper-scintillating-fiber calorimeter (FoCal-H) of about 5$λ_{\rm int}$. The data were taken between 2021 and 2023 at the CERN PS and SPS beam lines with hadron (electron) beams up to energies of 350 (300) GeV. Regarding FoCal-E, we report a comprehensive analysis of its response to minimum ionizing particles across all pad layers. The longitudinal shower profile of electromagnetic showers is measured with a layer-wise segmentation of 1$X_0$. As a projection to the performance of the final detector in electromagnetic showers, we demonstrate linearity in the full energy range, and show that the energy resolution fulfills the requirements for the physics needs. Additionally, the performance to separate two-showers events was studied by quantifying the transverse shower width. Regarding FoCal-H, we report a detailed analysis of the response to hadron beams between 60 and 350 GeV. The results are compared to simulations obtained with a Geant4 model of the test beam setup, which in particular for FoCal-E are in good agreement with the data. The energy resolution of FoCal-E was found to be lower than 3% at energies larger than 100 GeV. The response of FoCal-H to hadron beams was found to be linear, albeit with a significant intercept that is about factor 2 larger than in simulations. Its resolution, which is non-Gaussian and generally larger than in simulations, was quantified using the FWHM, and decreases from about 16% at 100 GeV to about 11% at 350 GeV. The discrepancy to simulations, which is particularly evident at low hadron energies, needs to be further investigated.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Progress in End-to-End Optimization of Detectors for Fundamental Physics with Differentiable Programming
Authors:
Max Aehle,
Lorenzo Arsini,
R. Belén Barreiro,
Anastasios Belias,
Florian Bury,
Susana Cebrian,
Alexander Demin,
Jennet Dickinson,
Julien Donini,
Tommaso Dorigo,
Michele Doro,
Nicolas R. Gauger,
Andrea Giammanco,
Lindsey Gray,
Borja S. González,
Verena Kain,
Jan Kieseler,
Lisa Kusch,
Marcus Liwicki,
Gernot Maier,
Federico Nardi,
Fedor Ratnikov,
Ryan Roussel,
Roberto Ruiz de Austri,
Fredrik Sandin
, et al. (5 additional authors not shown)
Abstract:
In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance -- from the data-generating processes to their reconstruction and the ext…
▽ More
In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance -- from the data-generating processes to their reconstruction and the extraction of inference on the parameters of interest of a measuring instrument -- along with the careful specification of a utility function well aligned with the end goals of the experiment.
Building on previous studies originated within the MODE Collaboration, we focus specifically on applications involving instruments for particle physics experimentation, as well as industrial and medical applications that share the detection of radiation as their data-generating mechanism.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
Trailing-Edge Noise Reduction using Porous Treatment and Surrogate-based Global Optimization
Authors:
Jan Rottmayer,
Emre Özkaya,
Sutharsan Satcunanathan,
Beckett Y. Zhou,
Max Aehle,
Nicolas R. Gauger,
Matthias Meinke,
Wolfgang Schröder,
Shaun Pullin
Abstract:
Broadband noise reduction is a significant problem in aerospace and industrial applications. Specifically, the noise generated from the trailing edge of an airfoil poses a challenging problem with various proposed solutions. This study investigates the porous trailing edge treatment. We use surrogate-based gradient-free optimization and an empirical noise model to efficiently explore the design sp…
▽ More
Broadband noise reduction is a significant problem in aerospace and industrial applications. Specifically, the noise generated from the trailing edge of an airfoil poses a challenging problem with various proposed solutions. This study investigates the porous trailing edge treatment. We use surrogate-based gradient-free optimization and an empirical noise model to efficiently explore the design space and find the optimal porosity distribution. As a result, a predicted 8-10 dB reduction in the broadband 300-5000 Hz was achieved. Furthermore, the optimal design emphasizes the design space's complexity and global exploration's difficulty. Further, the optimal design presents a low porous solution while constituting significant noise reduction.
△ Less
Submitted 3 February, 2023; v1 submitted 30 January, 2023;
originally announced January 2023.
-
Toward the End-to-End Optimization of Particle Physics Instruments with Differentiable Programming: a White Paper
Authors:
Tommaso Dorigo,
Andrea Giammanco,
Pietro Vischia,
Max Aehle,
Mateusz Bawaj,
Alexey Boldyrev,
Pablo de Castro Manzano,
Denis Derkach,
Julien Donini,
Auralee Edelen,
Federica Fanzago,
Nicolas R. Gauger,
Christian Glaser,
Atılım G. Baydin,
Lukas Heinrich,
Ralf Keidel,
Jan Kieseler,
Claudius Krause,
Maxime Lagrange,
Max Lamparth,
Lukas Layer,
Gernot Maier,
Federico Nardi,
Helge E. S. Pettersen,
Alberto Ramos
, et al. (11 additional authors not shown)
Abstract:
The full optimization of the design and operation of instruments whose functioning relies on the interaction of radiation with matter is a super-human task, given the large dimensionality of the space of possible choices for geometry, detection technology, materials, data-acquisition, and information-extraction techniques, and the interdependence of the related parameters. On the other hand, massi…
▽ More
The full optimization of the design and operation of instruments whose functioning relies on the interaction of radiation with matter is a super-human task, given the large dimensionality of the space of possible choices for geometry, detection technology, materials, data-acquisition, and information-extraction techniques, and the interdependence of the related parameters. On the other hand, massive potential gains in performance over standard, "experience-driven" layouts are in principle within our reach if an objective function fully aligned with the final goals of the instrument is maximized by means of a systematic search of the configuration space. The stochastic nature of the involved quantum processes make the modeling of these systems an intractable problem from a classical statistics point of view, yet the construction of a fully differentiable pipeline and the use of deep learning techniques may allow the simultaneous optimization of all design parameters.
In this document we lay down our plans for the design of a modular and versatile modeling tool for the end-to-end optimization of complex instruments for particle physics experiments as well as industrial and medical applications that share the detection of radiation as their basic ingredient. We consider a selected set of use cases to highlight the specific needs of different applications.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Exploration of Differentiability in a Proton Computed Tomography Simulation Framework
Authors:
Max Aehle,
Johan Alme,
Gergely Gábor Barnaföldi,
Johannes Blühdorn,
Tea Bodova,
Vyacheslav Borshchov,
Anthony van den Brink,
Viljar Eikeland,
Gregory Feofilov,
Christoph Garth,
Nicolas R. Gauger,
Ola Grøttvik,
Håvard Helstrup,
Sergey Igolkin,
Ralf Keidel,
Chinorat Kobdaj,
Tobias Kortus,
Lisa Kusch,
Viktor Leonhardt,
Shruti Mehendale,
Raju Ningappa Mulawade,
Odd Harald Odland,
George O'Neill,
Gábor Papp,
Thomas Peitzmann
, et al. (25 additional authors not shown)
Abstract:
Objective. Algorithmic differentiation (AD) can be a useful technique to numerically optimize design and algorithmic parameters by, and quantify uncertainties in, computer simulations. However, the effectiveness of AD depends on how "well-linearizable" the software is. In this study, we assess how promising derivative information of a typical proton computed tomography (pCT) scan computer simulati…
▽ More
Objective. Algorithmic differentiation (AD) can be a useful technique to numerically optimize design and algorithmic parameters by, and quantify uncertainties in, computer simulations. However, the effectiveness of AD depends on how "well-linearizable" the software is. In this study, we assess how promising derivative information of a typical proton computed tomography (pCT) scan computer simulation is for the aforementioned applications.
Approach. This study is mainly based on numerical experiments, in which we repeatedly evaluate three representative computational steps with perturbed input values. We support our observations with a review of the algorithmic steps and arithmetic operations performed by the software, using debugging techniques.
Main results. The model-based iterative reconstruction (MBIR) subprocedure (at the end of the software pipeline) and the Monte Carlo (MC) simulation (at the beginning) were piecewise differentiable. Jumps in the MBIR function arose from the discrete computation of the set of voxels intersected by a proton path. Jumps in the MC function likely arose from changes in the control flow that affect the amount of consumed random numbers. The tracking algorithm solves an inherently non-differentiable problem.
Significance. The MC and MBIR codes are ready for the integration of AD, and further research on surrogate models for the tracking subprocedure is necessary.
△ Less
Submitted 12 May, 2023; v1 submitted 11 February, 2022;
originally announced February 2022.
