-
Progress in End-to-End Optimization of Detectors for Fundamental Physics with Differentiable Programming
Authors:
Max Aehle,
Lorenzo Arsini,
R. Belén Barreiro,
Anastasios Belias,
Florian Bury,
Susana Cebrian,
Alexander Demin,
Jennet Dickinson,
Julien Donini,
Tommaso Dorigo,
Michele Doro,
Nicolas R. Gauger,
Andrea Giammanco,
Lindsey Gray,
Borja S. González,
Verena Kain,
Jan Kieseler,
Lisa Kusch,
Marcus Liwicki,
Gernot Maier,
Federico Nardi,
Fedor Ratnikov,
Ryan Roussel,
Roberto Ruiz de Austri,
Fredrik Sandin
, et al. (5 additional authors not shown)
Abstract:
In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance -- from the data-generating processes to their reconstruction and the ext…
▽ More
In this article we examine recent developments in the research area concerning the creation of end-to-end models for the complete optimization of measuring instruments. The models we consider rely on differentiable programming methods and on the specification of a software pipeline including all factors impacting performance -- from the data-generating processes to their reconstruction and the extraction of inference on the parameters of interest of a measuring instrument -- along with the careful specification of a utility function well aligned with the end goals of the experiment.
Building on previous studies originated within the MODE Collaboration, we focus specifically on applications involving instruments for particle physics experimentation, as well as industrial and medical applications that share the detection of radiation as their data-generating mechanism.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
TomOpt: Differential optimisation for task- and constraint-aware design of particle detectors in the context of muon tomography
Authors:
Giles C. Strong,
Maxime Lagrange,
Aitor Orio,
Anna Bordignon,
Florian Bury,
Tommaso Dorigo,
Andrea Giammanco,
Mariam Heikal,
Jan Kieseler,
Max Lamparth,
Pablo Martínez Ruíz del Árbol,
Federico Nardi,
Pietro Vischia,
Haitham Zaraket
Abstract:
We describe a software package, TomOpt, developed to optimise the geometrical layout and specifications of detectors designed for tomography by scattering of cosmic-ray muons. The software exploits differentiable programming for the modeling of muon interactions with detectors and scanned volumes, the inference of volume properties, and the optimisation cycle performing the loss minimisation. In d…
▽ More
We describe a software package, TomOpt, developed to optimise the geometrical layout and specifications of detectors designed for tomography by scattering of cosmic-ray muons. The software exploits differentiable programming for the modeling of muon interactions with detectors and scanned volumes, the inference of volume properties, and the optimisation cycle performing the loss minimisation. In doing so, we provide the first demonstration of end-to-end-differentiable and inference-aware optimisation of particle physics instruments. We study the performance of the software on a relevant benchmark scenarios and discuss its potential applications.
△ Less
Submitted 8 October, 2023; v1 submitted 25 September, 2023;
originally announced September 2023.
-
Application of Inferno to a Top Pair Cross Section Measurement with CMS Open Data
Authors:
Lukas Layer,
Tommaso Dorigo,
Giles C. Strong
Abstract:
In recent years novel inference techniques have been developed based on the construction of non-linear summary statistics with neural networks by minimising inferencemotivated losses. One such technique is inferno (P. de Castro and T. Dorigo, Comp. Phys. Comm. 244 (2019) 170) which was shown on toy problems to outperform classical summary statistics for the problem of confidence interval estimatio…
▽ More
In recent years novel inference techniques have been developed based on the construction of non-linear summary statistics with neural networks by minimising inferencemotivated losses. One such technique is inferno (P. de Castro and T. Dorigo, Comp. Phys. Comm. 244 (2019) 170) which was shown on toy problems to outperform classical summary statistics for the problem of confidence interval estimation in the presence of nuisance parameters. In order to test and benchmark the algorithm in a real world application, a full, systematics-dominated analysis produced by the CMS experiment, "Measurement of the top-antitop production cross section in the tau+jets channel in pp collisions at sqrt(s) = 7 TeV" (CMS Collaboration, The European Physical Journal C, 2013) is reproduced with CMS Open Data. The application of the inferno-powered neural network architecture to this analysis demonstrates the potential to reduce the impact of systematic uncertainties in real LHC analyses. This work also exemplifies the extent to which LHC analyses can be reproduced with open data.
△ Less
Submitted 24 January, 2023;
originally announced January 2023.
-
Toward the End-to-End Optimization of Particle Physics Instruments with Differentiable Programming: a White Paper
Authors:
Tommaso Dorigo,
Andrea Giammanco,
Pietro Vischia,
Max Aehle,
Mateusz Bawaj,
Alexey Boldyrev,
Pablo de Castro Manzano,
Denis Derkach,
Julien Donini,
Auralee Edelen,
Federica Fanzago,
Nicolas R. Gauger,
Christian Glaser,
Atılım G. Baydin,
Lukas Heinrich,
Ralf Keidel,
Jan Kieseler,
Claudius Krause,
Maxime Lagrange,
Max Lamparth,
Lukas Layer,
Gernot Maier,
Federico Nardi,
Helge E. S. Pettersen,
Alberto Ramos
, et al. (11 additional authors not shown)
Abstract:
The full optimization of the design and operation of instruments whose functioning relies on the interaction of radiation with matter is a super-human task, given the large dimensionality of the space of possible choices for geometry, detection technology, materials, data-acquisition, and information-extraction techniques, and the interdependence of the related parameters. On the other hand, massi…
▽ More
The full optimization of the design and operation of instruments whose functioning relies on the interaction of radiation with matter is a super-human task, given the large dimensionality of the space of possible choices for geometry, detection technology, materials, data-acquisition, and information-extraction techniques, and the interdependence of the related parameters. On the other hand, massive potential gains in performance over standard, "experience-driven" layouts are in principle within our reach if an objective function fully aligned with the final goals of the instrument is maximized by means of a systematic search of the configuration space. The stochastic nature of the involved quantum processes make the modeling of these systems an intractable problem from a classical statistics point of view, yet the construction of a fully differentiable pipeline and the use of deep learning techniques may allow the simultaneous optimization of all design parameters.
In this document we lay down our plans for the design of a modular and versatile modeling tool for the end-to-end optimization of complex instruments for particle physics experiments as well as industrial and medical applications that share the detection of radiation as their basic ingredient. We consider a selected set of use cases to highlight the specific needs of different applications.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Deep Regression of Muon Energy with a K-Nearest Neighbor Algorithm
Authors:
T. Dorigo,
Sofia Guglielmini,
Jan Kieseler,
Lukas Layer,
Giles C. Strong
Abstract:
Within the context of studies for novel measurement solutions for future particle physics experiments, we developed a performant kNN-based regressor to infer the energy of highly-relativistic muons from the pattern of their radiation losses in a dense and granular calorimeter. The regressor is based on a pool of weak kNN learners, which learn by adapting weights and biases to each training event t…
▽ More
Within the context of studies for novel measurement solutions for future particle physics experiments, we developed a performant kNN-based regressor to infer the energy of highly-relativistic muons from the pattern of their radiation losses in a dense and granular calorimeter. The regressor is based on a pool of weak kNN learners, which learn by adapting weights and biases to each training event through stochastic gradient descent. The effective number of parameters optimized by the procedure is in the 60 millions range, thus comparable to that of large deep learning architectures. We test the performance of the regressor on the considered application by comparing it to that of several machine learning algorithms, showing comparable accuracy to that achieved by boosted decision trees and neural networks.
△ Less
Submitted 5 March, 2022;
originally announced March 2022.
-
Calorimetric Measurement of Multi-TeV Muons via Deep Regression
Authors:
Jan Kieseler,
Giles C. Strong,
Filippo Chiandotto,
Tommaso Dorigo,
Lukas Layer
Abstract:
The performance demands of future particle-physics experiments investigating the high-energy frontier pose a number of new challenges, forcing us to find improved solutions for the detection, identification, and measurement of final-state particles in subnuclear collisions. One such challenge is the precise measurement of muon momentum at very high energy, where an estimate of the curvature provid…
▽ More
The performance demands of future particle-physics experiments investigating the high-energy frontier pose a number of new challenges, forcing us to find improved solutions for the detection, identification, and measurement of final-state particles in subnuclear collisions. One such challenge is the precise measurement of muon momentum at very high energy, where an estimate of the curvature provided by conceivable magnetic fields in realistic detectors proves insufficient for achieving good momentum resolution when detecting, e.g., a narrow, high mass resonance decaying to a muon pair.
In this work we study the feasibility of an entirely new avenue for the measurement of the energy of muons based on their radiative losses in a dense, finely segmented calorimeter. This is made possible by exploiting spatial information of the clusters of energy from radiated photons in a regression task. The use of a task-specific deep learning architecture based on convolutional layers allows us to treat the problem as one akin to image reconstruction, where images are constituted by the pattern of energy released in successive layers of the calorimeter. A measurement of muon energy with better than 20% relative resolution is shown to be achievable for ultra-TeV muons.
△ Less
Submitted 30 March, 2022; v1 submitted 5 July, 2021;
originally announced July 2021.
-
RanBox: Anomaly Detection in the Copula Space
Authors:
Tommaso Dorigo,
Martina Fumanelli,
Chiara Maccani,
Marija Mojsovska,
Giles C. Strong,
Bruno Scarpa
Abstract:
The unsupervised search for overdense regions in high-dimensional feature spaces, where locally high population densities may be associated with anomalous contaminations to an otherwise more uniform population, is of relevance to applications ranging from fundamental research to industrial use cases. Motivated by the specific needs of searches for new phenomena in particle collisions, we propose a…
▽ More
The unsupervised search for overdense regions in high-dimensional feature spaces, where locally high population densities may be associated with anomalous contaminations to an otherwise more uniform population, is of relevance to applications ranging from fundamental research to industrial use cases. Motivated by the specific needs of searches for new phenomena in particle collisions, we propose a novel approach that targets signals of interest populating compact regions of the feature space. The method consists in a systematic scan of subspaces of a standardized copula of the feature space, where the minimum p-value of a hypothesis test of local uniformity is sought by gradient descent. We characterize the performance of the proposed algorithm and show its effectiveness in several experimental situations.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
Advances in Multi-Variate Analysis Methods for New Physics Searches at the Large Hadron Collider
Authors:
Anna Stakia,
Tommaso Dorigo,
Giovanni Banelli,
Daniela Bortoletto,
Alessandro Casa,
Pablo de Castro,
Christophe Delaere,
Julien Donini,
Livio Finos,
Michele Gallinaro,
Andrea Giammanco,
Alexander Held,
Fabricio Jiménez Morales,
Grzegorz Kotkowski,
Seng Pei Liew,
Fabio Maltoni,
Giovanna Menardi,
Ioanna Papavergou,
Alessia Saggio,
Bruno Scarpa,
Giles C. Strong,
Cecilia Tosciri,
João Varela,
Pietro Vischia,
Andreas Weiler
Abstract:
Between the years 2015 and 2019, members of the Horizon 2020-funded Innovative Training Network named "AMVA4NewPhysics" studied the customization and application of advanced multivariate analysis methods and statistical learning tools to high-energy physics problems, as well as developed entirely new ones. Many of those methods were successfully used to improve the sensitivity of data analyses per…
▽ More
Between the years 2015 and 2019, members of the Horizon 2020-funded Innovative Training Network named "AMVA4NewPhysics" studied the customization and application of advanced multivariate analysis methods and statistical learning tools to high-energy physics problems, as well as developed entirely new ones. Many of those methods were successfully used to improve the sensitivity of data analyses performed by the ATLAS and CMS experiments at the CERN Large Hadron Collider; several others, still in the testing phase, promise to further improve the precision of measurements of fundamental physics parameters and the reach of searches for new phenomena. In this paper, the most relevant new tools, among those studied and developed, are presented along with the evaluation of their performances.
△ Less
Submitted 22 November, 2021; v1 submitted 16 May, 2021;
originally announced May 2021.
-
On the impact of selected modern deep-learning techniques to the performance and celerity of classification models in an experimental high-energy physics use case
Authors:
Giles Chatham Strong
Abstract:
Beginning from a basic neural-network architecture, we test the potential benefits offered by a range of advanced techniques for machine learning, in particular deep learning, in the context of a typical classification problem encountered in the domain of high-energy physics, using a well-studied dataset: the 2014 Higgs ML Kaggle dataset. The advantages are evaluated in terms of both performance m…
▽ More
Beginning from a basic neural-network architecture, we test the potential benefits offered by a range of advanced techniques for machine learning, in particular deep learning, in the context of a typical classification problem encountered in the domain of high-energy physics, using a well-studied dataset: the 2014 Higgs ML Kaggle dataset. The advantages are evaluated in terms of both performance metrics and the time required to train and apply the resulting models. Techniques examined include domain-specific data-augmentation, learning rate and momentum scheduling, (advanced) ensembling in both model-space and weight-space, and alternative architectures and connection methods. Following the investigation, we arrive at a model which achieves equal performance to the winning solution of the original Kaggle challenge, whilst being significantly quicker to train and apply, and being suitable for use with both GPU and CPU hardware setups. These reductions in timing and hardware requirements potentially allow the use of more powerful algorithms in HEP analyses, where models must be retrained frequently, sometimes at short notice, by small groups of researchers with limited hardware resources. Additionally, a new wrapper library for PyTorch called LUMIN is presented, which incorporates all of the techniques studied.
△ Less
Submitted 8 May, 2020; v1 submitted 3 February, 2020;
originally announced February 2020.
