-
Auto-tuning capabilities of the ACTS track reconstruction suite
Authors:
Corentin Allaire,
Rocky Bala Garg,
Hadrien Benjamin Grasland,
Elyssa Frances Hofgard,
David Rousseau,
Rama Salahat,
Andreas Salzburger,
Lauren Alexandra Tompkins
Abstract:
The reconstruction of charged particle trajectories is a crucial challenge of particle physics experiments as it directly impacts particle reconstruction and physics performances. To reconstruct these trajectories, different reconstruction algorithms are used sequentially. Each of these algorithms uses many configuration parameters that must be fine-tuned to properly account for the detector/exper…
▽ More
The reconstruction of charged particle trajectories is a crucial challenge of particle physics experiments as it directly impacts particle reconstruction and physics performances. To reconstruct these trajectories, different reconstruction algorithms are used sequentially. Each of these algorithms uses many configuration parameters that must be fine-tuned to properly account for the detector/experimental setup, the available CPU budget and the desired physics performance. Examples of such parameters are cut values limiting the algorithm's search space, approximations accounting for complex phenomenons, or parameters controlling algorithm performance. Until now, these parameters had to be optimised by human experts, which is inefficient and raises issues for the long-term maintainability of such algorithms. Previous experience using machine learning for particle reconstruction (such as the TrackML challenge) has shown that they can be easily adapted to different experiments by learning directly from the data. We propose to bring the same approach to the classic track reconstruction algorithms by connecting them to an agent-driven optimiser, allowing us to find the best input parameters using an iterative tuning approach. We have so far demonstrated this method on different track reconstruction algorithms within A Common Tracking Software (ACTS) framework using the Open Data Detector (ODD). These algorithms include the trajectory seed reconstruction and selection, the particle vertex reconstruction and the generation of simplified material maps used for trajectory reconstruction.
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
-
Ranking-based neural network for ambiguity resolution in ACTS
Authors:
Corentin Allaire,
Françoise Bouvet,
Hadrien Grasland,
David Rousseau
Abstract:
The reconstruction of particle trajectories is a key challenge of particle physics experiments, as it directly impacts particle identification and physics performances while also representing one of the main CPU consumers of many high-energy physics experiments. As the luminosity of particle colliders increases, this reconstruction will become more challenging and resource-intensive. New algorithm…
▽ More
The reconstruction of particle trajectories is a key challenge of particle physics experiments, as it directly impacts particle identification and physics performances while also representing one of the main CPU consumers of many high-energy physics experiments. As the luminosity of particle colliders increases, this reconstruction will become more challenging and resource-intensive. New algorithms are thus needed to address these challenges efficiently. One potential step of track reconstruction is ambiguity resolution. In this step, performed at the end of the tracking chain, we select which tracks candidates should be kept and which must be discarded. The speed of this algorithm is directly driven by the number of track candidates, which can be reduced at the cost of some physics performance. Since this problem is fundamentally an issue of comparison and classification, we propose to use a machine learning-based approach to the Ambiguity Resolution. Using a shared-hits-based clustering algorithm, we can efficiently determine which candidates belong to the same truth particle. Afterwards, we can apply a Neural Network (NN) to compare those tracks and decide which ones are duplicates and which ones should be kept. This approach is implemented within A Common Tracking Software (ACTS) framework and tested on the Open Data Detector (ODD), a realistic virtual detector similar to a future ATLAS one. This new approach was shown to be 15 times faster than the default ACTS algorithm while removing 32 times more duplicates down to less than one duplicated track per event.
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
-
A Common Tracking Software Project
Authors:
Xiaocong Ai,
Corentin Allaire,
Noemi Calace,
Angéla Czirkos,
Irina Ene,
Markus Elsing,
Ralf Farkas,
Louis-Guillaume Gagnon,
Rocky Garg,
Paul Gessinger,
Hadrien Grasland,
Heather M. Gray,
Christian Gumpert,
Julia Hrdinka,
Benjamin Huth,
Moritz Kiehn,
Fabian Klimpel,
Attila Krasznahorkay,
Robert Langenberg,
Charles Leggett,
Joana Niermann,
Joseph D. Osborn,
Andreas Salzburger,
Bastian Schlag,
Lauren Tompkins
, et al. (7 additional authors not shown)
Abstract:
The reconstruction of the trajectories of charged particles, or track reconstruction, is a key computational challenge for particle and nuclear physics experiments. While the tuning of track reconstruction algorithms can depend strongly on details of the detector geometry, the algorithms currently in use by experiments share many common features. At the same time, the intense environment of the Hi…
▽ More
The reconstruction of the trajectories of charged particles, or track reconstruction, is a key computational challenge for particle and nuclear physics experiments. While the tuning of track reconstruction algorithms can depend strongly on details of the detector geometry, the algorithms currently in use by experiments share many common features. At the same time, the intense environment of the High-Luminosity LHC accelerator and other future experiments is expected to put even greater computational stress on track reconstruction software, motivating the development of more performant algorithms. We present here A Common Tracking Software (ACTS) toolkit, which draws on the experience with track reconstruction algorithms in the ATLAS experiment and presents them in an experiment-independent and framework-independent toolkit. It provides a set of high-level track reconstruction tools which are agnostic to the details of the detection technologies and magnetic field configuration and tested for strict thread-safety to support multi-threaded event processing. We discuss the conceptual design and technical implementation of ACTS, selected applications and performance of ACTS, and the lessons learned.
△ Less
Submitted 25 June, 2021;
originally announced June 2021.
-
HL-LHC Computing Review: Common Tools and Community Software
Authors:
HEP Software Foundation,
:,
Thea Aarrestad,
Simone Amoroso,
Markus Julian Atkinson,
Joshua Bendavid,
Tommaso Boccali,
Andrea Bocci,
Andy Buckley,
Matteo Cacciari,
Paolo Calafiura,
Philippe Canal,
Federico Carminati,
Taylor Childers,
Vitaliano Ciulli,
Gloria Corti,
Davide Costanzo,
Justin Gage Dezoort,
Caterina Doglioni,
Javier Mauricio Duarte,
Agnieszka Dziurda,
Peter Elmer,
Markus Elsing,
V. Daniel Elvira,
Giulio Eulisse
, et al. (85 additional authors not shown)
Abstract:
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this doc…
▽ More
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this document we address the issues for software that is used in multiple experiments (usually even more widely than ATLAS and CMS) and maintained by teams of developers who are either not linked to a particular experiment or who contribute to common software within the context of their experiment activity. We also give space to general considerations for future software and projects that tackle upcoming challenges, no matter who writes it, which is an area where community convergence on best practice is extremely useful.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.
-
HEP Software Foundation Community White Paper Working Group - Data Processing Frameworks
Authors:
Paolo Calafiura,
Marco Clemencic,
Hadrien Grasland,
Chris Green,
Benedikt Hegner,
Chris Jones,
Michel Jouvin,
Kyle Knoepfel,
Thomas Kuhr,
Jim Kowalkowski,
Charles Leggett,
Adam Lyon,
David Malon,
Marc Paterno,
Simon Patton,
Elizabeth Sexton-Kennedy,
Graeme A Stewart,
Vakho Tsulaia
Abstract:
Data processing frameworks are an essential part of HEP experiments' software stacks. Frameworks provide a means by which code developers can undertake the essential tasks of physics data processing, accessing relevant inputs and storing their outputs, in a coherent way without needing to know the details of other domains. Frameworks provide essential core services for developers and help deliver…
▽ More
Data processing frameworks are an essential part of HEP experiments' software stacks. Frameworks provide a means by which code developers can undertake the essential tasks of physics data processing, accessing relevant inputs and storing their outputs, in a coherent way without needing to know the details of other domains. Frameworks provide essential core services for developers and help deliver a configurable working application to the experiments' production systems. Modern HEP processing frameworks are in the process of adapting to a new computing landscape dominated by parallel processing and heterogeneity, which pose many questions regarding enhanced functionality and scaling that must be faced without compromising the maintainability of the code. In this paper we identify a program of work that can help further clarify the key concepts of frameworks for HEP and then spawn R&D activities that can focus the community's efforts in the most efficient manner to address the challenges of the upcoming experimental program.
△ Less
Submitted 2 May, 2019; v1 submitted 19 December, 2018;
originally announced December 2018.
-
HEP Software Foundation Community White Paper Working Group --- Visualization
Authors:
Matthew Bellis,
Riccardo Maria Bianchi,
Sebastien Binet,
Ciril Bohak,
Benjamin Couturier,
Hadrien Grasland,
Oliver Gutsche,
Sergey Linev,
Alex Martyniuk,
Thomas McCauley,
Edward Moyse,
Alja Mrak Tadel,
Mark Neubauer,
Jeremi Niedziela,
Leo Piilonen,
Jim Pivarski,
Martin Ritter,
Tai Sakuma,
Matevz Tadel,
Barthélémy von Haller,
Ilija Vukotic,
Ben Waugh
Abstract:
In modern High Energy Physics (HEP) experiments visualization of experimental data has a key role in many activities and tasks across the whole data chain: from detector development to monitoring, from event generation to reconstruction of physics objects, from detector simulation to data analysis, and all the way to outreach and education. In this paper, the definition, status, and evolution of d…
▽ More
In modern High Energy Physics (HEP) experiments visualization of experimental data has a key role in many activities and tasks across the whole data chain: from detector development to monitoring, from event generation to reconstruction of physics objects, from detector simulation to data analysis, and all the way to outreach and education. In this paper, the definition, status, and evolution of data visualization for HEP experiments will be presented. Suggestions for the upgrade of data visualization tools and techniques in current experiments will be outlined, along with guidelines for future experiments. This paper expands on the summary content published in the HSF \emph{Roadmap} Community White Paper~\cite{HSF-CWP-2017-01}
△ Less
Submitted 26 November, 2018;
originally announced November 2018.
-
HEP Community White Paper on Software trigger and event reconstruction: Executive Summary
Authors:
Johannes Albrecht,
Kenneth Bloom,
Tommaso Boccali,
Antonio Boveia,
Michel De Cian,
Caterina Doglioni,
Agnieszka Dziurda,
Amir Farbin,
Conor Fitzpatrick,
Frank Gaede,
Simon George,
Vladimir Gligorov,
Hadrien Grasland,
Lucia Grillo,
Benedikt Hegner,
William Kalderon,
Sami Kama,
Patrick Koppenburg,
Slava Krutelyov,
Rob Kutschke,
Walter Lampl,
David Lange,
Ed Moyse,
Andrew Norman,
Marko Petric
, et al. (17 additional authors not shown)
Abstract:
Realizing the physics programs of the planned and upgraded high-energy physics (HEP) experiments over the next 10 years will require the HEP community to address a number of challenges in the area of software and computing. For this reason, the HEP software community has engaged in a planning process over the past two years, with the objective of identifying and prioritizing the research and devel…
▽ More
Realizing the physics programs of the planned and upgraded high-energy physics (HEP) experiments over the next 10 years will require the HEP community to address a number of challenges in the area of software and computing. For this reason, the HEP software community has engaged in a planning process over the past two years, with the objective of identifying and prioritizing the research and development required to enable the next generation of HEP detectors to fulfill their full physics potential. The aim is to produce a Community White Paper which will describe the community strategy and a roadmap for software and computing research and development in HEP for the 2020s. The topics of event reconstruction and software triggers were considered by a joint working group and are summarized together in this document.
△ Less
Submitted 23 February, 2018;
originally announced February 2018.
-
HEP Community White Paper on Software trigger and event reconstruction
Authors:
Johannes Albrecht,
Kenneth Bloom,
Tommaso Boccali,
Antonio Boveia,
Michel De Cian,
Caterina Doglioni,
Agnieszka Dziurda,
Amir Farbin,
Conor Fitzpatrick,
Frank Gaede,
Simon George,
Vladimir Gligorov,
Hadrien Grasland,
Lucia Grillo,
Benedikt Hegner,
William Kalderon,
Sami Kama,
Patrick Koppenburg,
Slava Krutelyov,
Rob Kutschke,
Walter Lampl,
David Lange,
Ed Moyse,
Andrew Norman,
Marko Petric
, et al. (17 additional authors not shown)
Abstract:
Realizing the physics programs of the planned and upgraded high-energy physics (HEP) experiments over the next 10 years will require the HEP community to address a number of challenges in the area of software and computing. For this reason, the HEP software community has engaged in a planning process over the past two years, with the objective of identifying and prioritizing the research and devel…
▽ More
Realizing the physics programs of the planned and upgraded high-energy physics (HEP) experiments over the next 10 years will require the HEP community to address a number of challenges in the area of software and computing. For this reason, the HEP software community has engaged in a planning process over the past two years, with the objective of identifying and prioritizing the research and development required to enable the next generation of HEP detectors to fulfill their full physics potential. The aim is to produce a Community White Paper which will describe the community strategy and a roadmap for software and computing research and development in HEP for the 2020s. The topics of event reconstruction and software triggers were considered by a joint working group and are summarized together in this document.
△ Less
Submitted 23 February, 2018;
originally announced February 2018.
-
HEP Software Foundation Community White Paper Working Group - Software Development, Deployment and Validation
Authors:
Benjamin Couturier,
Giulio Eulisse,
Hadrien Grasland,
Benedikt Hegner,
Michel Jouvin,
Meghan Kane,
Daniel S. Katz,
Thomas Kuhr,
David Lange,
Patricia Mendez Lorenzo,
Martin Ritter,
Graeme Andrew Stewart,
Andrea Valassi
Abstract:
The High Energy Phyiscs community has developed and needs to maintain many tens of millions of lines of code and to integrate effectively the work of thousands of developers across large collaborations. Software needs to be built, validated, and deployed across hundreds of sites. Software also has a lifetime of many years, frequently beyond that of the original developer, it must be developed with…
▽ More
The High Energy Phyiscs community has developed and needs to maintain many tens of millions of lines of code and to integrate effectively the work of thousands of developers across large collaborations. Software needs to be built, validated, and deployed across hundreds of sites. Software also has a lifetime of many years, frequently beyond that of the original developer, it must be developed with sustainability in mind. Adequate recognition of software development as a critical task in the HEP community needs to be fostered and an appropriate publication and citation strategy needs to be developed. As part of the HEP Softare Foundation's Community White Paper process a working group on Software Development, Deployment and Validation was formed to examine all of these issues, identify best practice and to formulare recommendations for the next decade. Its report is presented here.
△ Less
Submitted 15 June, 2018; v1 submitted 21 December, 2017;
originally announced December 2017.
-
A Roadmap for HEP Software and Computing R&D for the 2020s
Authors:
Johannes Albrecht,
Antonio Augusto Alves Jr,
Guilherme Amadio,
Giuseppe Andronico,
Nguyen Anh-Ky,
Laurent Aphecetche,
John Apostolakis,
Makoto Asai,
Luca Atzori,
Marian Babik,
Giuseppe Bagliesi,
Marilena Bandieramonte,
Sunanda Banerjee,
Martin Barisits,
Lothar A. T. Bauerdick,
Stefano Belforte,
Douglas Benjamin,
Catrin Bernius,
Wahid Bhimji,
Riccardo Maria Bianchi,
Ian Bird,
Catherine Biscarat,
Jakob Blomer,
Kenneth Bloom,
Tommaso Boccali
, et al. (285 additional authors not shown)
Abstract:
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for…
▽ More
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for the HL-LHC in particular, it is critical that all of the collaborating stakeholders agree on the software goals and priorities, and that the efforts complement each other. In this spirit, this white paper describes the R&D activities required to prepare for this software upgrade.
△ Less
Submitted 19 December, 2018; v1 submitted 18 December, 2017;
originally announced December 2017.
