Modeling Distributed Computing Infrastructures for HEP Applications
Authors:
Maximilian Horzela,
Henri Casanova,
Manuel Giffels,
Artur Gottmann,
Robin Hofsaess,
Günter Quast,
Simone Rossi Tisbeni,
Achim Streit,
Frédéric Suter
Abstract:
Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales…
▽ More
Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.
△ Less
Submitted 13 May, 2024; v1 submitted 21 March, 2024;
originally announced March 2024.
ARTUS - A Framework for Event-based Data Analysis in High Energy Physics
Authors:
Joram Berger,
Fabio Colombo,
Raphael Friese,
Dominik Haitz,
Thomas Hauth,
Thomas Müller,
Günter Quast,
Georg Sieber
Abstract:
ARTUS is an event-based data-processing framework for high energy physics experiments. It is designed for large-scale data analysis in a collaborative environment. The architecture design choices take into account typical challenges and are based on experiences with similar applications. The structure of the framework and its advantages are described. An example use case and performance measuremen…
▽ More
ARTUS is an event-based data-processing framework for high energy physics experiments. It is designed for large-scale data analysis in a collaborative environment. The architecture design choices take into account typical challenges and are based on experiences with similar applications. The structure of the framework and its advantages are described. An example use case and performance measurements are presented. The framework is well-tested and successfully used by several analysis groups.
△ Less
Submitted 3 November, 2015;
originally announced November 2015.
