Consistent, multidimensional differential histogramming and summary statistics with YODA 2
Authors:
Andy Buckley,
Louie Corpe,
Matthew Filipovich,
Christian Gutschow,
Nick Rozinsky,
Simon Thor,
Yoran Yeh,
Jamie Yellen
Abstract:
Histogramming is often taken for granted, but the power and compactness of partially aggregated, multidimensional summary statistics, and their fundamental connection to differential and integral calculus make them formidable statistical objects, especially when very large data volumes are involved. But expressing these concepts robustly and efficiently in high-dimensional parameter spaces and for…
▽ More
Histogramming is often taken for granted, but the power and compactness of partially aggregated, multidimensional summary statistics, and their fundamental connection to differential and integral calculus make them formidable statistical objects, especially when very large data volumes are involved. But expressing these concepts robustly and efficiently in high-dimensional parameter spaces and for large data samples is a highly non-trivial challenge -- doubly so if the resulting library is to remain usable by scientists as opposed to software engineers. In this paper we summarise the core principles required for consistent generalised histogramming, and use them to motivate the design principles and implementation mechanics of the re-engineered YODA histogramming library, a key component of physics data-model comparison and statistical interpretation in collider physics.
△ Less
Submitted 25 April, 2024; v1 submitted 22 December, 2023;
originally announced December 2023.
