-
Physics Community Needs, Tools, and Resources for Machine Learning
Authors:
Philip Harris,
Erik Katsavounidis,
William Patrick McCormack,
Dylan Rankin,
Yongbin Feng,
Abhijith Gandrakota,
Christian Herwig,
Burt Holzman,
Kevin Pedro,
Nhan Tran,
Tingjun Yang,
Jennifer Ngadiuba,
Michael Coughlin,
Scott Hauck,
Shih-Chieh Hsu,
Elham E Khoda,
Deming Chen,
Mark Neubauer,
Javier Duarte,
Georgia Karagiorgi,
Mia Liu
Abstract:
Machine learning (ML) is becoming an increasingly important component of cutting-edge physics research, but its computational requirements present significant challenges. In this white paper, we discuss the needs of the physics community regarding ML across latency and throughput regimes, the tools and resources that offer the possibility of addressing these needs, and how these can be best utiliz…
▽ More
Machine learning (ML) is becoming an increasingly important component of cutting-edge physics research, but its computational requirements present significant challenges. In this white paper, we discuss the needs of the physics community regarding ML across latency and throughput regimes, the tools and resources that offer the possibility of addressing these needs, and how these can be best utilized and accessed in the coming years.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
Applications and Techniques for Fast Machine Learning in Science
Authors:
Allison McCarn Deiana,
Nhan Tran,
Joshua Agar,
Michaela Blott,
Giuseppe Di Guglielmo,
Javier Duarte,
Philip Harris,
Scott Hauck,
Mia Liu,
Mark S. Neubauer,
Jennifer Ngadiuba,
Seda Ogrenci-Memik,
Maurizio Pierini,
Thea Aarrestad,
Steffen Bahr,
Jurgen Becker,
Anne-Sophie Berthold,
Richard J. Bonventre,
Tomas E. Muller Bravo,
Markus Diefenthaler,
Zhen Dong,
Nick Fritzsche,
Amir Gholami,
Ekaterina Govorkova,
Kyle J Hazelwood
, et al. (62 additional authors not shown)
Abstract:
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery. The material for the report builds on two workshops held by the Fast ML for Science community and covers three main areas: applications for fast ML ac…
▽ More
In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to accelerate scientific discovery. The material for the report builds on two workshops held by the Fast ML for Science community and covers three main areas: applications for fast ML across a number of scientific domains; techniques for training and implementing performant and resource-efficient ML algorithms; and computing architectures, platforms, and technologies for deploying these algorithms. We also present overlap** challenges across the multiple scientific domains where common solutions can be found. This community report is intended to give plenty of examples and inspiration for scientific discovery through integrated and accelerated ML solutions. This is followed by a high-level overview and organization of technical advances, including an abundance of pointers to source material, which can enable these breakthroughs.
△ Less
Submitted 25 October, 2021;
originally announced October 2021.
-
Hardware-accelerated Inference for Real-Time Gravitational-Wave Astronomy
Authors:
Alec Gunny,
Dylan Rankin,
Jeffrey Krupa,
Muhammed Saleem,
Tri Nguyen,
Michael Coughlin,
Philip Harris,
Erik Katsavounidis,
Steven Timm,
Burt Holzman
Abstract:
The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network…
▽ More
The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.
△ Less
Submitted 27 August, 2021;
originally announced August 2021.
-
A Coincidence Null Test for Poisson-Distributed Events
Authors:
Reed Essick,
Geoffrey Mo,
Erik Katsavounidis
Abstract:
When transient events are observed with multiple sensors, it is often necessary to establish the significance of coincident events. We derive a universal null test for an arbitrary number of sensors motivated by the archetypal detection problem for independent Poisson-distributed events in gravitational-wave detectors such as LIGO and Virgo. In these detectors, transient events may be witnessed by…
▽ More
When transient events are observed with multiple sensors, it is often necessary to establish the significance of coincident events. We derive a universal null test for an arbitrary number of sensors motivated by the archetypal detection problem for independent Poisson-distributed events in gravitational-wave detectors such as LIGO and Virgo. In these detectors, transient events may be witnessed by myriad channels that record interferometric signals and the surrounding physical environment. We apply our null test to a broad set of simulated gravitational-wave events as well as to a real gravitational-wave detection to determine which auxiliary channels do and do not witness real gravitational waves, and therefore which are safe to use when constructing vetoes. We also describe how our approach can be used to study detector artifacts and their origin, as well as to quantify the statistical independence of candidate GW signals from noise artifacts observed in auxiliary channels.
△ Less
Submitted 27 November, 2020;
originally announced November 2020.
-
Noise Reduction in Gravitational-wave Data via Deep Learning
Authors:
Rich Ormiston,
Tri Nguyen,
Michael Coughlin,
Rana X. Adhikari,
Erik Katsavounidis
Abstract:
With the advent of gravitational wave astronomy, techniques to extend the reach of gravitational wave detectors are desired. In addition to the stellar-mass black hole and neutron star mergers already detected, many more are below the surface of the noise, available for detection if the noise is reduced enough. Our method (DeepClean) applies machine learning algorithms to gravitational wave detect…
▽ More
With the advent of gravitational wave astronomy, techniques to extend the reach of gravitational wave detectors are desired. In addition to the stellar-mass black hole and neutron star mergers already detected, many more are below the surface of the noise, available for detection if the noise is reduced enough. Our method (DeepClean) applies machine learning algorithms to gravitational wave detector data and data from on-site sensors monitoring the instrument to reduce the noise in the time-series due to instrumental artifacts and environmental contamination. This framework is generic enough to subtract linear, non-linear, and non-stationary coupling mechanisms. It may also provide handles in learning about the mechanisms which are not currently understood to be limiting detector sensitivities. The robustness of the noise reduction technique in its ability to efficiently remove noise with no unintended effects on gravitational-wave signals is also addressed through software signal injection and parameter estimation of the recovered signal. It is shown that the optimal SNR ratio of the injected signal is enhanced by $\sim 21.6\%$ and the recovered parameters are consistent with the injected set. We present the performance of this algorithm on linear and non-linear noise sources and discuss its impact on astrophysical searches by gravitational wave detectors.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Beyond single-threshold searches: the Event Stacking Test
Authors:
Ryan Lynch,
Salvatore Vitale,
Erik Katsavounidis
Abstract:
We present a new statistical test that examines the consistency of the tails of two empirical distributions at multiple thresholds. Such distributions are often encountered in counting experiments, in physics and elsewhere, where the significance of populations of events is evaluated. This multi-threshold approach has the effect of "stacking" multiple events into the tail bin of the distribution,…
▽ More
We present a new statistical test that examines the consistency of the tails of two empirical distributions at multiple thresholds. Such distributions are often encountered in counting experiments, in physics and elsewhere, where the significance of populations of events is evaluated. This multi-threshold approach has the effect of "stacking" multiple events into the tail bin of the distribution, and thus we call it the Event Stacking Test. This test has the ability to confidently detect inconsistencies composed of multiple events, even if these events are low-significance outliers in isolation. We derive the Event Stacking Test from first principles and show that the p-value it reports is a well-calibrated representation of noise fluctuations. When applying this test to the detection of gravitational-wave transients in LIGO-Virgo data, we find that it performs better than or comparably to other statistical tests historically used within the gravitational-wave community. This test is particularly well-suited for detecting classes of gravitational-wave transients that are minimally-modeled, i.e., gravitational-wave bursts. We show that the Event Stacking Test allows us to set upper limits on the astrophysical rate-density of gravitational-wave bursts that are stricter than those set using other statistical tests by factors of up to 2 - 3.
△ Less
Submitted 3 November, 2018;
originally announced November 2018.
-
Calibration of the Advanced LIGO detectors for the discovery of the binary black-hole merger GW150914
Authors:
The LIGO Scientific Collaboration,
B. P. Abbott,
R. Abbott,
T. D. Abbott,
M. R. Abernathy,
K. Ackley,
C. Adams,
P. Addesso,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
N. Aggarwal,
O. D. Aguiar,
A. Ain,
P. Ajith,
B. Allen,
P. A. Altin,
D. V. Amariutei,
S. B. Anderson,
W. G. Anderson,
K. Arai,
M. C. Araya,
C. C. Arceneaux,
J. S. Areeda,
K. G. Arun
, et al. (702 additional authors not shown)
Abstract:
In Advanced LIGO, detection and astrophysical source parameter estimation of the binary black hole merger GW150914 requires a calibrated estimate of the gravitational-wave strain sensed by the detectors. Producing an estimate from each detector's differential arm length control loop readout signals requires applying time domain filters, which are designed from a frequency domain model of the detec…
▽ More
In Advanced LIGO, detection and astrophysical source parameter estimation of the binary black hole merger GW150914 requires a calibrated estimate of the gravitational-wave strain sensed by the detectors. Producing an estimate from each detector's differential arm length control loop readout signals requires applying time domain filters, which are designed from a frequency domain model of the detector's gravitational-wave response. The gravitational-wave response model is determined by the detector's opto-mechanical response and the properties of its feedback control system. The measurements used to validate the model and characterize its uncertainty are derived primarily from a dedicated photon radiation pressure actuator, with cross-checks provided by optical and radio frequency references. We describe how the gravitational-wave readout signal is calibrated into equivalent gravitational-wave-induced strain and how the statistical uncertainties and systematic errors are assessed. Detector data collected over 38 calendar days, from September 12 to October 20, 2015, contain the event GW150914 and approximately 16 of coincident data used to estimate the event false alarm probability. The calibration uncertainty is less than 10% in magnitude and 10 degrees in phase across the relevant frequency band 20 Hz to 1 kHz.
△ Less
Submitted 28 February, 2017; v1 submitted 11 February, 2016;
originally announced February 2016.