-
Spatial characterization of debris ejection from the interaction of a tightly focused PW-laser pulse with metal targets
Authors:
I. -M. Vladisavlevici,
C. Vlachos,
J. -L. Dubois,
A. Huerta,
S. Agarwal,
H. Ahmed,
J. I. Apiñaniz,
M. Cernaianu,
M. Gugiu,
M. Krupka,
R. Lera,
A. Morabito,
D. Sangwan,
D. Ursescu,
A. Curcio,
N. Fefeu,
J. A. Pérez-Hernández,
T. Vacek,
P. Vicente,
N. Woolsey,
G. Gatti,
M. D. Rodríguez-Frías,
J. J. Santos,
P. W. Bradford,
M. Ehret
Abstract:
We present a novel scheme for rapid quantitative analysis of debris generated during experiments with solid targets following relativistic laser-plasma interaction at high-power laser facilities. Experimental data indicates that predictions by available modelling for non-mass-limited targets are reasonable, with debris on the order of hundreds ug-per-shot. We detect for the first time that several…
▽ More
We present a novel scheme for rapid quantitative analysis of debris generated during experiments with solid targets following relativistic laser-plasma interaction at high-power laser facilities. Experimental data indicates that predictions by available modelling for non-mass-limited targets are reasonable, with debris on the order of hundreds ug-per-shot. We detect for the first time that several % of the debris is ejected directional following the target normal (rear- and interaction side); and confirm previous work that found the debris ejection in direction of the interaction side to be larger than on the side of the target rear.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
A face-centred finite volume method for laminar and turbulent incompressible flows
Authors:
Luan M. Vieira,
Matteo Giacomini,
Ruben Sevilla,
Antonio Huerta
Abstract:
This work develops, for the first time, a face-centred finite volume (FCFV) solver for the simulation of laminar and turbulent viscous incompressible flows. The formulation relies on the Reynolds-averaged Navier-Stokes (RANS) equations coupled with the negative Spalart-Allmaras (SA) model and three novel convective stabilisations, inspired by Riemann solvers, are derived and compared numerically.…
▽ More
This work develops, for the first time, a face-centred finite volume (FCFV) solver for the simulation of laminar and turbulent viscous incompressible flows. The formulation relies on the Reynolds-averaged Navier-Stokes (RANS) equations coupled with the negative Spalart-Allmaras (SA) model and three novel convective stabilisations, inspired by Riemann solvers, are derived and compared numerically. The resulting method achieves first-order convergence of the velocity, the velocity-gradient tensor and the pressure. FCFV accurately predicts engineering quantities of interest, such as drag and lift, on unstructured meshes and, by avoiding gradient reconstruction, the method is less sensitive to mesh quality than other FV methods, even in the presence of highly distorted and stretched cells. A monolithic and a staggered solution strategies for the RANS-SA system are derived and compared numerically. Numerical benchmarks, involving laminar and turbulent, steady and transient cases are used to assess the performance, accuracy and robustness of the proposed FCFV method.
△ Less
Submitted 11 June, 2024; v1 submitted 3 March, 2024;
originally announced March 2024.
-
Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources -- A Case Study on Federated Fine-tuning of LLaMA 2
Authors:
Zilinghan Li,
Shilan He,
Pranshu Chaturvedi,
Volodymyr Kindratenko,
Eliu A Huerta,
Kibaek Kim,
Ravi Madduri
Abstract:
Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the parameters of the locally trained models. In this paper, we elaborate on the design of our Advanced Privacy-Preserving Federated Learning (APPFL) framework, which streamlines end-to-end secure and reliable federated learn…
▽ More
Federated learning enables multiple data owners to collaboratively train robust machine learning models without transferring large or sensitive local datasets by only sharing the parameters of the locally trained models. In this paper, we elaborate on the design of our Advanced Privacy-Preserving Federated Learning (APPFL) framework, which streamlines end-to-end secure and reliable federated learning experiments across cloud computing facilities and high-performance computing resources by leveraging Globus Compute, a distributed function as a service platform, and Amazon Web Services. We further demonstrate the use case of APPFL in fine-tuning a LLaMA 2 7B model using several cloud resources and supercomputers.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
An unfitted high-order HDG method for two-fluid Stokes flow with exact NURBS geometries
Authors:
Stefano Piccardo,
Matteo Giacomini,
Antonio Huerta
Abstract:
A high-order, degree-adaptive hybridizable discontinuous Galerkin (HDG) method is presented for two-fluid incompressible Stokes flows, with boundaries and interfaces described using NURBS. The NURBS curves are embedded in a fixed Cartesian grid, yielding an unfitted HDG scheme capable of treating the exact geometry of the boundaries/interfaces, circumventing the need for fitted, high-order, curved…
▽ More
A high-order, degree-adaptive hybridizable discontinuous Galerkin (HDG) method is presented for two-fluid incompressible Stokes flows, with boundaries and interfaces described using NURBS. The NURBS curves are embedded in a fixed Cartesian grid, yielding an unfitted HDG scheme capable of treating the exact geometry of the boundaries/interfaces, circumventing the need for fitted, high-order, curved meshes. The framework of the NURBS-enhanced finite element method (NEFEM) is employed for accurate quadrature along immersed NURBS and in elements cut by NURBS curves. A Nitsche's formulation is used to enforce Dirichlet conditions on embedded surfaces, yielding unknowns only on the mesh skeleton as in standard HDG, without introducing any additional degree of freedom on non-matching boundaries/interfaces. The resulting unfitted HDG-NEFEM method combines non-conforming meshes, exact NURBS geometry and high-order approximations to provide high-fidelity results on coarse meshes, independent of the geometric features of the domain. Numerical examples illustrate the optimal accuracy and robustness of the method, even in the presence of badly cut cells or faces, and its suitability to simulate microfluidic systems from CAD geometries.
△ Less
Submitted 23 May, 2024; v1 submitted 21 December, 2023;
originally announced December 2023.
-
Enabling End-to-End Secure Federated Learning in Biomedical Research on Heterogeneous Computing Environments with APPFLx
Authors:
Trung-Hieu Hoang,
Jordan Fuhrman,
Ravi Madduri,
Miao Li,
Pranshu Chaturvedi,
Zilinghan Li,
Kibaek Kim,
Minseok Ryu,
Ryan Chard,
E. A. Huerta,
Maryellen Giger
Abstract:
Facilitating large-scale, cross-institutional collaboration in biomedical machine learning projects requires a trustworthy and resilient federated learning (FL) environment to ensure that sensitive information such as protected health information is kept confidential. In this work, we introduce APPFLx, a low-code FL framework that enables the easy setup, configuration, and running of FL experiment…
▽ More
Facilitating large-scale, cross-institutional collaboration in biomedical machine learning projects requires a trustworthy and resilient federated learning (FL) environment to ensure that sensitive information such as protected health information is kept confidential. In this work, we introduce APPFLx, a low-code FL framework that enables the easy setup, configuration, and running of FL experiments across organizational and administrative boundaries while providing secure end-to-end communication, privacy-preserving functionality, and identity management. APPFLx is completely agnostic to the underlying computational infrastructure of participating clients. We demonstrate the capability of APPFLx as an easy-to-use framework for accelerating biomedical studies across institutions and healthcare systems while maintaining the protection of private medical data in two case studies: (1) predicting participant age from electrocardiogram (ECG) waveforms, and (2) detecting COVID-19 disease from chest radiographs. These experiments were performed securely across heterogeneous compute resources, including a mixture of on-premise high-performance computing and cloud computing, and highlight the role of federated learning in improving model generalizability and performance when aggregating data from multiple healthcare systems. Finally, we demonstrate that APPFLx serves as a convenient and easy-to-use framework for accelerating biomedical studies across institutions and healthcare system while maintaining the protection of private medical data.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
Bright Spectroscopic Binaries: III. Binary systems with orbital periods of P > 500 days
Authors:
Dennis Jack,
Missael Alejandro Hernández Huerta,
Faiber Danilo Rosas-Portilla,
Klaus-Peter Schröder
Abstract:
We present an analysis of nine bright spectroscopic binaries (HD 1585, HD 6613, HD 12390, HD 39923, HD 55201, HD 147430, HD 195543, HD 202699, HD 221643), which have orbital periods of P > 500 days. These well-separated binaries are the last stars of our sample that we observed with the TIGRE telescope obtaining intermediate-resolution spectra of R = 20,000. We applied the same method as described…
▽ More
We present an analysis of nine bright spectroscopic binaries (HD 1585, HD 6613, HD 12390, HD 39923, HD 55201, HD 147430, HD 195543, HD 202699, HD 221643), which have orbital periods of P > 500 days. These well-separated binaries are the last stars of our sample that we observed with the TIGRE telescope obtaining intermediate-resolution spectra of R = 20,000. We applied the same method as described in our previous publication of this series. For the analysis of the radial velocity curves, we used the toolkit RadVel, which allowed us to determine all orbital parameters. Recently published orbital solutions of some systems from Gaia DR3 agree with our results. However, our solutions have much smaller uncertainties. We determined the basic stellar parameters of the primary stars with our automatic script using iSpec. The parameter determination allowed us to place all nine stars in the Hertzsprung-Russell diagram. We found that all stars have already evolved to the giant phase. A comparison with stellar evolution tracks of the Eggleton code was applied to determine the stellar masses and ages. As a result of our analysis, we were able to estimate the masses of the secondary stars and the orbital inclinations of the binary systems.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
Waveform Modelling for the Laser Interferometer Space Antenna
Authors:
LISA Consortium Waveform Working Group,
Niayesh Afshordi,
Sarp Akçay,
Pau Amaro Seoane,
Andrea Antonelli,
Josu C. Aurrekoetxea,
Leor Barack,
Enrico Barausse,
Robert Benkel,
Laura Bernard,
Sebastiano Bernuzzi,
Emanuele Berti,
Matteo Bonetti,
Béatrice Bonga,
Gabriele Bozzola,
Richard Brito,
Alessandra Buonanno,
Alejandro Cárdenas-Avendaño,
Marc Casals,
David F. Chernoff,
Alvin J. K. Chua,
Katy Clough,
Marta Colleoni,
Mekhi Dhesi,
Adrien Druart
, et al. (121 additional authors not shown)
Abstract:
LISA, the Laser Interferometer Space Antenna, will usher in a new era in gravitational-wave astronomy. As the first anticipated space-based gravitational-wave detector, it will expand our view to the millihertz gravitational-wave sky, where a spectacular variety of interesting new sources abound: from millions of ultra-compact binaries in our Galaxy, to mergers of massive black holes at cosmologic…
▽ More
LISA, the Laser Interferometer Space Antenna, will usher in a new era in gravitational-wave astronomy. As the first anticipated space-based gravitational-wave detector, it will expand our view to the millihertz gravitational-wave sky, where a spectacular variety of interesting new sources abound: from millions of ultra-compact binaries in our Galaxy, to mergers of massive black holes at cosmological distances; from the beginnings of inspirals that will venture into the ground-based detectors' view to the death spiral of compact objects into massive black holes, and many sources in between. Central to realising LISA's discovery potential are waveform models, the theoretical and phenomenological predictions of the pattern of gravitational waves that these sources emit. This white paper is presented on behalf of the Waveform Working Group for the LISA Consortium. It provides a review of the current state of waveform models for LISA sources, and describes the significant challenges that must yet be overcome.
△ Less
Submitted 20 December, 2023; v1 submitted 2 November, 2023;
originally announced November 2023.
-
AI ensemble for signal detection of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
Authors:
Minyang Tian,
E. A. Huerta,
Huihuo Zheng
Abstract:
We introduce spatiotemporal-graph models that concurrently process data from the twin advanced LIGO detectors and the advanced Virgo detector. We trained these AI classifiers with 2.4 million IMRPhenomXPHM waveforms that describe quasi-circular, spinning, non-precessing binary black hole mergers with component masses $m_{\{1,2\}}\in[3M_\odot, 50 M_\odot]$, and individual spins…
▽ More
We introduce spatiotemporal-graph models that concurrently process data from the twin advanced LIGO detectors and the advanced Virgo detector. We trained these AI classifiers with 2.4 million IMRPhenomXPHM waveforms that describe quasi-circular, spinning, non-precessing binary black hole mergers with component masses $m_{\{1,2\}}\in[3M_\odot, 50 M_\odot]$, and individual spins $s^z_{\{1,2\}}\in[-0.9, 0.9]$; and which include the $(\ell, |m|) = \{(2, 2), (2, 1), (3, 3), (3, 2), (4, 4)\}$ modes, and mode mixing effects in the $\ell = 3, |m| = 2$ harmonics. We trained these AI classifiers within 22 hours using distributed training over 96 NVIDIA V100 GPUs in the Summit supercomputer. We then used transfer learning to create AI predictors that estimate the total mass of potential binary black holes identified by all AI classifiers in the ensemble. We used this ensemble, 3 classifiers for signal detection and 2 total mass predictors, to process a year-long test set in which we injected 300,000 signals. This year-long test set was processed within 5.19 minutes using 1024 NVIDIA A100 GPUs in the Polaris supercomputer (for AI inference) and 128 CPU nodes in the ThetaKNL supercomputer (for post-processing of noise triggers), housed at the Argonne Leadership Computing Facility. These studies indicate that our AI ensemble provides state-of-the-art signal detection accuracy, and reports 2 misclassifications for every year of searched data. This is the first AI ensemble designed to search for and find higher order gravitational wave mode signals.
△ Less
Submitted 4 December, 2023; v1 submitted 29 September, 2023;
originally announced October 2023.
-
FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices using a Computing Power Aware Scheduler
Authors:
Zilinghan Li,
Pranshu Chaturvedi,
Shilan He,
Han Chen,
Gagandeep Singh,
Volodymyr Kindratenko,
E. A. Huerta,
Kibaek Kim,
Ravi Madduri
Abstract:
Cross-silo federated learning offers a promising solution to collaboratively train robust and generalized AI models without compromising the privacy of local datasets, e.g., healthcare, financial, as well as scientific projects that lack a centralized data facility. Nonetheless, because of the disparity of computing resources among different clients (i.e., device heterogeneity), synchronous federa…
▽ More
Cross-silo federated learning offers a promising solution to collaboratively train robust and generalized AI models without compromising the privacy of local datasets, e.g., healthcare, financial, as well as scientific projects that lack a centralized data facility. Nonetheless, because of the disparity of computing resources among different clients (i.e., device heterogeneity), synchronous federated learning algorithms suffer from degraded efficiency when waiting for straggler clients. Similarly, asynchronous federated learning algorithms experience degradation in the convergence rate and final model accuracy on non-identically and independently distributed (non-IID) heterogeneous datasets due to stale local models and client drift. To address these limitations in cross-silo federated learning with heterogeneous clients and data, we propose FedCompass, an innovative semi-asynchronous federated learning algorithm with a computing power-aware scheduler on the server side, which adaptively assigns varying amounts of training tasks to different clients using the knowledge of the computing power of individual clients. FedCompass ensures that multiple locally trained models from clients are received almost simultaneously as a group for aggregation, effectively reducing the staleness of local models. At the same time, the overall training process remains asynchronous, eliminating prolonged waiting periods from straggler clients. Using diverse non-IID heterogeneous distributed datasets, we demonstrate that FedCompass achieves faster convergence and higher accuracy than other asynchronous algorithms while remaining more efficient than synchronous algorithms when performing federated learning on heterogeneous clients. The source code for FedCompass is available at https://github.com/APPFL/FedCompass.
△ Less
Submitted 11 March, 2024; v1 submitted 26 September, 2023;
originally announced September 2023.
-
APPFLx: Providing Privacy-Preserving Cross-Silo Federated Learning as a Service
Authors:
Zilinghan Li,
Shilan He,
Pranshu Chaturvedi,
Trung-Hieu Hoang,
Minseok Ryu,
E. A. Huerta,
Volodymyr Kindratenko,
Jordan Fuhrman,
Maryellen Giger,
Ryan Chard,
Kibaek Kim,
Ravi Madduri
Abstract:
Cross-silo privacy-preserving federated learning (PPFL) is a powerful tool to collaboratively train robust and generalized machine learning (ML) models without sharing sensitive (e.g., healthcare of financial) local data. To ease and accelerate the adoption of PPFL, we introduce APPFLx, a ready-to-use platform that provides privacy-preserving cross-silo federated learning as a service. APPFLx empl…
▽ More
Cross-silo privacy-preserving federated learning (PPFL) is a powerful tool to collaboratively train robust and generalized machine learning (ML) models without sharing sensitive (e.g., healthcare of financial) local data. To ease and accelerate the adoption of PPFL, we introduce APPFLx, a ready-to-use platform that provides privacy-preserving cross-silo federated learning as a service. APPFLx employs Globus authentication to allow users to easily and securely invite trustworthy collaborators for PPFL, implements several synchronous and asynchronous FL algorithms, streamlines the FL experiment launch process, and enables tracking and visualizing the life cycle of FL experiments, allowing domain experts and ML practitioners to easily orchestrate and evaluate cross-silo FL under one platform. APPFLx is available online at https://appflx.link
△ Less
Submitted 17 August, 2023;
originally announced August 2023.
-
APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics
Authors:
Hyun Park,
Parth Patel,
Roland Haas,
E. A. Huerta
Abstract:
The prediction of protein 3D structure from amino acid sequence is a computational grand challenge in biophysics, and plays a key role in robust protein structure prediction algorithms, from drug discovery to genome interpretation. The advent of AI models, such as AlphaFold, is revolutionizing applications that depend on robust protein structure prediction algorithms. To maximize the impact, and e…
▽ More
The prediction of protein 3D structure from amino acid sequence is a computational grand challenge in biophysics, and plays a key role in robust protein structure prediction algorithms, from drug discovery to genome interpretation. The advent of AI models, such as AlphaFold, is revolutionizing applications that depend on robust protein structure prediction algorithms. To maximize the impact, and ease the usability, of these novel AI tools we introduce APACE, AlphaFold2 and advanced computing as a service, a novel computational framework that effectively handles this AI model and its TB-size database to conduct accelerated protein structure prediction analyses in modern supercomputing environments. We deployed APACE in the Delta and Polaris supercomputers, and quantified its performance for accurate protein structure predictions using four exemplar proteins: 6AWO, 6OAN, 7MEZ, and 6D6U. Using up to 300 ensembles, distributed across 200 NVIDIA A100 GPUs, we found that APACE is up to two orders of magnitude faster than off-the-self AlphaFold2 implementations, reducing time-to-solution from weeks to minutes. This computational approach may be readily linked with robotics laboratories to automate and accelerate scientific discovery.
△ Less
Submitted 1 July, 2024; v1 submitted 15 August, 2023;
originally announced August 2023.
-
Star Cluster Classification using Deep Transfer Learning with PHANGS-HST
Authors:
Stephen Hannon,
Bradley C. Whitmore,
Janice C. Lee,
David A. Thilker,
Sinan Deger,
E. A. Huerta,
Wei Wei,
Bahram Mobasher,
Ralf Klessen,
Mederic Boquien,
Daniel A. Dale,
Melanie Chevance,
Kathryn Grasha,
Patricia Sanchez-Blazquez,
Thomas Williams,
Fabian Scheuermann,
Brent Groves,
Hwihyun Kim,
J. M. Diederick Kruijssen,
the PHANGS-HST Team
Abstract:
Currently available star cluster catalogues from HST imaging of nearby galaxies heavily rely on visual inspection and classification of candidate clusters. The time-consuming nature of this process has limited the production of reliable catalogues and thus also post-observation analysis. To address this problem, deep transfer learning has recently been used to create neural network models which ac…
▽ More
Currently available star cluster catalogues from HST imaging of nearby galaxies heavily rely on visual inspection and classification of candidate clusters. The time-consuming nature of this process has limited the production of reliable catalogues and thus also post-observation analysis. To address this problem, deep transfer learning has recently been used to create neural network models which accurately classify star cluster morphologies at production scale for nearby spiral galaxies (D < 20 Mpc). Here, we use HST UV-optical imaging of over 20,000 sources in 23 galaxies from the Physics at High Angular Resolution in Nearby GalaxieS (PHANGS) survey to train and evaluate two new sets of models: i) distance-dependent models, based on cluster candidates binned by galaxy distance (9-12 Mpc, 14-18 Mpc, 18-24 Mpc), and ii) distance-independent models, based on the combined sample of candidates from all galaxies. We find that the overall accuracy of both sets of models is comparable to previous automated star cluster classification studies (~60-80 per cent) and show improvement by a factor of two in classifying asymmetric and multi-peaked clusters from PHANGS-HST. Somewhat surprisingly, while we observe a weak negative correlation between model accuracy and galactic distance, we find that training separate models for the three distance bins does not significantly improve classification accuracy. We also evaluate model accuracy as a function of cluster properties such as brightness, colour, and SED-fit age. Based on the success of these experiments, our models will provide classifications for the full set of PHANGS-HST candidate clusters (N ~ 200,000) for public release.
△ Less
Submitted 27 July, 2023;
originally announced July 2023.
-
Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
Authors:
Minyang Tian,
E. A. Huerta,
Huihuo Zheng,
Prayush Kumar
Abstract:
We present a new class of AI models for the detection of quasi-circular, spinning, non-precessing binary black hole mergers whose waveforms include the higher order gravitational wave modes $(l, |m|)=\{(2, 2), (2, 1), (3, 3), (3, 2), (4, 4)\}$, and mode mixing effects in the $l = 3, |m| = 2$ harmonics. These AI models combine hybrid dilated convolution neural networks to accurately model both shor…
▽ More
We present a new class of AI models for the detection of quasi-circular, spinning, non-precessing binary black hole mergers whose waveforms include the higher order gravitational wave modes $(l, |m|)=\{(2, 2), (2, 1), (3, 3), (3, 2), (4, 4)\}$, and mode mixing effects in the $l = 3, |m| = 2$ harmonics. These AI models combine hybrid dilated convolution neural networks to accurately model both short- and long-range temporal sequential information of gravitational waves; and graph neural networks to capture spatial correlations among gravitational wave observatories to consistently describe and identify the presence of a signal in a three detector network encompassing the Advanced LIGO and Virgo detectors. We first trained these spatiotemporal-graph AI models using synthetic noise, using 1.2 million modeled waveforms to densely sample this signal manifold, within 1.7 hours using 256 A100 GPUs in the Polaris supercomputer at the ALCF. Our distributed training approach had optimal performance, and strong scaling up to 512 A100 GPUs. With these AI ensembles we processed data from a three detector network, and found that an ensemble of 4 AI models achieves state-of-the-art performance for signal detection, and reports two misclassifications for every decade of searched data. We distributed AI inference over 128 GPUs in the Polaris supercomputer and 128 nodes in the Theta supercomputer, and completed the processing of a decade of gravitational wave data from a three detector network within 3.5 hours. Finally, we fine-tuned these AI ensembles to process the entire month of February 2020, which is part of the O3b LIGO/Virgo observation run, and found 6 gravitational waves, concurrently identified in Advanced LIGO and Advanced Virgo data, and zero false positives. This analysis was completed in one hour using one A100 GPU.
△ Less
Submitted 18 June, 2024; v1 submitted 27 June, 2023;
originally announced June 2023.
-
A generative artificial intelligence framework based on a molecular diffusion model for the design of metal-organic frameworks for carbon capture
Authors:
Hyun Park,
Xiaoli Yan,
Ruijie Zhu,
E. A. Huerta,
Santanu Chaudhuri,
Donny Cooper,
Ian Foster,
Emad Tajkhorshid
Abstract:
Metal-organic frameworks (MOFs) exhibit great promise for CO2 capture. However, finding the best performing materials poses computational and experimental grand challenges in view of the vast chemical space of potential building blocks. Here, we introduce GHP-MOFassemble, a generative artificial intelligence (AI), high performance framework for the rational and accelerated design of MOFs with high…
▽ More
Metal-organic frameworks (MOFs) exhibit great promise for CO2 capture. However, finding the best performing materials poses computational and experimental grand challenges in view of the vast chemical space of potential building blocks. Here, we introduce GHP-MOFassemble, a generative artificial intelligence (AI), high performance framework for the rational and accelerated design of MOFs with high CO2 adsorption capacity and synthesizable linkers. GHP-MOFassemble generates novel linkers, assembled with one of three pre-selected metal nodes (Cu paddlewheel, Zn paddlewheel, Zn tetramer) into MOFs in a primitive cubic topology. GHP-MOFassemble screens and validates AI-generated MOFs for uniqueness, synthesizability, structural validity, uses molecular dynamics simulations to study their stability and chemical consistency, and crystal graph neural networks and Grand Canonical Monte Carlo simulations to quantify their CO2 adsorption capacities. We present the top six AI-generated MOFs with CO2 capacities greater than 2 $m mol/g$, i.e., higher than 96.9% of structures in the hypothetical MOF dataset.
△ Less
Submitted 12 March, 2024; v1 submitted 14 June, 2023;
originally announced June 2023.
-
Magnetohydrodynamics with Physics Informed Neural Operators
Authors:
Shawn G. Rosofsky,
E. A. Huerta
Abstract:
The modeling of multi-scale and multi-physics complex systems typically involves the use of scientific software that can optimally leverage extreme scale computing. Despite major developments in recent years, these simulations continue to be computationally intensive and time consuming. Here we explore the use of AI to accelerate the modeling of complex systems at a fraction of the computational c…
▽ More
The modeling of multi-scale and multi-physics complex systems typically involves the use of scientific software that can optimally leverage extreme scale computing. Despite major developments in recent years, these simulations continue to be computationally intensive and time consuming. Here we explore the use of AI to accelerate the modeling of complex systems at a fraction of the computational cost of classical methods, and present the first application of physics informed neural operators to model 2D incompressible magnetohydrodynamics simulations. Our AI models incorporate tensor Fourier neural operators as their backbone, which we implemented with the TensorLY package. Our results indicate that physics informed neural operators can accurately capture the physics of magnetohydrodynamics simulations that describe laminar flows with Reynolds numbers $Re\leq250$. We also explore the applicability of our AI surrogates for turbulent flows, and discuss a variety of methodologies that may be incorporated in future work to create AI models that provide a computationally efficient and high fidelity description of magnetohydrodynamics simulations for a broad range of Reynolds numbers. The scientific software developed in this project is released with this manuscript.
△ Less
Submitted 7 July, 2023; v1 submitted 13 February, 2023;
originally announced February 2023.
-
End-to-end AI framework for interpretable prediction of molecular and crystal properties
Authors:
Hyun Park,
Ruijie Zhu,
E. A. Huerta,
Santanu Chaudhuri,
Emad Tajkhorshid,
Donny Cooper
Abstract:
We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models including CGCNN, PhysNet, SchNet, MPNN, MPNN-transformer, and TorchMD-NET. We employ these AI models along with the benchmark QM9, hMOF, and MD17 datasets to showc…
▽ More
We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference. The framework is based on state-of-the-art AI models including CGCNN, PhysNet, SchNet, MPNN, MPNN-transformer, and TorchMD-NET. We employ these AI models along with the benchmark QM9, hMOF, and MD17 datasets to showcase how the models can predict user-specified material properties within modern computing environments. We demonstrate transferable applications in the modeling of small molecules, inorganic crystals and nanoporous metal organic frameworks with a unified, standalone framework. We have deployed and tested this framework in the ThetaGPU supercomputer at the Argonne Leadership Computing Facility, and in the Delta supercomputer at the National Center for Supercomputing Applications to provide researchers with modern tools to conduct accelerated AI-driven discovery in leadership-class computing environments. We release these digital assets as open source scientific software in GitLab, and ready-to-use Jupyter notebooks in Google Colab.
△ Less
Submitted 14 August, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
FAIR AI Models in High Energy Physics
Authors:
Javier Duarte,
Haoyang Li,
Avik Roy,
Ruike Zhu,
E. A. Huerta,
Daniel Diaz,
Philip Harris,
Raghav Kansal,
Daniel S. Katz,
Ishaan H. Kavoori,
Volodymyr V. Kindratenko,
Farouk Mokhtar,
Mark S. Neubauer,
Sang Eon Park,
Melissa Quinnan,
Roger Rusack,
Zhizhen Zhao
Abstract:
The findable, accessible, interoperable, and reusable (FAIR) data principles provide a framework for examining, evaluating, and improving how data is shared to facilitate scientific discovery. Generalizing these principles to research software and other digital products is an active area of research. Machine learning (ML) models -- algorithms that have been trained on data without being explicitly…
▽ More
The findable, accessible, interoperable, and reusable (FAIR) data principles provide a framework for examining, evaluating, and improving how data is shared to facilitate scientific discovery. Generalizing these principles to research software and other digital products is an active area of research. Machine learning (ML) models -- algorithms that have been trained on data without being explicitly programmed -- and more generally, artificial intelligence (AI) models, are an important target for this because of the ever-increasing pace with which AI is transforming scientific domains, such as experimental high energy physics (HEP). In this paper, we propose a practical definition of FAIR principles for AI models in HEP and describe a template for the application of these principles. We demonstrate the template's use with an example AI model applied to HEP, in which a graph neural network is used to identify Higgs bosons decaying to two bottom quarks. We report on the robustness of this FAIR AI model, its portability across hardware architectures and software frameworks, and its interpretability.
△ Less
Submitted 29 December, 2023; v1 submitted 9 December, 2022;
originally announced December 2022.
-
FAIR for AI: An interdisciplinary and international community building perspective
Authors:
E. A. Huerta,
Ben Blaiszik,
L. Catherine Brinson,
Kristofer E. Bouchard,
Daniel Diaz,
Caterina Doglioni,
Javier M. Duarte,
Murali Emani,
Ian Foster,
Geoffrey Fox,
Philip Harris,
Lukas Heinrich,
Shantenu Jha,
Daniel S. Katz,
Volodymyr Kindratenko,
Christine R. Kirkpatrick,
Kati Lassila-Perini,
Ravi K. Madduri,
Mark S. Neubauer,
Fotis E. Psomopoulos,
Avik Roy,
Oliver Rübel,
Zhizhen Zhao,
Ruike Zhu
Abstract:
A foundational set of findable, accessible, interoperable, and reusable (FAIR) principles were proposed in 2016 as prerequisites for proper data management and stewardship, with the goal of enabling the reusability of scholarly data. The principles were also meant to apply to other digital assets, at a high level, and over time, the FAIR guiding principles have been re-interpreted or extended to i…
▽ More
A foundational set of findable, accessible, interoperable, and reusable (FAIR) principles were proposed in 2016 as prerequisites for proper data management and stewardship, with the goal of enabling the reusability of scholarly data. The principles were also meant to apply to other digital assets, at a high level, and over time, the FAIR guiding principles have been re-interpreted or extended to include the software, tools, algorithms, and workflows that produce data. FAIR principles are now being adapted in the context of AI models and datasets. Here, we present the perspectives, vision, and experiences of researchers from different countries, disciplines, and backgrounds who are leading the definition and adoption of FAIR principles in their communities of practice, and discuss outcomes that may result from pursuing and incentivizing FAIR AI research. The material for this report builds on the FAIR for AI Workshop held at Argonne National Laboratory on June 7, 2022.
△ Less
Submitted 1 August, 2023; v1 submitted 30 September, 2022;
originally announced October 2022.
-
Numerical relativity higher order gravitational waveforms of eccentric, spinning, non-precessing binary black hole mergers
Authors:
Abhishek V. Joshi,
Shawn G. Rosofsky,
Roland Haas,
E. A. Huerta
Abstract:
We use the open source, community-driven, numerical relativity software, the Einstein Toolkit to study the physics of eccentric, spinning, nonprecessing binary black hole mergers with mass-ratios $q=\{2, 4, 6\}$, individual dimensionless spin parameters $χ_{1z}=\pm0.6$, $χ_{2z}=\pm0.3$, that include higher order gravitational wave modes $\ell\leq4$, except for memory modes. Assuming stellar mass b…
▽ More
We use the open source, community-driven, numerical relativity software, the Einstein Toolkit to study the physics of eccentric, spinning, nonprecessing binary black hole mergers with mass-ratios $q=\{2, 4, 6\}$, individual dimensionless spin parameters $χ_{1z}=\pm0.6$, $χ_{2z}=\pm0.3$, that include higher order gravitational wave modes $\ell\leq4$, except for memory modes. Assuming stellar mass binary black hole mergers that may be detectable by the advanced LIGO detectors, we find that including modes up to $\ell=4$ increases the signal-to-noise of compact binaries between $3.5\%$ to $35\%$, compared to signals that only include the $\ell=|m|=2$ mode. We use two waveform models, TEOBResumS and SEOBNRE, which incorporate spin and eccentricity corrections in the waveform dynamics, to quantify the orbital eccentricity of our numerical relativity catalog in a gauge-invariant manner through fitting factor calculations. Our findings indicate that the inclusion of higher order wave modes has a measurable effect in the recovery of moderately and highly eccentric black hole mergers, and thus it is essential to develop waveform models and signal processing tools that accurately describe the physics of these astrophysical sources.
△ Less
Submitted 21 March, 2023; v1 submitted 4 October, 2022;
originally announced October 2022.
-
MLGWSC-1: The first Machine Learning Gravitational-Wave Search Mock Data Challenge
Authors:
Marlin B. Schäfer,
Ondřej Zelenka,
Alexander H. Nitz,
He Wang,
Shichao Wu,
Zong-Kuan Guo,
Zhoujian Cao,
Zhixiang Ren,
Paraskevi Nousi,
Nikolaos Stergioulas,
Panagiotis Iosif,
Alexandra E. Koloniari,
Anastasios Tefas,
Nikolaos Passalis,
Francesco Salemi,
Gabriele Vedovato,
Sergey Klimenko,
Tanmaya Mishra,
Bernd Brügmann,
Elena Cuoco,
E. A. Huerta,
Chris Messenger,
Frank Ohme
Abstract:
We present the results of the first Machine Learning Gravitational-Wave Search Mock Data Challenge (MLGWSC-1). For this challenge, participating groups had to identify gravitational-wave signals from binary black hole mergers of increasing complexity and duration embedded in progressively more realistic noise. The final of the 4 provided datasets contained real noise from the O3a observing run and…
▽ More
We present the results of the first Machine Learning Gravitational-Wave Search Mock Data Challenge (MLGWSC-1). For this challenge, participating groups had to identify gravitational-wave signals from binary black hole mergers of increasing complexity and duration embedded in progressively more realistic noise. The final of the 4 provided datasets contained real noise from the O3a observing run and signals up to a duration of 20 seconds with the inclusion of precession effects and higher order modes. We present the average sensitivity distance and runtime for the 6 entered algorithms derived from 1 month of test data unknown to the participants prior to submission. Of these, 4 are machine learning algorithms. We find that the best machine learning based algorithms are able to achieve up to 95% of the sensitive distance of matched-filtering based production analyses for simulated Gaussian noise at a false-alarm rate (FAR) of one per month. In contrast, for real noise, the leading machine learning search achieved 70%. For higher FARs the differences in sensitive distance shrink to the point where select machine learning submissions outperform traditional search algorithms at FARs $\geq 200$ per month on some datasets. Our results show that current machine learning search algorithms may already be sensitive enough in limited parameter regions to be useful for some production settings. To improve the state-of-the-art, machine learning algorithms need to reduce the false-alarm rates at which they are capable of detecting signals and extend their validity to regions of parameter space where modeled searches are computationally expensive to run. Based on our findings we compile a list of research areas that we believe are the most important to elevate machine learning searches to an invaluable tool in gravitational-wave signal detection.
△ Less
Submitted 22 September, 2022;
originally announced September 2022.
-
Benchmarking the face-centred finite volume method for compressible laminar flows
Authors:
Jordi Vila-Pérez,
Matteo Giacomini,
Antonio Huerta
Abstract:
Purpose: This study aims to assess the robustness and accuracy of the face-centred finite volume (FCFV) method for the simulation of compressible laminar flows in different regimes, using numerical benchmarks.
Design/methodology/approach: The work presents a detailed comparison with reference solutions published in the literature -- when available -- and numerical results computed using a commer…
▽ More
Purpose: This study aims to assess the robustness and accuracy of the face-centred finite volume (FCFV) method for the simulation of compressible laminar flows in different regimes, using numerical benchmarks.
Design/methodology/approach: The work presents a detailed comparison with reference solutions published in the literature -- when available -- and numerical results computed using a commercial cell-centred finite volume software.
Findings: The FCFV scheme provides first-order accurate approximations of the viscous stress tensor and the heat flux, insensitively to cell distortion or stretching. The strategy demonstrates its efficiency in inviscid and viscous flows, for a wide range of Mach numbers, also in the incompressible limit. In purely inviscid flows, non-oscillatory approximations are obtained in the presence of shock waves. In the incompressible limit, accurate solutions are computed without pressure correction algorithms. The method shows its superior performance for viscous high Mach number flows, achieving physically admissible solutions without carbuncle effect and predictions of quantities of interest with errors below 5%.
Originality/value: The FCFV method accurately evaluates, for a wide range of compressible laminar flows, quantities of engineering interest, such as drag, lift and heat transfer coefficients, on unstructured meshes featuring distorted and highly stretched cells, with an aspect ratio up to ten thousand. The method is suitable to simulate industrial flows on complex geometries, relaxing the requirements on mesh quality introduced by existing finite volume solvers and alleviating the need for time-consuming manual procedures for mesh generation to be performed by specialised technicians.
△ Less
Submitted 11 December, 2022; v1 submitted 4 August, 2022;
originally announced August 2022.
-
FAIR principles for AI models with a practical application for accelerated high energy diffraction microscopy
Authors:
Nikil Ravi,
Pranshu Chaturvedi,
E. A. Huerta,
Zhengchun Liu,
Ryan Chard,
Aristana Scourtas,
K. J. Schmidt,
Kyle Chard,
Ben Blaiszik,
Ian Foster
Abstract:
A concise and measurable set of FAIR (Findable, Accessible, Interoperable and Reusable) principles for scientific data is transforming the state-of-practice for data management and stewardship, supporting and enabling discovery and innovation. Learning from this initiative, and acknowledging the impact of artificial intelligence (AI) in the practice of science and engineering, we introduce a set o…
▽ More
A concise and measurable set of FAIR (Findable, Accessible, Interoperable and Reusable) principles for scientific data is transforming the state-of-practice for data management and stewardship, supporting and enabling discovery and innovation. Learning from this initiative, and acknowledging the impact of artificial intelligence (AI) in the practice of science and engineering, we introduce a set of practical, concise, and measurable FAIR principles for AI models. We showcase how to create and share FAIR data and AI models within a unified computational framework combining the following elements: the Advanced Photon Source at Argonne National Laboratory, the Materials Data Facility, the Data and Learning Hub for Science, and funcX, and the Argonne Leadership Computing Facility (ALCF), in particular the ThetaGPU supercomputer and the SambaNova DataScale system at the ALCF AI Testbed. We describe how this domain-agnostic computational framework may be harnessed to enable autonomous AI-driven discovery.
△ Less
Submitted 21 December, 2022; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Applications of physics informed neural operators
Authors:
Shawn G. Rosofsky,
Hani Al Majed,
E. A. Huerta
Abstract:
We present an end-to-end framework to learn partial differential equations that brings together initial data production, selection of boundary conditions, and the use of physics-informed neural operators to solve partial differential equations that are ubiquitous in the study and modeling of physics phenomena. We first demonstrate that our methods reproduce the accuracy and performance of other ne…
▽ More
We present an end-to-end framework to learn partial differential equations that brings together initial data production, selection of boundary conditions, and the use of physics-informed neural operators to solve partial differential equations that are ubiquitous in the study and modeling of physics phenomena. We first demonstrate that our methods reproduce the accuracy and performance of other neural operators published elsewhere in the literature to learn the 1D wave equation and the 1D Burgers equation. Thereafter, we apply our physics-informed neural operators to learn new types of equations, including the 2D Burgers equation in the scalar, inviscid and vector types. Finally, we show that our approach is also applicable to learn the physics of the 2D linear and nonlinear shallow water equations, which involve three coupled partial differential equations. We release our artificial intelligence surrogates and scientific software to produce initial data and boundary conditions to study a broad range of physically motivated scenarios. We provide the source code, an interactive website to visualize the predictions of our physics informed neural operators, and a tutorial for their use at the Data and Learning Hub for Science.
△ Less
Submitted 8 December, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Interpreting a Machine Learning Model for Detecting Gravitational Waves
Authors:
Mohammadtaher Safarzadeh,
Asad Khan,
E. A. Huerta,
Martin Wattenberg
Abstract:
We describe a case study of translational research, applying interpretability techniques developed for computer vision to machine learning models used to search for and find gravitational waves. The models we study are trained to detect black hole merger events in non-Gaussian and non-stationary advanced Laser Interferometer Gravitational-wave Observatory (LIGO) data. We produced visualizations of…
▽ More
We describe a case study of translational research, applying interpretability techniques developed for computer vision to machine learning models used to search for and find gravitational waves. The models we study are trained to detect black hole merger events in non-Gaussian and non-stationary advanced Laser Interferometer Gravitational-wave Observatory (LIGO) data. We produced visualizations of the response of machine learning models when they process advanced LIGO data that contains real gravitational wave signals, noise anomalies, and pure advanced LIGO noise. Our findings shed light on the responses of individual neurons in these machine learning models. Further analysis suggests that different parts of the network appear to specialize in local versus global features, and that this difference appears to be rooted in the branched architecture of the network as well as noise characteristics of the LIGO detectors. We believe efforts to whiten these "black box" models can suggest future avenues for research and help inform the design of interpretable machine learning models for gravitational wave astrophysics.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
-
Inference-optimized AI and high performance computing for gravitational wave detection at scale
Authors:
Pranshu Chaturvedi,
Asad Khan,
Minyang Tian,
E. A. Huerta,
Huihuo Zheng
Abstract:
We introduce an ensemble of artificial intelligence models for gravitational wave detection that we trained in the Summit supercomputer using 32 nodes, equivalent to 192 NVIDIA V100 GPUs, within 2 hours. Once fully trained, we optimized these models for accelerated inference using NVIDIA TensorRT. We deployed our inference-optimized AI ensemble in the ThetaGPU supercomputer at Argonne Leadership C…
▽ More
We introduce an ensemble of artificial intelligence models for gravitational wave detection that we trained in the Summit supercomputer using 32 nodes, equivalent to 192 NVIDIA V100 GPUs, within 2 hours. Once fully trained, we optimized these models for accelerated inference using NVIDIA TensorRT. We deployed our inference-optimized AI ensemble in the ThetaGPU supercomputer at Argonne Leadership Computer Facility to conduct distributed inference. Using the entire ThetaGPU supercomputer, consisting of 20 nodes each of which has 8 NVIDIA A100 Tensor Core GPUs and 2 AMD Rome CPUs, our NVIDIA TensorRT-optimized AI ensemble processed an entire month of advanced LIGO data (including Hanford and Livingston data streams) within 50 seconds. Our inference-optimized AI ensemble retains the same sensitivity of traditional AI models, namely, it identifies all known binary black hole mergers previously identified in this advanced LIGO dataset and reports no misclassifications, while also providing a 3X inference speedup compared to traditional artificial intelligence models. We used time slides to quantify the performance of our AI ensemble to process up to 5 years worth of advanced LIGO data. In this synthetically enhanced dataset, our AI ensemble reports an average of one misclassification for every month of searched advanced LIGO data. We also present the receiver operating characteristic curve of our AI ensemble using this 5 year long advanced LIGO dataset. This approach provides the required tools to conduct accelerated, AI-driven gravitational wave detection at scale.
△ Less
Submitted 17 February, 2022; v1 submitted 26 January, 2022;
originally announced January 2022.
-
Bright Spectroscopic Binaries: II. A study of five systems with orbital periods of P < 500 days
Authors:
Dennis Jack,
Missael Alejandro Hernández Huerta,
Faiber Danilo Rosas-Portilla,
Klaus-Peter Schröder
Abstract:
We present a detailed analysis of five bright spectroscopic binary systems (HD 18665, HD 27131, HD 171852, HD 215550, HD 217427) that have orbital periods of P < 500 days. We determined the complete set of orbital parameters using the toolkit RadVel by analyzing the observed radial velocity curves. To study the properties of the five systems, we also analyzed the intermediate resolution spectra (R…
▽ More
We present a detailed analysis of five bright spectroscopic binary systems (HD 18665, HD 27131, HD 171852, HD 215550, HD 217427) that have orbital periods of P < 500 days. We determined the complete set of orbital parameters using the toolkit RadVel by analyzing the observed radial velocity curves. To study the properties of the five systems, we also analyzed the intermediate resolution spectra (R = 20,000) observed with the TIGRE telescope and determined the stellar parameters of the primary stars using the toolkit iSpec. With Gaia Early Data Release 3 parallaxes, a correction for interstellar extinction using the 3D dust map, and bolometric corrections, we placed the stars in the Hertzsprung-Russell diagram and compared the positions with stellar evolution tracks calculated with the Eggleton code to determine the masses and ages of the primary stars. They have all evolved to the giant phase. Finally, we were able to determine the masses of the secondary stars and to estimate the orbital inclinations i of the binary systems.
△ Less
Submitted 11 January, 2022;
originally announced January 2022.
-
AI and extreme scale computing to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non-precessing binary black hole mergers
Authors:
Asad Khan,
E. A. Huerta,
Prayush Kumar
Abstract:
We use artificial intelligence (AI) to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non precessing binary black hole mergers. We trained AI models using 14 million waveforms, produced with the surrogate model NRHybSur3dq8, that include modes up to $\ell \leq 4$ and $(5,5)$, except for $(4,0)$ and $(4,1)$, that describe binaries with mass-ratios…
▽ More
We use artificial intelligence (AI) to learn and infer the physics of higher order gravitational wave modes of quasi-circular, spinning, non precessing binary black hole mergers. We trained AI models using 14 million waveforms, produced with the surrogate model NRHybSur3dq8, that include modes up to $\ell \leq 4$ and $(5,5)$, except for $(4,0)$ and $(4,1)$, that describe binaries with mass-ratios $q\leq8$, individual spins $s^z_{\{1,2\}}\in[-0.8, 0.8]$, and inclination angle $θ\in[0,π]$.Our probabilistic AI surrogates can accurately constrain the mass-ratio, individual spins, effective spin, and inclination angle of numerical relativity waveforms that describe such signal manifold. We compared the predictions of our AI models with Gaussian process regression, random forest, k-nearest neighbors, and linear regression, and with traditional Bayesian inference methods through the PyCBC Inference toolkit, finding that AI outperforms all these approaches in terms of accuracy, and are between three to four orders of magnitude faster than traditional Bayesian inference methods. Our AI surrogates were trained within 3.4 hours using distributed training on 1,536 NVIDIA V100 GPUs in the Summit supercomputer.
△ Less
Submitted 26 October, 2022; v1 submitted 13 December, 2021;
originally announced December 2021.
-
Interpretable AI forecasting for numerical relativity waveforms of quasi-circular, spinning, non-precessing binary black hole mergers
Authors:
Asad Khan,
E. A. Huerta,
Huihuo Zheng
Abstract:
We present a deep-learning artificial intelligence model that is capable of learning and forecasting the late-inspiral, merger and ringdown of numerical relativity waveforms that describe quasi-circular, spinning, non-precessing binary black hole mergers. We used the NRHybSur3dq8 surrogate model to produce train, validation and test sets of $\ell=|m|=2$ waveforms that cover the parameter space of…
▽ More
We present a deep-learning artificial intelligence model that is capable of learning and forecasting the late-inspiral, merger and ringdown of numerical relativity waveforms that describe quasi-circular, spinning, non-precessing binary black hole mergers. We used the NRHybSur3dq8 surrogate model to produce train, validation and test sets of $\ell=|m|=2$ waveforms that cover the parameter space of binary black hole mergers with mass-ratios $q\leq8$ and individual spins $|s^z_{\{1,2\}}| \leq 0.8$. These waveforms cover the time range $t\in[-5000\textrm{M}, 130\textrm{M}]$, where $t=0M$ marks the merger event, defined as the maximum value of the waveform amplitude. We harnessed the ThetaGPU supercomputer at the Argonne Leadership Computing Facility to train our AI model using a training set of 1.5 million waveforms. We used 16 NVIDIA DGX A100 nodes, each consisting of 8 NVIDIA A100 Tensor Core GPUs and 2 AMD Rome CPUs, to fully train our model within 3.5 hours. Our findings show that artificial intelligence can accurately forecast the dynamical evolution of numerical relativity waveforms in the time range $t\in[-100\textrm{M}, 130\textrm{M}]$. Sampling a test set of 190,000 waveforms, we find that the average overlap between target and predicted waveforms is $\gtrsim99\%$ over the entire parameter space under consideration. We also combined scientific visualization and accelerated computing to identify what components of our model take in knowledge from the early and late-time waveform evolution to accurately forecast the latter part of numerical relativity waveforms. This work aims to accelerate the creation of scalable, computationally efficient and interpretable artificial intelligence models for gravitational wave astrophysics.
△ Less
Submitted 17 January, 2022; v1 submitted 13 October, 2021;
originally announced October 2021.
-
A FAIR and AI-ready Higgs boson decay dataset
Authors:
Yifan Chen,
E. A. Huerta,
Javier Duarte,
Philip Harris,
Daniel S. Katz,
Mark S. Neubauer,
Daniel Diaz,
Farouk Mokhtar,
Raghav Kansal,
Sang Eon Park,
Volodymyr V. Kindratenko,
Zhizhen Zhao,
Roger Rusack
Abstract:
To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate…
▽ More
To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate how to use this guide to evaluate the FAIRness of an open simulated dataset produced by the CMS Collaboration at the CERN Large Hadron Collider. This dataset consists of Higgs boson decays and quark and gluon background, and is available through the CERN Open Data Portal. We use additional available tools to assess the FAIRness of this dataset, and incorporate feedback from members of the FAIR community to validate our results. This article is accompanied by a Jupyter notebook to visualize and explore this dataset. This study marks the first in a planned series of articles that will guide scientists in the creation of FAIR AI models and datasets in high energy particle physics.
△ Less
Submitted 16 February, 2022; v1 submitted 4 August, 2021;
originally announced August 2021.
-
Star Cluster Classification in the PHANGS-HST Survey: Comparison between Human and Machine Learning Approaches
Authors:
Bradley C. Whitmore,
Janice C. Lee,
Rupali Chandar,
David A. Thilker,
Stephen Hannon,
Wei Wei,
E. A. Huerta,
Frank Bigiel,
Médéric Boquien,
Mélanie Chevance,
Daniel A. Dale,
Sinan Deger,
Kathryn Grasha,
Ralf S. Klessen,
J. M. Diederik Kruijssen,
Kirsten L. Larson,
Angus Mok,
Erik Rosolowsky,
Eva Schinnerer,
Andreas Schruba,
Leonardo Ubeda,
Schuyler D. Van Dyk,
Elizabeth Watkins,
Thomas Williams
Abstract:
When completed, the PHANGS-HST project will provide a census of roughly 50,000 compact star clusters and associations, as well as human morphological classifications for roughly 20,000 of those objects. These large numbers motivated the development of a more objective and repeatable method to help perform source classifications. In this paper we consider the results for five PHANGS-HST galaxies (N…
▽ More
When completed, the PHANGS-HST project will provide a census of roughly 50,000 compact star clusters and associations, as well as human morphological classifications for roughly 20,000 of those objects. These large numbers motivated the development of a more objective and repeatable method to help perform source classifications. In this paper we consider the results for five PHANGS-HST galaxies (NGC 628, NGC 1433, NGC 1566, NGC 3351, NGC 3627) using classifications from two convolutional neural network architectures (RESNET and VGG) trained using deep transfer learning techniques. The results are compared to classifications performed by humans. The primary result is that the neural network classifications are comparable in quality to the human classifications with typical agreement around 70 to 80$\%$ for Class 1 clusters (symmetric, centrally concentrated) and 40 to 70$\%$ for Class 2 clusters (asymmetric, centrally concentrated). If Class 1 and 2 are considered together the agreement is 82 $\pm$ 3$\%$. Dependencies on magnitudes, crowding, and background surface brightness are examined. A detailed description of the criteria and methodology used for the human classifications is included along with an examination of systematic differences between PHANGS-HST and LEGUS. The distribution of data points in a colour-colour diagram is used as a 'figure of merit' to further test the relative performances of the different methods. The effects on science results (e.g., determinations of mass and age functions) of using different cluster classification methods are examined and found to be minimal.
△ Less
Submitted 27 July, 2021;
originally announced July 2021.
-
All-sky Search for Continuous Gravitational Waves from Isolated Neutron Stars in the Early O3 LIGO Data
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1566 additional authors not shown)
Abstract:
We report on an all-sky search for continuous gravitational waves in the frequency band 20-2000\,Hz and with a frequency time derivative in the range of $[-1.0, +0.1]\times10^{-8}$\,Hz/s. Such a signal could be produced by a nearby, spinning and slightly non-axisymmetric isolated neutron star in our galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Vi…
▽ More
We report on an all-sky search for continuous gravitational waves in the frequency band 20-2000\,Hz and with a frequency time derivative in the range of $[-1.0, +0.1]\times10^{-8}$\,Hz/s. Such a signal could be produced by a nearby, spinning and slightly non-axisymmetric isolated neutron star in our galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Virgo's third observational run, O3. No periodic gravitational wave signals are observed, and 95\%\ confidence-level (CL) frequentist upper limits are placed on their strengths. The lowest upper limits on worst-case (linearly polarized) strain amplitude $h_0$ are $~1.7\times10^{-25}$ near 200\,Hz. For a circularly polarized source (most favorable orientation), the lowest upper limits are $\sim6.3\times10^{-26}$. These strict frequentist upper limits refer to all sky locations and the entire range of frequency derivative values. For a population-averaged ensemble of sky locations and stellar orientations, the lowest 95\%\ CL upper limits on the strain amplitude are $\sim1.\times10^{-25}$. These upper limits improve upon our previously published all-sky results, with the greatest improvement (factor of $\sim$2) seen at higher frequencies, in part because quantum squeezing has dramatically improved the detector noise level relative to the second observational run, O2. These limits are the most constraining to date over most of the parameter space searched.
△ Less
Submitted 8 October, 2021; v1 submitted 1 July, 2021;
originally announced July 2021.
-
Observation of gravitational waves from two neutron star-black hole coalescences
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1577 additional authors not shown)
Abstract:
We report the observation of gravitational waves from two compact binary coalescences in LIGO's and Virgo's third observing run with properties consistent with neutron star-black hole (NSBH) binaries. The two events are named GW200105_162426 and GW200115_042309, abbreviated as GW200105 and GW200115; the first was observed by LIGO Livingston and Virgo, and the second by all three LIGO-Virgo detecto…
▽ More
We report the observation of gravitational waves from two compact binary coalescences in LIGO's and Virgo's third observing run with properties consistent with neutron star-black hole (NSBH) binaries. The two events are named GW200105_162426 and GW200115_042309, abbreviated as GW200105 and GW200115; the first was observed by LIGO Livingston and Virgo, and the second by all three LIGO-Virgo detectors. The source of GW200105 has component masses $8.9^{+1.2}_{-1.5}\,M_\odot$ and $1.9^{+0.3}_{-0.2}\,M_\odot$, whereas the source of GW200115 has component masses $5.7^{+1.8}_{-2.1}\,M_\odot$ and $1.5^{+0.7}_{-0.3}\,M_\odot$ (all measurements quoted at the 90% credible level). The probability that the secondary's mass is below the maximal mass of a neutron star is 89%-96% and 87%-98%, respectively, for GW200105 and GW200115, with the ranges arising from different astrophysical assumptions. The source luminosity distances are $280^{+110}_{-110}$ Mpc and $300^{+150}_{-100}$ Mpc, respectively. The magnitude of the primary spin of GW200105 is less than 0.23 at the 90% credible level, and its orientation is unconstrained. For GW200115, the primary spin has a negative spin projection onto the orbital angular momentum at 88% probability. We are unable to constrain spin or tidal deformation of the secondary component for either event. We infer a NSBH merger rate density of $45^{+75}_{-33}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ when assuming GW200105 and GW200115 are representative of the NSBH population, or $130^{+112}_{-69}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ under the assumption of a broader distribution of component masses.
△ Less
Submitted 29 June, 2021;
originally announced June 2021.
-
Searches for continuous gravitational waves from young supernova remnants in the early third observing run of Advanced LIGO and Virgo
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1567 additional authors not shown)
Abstract:
We present results of three wide-band directed searches for continuous gravitational waves from 15 young supernova remnants in the first half of the third Advanced LIGO and Virgo observing run. We use three search pipelines with distinct signal models and methods of identifying noise artifacts. Without ephemerides of these sources, the searches are conducted over a frequency band spanning from 10~…
▽ More
We present results of three wide-band directed searches for continuous gravitational waves from 15 young supernova remnants in the first half of the third Advanced LIGO and Virgo observing run. We use three search pipelines with distinct signal models and methods of identifying noise artifacts. Without ephemerides of these sources, the searches are conducted over a frequency band spanning from 10~Hz to 2~kHz. We find no evidence of continuous gravitational radiation from these sources. We set upper limits on the intrinsic signal strain at 95\% confidence level in sample sub-bands, estimate the sensitivity in the full band, and derive the corresponding constraints on the fiducial neutron star ellipticity and $r$-mode amplitude. The best 95\% confidence constraints placed on the signal strain are $7.7\times 10^{-26}$ and $7.8\times 10^{-26}$ near 200~Hz for the supernova remnants G39.2--0.3 and G65.7+1.2, respectively. The most stringent constraints on the ellipticity and $r$-mode amplitude reach $\lesssim 10^{-7}$ and $ \lesssim 10^{-5}$, respectively, at frequencies above $\sim 400$~Hz for the closest supernova remnant G266.2--1.2/Vela Jr.
△ Less
Submitted 14 July, 2021; v1 submitted 24 May, 2021;
originally announced May 2021.
-
Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources
Authors:
E. A. Huerta,
Zhizhen Zhao
Abstract:
We live in momentous times. The science community is empowered with an arsenal of cosmic messengers to study the Universe in unprecedented detail. Gravitational waves, electromagnetic waves, neutrinos and cosmic rays cover a wide range of wavelengths and time scales. Combining and processing these datasets that vary in volume, speed and dimensionality requires new modes of instrument coordination,…
▽ More
We live in momentous times. The science community is empowered with an arsenal of cosmic messengers to study the Universe in unprecedented detail. Gravitational waves, electromagnetic waves, neutrinos and cosmic rays cover a wide range of wavelengths and time scales. Combining and processing these datasets that vary in volume, speed and dimensionality requires new modes of instrument coordination, funding and international collaboration with a specialized human and technological infrastructure. In tandem with the advent of large-scale scientific facilities, the last decade has experienced an unprecedented transformation in computing and signal processing algorithms. The combination of graphics processing units, deep learning, and the availability of open source, high-quality datasets, have powered the rise of artificial intelligence. This digital revolution now powers a multi-billion dollar industry, with far-reaching implications in technology and society. In this chapter we describe pioneering efforts to adapt artificial intelligence algorithms to address computational grand challenges in Multi-Messenger Astrophysics. We review the rapid evolution of these disruptive algorithms, from the first class of algorithms introduced in early 2017, to the sophisticated algorithms that now incorporate domain expertise in their architectural design and optimization schemes. We discuss the importance of scientific visualization and extreme-scale computing in reducing time-to-insight and obtaining new knowledge from the interplay between models and data.
△ Less
Submitted 1 October, 2021; v1 submitted 13 May, 2021;
originally announced May 2021.
-
Search for lensing signatures in the gravitational-wave observations from the first half of LIGO-Virgo's third observing run
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
K. M. Aleman,
G. Allen,
A. Allocca,
P. A. Altin,
A. Amato
, et al. (1356 additional authors not shown)
Abstract:
We search for signatures of gravitational lensing in the gravitational-wave signals from compact binary coalescences detected by Advanced LIGO and Advanced Virgo during O3a, the first half of their third observing run. We study: 1) the expected rate of lensing at current detector sensitivity and the implications of a non-observation of strong lensing or a stochastic gravitational-wave background o…
▽ More
We search for signatures of gravitational lensing in the gravitational-wave signals from compact binary coalescences detected by Advanced LIGO and Advanced Virgo during O3a, the first half of their third observing run. We study: 1) the expected rate of lensing at current detector sensitivity and the implications of a non-observation of strong lensing or a stochastic gravitational-wave background on the merger-rate density at high redshift; 2) how the interpretation of individual high-mass events would change if they were found to be lensed; 3) the possibility of multiple images due to strong lensing by galaxies or galaxy clusters; and 4) possible wave-optics effects due to point-mass microlenses. Several pairs of signals in the multiple-image analysis show similar parameters and, in this sense, are nominally consistent with the strong lensing hypothesis. However, taking into account population priors, selection effects, and the prior odds against lensing, these events do not provide sufficient evidence for lensing. Overall, we find no compelling evidence for lensing in the observed gravitational-wave signals from any of these analyses.
△ Less
Submitted 30 November, 2021; v1 submitted 13 May, 2021;
originally announced May 2021.
-
Constraints from LIGO O3 data on gravitational-wave emission due to r-modes in the glitching pulsar PSR J0537-6910
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1574 additional authors not shown)
Abstract:
We present a search for continuous gravitational-wave emission due to r-modes in the pulsar PSR J0537-6910 using data from the LIGO-Virgo Collaboration observing run O3. PSR J0537-6910 is a young energetic X-ray pulsar and is the most frequent glitcher known. The inter-glitch braking index of the pulsar suggests that gravitational-wave emission due to r-mode oscillations may play an important role…
▽ More
We present a search for continuous gravitational-wave emission due to r-modes in the pulsar PSR J0537-6910 using data from the LIGO-Virgo Collaboration observing run O3. PSR J0537-6910 is a young energetic X-ray pulsar and is the most frequent glitcher known. The inter-glitch braking index of the pulsar suggests that gravitational-wave emission due to r-mode oscillations may play an important role in the spin evolution of this pulsar. Theoretical models confirm this possibility and predict emission at a level that can be probed by ground-based detectors. In order to explore this scenario, we search for r-mode emission in the epochs between glitches by using a contemporaneous timing ephemeris obtained from NICER data. We do not detect any signals in the theoretically expected band of 86-97 Hz, and report upper limits on the amplitude of the gravitational waves. Our results improve on previous amplitude upper limits from r-modes in J0537-6910 by a factor of up to 3 and place stringent constraints on theoretical models for r-mode driven spin-down in PSR J0537-6910, especially for higher frequencies at which our results reach below the spin-down limit defined by energy conservation.
△ Less
Submitted 7 January, 2022; v1 submitted 29 April, 2021;
originally announced April 2021.
-
Search for anisotropic gravitational-wave backgrounds using data from Advanced LIGO and Advanced Virgo's first three observing runs
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1568 additional authors not shown)
Abstract:
We report results from searches for anisotropic stochastic gravitational-wave backgrounds using data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. For the first time, we include Virgo data in our analysis and run our search with a new efficient pipeline called {\tt PyStoch} on data folded over one sidereal day. We use gravitational-wave radiometry (broadban…
▽ More
We report results from searches for anisotropic stochastic gravitational-wave backgrounds using data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. For the first time, we include Virgo data in our analysis and run our search with a new efficient pipeline called {\tt PyStoch} on data folded over one sidereal day. We use gravitational-wave radiometry (broadband and narrow band) to produce sky maps of stochastic gravitational-wave backgrounds and to search for gravitational waves from point sources. A spherical harmonic decomposition method is employed to look for gravitational-wave emission from spatially-extended sources. Neither technique found evidence of gravitational-wave signals. Hence we derive 95\% confidence-level upper limit sky maps on the gravitational-wave energy flux from broadband point sources, ranging from $F_{α, Θ} < {\rm (0.013 - 7.6)} \times 10^{-8} {\rm erg \, cm^{-2} \, s^{-1} \, Hz^{-1}},$ and on the (normalized) gravitational-wave energy density spectrum from extended sources, ranging from $Ω_{α, Θ} < {\rm (0.57 - 9.3)} \times 10^{-9} \, {\rm sr^{-1}}$, depending on direction ($Θ$) and spectral index ($α$). These limits improve upon previous limits by factors of $2.9 - 3.5$. We also set 95\% confidence level upper limits on the frequency-dependent strain amplitudes of quasimonochromatic gravitational waves coming from three interesting targets, Scorpius X-1, SN 1987A and the Galactic Center, with best upper limits range from $h_0 < {\rm (1.7-2.1)} \times 10^{-25},$ a factor of $\geq 2.0$ improvement compared to previous stochastic radiometer searches.
△ Less
Submitted 2 February, 2022; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Constraints on cosmic strings using data from the third Advanced LIGO-Virgo observing run
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1565 additional authors not shown)
Abstract:
We search for gravitational-wave signals produced by cosmic strings in the Advanced LIGO and Virgo full O3 data set. Search results are presented for gravitational waves produced by cosmic string loop features such as cusps, kinks and, for the first time, kink-kink collisions.cA template-based search for short-duration transient signals does not yield a detection. We also use the stochastic gravit…
▽ More
We search for gravitational-wave signals produced by cosmic strings in the Advanced LIGO and Virgo full O3 data set. Search results are presented for gravitational waves produced by cosmic string loop features such as cusps, kinks and, for the first time, kink-kink collisions.cA template-based search for short-duration transient signals does not yield a detection. We also use the stochastic gravitational-wave background energy density upper limits derived from the O3 data to constrain the cosmic string tension, $Gμ$, as a function of the number of kinks, or the number of cusps, for two cosmic string loop distribution models.cAdditionally, we develop and test a third model which interpolates between these two models. Our results improve upon the previous LIGO-Virgo constraints on $Gμ$ by one to two orders of magnitude depending on the model which is tested. In particular, for one loop distribution model, we set the most competitive constraints to date, $Gμ\lesssim 4\times 10^{-15}$.
△ Less
Submitted 28 January, 2021;
originally announced January 2021.
-
Upper Limits on the Isotropic Gravitational-Wave Background from Advanced LIGO's and Advanced Virgo's Third Observing Run
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca,
P. A. Altin
, et al. (1566 additional authors not shown)
Abstract:
We report results of a search for an isotropic gravitational-wave background (GWB) using data from Advanced LIGO's and Advanced Virgo's third observing run (O3) combined with upper limits from the earlier O1 and O2 runs. Unlike in previous observing runs in the advanced detector era, we include Virgo in the search for the GWB. The results are consistent with uncorrelated noise, and therefore we pl…
▽ More
We report results of a search for an isotropic gravitational-wave background (GWB) using data from Advanced LIGO's and Advanced Virgo's third observing run (O3) combined with upper limits from the earlier O1 and O2 runs. Unlike in previous observing runs in the advanced detector era, we include Virgo in the search for the GWB. The results are consistent with uncorrelated noise, and therefore we place upper limits on the strength of the GWB. We find that the dimensionless energy density $Ω_{\rm GW}\leq 5.8\times 10^{-9}$ at the 95% credible level for a flat (frequency-independent) GWB, using a prior which is uniform in the log of the strength of the GWB, with 99% of the sensitivity coming from the band 20-76.6 Hz; $\leq 3.4 \times 10^{-9}$ at 25 Hz for a power-law GWB with a spectral index of 2/3 (consistent with expectations for compact binary coalescences), in the band 20-90.6 Hz; and $\leq 3.9 \times 10^{-10}$ at 25 Hz for a spectral index of 3, in the band 20-291.6 Hz. These upper limits improve over our previous results by a factor of 6.0 for a flat GWB. We also search for a GWB arising from scalar and vector modes, which are predicted by alternative theories of gravity; we place upper limits on the strength of GWBs with these polarizations. We demonstrate that there is no evidence of correlated noise of magnetic origin by performing a Bayesian analysis that allows for the presence of both a GWB and an effective magnetic background arising from geophysical Schumann resonances. We compare our upper limits to a fiducial model for the GWB from the merger of compact binaries. Finally, we combine our results with observations of individual mergers andshow that, at design sensitivity, this joint approach may yield stronger constraints on the merger rate of binary black holes at $z \lesssim 2$ than can be achieved with individually resolved mergers alone. [abridged]
△ Less
Submitted 28 January, 2021;
originally announced January 2021.
-
Diving below the spin-down limit: Constraints on gravitational waves from the energetic young pulsar PSR J0537-6910
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
K. M. Aleman,
G. Allen,
A. Allocca
, et al. (1568 additional authors not shown)
Abstract:
We present a search for continuous gravitational-wave signals from the young, energetic X-ray pulsar PSR J0537-6910 using data from the second and third observing runs of LIGO and Virgo. The search is enabled by a contemporaneous timing ephemeris obtained using NICER data. The NICER ephemeris has also been extended through 2020 October and includes three new glitches. PSR J0537-6910 has the larges…
▽ More
We present a search for continuous gravitational-wave signals from the young, energetic X-ray pulsar PSR J0537-6910 using data from the second and third observing runs of LIGO and Virgo. The search is enabled by a contemporaneous timing ephemeris obtained using NICER data. The NICER ephemeris has also been extended through 2020 October and includes three new glitches. PSR J0537-6910 has the largest spin-down luminosity of any pulsar and is highly active with regards to glitches. Analyses of its long-term and inter-glitch braking indices provided intriguing evidence that its spin-down energy budget may include gravitational-wave emission from a time-varying mass quadrupole moment. Its 62 Hz rotation frequency also puts its possible gravitational-wave emission in the most sensitive band of LIGO/Virgo detectors. Motivated by these considerations, we search for gravitational-wave emission at both once and twice the rotation frequency. We find no signal, however, and report our upper limits. Assuming a rigidly rotating triaxial star, our constraints reach below the gravitational-wave spin-down limit for this star for the first time by more than a factor of two and limit gravitational waves from the $l=m=2$ mode to account for less than 14% of the spin-down energy budget. The fiducial equatorial ellipticity is limited to less than about 3e-5, which is the third best constraint for any young pulsar.
△ Less
Submitted 10 June, 2021; v1 submitted 23 December, 2020;
originally announced December 2020.
-
All-sky search in early O3 LIGO data for continuous gravitational-wave signals from unknown neutron stars in binary systems
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
K. M. Aleman,
G. Allen,
A. Allocca,
P. A. Altin,
A. Amato
, et al. (1347 additional authors not shown)
Abstract:
Rapidly spinning neutron stars are promising sources of persistent, continuous gravitational waves. Detecting such a signal would allow probing of the physical properties of matter under extreme conditions. A significant fraction of the known pulsar population belongs to binary systems. Searching for unknown neutron stars in binary systems requires specialized algorithms to address unknown orbital…
▽ More
Rapidly spinning neutron stars are promising sources of persistent, continuous gravitational waves. Detecting such a signal would allow probing of the physical properties of matter under extreme conditions. A significant fraction of the known pulsar population belongs to binary systems. Searching for unknown neutron stars in binary systems requires specialized algorithms to address unknown orbital frequency modulations. We present a search for continuous gravitational waves emitted by neutron stars in binary systems in early data from the third observing run of the Advanced LIGO and Advanced Virgo detectors using the semicoherent, GPU-accelerated, BinarySkyHough pipeline. The search analyzes the most sensitive frequency band of the LIGO detectors, 50 - 300 Hz. Binary orbital parameters are split into four regions, comprising orbital periods of 3 - 45 days and projected semimajor axes of 2 - 40 light-seconds. No detections are reported. We estimate the sensitivity of the search using simulated continuous wave signals, achieving the most sensitive results to date across the analyzed parameter space.
△ Less
Submitted 19 March, 2021; v1 submitted 22 December, 2020;
originally announced December 2020.
-
Accelerated, Scalable and Reproducible AI-driven Gravitational Wave Detection
Authors:
E. A. Huerta,
Asad Khan,
Xiaobo Huang,
Minyang Tian,
Maksim Levental,
Ryan Chard,
Wei Wei,
Maeve Heflin,
Daniel S. Katz,
Volodymyr Kindratenko,
Dawei Mu,
Ben Blaiszik,
Ian Foster
Abstract:
The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware Accelerated Learning (HAL) cluster, using funcX as a universal distributed…
▽ More
The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing, and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery.
△ Less
Submitted 9 July, 2021; v1 submitted 15 December, 2020;
originally announced December 2020.
-
Deep Learning with Quantized Neural Networks for Gravitational Wave Forecasting of Eccentric Compact Binary Coalescence
Authors:
Wei Wei,
E. A. Huerta,
Mengshen Yun,
Nicholas Loutrel,
Md Arif Shaikh,
Prayush Kumar,
Roland Haas,
Volodymyr Kindratenko
Abstract:
We present the first application of deep learning forecasting for binary neutron stars, neutron star - black hole systems, and binary black hole mergers that span an eccentricity range e <= 0.9. We train neural networks that describe these astrophysical populations, and then test their performance by injecting simulated eccentric signals in advanced LIGO noise available at the \texttt{Gravitationa…
▽ More
We present the first application of deep learning forecasting for binary neutron stars, neutron star - black hole systems, and binary black hole mergers that span an eccentricity range e <= 0.9. We train neural networks that describe these astrophysical populations, and then test their performance by injecting simulated eccentric signals in advanced LIGO noise available at the \texttt{Gravitational Wave Open Science Center} to: 1) quantify how fast neural networks identify these signals before the binary components merge; 2) quantify how accurately neural networks estimate the time to merger once gravitational waves are identified; and 3) estimate the time-dependent sky localization of these events from early detection to merger. Our findings show that deep learning can identify eccentric signals from a few seconds (for binary black holes) up to tens of seconds (for binary neutron stars) prior to merger. A quantized version of our neural networks achieves 4x reduction in model size, and up to 2.5x inference speed up. These novel algorithms may be used to facilitate time-sensitive multi-messenger astrophysics observations of compact binaries in dense stellar environments.
△ Less
Submitted 17 October, 2021; v1 submitted 7 December, 2020;
originally announced December 2020.
-
A celestial matryoshka: Dynamical and spectroscopic analysis of the Albireo system
Authors:
Ronald Drimmel,
Alessandro Sozzetti,
Klaus-Peter Schroeder,
Ulrich Bastian,
Matteo Pinamonti,
Dennis Jack,
Missael A. Hernandez Huerta
Abstract:
We present a spectroscopic characterisation and a new orbital solution for the binary system beta Cyg Aa/Ac (MCA 55), the primary component (beta Cyg A) of the well-known wide double star Albireo. By matching evolutionary tracks to the physical parameters of all three Albireo stars (beta Cyg Aa, Ac and B) as obtained from a spectroscopic analysis of TIGRE and IUE spectra, we confirm that they are…
▽ More
We present a spectroscopic characterisation and a new orbital solution for the binary system beta Cyg Aa/Ac (MCA 55), the primary component (beta Cyg A) of the well-known wide double star Albireo. By matching evolutionary tracks to the physical parameters of all three Albireo stars (beta Cyg Aa, Ac and B) as obtained from a spectroscopic analysis of TIGRE and IUE spectra, we confirm that they are likely coeval. Our final orbit solution is based on radial-velocity measurements taken over a baseline exceeding $120$ years, combined with relative astrometry from speckle interferometric observations and the absolute astrometry from the Hipparcos and Gaia missions. Our final orbit solution has a period of $121.65^{+3.34}_{-2.90}$ years with an eccentricity of $0.20^{+0.01}_{-0.02}$. Thanks to the inclusion of the absolute astrometry, we find a mass ratio of $q = 1.25^{+0.19}_{-0.17}$, and a total mass of $9.47_{-3.24}^{+5.88}$ M$_\odot$, indicating that the secondary (Ac) is the more massive of the pair. These results strongly suggest the presence of a fourth, unseen, member of the Albireo system. Given the current photometric data it is likely that beta Cyg A is itself a hierarchical triple. We also derive the systemic proper motion, line-of-sight velocity, and an orbital parallax of the beta Cyg A system, allowing us to quantitatively assess the hypothesis that Albireo A and B form a physically bound and genealogically connected system. Finally, we find four potential members of a common proper motion group with Albireo, though none anywhere as close by as the Albireo components A to B.
△ Less
Submitted 30 December, 2020; v1 submitted 2 December, 2020;
originally announced December 2020.
-
A non-oscillatory face-centred finite volume method for compressible flows
Authors:
Jordi Vila-Pérez,
Matteo Giacomini,
Ruben Sevilla,
Antonio Huerta
Abstract:
This work presents the face-centred finite volume (FCFV) paradigm for the simulation of compressible flows. The FCFV method defines the unknowns at the face barycentre and uses a hybridisation procedure to eliminate all the degrees of freedom inside the cells. In addition, Riemann solvers are defined implicitly within the expressions of the numerical fluxes. The resulting methodology provides firs…
▽ More
This work presents the face-centred finite volume (FCFV) paradigm for the simulation of compressible flows. The FCFV method defines the unknowns at the face barycentre and uses a hybridisation procedure to eliminate all the degrees of freedom inside the cells. In addition, Riemann solvers are defined implicitly within the expressions of the numerical fluxes. The resulting methodology provides first-order accurate approximations of the conservative quantities, i.e. density, momentum and energy, as well as of the viscous stress tensor and of the heat flux, without the need of any gradient reconstruction procedure. Hence, the FCFV solver preserves the accuracy of the approximation in presence of distorted and highly stretched cells, providing a solver insensitive to mesh quality. In addition, FCFV is capable of constructing non-oscillatory approximations of sharp discontinuities without resorting to shock capturing or limiting techniques. For flows at low Mach number, the method is robust and is capable of computing accurate solutions in the incompressible limit without the need of introducing specific pressure correction strategies. A set of 2D and 3D benchmarks of external flows is presented to validate the methodology in different flow regimes, from inviscid to viscous laminar flows, from transonic to subsonic incompressible flows, demonstrating its potential to handle compressible flows in realistic scenarios.
△ Less
Submitted 6 January, 2022; v1 submitted 26 November, 2020;
originally announced November 2020.
-
Initial Data and Eccentricity Reduction Toolkit for Binary Black Hole Numerical Relativity Waveforms
Authors:
Sarah Habib,
Antoni Ramos-Buades,
E. A. Huerta,
Sascha Husa,
Roland Haas,
Zachariah Etienne
Abstract:
The production of numerical relativity waveforms that describe quasicircular binary black hole mergers requires high-quality initial data, and an algorithm to iteratively reduce residual eccentricity. To date, these tools remain closed source, or in commercial software that prevents their use in high performance computing platforms. To address these limitations, and to ensure that the broader nume…
▽ More
The production of numerical relativity waveforms that describe quasicircular binary black hole mergers requires high-quality initial data, and an algorithm to iteratively reduce residual eccentricity. To date, these tools remain closed source, or in commercial software that prevents their use in high performance computing platforms. To address these limitations, and to ensure that the broader numerical relativity community has access to these tools, herein we provide all the required elements to produce high-quality numerical relativity simulations in supercomputer platforms, namely: open source parameter files to numerical simulate spinning black hole binaries with asymmetric mass-ratios; open source $\texttt{Python}$ tools to produce high-quality initial data for numerical relativity simulations of spinning black hole binaries on quasi-circular orbits; open source $\texttt{Python}$ tools for eccentricity reduction, both as stand-alone software and deployed in the $\texttt{Einstein Toolkit}$'s software infrastructure. This open source toolkit fills in a critical void in the literature at a time when numerical relativity has an ever increasing role in the study and interpretation of gravitational wave sources. As part of our community building efforts, and to streamline and accelerate the use of these resources, we provide tutorials that describe, step by step, how to obtain and use these open source numerical relativity tools.
△ Less
Submitted 17 November, 2020;
originally announced November 2020.
-
Deep Learning Ensemble for Real-time Gravitational Wave Detection of Spinning Binary Black Hole Mergers
Authors:
Wei Wei,
Asad Khan,
E. A. Huerta,
Xiaobo Huang,
Minyang Tian
Abstract:
We introduce the use of deep learning ensembles for real-time, gravitational wave detection of spinning binary black hole mergers. This analysis consists of training independent neural networks that simultaneously process strain data from multiple detectors. The output of these networks is then combined and processed to identify significant noise triggers. We have applied this methodology in O2 an…
▽ More
We introduce the use of deep learning ensembles for real-time, gravitational wave detection of spinning binary black hole mergers. This analysis consists of training independent neural networks that simultaneously process strain data from multiple detectors. The output of these networks is then combined and processed to identify significant noise triggers. We have applied this methodology in O2 and O3 data finding that deep learning ensembles clearly identify binary black hole mergers in open source data available at the Gravitational-Wave Open Science Center. We have also benchmarked the performance of this new methodology by processing 200 hours of open source, advanced LIGO noise from August 2017. Our findings indicate that our approach identifies real gravitational wave sources in advanced LIGO data with a false positive rate of 1 misclassification for every 2.7 days of searched data. A follow up of these misclassifications identified them as glitches. Our deep learning ensemble represents the first class of neural network classifiers that are trained with millions of modeled waveforms that describe quasi-circular, spinning, non-precessing, binary black hole mergers. Once fully trained, our deep learning ensemble processes advanced LIGO strain data faster than real-time using 4 NVIDIA V100 GPUs.
△ Less
Submitted 29 October, 2020;
originally announced October 2020.
-
Search for Gravitational Waves Associated with Gamma-Ray Bursts Detected by Fermi and Swift During the LIGO-Virgo Run O3a
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
A. Aich,
L. Aiello,
A. Ain,
P. Ajith,
G. Allen,
A. Allocca,
P. A. Altin,
A. Amato,
S. Anand,
A. Ananyeva
, et al. (1228 additional authors not shown)
Abstract:
We search for gravitational-wave transients associated with gamma-ray bursts detected by the Fermi and Swift satellites during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC - 1 October 2019 15:00 UTC). 105 gamma-ray bursts were analyzed using a search for generic gravitational-wave transients; 32 gamma-ray bursts were analyzed with a search t…
▽ More
We search for gravitational-wave transients associated with gamma-ray bursts detected by the Fermi and Swift satellites during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC - 1 October 2019 15:00 UTC). 105 gamma-ray bursts were analyzed using a search for generic gravitational-wave transients; 32 gamma-ray bursts were analyzed with a search that specifically targets neutron star binary mergers as short gamma-ray burst progenitors. We describe a method to calculate the probability that triggers from the binary merger targeted search are astrophysical and apply that method to the most significant gamma-ray bursts in that search. We find no significant evidence for gravitational-wave signals associated with the gamma-ray bursts that we followed up, nor for a population of unidentified subthreshold signals. We consider several source types and signal morphologies, and report for these lower bounds on the distance to each gamma-ray burst.
△ Less
Submitted 20 August, 2021; v1 submitted 27 October, 2020;
originally announced October 2020.
-
Population Properties of Compact Objects from the Second LIGO-Virgo Gravitational-Wave Transient Catalog
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
G. Allen,
A. Allocca,
P. A. Altin,
A. Amato,
S. Anand,
A. Ananyeva
, et al. (1316 additional authors not shown)
Abstract:
We report on the population of the 47 compact binary mergers detected with a false-alarm rate 1/yr in the second LIGO--Virgo Gravitational-Wave Transient Catalog, GWTC-2. We observe several characteristics of the merging binary black hole (BBH) population not discernible until now. First, we find that the primary mass spectrum contains structure beyond a power-law with a sharp high-mass cut-off; i…
▽ More
We report on the population of the 47 compact binary mergers detected with a false-alarm rate 1/yr in the second LIGO--Virgo Gravitational-Wave Transient Catalog, GWTC-2. We observe several characteristics of the merging binary black hole (BBH) population not discernible until now. First, we find that the primary mass spectrum contains structure beyond a power-law with a sharp high-mass cut-off; it is more consistent with a broken power law with a break at $39.7^{+20.3}_{-9.1}\,M_\odot$, or a power law with a Gaussian feature peaking at $33.1^{+4.0}_{-5.6}\,M_\odot$ (90\% credible interval). While the primary mass distribution must extend to $\sim65\,M_\odot$ or beyond, only $2.9^{+3.5}_{1.7}\%$ of systems have primary masses greater than $45\,M_\odot$. Second, we find that a fraction of BBH systems have component spins misaligned with the orbital angular momentum, giving rise to precession of the orbital plane. Moreover, 12% to 44% of BBH systems have spins tilted by more than $90^\circ$, giving rise to a negative effective inspiral spin parameter $χ_\mathrm{eff}$. Under the assumption that such systems can only be formed by dynamical interactions, we infer that between 25% and 93% of BBH with non-vanishing $|χ_\mathrm{eff}| > 0.01$ are dynamically assembled. Third, we estimate merger rates, finding $\mathcal{R}_\text{BBH} = 23.9^{+14.3}_{8.6}$ Gpc$^{-3}$ yr$^{-1}$ for BBH and $\mathcal{R}_\text{BNS}= 320^{+490}_{-240}$ Gpc$^{-3}$ yr$^{-1}$ for binary neutron stars. We find that the BBH rate likely increases with redshift ($85\%$ credibility), but not faster than the star-formation rate ($86\%$ credibility). Additionally, we examine recent exceptional events in the context of our population models, finding that the asymmetric masses of GW190412 and the high component masses of GW190521 are consistent with our models, but the low secondary mass of GW190814 makes it an outlier.
△ Less
Submitted 25 February, 2021; v1 submitted 27 October, 2020;
originally announced October 2020.
-
Tests of General Relativity with Binary Black Holes from the second LIGO-Virgo Gravitational-Wave Transient Catalog
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
R. Abbott,
T. D. Abbott,
S. Abraham,
F. Acernese,
K. Ackley,
A. Adams,
C. Adams,
R. X. Adhikari,
V. B. Adya,
C. Affeldt,
M. Agathos,
K. Agatsuma,
N. Aggarwal,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
G. Allen,
A. Allocca,
P. A. Altin,
A. Amato,
S. Anand,
A. Ananyeva
, et al. (1322 additional authors not shown)
Abstract:
Gravitational waves enable tests of general relativity in the highly dynamical and strong-field regime. Using events detected by LIGO-Virgo up to 1 October 2019, we evaluate the consistency of the data with predictions from the theory. We first establish that residuals from the best-fit waveform are consistent with detector noise, and that the low- and high-frequency parts of the signals are in ag…
▽ More
Gravitational waves enable tests of general relativity in the highly dynamical and strong-field regime. Using events detected by LIGO-Virgo up to 1 October 2019, we evaluate the consistency of the data with predictions from the theory. We first establish that residuals from the best-fit waveform are consistent with detector noise, and that the low- and high-frequency parts of the signals are in agreement. We then consider parametrized modifications to the waveform by varying post-Newtonian and phenomenological coefficients, improving past constraints by factors of ${\sim}2$; we also find consistency with Kerr black holes when we specifically target signatures of the spin-induced quadrupole moment. Looking for gravitational-wave dispersion, we tighten constraints on Lorentz-violating coefficients by a factor of ${\sim}2.6$ and bound the mass of the graviton to $m_g \leq 1.76 \times 10^{-23} \mathrm{eV}/c^2$ with 90% credibility. We also analyze the properties of the merger remnants by measuring ringdown frequencies and dam** times, constraining fractional deviations away from the Kerr frequency to $δ\hat{f}_{220} = 0.03^{+0.38}_{-0.35}$ for the fundamental quadrupolar mode, and $δ\hat{f}_{221} = 0.04^{+0.27}_{-0.32}$ for the first overtone; additionally, we find no evidence for postmerger echoes. Finally, we determine that our data are consistent with tensorial polarizations through a template-independent method. When possible, we assess the validity of general relativity based on collections of events analyzed jointly. We find no evidence for new physics beyond general relativity, for black hole mimickers, or for any unaccounted systematics.
△ Less
Submitted 16 June, 2021; v1 submitted 27 October, 2020;
originally announced October 2020.