Showing 1–50 of 319 results for author: Lee, H k

Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers

Authors: Brian K Chen, Tianyang Hu, Hui **, Hwee Kuan Lee, Kenji Kawaguchi

Abstract: In-Context Learning (ICL) has been a powerful emergent property of large language models that has attracted increasing attention in recent years. In contrast to regular gradient-based learning, ICL is highly interpretable and does not require parameter updates. In this paper, we show that, for linearized transformer networks, ICL can be made explicit and permanent through the inclusion of bias ter… ▽ More In-Context Learning (ICL) has been a powerful emergent property of large language models that has attracted increasing attention in recent years. In contrast to regular gradient-based learning, ICL is highly interpretable and does not require parameter updates. In this paper, we show that, for linearized transformer networks, ICL can be made explicit and permanent through the inclusion of bias terms. We mathematically demonstrate the equivalence between a model with ICL demonstration prompts and the same model with the additional bias terms. Our algorithm (ICLCA) allows for exact conversion in an inexpensive manner. Existing methods are not exact and require expensive parameter updates. We demonstrate the efficacy of our approach through experiments that show the exact incorporation of ICL tokens into a linear transformer. We further suggest how our method can be adapted to achieve cheap approximate conversion of ICL tokens, even in regular transformer networks that are not linearized. Our experiments on GPT-2 show that, even though the conversion is only approximate, the model still gains valuable context from the included bias terms. △ Less

Submitted 6 June, 2024; v1 submitted 4 June, 2024; originally announced June 2024.

Comments: Accepted to ICML 2024

Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbations

Authors: Davide Coppola, Hwee Kuan Lee

Abstract: This study explores the impact of adversarial perturbations on Convolutional Neural Networks (CNNs) with the aim of enhancing the understanding of their underlying mechanisms. Despite numerous defense methods proposed in the literature, there is still an incomplete understanding of this phenomenon. Instead of treating the entire model as vulnerable, we propose that specific feature maps learned du… ▽ More This study explores the impact of adversarial perturbations on Convolutional Neural Networks (CNNs) with the aim of enhancing the understanding of their underlying mechanisms. Despite numerous defense methods proposed in the literature, there is still an incomplete understanding of this phenomenon. Instead of treating the entire model as vulnerable, we propose that specific feature maps learned during training contribute to the overall vulnerability. To investigate how the hidden representations learned by a CNN affect its vulnerability, we introduce the Adversarial Intervention framework. Experiments were conducted on models trained on three well-known computer vision datasets, subjecting them to attacks of different nature. Our focus centers on the effects that adversarial perturbations to a model's initial layer have on the overall behavior of the model. Empirical results revealed compelling insights: a) perturbing selected channel combinations in shallow layers causes significant disruptions; b) the channel combinations most responsible for the disruptions are common among different types of attacks; c) despite shared vulnerable combinations of channels, different attacks affect hidden representations with varying magnitudes; d) there exists a positive correlation between a kernel's magnitude and its vulnerability. In conclusion, this work introduces a novel framework to study the vulnerability of a CNN model to adversarial perturbations, revealing insights that contribute to a deeper understanding of the phenomenon. The identified properties pave the way for the development of efficient ad-hoc defense mechanisms in future applications. △ Less

Submitted 31 May, 2024; originally announced May 2024.

Comments: 22 pages, 15 figures (including appendix)

WoLF: Wide-scope Large Language Model Framework for CXR Understanding

Authors: Seil Kang, Donghyun Kim, Junhyeok Kim, Hyo Kyung Lee, Seong Jae Hwang

Abstract: Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However, existing CXR understanding frameworks still possess several procedural caveats. (1) Previous methods solely use CXR reports, which are insufficient for comprehensive… ▽ More Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However, existing CXR understanding frameworks still possess several procedural caveats. (1) Previous methods solely use CXR reports, which are insufficient for comprehensive Visual Question Answering (VQA), especially when additional health-related data like medication history and prior diagnoses are needed. (2) Previous methods use raw CXR reports, which are often arbitrarily structured. While modern language models can understand various text formats, restructuring reports for clearer, organized anatomy-based information could enhance their usefulness. (3) Current evaluation methods for CXR-VQA primarily emphasize linguistic correctness, lacking the capability to offer nuanced assessments of the generated answers. In this work, to address the aforementioned caveats, we introduce WoLF, a Wide-scope Large Language Model Framework for CXR understanding. To resolve (1), we capture multi-faceted records of patients, which are utilized for accurate diagnoses in real-world clinical scenarios. Specifically, we adopt the Electronic Health Records (EHR) to generate instruction-following data suited for CXR understanding. Regarding (2), we enhance report generation performance by decoupling knowledge in CXR reports based on anatomical structure even within the attention step via masked attention. To address (3), we introduce an AI-evaluation protocol optimized for assessing the capabilities of LLM. Through extensive experimental validations, WoLF demonstrates superior performance over other models on MIMIC-CXR in the AI-evaluation arena about VQA (up to +9.47%p mean score) and by metrics about report generation (+7.3%p BLEU-1). △ Less

Submitted 29 March, 2024; v1 submitted 19 March, 2024; originally announced March 2024.

Comments: 11 pages main paper, 2 pages supplementary

FlipHash: A Constant-Time Consistent Range-Hashing Algorithm

Authors: Charles Masson, Homin K. Lee

Abstract: Consistent range-hashing is a technique used in distributed systems, either directly or as a subroutine for consistent hashing, commonly to realize an even and stable data distribution over a variable number of resources. We introduce FlipHash, a consistent range-hashing algorithm with constant time complexity and low memory requirements. Like Jump Consistent Hash, FlipHash is intended for applica… ▽ More Consistent range-hashing is a technique used in distributed systems, either directly or as a subroutine for consistent hashing, commonly to realize an even and stable data distribution over a variable number of resources. We introduce FlipHash, a consistent range-hashing algorithm with constant time complexity and low memory requirements. Like Jump Consistent Hash, FlipHash is intended for applications where resources can be indexed sequentially. Under this condition, it ensures that keys are hashed evenly across resources and that changing the number of resources only causes keys to be remapped from a removed resource or to an added one, but never shuffled across persisted ones. FlipHash differentiates itself with its low computational cost, achieving constant-time complexity. We show that FlipHash beats Jump Consistent Hash's cost, which is logarithmic in the number of resources, both theoretically and in experiments over practical settings. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Comments: 16 pages, 3 figures, 4 tables

ACM Class: E.2; E.1

Sampling Space-Saving Set Sketches

Authors: Homin K. Lee, Charles Masson

Abstract: Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts using fixed memory, we need to turn to mergeable heavy hitter sketches that can provide highly accurate approximate counts. Similarly, if we wish to keep track… ▽ More Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts using fixed memory, we need to turn to mergeable heavy hitter sketches that can provide highly accurate approximate counts. Similarly, if we wish to keep track of the number of distinct items in a single set spread across several streams using fixed memory, we can turn to mergeable count distinct sketches that can provide highly accurate set cardinalities. If we were to try to keep track of the cardinality of multiple sets and report only on the largest ones, maintaining individual count distinct sketches for each set can grow unwieldy, especially if the number of sets is not known in advance. We consider the natural combination of the heavy hitters problem with the count distinct problem, the heavy distinct hitters problem: given a stream of $(\ell, x)$ pairs, find all the labels $\ell$ that are paired with a large number of distinct items $x$ using only constant memory. No previous work on heavy distinct hitters has managed to be of practical use in the large, distributed data stream setting. We propose a new algorithm, the Sampling Space-Saving Set Sketch, which combines sketching and sampling techniques and has all the desired properties for size, speed, accuracy, mergeability, and invertibility. We compare our algorithm to several existing solutions to the heavy distinct hitters problem, and provide experimental results across several data sets showing the superiority of the new sketch. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 12 pages, 5 figures

ACM Class: E.1

Contrastive Unlearning: A Contrastive Approach to Machine Unlearning

Authors: Hong kyu Lee, Qiuchen Zhang, Carl Yang, Jian Lou, Li Xiong

Abstract: Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model performance is still challenging. In this paper, we propose a contrastive unlearning framework, leveraging the concept of representation learning for more effect… ▽ More Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model performance is still challenging. In this paper, we propose a contrastive unlearning framework, leveraging the concept of representation learning for more effective unlearning. It removes the influence of unlearning samples by contrasting their embeddings against the remaining samples so that they are pushed away from their original classes and pulled toward other classes. By directly optimizing the representation space, it effectively removes the influence of unlearning samples while maintaining the representations learned from the remaining samples. Experiments on a variety of datasets and models on both class unlearning and sample unlearning showed that contrastive unlearning achieves the best unlearning effects and efficiency with the lowest performance loss compared with the state-of-the-art algorithms. △ Less

Submitted 18 January, 2024; originally announced January 2024.

PuzzleTuning: Explicitly Bridge Pathological and Natural Image with Puzzles

Authors: Tianyi Zhang, Shangqing Lyu, Yanli Lei, Sicheng Chen, Nan Ying, Yufang He, Yu Zhao, Yunlu Feng, Hwee Kuan Lee, Guanglei Zhang

Abstract: Pathological image analysis is a crucial field in computer vision. Due to the annotation scarcity in the pathological field, pre-training with self-supervised learning (SSL) is widely applied to learn on unlabeled images. However, the current SSL-based pathological pre-training: (1) does not explicitly explore the essential focuses of the pathological field, and (2) does not effectively bridge wit… ▽ More Pathological image analysis is a crucial field in computer vision. Due to the annotation scarcity in the pathological field, pre-training with self-supervised learning (SSL) is widely applied to learn on unlabeled images. However, the current SSL-based pathological pre-training: (1) does not explicitly explore the essential focuses of the pathological field, and (2) does not effectively bridge with and thus take advantage of the knowledge from natural images. To explicitly address them, we propose our large-scale PuzzleTuning framework, containing the following innovations. Firstly, we define three task focuses that can effectively bridge knowledge of pathological and natural domain: appearance consistency, spatial consistency, and restoration understanding. Secondly, we devise a novel multiple puzzle restoring task, which explicitly pre-trains the model regarding these focuses. Thirdly, we introduce an explicit prompt-tuning process to incrementally integrate the domain-specific knowledge. It builds a bridge to align the large domain gap between natural and pathological images. Additionally, a curriculum-learning training strategy is designed to regulate task difficulty, making the model adaptive to the puzzle restoring complexity. Experimental results show that our PuzzleTuning framework outperforms the previous state-of-the-art methods in various downstream tasks on multiple datasets. The code, demo, and pre-trained weights are available at https://github.com/sagizty/PuzzleTuning. △ Less

Submitted 22 April, 2024; v1 submitted 11 November, 2023; originally announced November 2023.

Comments: 13 pages, 9 figures, 8 tables

Understanding an Acquisition Function Family for Bayesian Optimization

Authors: Jiajie Kong, Tony Pourmohamad, Herbert K. H. Lee

Abstract: Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated and possibly real examples to show its efficacy. Yet on a different example, this new algorithm might not be as effective as the alternatives. This paper looks… ▽ More Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated and possibly real examples to show its efficacy. Yet on a different example, this new algorithm might not be as effective as the alternatives. This paper looks at a broader family of approaches to explain the strengths and weaknesses of algorithms in the family, with guidance on what choices might work best on different classes of problems. △ Less

Submitted 16 October, 2023; originally announced October 2023.

Finding Meaningful Distributions of ML Black-boxes under Forensic Investigation

Authors: Jiyi Zhang, Han Fang, Hwee Kuan Lee, Ee-Chien Chang

Abstract: Given a poorly documented neural network model, we take the perspective of a forensic investigator who wants to find out the model's data domain (e.g. whether on face images or traffic signs). Although existing methods such as membership inference and model inversion can be used to uncover some information about an unknown model, they still require knowledge of the data domain to start with. In th… ▽ More Given a poorly documented neural network model, we take the perspective of a forensic investigator who wants to find out the model's data domain (e.g. whether on face images or traffic signs). Although existing methods such as membership inference and model inversion can be used to uncover some information about an unknown model, they still require knowledge of the data domain to start with. In this paper, we propose solving this problem by leveraging on comprehensive corpus such as ImageNet to select a meaningful distribution that is close to the original training distribution and leads to high performance in follow-up investigations. The corpus comprises two components, a large dataset of samples and meta information such as hierarchical structure and textual information on the samples. Our goal is to select a set of samples from the corpus for the given model. The core of our method is an objective function that considers two criteria on the selected samples: the model functional properties (derived from the dataset), and semantics (derived from the metadata). We also give an algorithm to efficiently search the large space of all possible subsets w.r.t. the objective function. Experimentation results show that the proposed method is effective. For example, cloning a given model (originally trained with CIFAR-10) by using Caltech 101 can achieve 45.5% accuracy. By using datasets selected by our method, the accuracy is improved to 72.0%. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Twisted carotenoids do not support efficient intramolecular singlet fission in the orange carotenoid protein

Authors: George A. Sutherland, James P. Pidgeon, Harrison Ka Hin Lee, Matthew S. Proctor, Andrew Hitchcock, Shuangqing Wang, Dimitri Chekulaev, Wing Chung Tsoi, Matthew P. Johnson, C. Neil Hunter, Jenny Clark

Abstract: Singlet exciton fission is the spin-allowed generation of two triplet electronic excited states from a singlet state. Intramolecular singlet fission has been suggested to occur on individual carotenoid molecules within protein complexes, provided the conjugated backbone is twisted out-of-plane. However, this hypothesis has only been forwarded in protein complexes containing multiple carotenoids an… ▽ More Singlet exciton fission is the spin-allowed generation of two triplet electronic excited states from a singlet state. Intramolecular singlet fission has been suggested to occur on individual carotenoid molecules within protein complexes, provided the conjugated backbone is twisted out-of-plane. However, this hypothesis has only been forwarded in protein complexes containing multiple carotenoids and bacteriochlorophylls in close contact. To test the hypothesis on twisted carotenoids in a 'minimal' one-carotenoid system, we study the orange carotenoid protein (OCP). OCP exists in two forms: in its orange form (OCPo), the single bound carotenoid is twisted, whereas in its red form (OCPr), the carotenoid is planar. To enable room-temperature spectroscopy on canthaxanthin-binding OCPo and OCPr without laser-induced photoconversion, we trap them in trehalose glass. Using transient absorption spectroscopy, we show that there is no evidence of long-lived triplet generation through intramolecular singlet fission, despite the canthaxanthin twist in OCPo. △ Less

Submitted 24 November, 2022; originally announced November 2022.

Input optics systems of the KAGRA detector during O3GK

Authors: T. Akutsu, M. Ando, K. Arai, Y. Arai, S. Araki, A. Araya, N. Aritomi, H. Asada, Y. Aso, S. Bae, Y. Bae, L. Baiotti, R. Bajpai, M. A. Barton, K. Cannon, Z. Cao, E. Capocasa, M. Chan, C. Chen, K. Chen, Y. Chen, C-I. Chiang, H. Chu, Y-K. Chu, S. Eguchi , et al. (228 additional authors not shown)

Abstract: KAGRA, the underground and cryogenic gravitational-wave detector, was operated for its solo observation from February 25th to March 10th, 2020, and its first joint observation with the GEO 600 detector from April 7th -- 21st, 2020 (O3GK). This study presents an overview of the input optics systems of the KAGRA detector, which consist of various optical systems, such as a laser source, its intensit… ▽ More KAGRA, the underground and cryogenic gravitational-wave detector, was operated for its solo observation from February 25th to March 10th, 2020, and its first joint observation with the GEO 600 detector from April 7th -- 21st, 2020 (O3GK). This study presents an overview of the input optics systems of the KAGRA detector, which consist of various optical systems, such as a laser source, its intensity and frequency stabilization systems, modulators, a Faraday isolator, mode-matching telescopes, and a high-power beam dump. These optics were successfully delivered to the KAGRA interferometer and operated stably during the observations. The laser frequency noise was observed to limit the detector sensitivity above a few kHz, whereas the laser intensity did not significantly limit the detector sensitivity. △ Less

Submitted 12 October, 2022; originally announced October 2022.

DPAR: Decoupled Graph Neural Networks with Node-Level Differential Privacy

Authors: Qiuchen Zhang, Hong kyu Lee, **g Ma, Jian Lou, Carl Yang, Li Xiong

Abstract: Graph Neural Networks (GNNs) have achieved great success in learning with graph-structured data. Privacy concerns have also been raised for the trained models which could expose the sensitive information of graphs including both node features and the structure information. In this paper, we aim to achieve node-level differential privacy (DP) for training GNNs so that a node and its edges are prote… ▽ More Graph Neural Networks (GNNs) have achieved great success in learning with graph-structured data. Privacy concerns have also been raised for the trained models which could expose the sensitive information of graphs including both node features and the structure information. In this paper, we aim to achieve node-level differential privacy (DP) for training GNNs so that a node and its edges are protected. Node DP is inherently difficult for GNNs because all direct and multi-hop neighbors participate in the calculation of gradients for each node via layer-wise message passing and there is no bound on how many direct and multi-hop neighbors a node can have, so existing DP methods will result in high privacy cost or poor utility due to high node sensitivity. We propose a Decoupled GNN with Differentially Private Approximate Personalized PageRank (DPAR) for training GNNs with an enhanced privacy-utility tradeoff. The key idea is to decouple the feature projection and message passing via a DP PageRank algorithm which learns the structure information and uses the top-$K$ neighbors determined by the PageRank for feature aggregation. By capturing the most important neighbors for each node and avoiding the layer-wise message passing, it bounds the node sensitivity and achieves improved privacy-utility tradeoff compared to layer-wise perturbation based methods. We theoretically analyze the node DP guarantee for the two processes combined together and empirically demonstrate better utilities of DPAR with the same level of node DP compared with state-of-the-art methods. △ Less

Submitted 14 March, 2024; v1 submitted 10 October, 2022; originally announced October 2022.

Comments: Accepted to The 2024 Web Conference

Improved Numerical Scheme for the Generalized Kuramoto Model

Authors: Hyun Keun Lee, Hyunsuk Hong, Joonhyun Yeo

Abstract: We present an improved and more accurate numerical scheme for a generalization of the Kuramoto model of coupled phase oscillators to the three-dimensional space. The present numerical scheme relies crucially on our observation that the generalized Kuramoto model corresponds to particles on the unit sphere undergoing rigid body rotations with position-dependent angular velocities. We demonstrate th… ▽ More We present an improved and more accurate numerical scheme for a generalization of the Kuramoto model of coupled phase oscillators to the three-dimensional space. The present numerical scheme relies crucially on our observation that the generalized Kuramoto model corresponds to particles on the unit sphere undergoing rigid body rotations with position-dependent angular velocities. We demonstrate that our improved scheme is able to reproduce known analytic results and capture the expected behavior of the three-dimensional oscillators in various cases. On the other hand, we find that the conventional numerical method, which amounts to a direct numerical integration with the constraint that forces the particles to be on the unit sphere at each time step, may result in inaccurate and misleading behavior especially in the long time limit. We analyze in detail the origin of the discrepancy between the two methods and present the effectiveness of our method in studying the limit cycle of the Kuramoto oscillators. △ Less

Submitted 10 May, 2023; v1 submitted 15 August, 2022; originally announced August 2022.

Comments: 9 pages, 6 figures, to appear in J. Stat. Mech.: Theory Exp

A Deep Learning Network for the Classification of Intracardiac Electrograms in Atrial Tachycardia

Authors: Zerui Chen, Sonia Xhyn Teo, Andrie Ochtman, Shier Nee Saw, Nicholas Cheng, Eric Tien Siang Lim, Murphy Lyu, Hwee Kuan Lee

Abstract: A key technology enabling the success of catheter ablation treatment for atrial tachycardia is activation map**, which relies on manual local activation time (LAT) annotation of all acquired intracardiac electrogram (EGM) signals. This is a time-consuming and error-prone procedure, due to the difficulty in identifying the signal activation peaks for fractionated signals. This work presents a Dee… ▽ More A key technology enabling the success of catheter ablation treatment for atrial tachycardia is activation map**, which relies on manual local activation time (LAT) annotation of all acquired intracardiac electrogram (EGM) signals. This is a time-consuming and error-prone procedure, due to the difficulty in identifying the signal activation peaks for fractionated signals. This work presents a Deep Learning approach for the automated classification of EGM signals into three different types: normal, abnormal, and unclassified, which forms part of the LAT annotation pipeline, and contributes towards bypassing the need for manual annotations of the LAT. The Deep Learning network, the CNN-LSTM model, is a hybrid network architecture which combines convolutional neural network (CNN) layers with long short-term memory (LSTM) layers. 1452 EGM signals from a total of 9 patients undergoing clinically-indicated 3D cardiac map** were used for the training, validation and testing of our models. From our findings, the CNN-LSTM model achieved an accuracy of 81% for the balanced dataset. For comparison, we separately developed a rule-based Decision Trees model which attained an accuracy of 67% for the same balanced dataset. Our work elucidates that analysing the EGM signals using a set of explicitly specified rules as proposed by the Decision Trees model is not suitable as EGM signals are complex. The CNN-LSTM model, on the other hand, has the ability to learn the complex, intrinsic features within the signals and identify useful features to differentiate the EGM signals. △ Less

Submitted 2 June, 2022; originally announced June 2022.

Comments: 34 pages, 10 figures

ACM Class: J.3

Statistical inference as Green's functions

Authors: Hyun Keun Lee, Chulan Kwon, Yong Woon Kim

Abstract: Statistical inference from data is a foundational task in science. Recently, it has received growing attention for its central role in inference systems of primary interest in data sciences and machine learning. However, the understanding of statistical inference is not that solid while remains as a matter of subjective belief or as the routine procedures once claimed objective. We here show that… ▽ More Statistical inference from data is a foundational task in science. Recently, it has received growing attention for its central role in inference systems of primary interest in data sciences and machine learning. However, the understanding of statistical inference is not that solid while remains as a matter of subjective belief or as the routine procedures once claimed objective. We here show that there is an objective description of statistical inference for long sequence of exchangeable binary random variables, the prototypal stochasticity in theories and applications. A linear differential equation is derived from the identity known as de Finetti's representation theorem, and it turns out that statistical inference is given by the Green's functions. Our finding is an answer to the normative issue of science that pursues the objectivity based on data, and its significance will be far-reaching in most pure and applied fields. △ Less

Submitted 10 October, 2022; v1 submitted 23 May, 2022; originally announced May 2022.

Comments: 21 pages, 1 figure

Search for Gravitational Waves Associated with Fast Radio Bursts Detected by CHIME/FRB During the LIGO--Virgo Observing Run O3a

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, the CHIME/FRB Collaboration, :, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca , et al. (1633 additional authors not shown)

Abstract: We search for gravitational-wave transients associated with fast radio bursts (FRBs) detected by the Canadian Hydrogen Intensity Map** Experiment Fast Radio Burst Project (CHIME/FRB), during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC-1 Oct 2019 15:00 UTC). Triggers from 22 FRBs were analyzed with a search that targets compact binary coal… ▽ More We search for gravitational-wave transients associated with fast radio bursts (FRBs) detected by the Canadian Hydrogen Intensity Map** Experiment Fast Radio Burst Project (CHIME/FRB), during the first part of the third observing run of Advanced LIGO and Advanced Virgo (1 April 2019 15:00 UTC-1 Oct 2019 15:00 UTC). Triggers from 22 FRBs were analyzed with a search that targets compact binary coalescences with at least one neutron star component. A targeted search for generic gravitational-wave transients was conducted on 40 FRBs. We find no significant evidence for a gravitational-wave association in either search. Given the large uncertainties in the distances of the FRBs inferred from the dispersion measures in our sample, however, this does not conclusively exclude any progenitor models that include emission of a gravitational wave of the types searched for from any of these FRB events. We report $90\%$ confidence lower bounds on the distance to each FRB for a range of gravitational-wave progenitor models. By combining the inferred maximum distance information for each FRB with the sensitivity of the gravitational-wave searches, we set upper limits on the energy emitted through gravitational waves for a range of emission scenarios. We find values of order $10^{51}$-$10^{57}$ erg for a range of different emission models with central gravitational wave frequencies in the range 70-3560 Hz. Finally, we also found no significant coincident detection of gravitational waves with the repeater, FRB 20200120E, which is the closest known extragalactic FRB. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Comments: 35 pages, 6 figures, 8 tables

Report number: P2100124

PaRT: Parallel Learning Towards Robust and Transparent AI

Authors: Mahsa Paknezhad, Hamsawardhini Rengarajan, Chenghao Yuan, Sujanya Suresh, Manas Gupta, Savitha Ramasamy, Hwee Kuan Lee

Abstract: This paper takes a parallel learning approach for robust and transparent AI. A deep neural network is trained in parallel on multiple tasks, where each task is trained only on a subset of the network resources. Each subset consists of network segments, that can be combined and shared across specific tasks. Tasks can share resources with other tasks, while having independent task-related network re… ▽ More This paper takes a parallel learning approach for robust and transparent AI. A deep neural network is trained in parallel on multiple tasks, where each task is trained only on a subset of the network resources. Each subset consists of network segments, that can be combined and shared across specific tasks. Tasks can share resources with other tasks, while having independent task-related network resources. Therefore, the trained network can share similar representations across various tasks, while also enabling independent task-related representations. The above allows for some crucial outcomes. (1) The parallel nature of our approach negates the issue of catastrophic forgetting. (2) The sharing of segments uses network resources more efficiently. (3) We show that the network does indeed use learned knowledge from some tasks in other tasks, through shared representations. (4) Through examination of individual task-related and shared representations, the model offers transparency in the network and in the relationships across tasks in a multi-task setting. Evaluation of the proposed approach against complex competing approaches such as Continual Learning, Neural Architecture Search, and Multi-task learning shows that it is capable of learning robust representations. This is the first effort to train a DL model on multiple tasks in parallel. Our code is available at https://github.com/MahsaPaknezhad/PaRT △ Less

Submitted 23 February, 2022; v1 submitted 24 January, 2022; originally announced January 2022.

Narrowband searches for continuous and long-duration transient gravitational waves from known pulsars in the LIGO-Virgo third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1636 additional authors not shown)

Abstract: Isolated neutron stars that are asymmetric with respect to their spin axis are possible sources of detectable continuous gravitational waves. This paper presents a fully-coherent search for such signals from eighteen pulsars in data from LIGO and Virgo's third observing run (O3). For known pulsars, efficient and sensitive matched-filter searches can be carried out if one assumes the gravitational… ▽ More Isolated neutron stars that are asymmetric with respect to their spin axis are possible sources of detectable continuous gravitational waves. This paper presents a fully-coherent search for such signals from eighteen pulsars in data from LIGO and Virgo's third observing run (O3). For known pulsars, efficient and sensitive matched-filter searches can be carried out if one assumes the gravitational radiation is phase-locked to the electromagnetic emission. In the search presented here, we relax this assumption and allow the frequency and frequency time-derivative of the gravitational waves to vary in a small range around those inferred from electromagnetic observations. We find no evidence for continuous gravitational waves, and set upper limits on the strain amplitude for each target. These limits are more constraining for seven of the targets than the spin-down limit defined by ascribing all rotational energy loss to gravitational radiation. In an additional search we look in O3 data for long-duration (hours-months) transient gravitational waves in the aftermath of pulsar glitches for six targets with a total of nine glitches. We report two marginal outliers from this search, but find no clear evidence for such emission either. The resulting duration-dependent strain upper limits do not surpass indirect energy constraints for any of these targets. △ Less

Submitted 27 June, 2022; v1 submitted 21 December, 2021; originally announced December 2021.

Comments: 37 pages, 9 figures, submitted to ApJ

Report number: LIGO-P2100267

Journal ref: ApJ, 932, 133 (2022)

The population of merging compact binaries inferred using gravitational waves through GWTC-3

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1612 additional authors not shown)

Abstract: We report on the population properties of 76 compact binary mergers detected with gravitational waves below a false alarm rate of 1 per year through GWTC-3. The catalog contains three classes of binary mergers: BBH, BNS, and NSBH mergers. We infer the BNS merger rate to be between 10 $\rm{Gpc^{-3} yr^{-1}}$ and 1700 $\rm{Gpc^{-3} yr^{-1}}$ and the NSBH merger rate to be between 7.8… ▽ More We report on the population properties of 76 compact binary mergers detected with gravitational waves below a false alarm rate of 1 per year through GWTC-3. The catalog contains three classes of binary mergers: BBH, BNS, and NSBH mergers. We infer the BNS merger rate to be between 10 $\rm{Gpc^{-3} yr^{-1}}$ and 1700 $\rm{Gpc^{-3} yr^{-1}}$ and the NSBH merger rate to be between 7.8 $\rm{Gpc^{-3}\, yr^{-1}}$ and 140 $\rm{Gpc^{-3} yr^{-1}}$ , assuming a constant rate density versus comoving volume and taking the union of 90% credible intervals for methods used in this work. Accounting for the BBH merger rate to evolve with redshift, we find the BBH merger rate to be between 17.9 $\rm{Gpc^{-3}\, yr^{-1}}$ and 44 $\rm{Gpc^{-3}\, yr^{-1}}$ at a fiducial redshift (z=0.2). We obtain a broad neutron star mass distribution extending from $1.2^{+0.1}_{-0.2} M_\odot$ to $2.0^{+0.3}_{-0.3} M_\odot$. We can confidently identify a rapid decrease in merger rate versus component mass between neutron star-like masses and black-hole-like masses, but there is no evidence that the merger rate increases again before 10 $M_\odot$. We also find the BBH mass distribution has localized over- and under-densities relative to a power law distribution. While we continue to find the mass distribution of a binary's more massive component strongly decreases as a function of primary mass, we observe no evidence of a strongly suppressed merger rate above $\sim 60 M_\odot$. The rate of BBH mergers is observed to increase with redshift at a rate proportional to $(1+z)^κ$ with $κ= 2.9^{+1.7}_{-1.8}$ for $z\lesssim 1$. Observed black hole spins are small, with half of spin magnitudes below $χ_i \simeq 0.25$. We observe evidence of negative aligned spins in the population, and an increase in spin magnitude for systems with more unequal mass ratio. △ Less

Submitted 23 February, 2022; v1 submitted 5 November, 2021; originally announced November 2021.

Comments: v2: minor edits, most to Table 1 and caption; v3: rerun with public data; Data release: https://zenodo.org/record/5655785; v4: update Fig 14

Report number: LIGO-P2100239

Search for Gravitational Waves Associated with Gamma-Ray Bursts Detected by Fermi and Swift During the LIGO-Virgo Run O3b

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1610 additional authors not shown)

Abstract: We search for gravitational-wave signals associated with gamma-ray bursts detected by the Fermi and Swift satellites during the second half of the third observing run of Advanced LIGO and Advanced Virgo (1 November 2019 15:00 UTC-27 March 2020 17:00 UTC).We conduct two independent searches: a generic gravitational-wave transients search to analyze 86 gamma-ray bursts and an analysis to target bina… ▽ More We search for gravitational-wave signals associated with gamma-ray bursts detected by the Fermi and Swift satellites during the second half of the third observing run of Advanced LIGO and Advanced Virgo (1 November 2019 15:00 UTC-27 March 2020 17:00 UTC).We conduct two independent searches: a generic gravitational-wave transients search to analyze 86 gamma-ray bursts and an analysis to target binary mergers with at least one neutron star as short gamma-ray burst progenitors for 17 events. We find no significant evidence for gravitational-wave signals associated with any of these gamma-ray bursts. A weighted binomial test of the combined results finds no evidence for sub-threshold gravitational wave signals associated with this GRB ensemble either. We use several source types and signal morphologies during the searches, resulting in lower bounds on the estimated distance to each gamma-ray burst. Finally, we constrain the population of low luminosity short gamma-ray bursts using results from the first to the third observing runs of Advanced LIGO and Advanced Virgo. The resulting population is in accordance with the local binary neutron star merger rate. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: 26 pages, 6 figures, 2 tables

Report number: P2100091

GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, S. Akcay, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin , et al. (1637 additional authors not shown)

Abstract: The third Gravitational-Wave Transient Catalog (GWTC-3) describes signals detected with Advanced LIGO and Advanced Virgo up to the end of their third observing run. Updating the previous GWTC-2.1, we present candidate gravitational waves from compact binary coalescences during the second half of the third observing run (O3b) between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. There ar… ▽ More The third Gravitational-Wave Transient Catalog (GWTC-3) describes signals detected with Advanced LIGO and Advanced Virgo up to the end of their third observing run. Updating the previous GWTC-2.1, we present candidate gravitational waves from compact binary coalescences during the second half of the third observing run (O3b) between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. There are 35 compact binary coalescence candidates identified by at least one of our search algorithms with a probability of astrophysical origin $p_\mathrm{astro} > 0.5$. Of these, 18 were previously reported as low-latency public alerts, and 17 are reported here for the first time. Based upon estimates for the component masses, our O3b candidates with $p_\mathrm{astro} > 0.5$ are consistent with gravitational-wave signals from binary black holes or neutron star-black hole binaries, and we identify none from binary neutron stars. However, from the gravitational-wave data alone, we are not able to measure matter effects that distinguish whether the binary components are neutron stars or black holes. The range of inferred component masses is similar to that found with previous catalogs, but the O3b candidates include the first confident observations of neutron star-black hole binaries. Including the 35 candidates from O3b in addition to those from GWTC-2.1, GWTC-3 contains 90 candidates found by our analysis with $p_\mathrm{astro} > 0.5$ across the first three observing runs. These observations of compact binary coalescences present an unprecedented view of the properties of black holes and neutron stars. △ Less

Submitted 23 October, 2023; v1 submitted 5 November, 2021; originally announced November 2021.

Comments: 88 pages (10 pages author list, 31 pages main text, 1 page acknowledgements, 24 pages appendices, 22 pages bibliography), 17 figures, 16 tables. Update to match version to be published in Physical Review X. Data products available from https://gwosc.org/GWTC-3/

Report number: LIGO-P2000318

Journal ref: Phys. Rev. X; 13(4):041039; 2023

All-sky, all-frequency directional search for persistent gravitational-waves from Advanced LIGO's and Advanced Virgo's first three observing runs

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1605 additional authors not shown)

Abstract: We present the first results from an all-sky all-frequency (ASAF) search for an anisotropic stochastic gravitational-wave background using the data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. Upper limit maps on broadband anisotropies of a persistent stochastic background were published for all observing runs of the LIGO-Virgo detectors. However, a broadb… ▽ More We present the first results from an all-sky all-frequency (ASAF) search for an anisotropic stochastic gravitational-wave background using the data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. Upper limit maps on broadband anisotropies of a persistent stochastic background were published for all observing runs of the LIGO-Virgo detectors. However, a broadband analysis is likely to miss narrowband signals as the signal-to-noise ratio of a narrowband signal can be significantly reduced when combined with detector output from other frequencies. Data folding and the computationally efficient analysis pipeline, {\tt PyStoch}, enable us to perform the radiometer map-making at every frequency bin. We perform the search at 3072 {\tt{HEALPix}} equal area pixels uniformly tiling the sky and in every frequency bin of width $1/32$~Hz in the range $20-1726$~Hz, except for bins that are likely to contain instrumental artefacts and hence are notched. We do not find any statistically significant evidence for the existence of narrowband gravitational-wave signals in the analyzed frequency bins. Therefore, we place $95\%$ confidence upper limits on the gravitational-wave strain for each pixel-frequency pair, the limits are in the range $(0.030 - 9.6) \times10^{-24}$. In addition, we outline a method to identify candidate pixel-frequency pairs that could be followed up by a more sensitive (and potentially computationally expensive) search, e.g., a matched-filtering-based analysis, to look for fainter nearly monochromatic coherent signals. The ASAF analysis is inherently independent of models describing any spectral or spatial distribution of power. We demonstrate that the ASAF results can be appropriately combined over frequencies and sky directions to successfully recover the broadband directional and isotropic results. △ Less

Submitted 19 October, 2021; originally announced October 2021.

Comments: 22 pages, 6 figures, 1 table

Report number: LIGO-P2100292

Search for subsolar-mass binaries in the first half of Advanced LIGO and Virgo's third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1612 additional authors not shown)

Abstract: We report on a search for compact binary coalescences where at least one binary component has a mass between 0.2 $M_\odot$ and 1.0 $M_\odot$ in Advanced LIGO and Advanced Virgo data collected between 1 April 2019 1500 UTC and 1 October 2019 1500 UTC. We extend previous analyses in two main ways: we include data from the Virgo detector and we allow for more unequal mass systems, with mass ratio… ▽ More We report on a search for compact binary coalescences where at least one binary component has a mass between 0.2 $M_\odot$ and 1.0 $M_\odot$ in Advanced LIGO and Advanced Virgo data collected between 1 April 2019 1500 UTC and 1 October 2019 1500 UTC. We extend previous analyses in two main ways: we include data from the Virgo detector and we allow for more unequal mass systems, with mass ratio $q \geq 0.1$. We do not report any gravitational-wave candidates. The most significant trigger has a false alarm rate of 0.14 $\mathrm{yr}^{-1}$. This implies an upper limit on the merger rate of subsolar binaries in the range $[220-24200] \mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$, depending on the chirp mass of the binary. We use this upper limit to derive astrophysical constraints on two phenomenological models that could produce subsolar-mass compact objects. One is an isotropic distribution of equal-mass primordial black holes. Using this model, we find that the fraction of dark matter in primordial black holes is $f_\mathrm{PBH} \equiv Ω_\mathrm{PBH} / Ω_\mathrm{DM} \lesssim 6\%$. The other is a dissipative dark matter model, in which fermionic dark matter can collapse and form black holes. The upper limit on the fraction of dark matter black holes depends on the minimum mass of the black holes that can be formed: the most constraining result is obtained at $M_\mathrm{min}=1 M_\odot$, where $f_\mathrm{DBH} \equiv Ω_\mathrm{PBH} / Ω_\mathrm{DM} \lesssim 0.003\%$. These are the tightest limits on spinning subsolar-mass binaries to date. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Report number: LIGO-P2100163-v8

Search for continuous gravitational waves from 20 accreting millisecond X-ray pulsars in O3 LIGO data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato, C. Anand , et al. (1612 additional authors not shown)

Abstract: Results are presented of searches for continuous gravitational waves from 20 accreting millisecond X-ray pulsars with accurately measured spin frequencies and orbital parameters, using data from the third observing run of the Advanced LIGO and Advanced Virgo detectors. The search algorithm uses a hidden Markov model, where the transition probabilities allow the frequency to wander according to an… ▽ More Results are presented of searches for continuous gravitational waves from 20 accreting millisecond X-ray pulsars with accurately measured spin frequencies and orbital parameters, using data from the third observing run of the Advanced LIGO and Advanced Virgo detectors. The search algorithm uses a hidden Markov model, where the transition probabilities allow the frequency to wander according to an unbiased random walk, while the $\mathcal{J}$-statistic maximum-likelihood matched filter tracks the binary orbital phase. Three narrow sub-bands are searched for each target, centered on harmonics of the measured spin frequency. The search yields 16 candidates, consistent with a false alarm probability of 30% per sub-band and target searched. These candidates, along with one candidate from an additional target-of-opportunity search done for SAX J1808.4$-$3658, which was in outburst during one month of the observing run, cannot be confidently associated with a known noise source. Additional follow-up does not provide convincing evidence that any are a true astrophysical signal. When all candidates are assumed non-astrophysical, upper limits are set on the maximum wave strain detectable at 95% confidence, $h_0^{95\%}$. The strictest constraint is $h_0^{95\%} = 4.7\times 10^{-26}$ from IGR J17062$-$6143. Constraints on the detectable wave strain from each target lead to constraints on neutron star ellipticity and $r$-mode amplitude, the strictest of which are $ε^{95\%} = 3.1\times 10^{-7}$ and $α^{95\%} = 1.8\times 10^{-5}$ respectively. This analysis is the most comprehensive and sensitive search of continuous gravitational waves from accreting millisecond X-ray pulsars to date. △ Less

Submitted 21 January, 2022; v1 submitted 19 September, 2021; originally announced September 2021.

Comments: 40 pages, 6 figures. This version contains minor typographical revisions to match published article

Report number: LIGO-P2100221

Journal ref: Phys. Rev. D 105, 022002 (2022)

Coupling disorder in a population of swarmalators

Authors: Hyunsuk Hong, Kangmo Yeo, Hyun Keun Lee

Abstract: We consider a population of two-dimensional oscillators with random couplings, and explore the collective states. The coupling strength between oscillators is randomly quenched with two values one of which is positive while the other is negative, and the oscillators can spatially {\it{move}} depending on the state variables for phase and position. We find that the system shows the phase transition… ▽ More We consider a population of two-dimensional oscillators with random couplings, and explore the collective states. The coupling strength between oscillators is randomly quenched with two values one of which is positive while the other is negative, and the oscillators can spatially {\it{move}} depending on the state variables for phase and position. We find that the system shows the phase transition from the incoherent state to the fully synchronized one at a proper ratio of the number of positive couplings to the total. The threshold is numerically measured, and analytically predicted by the linear stability analysis of the fully synchronized state. It is found that the random couplings induces the long-term state patterns appearing for constant strength. The oscillators move to the places where the randomly quenched couplings work as if annealed. We further observe that the system with mixed randomnesses for quenched couplings shows the combination of the deformed patterns understandable with each annealed averages. △ Less

Submitted 29 October, 2021; v1 submitted 31 August, 2021; originally announced August 2021.

Comments: 7 pages, 5 figures

Journal ref: Phys. Rev. E 104, 044214 (2021)

All-sky search for long-duration gravitational-wave bursts in the third Advanced LIGO and Advanced Virgo run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1605 additional authors not shown)

Abstract: After the detection of gravitational waves from compact binary coalescences, the search for transient gravitational-wave signals with less well-defined waveforms for which matched filtering is not well-suited is one of the frontiers for gravitational-wave astronomy. Broadly classified into "short" $ \lesssim 1~$\,s and "long" $ \gtrsim 1~$\,s duration signals, these signals are expected from a var… ▽ More After the detection of gravitational waves from compact binary coalescences, the search for transient gravitational-wave signals with less well-defined waveforms for which matched filtering is not well-suited is one of the frontiers for gravitational-wave astronomy. Broadly classified into "short" $ \lesssim 1~$\,s and "long" $ \gtrsim 1~$\,s duration signals, these signals are expected from a variety of astrophysical processes, including non-axisymmetric deformations in magnetars or eccentric binary black hole coalescences. In this work, we present a search for long-duration gravitational-wave transients from Advanced LIGO and Advanced Virgo's third observing run from April 2019 to March 2020. For this search, we use minimal assumptions for the sky location, event time, waveform morphology, and duration of the source. The search covers the range of $2~\text{--}~ 500$~s in duration and a frequency band of $24 - 2048$ Hz. We find no significant triggers within this parameter space; we report sensitivity limits on the signal strength of gravitational waves characterized by the root-sum-square amplitude $h_{\mathrm{rss}}$ as a function of waveform morphology. These $h_{\mathrm{rss}}$ limits improve upon the results from the second observing run by an average factor of 1.8. △ Less

Submitted 29 July, 2021; originally announced July 2021.

Report number: P2100063

All-sky search for short gravitational-wave bursts in the third Advanced LIGO and Advanced Virgo run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1608 additional authors not shown)

Abstract: This paper presents the results of a search for generic short-duration gravitational-wave transients in data from the third observing run of Advanced LIGO and Advanced Virgo. Transients with durations of milliseconds to a few seconds in the 24--4096 Hz frequency band are targeted by the search, with no assumptions made regarding the incoming signal direction, polarization or morphology. Gravitatio… ▽ More This paper presents the results of a search for generic short-duration gravitational-wave transients in data from the third observing run of Advanced LIGO and Advanced Virgo. Transients with durations of milliseconds to a few seconds in the 24--4096 Hz frequency band are targeted by the search, with no assumptions made regarding the incoming signal direction, polarization or morphology. Gravitational waves from compact binary coalescences that have been identified by other targeted analyses are detected, but no statistically significant evidence for other gravitational wave bursts is found. Sensitivities to a variety of signals are presented. These include updated upper limits on the source rate-density as a function of the characteristic frequency of the signal, which are roughly an order of magnitude better than previous upper limits. This search is sensitive to sources radiating as little as $\sim$10$^{-10} M_{\odot} c^2$ in gravitational waves at $\sim$70 Hz from a distance of 10~kpc, with 50\% detection efficiency at a false alarm rate of one per century. The sensitivity of this search to two plausible astrophysical sources is estimated: neutron star f-modes, which may be excited by pulsar glitches, as well as selected core-collapse supernova models. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Comments: 23 pages, 8 figures

Report number: P2100045

Cusp in the Symmetry Energy, Speed of Sound in Neutron Stars and Emergent Pseudo-Conformal Symmetry

Authors: Hyun Kyu Lee, Yong-Liang Ma, Won-Gi Paeng, Mannque Rho

Abstract: We review how the "cusp" predicted in the nuclear symmetry energy generated by a topology change at density $n_{1/2}\gsim 2 n_0$ can have a surprising consequence, so far unrecognized in nuclear physics and astrophysics communities, on the structure of dense compact-star matter. The topology change, when translated into nuclear EFT with "effective" QCD degrees of freedom in terms of hidden local a… ▽ More We review how the "cusp" predicted in the nuclear symmetry energy generated by a topology change at density $n_{1/2}\gsim 2 n_0$ can have a surprising consequence, so far unrecognized in nuclear physics and astrophysics communities, on the structure of dense compact-star matter. The topology change, when translated into nuclear EFT with "effective" QCD degrees of freedom in terms of hidden local and scale symmetries duly taken into account, predicts an EoS that is soft below and stiff above $n\gsim n_{1/2}$, involving no low-order phase transitions, and yields the macrophysical properties of neutron stars consistent -- so far with no tension -- with the astrophysical observations, including the maximum mass $ 2.0\lsim M/ M_\odot\lsim 2.2$ as well as the GW data. Furthermore it describes the interior core of the massive stars populated by baryon-charge-fractionalized quasi-fermions that are neither baryonic nor quarkonic. It is argued that the cusp "buried" in the symmetry energy resulting from strong correlations with hidden heavy degrees of freedom leads, at $n\gsim n_{1/2}$, to what we dubbed "pseudo-conformal" sound speed, $v^2_{pcs}/c^2\approx 1/3$, precociously converged from below at $n_{1/2}$. It is not strictly conformal since the trace of energy-momentum tensor is not zero even in the chiral limit. This observation with the topology change identified with the putative hadron-quark continuity, taking place at at density $\gsim 2 n_0$, implies that the quantities accurately measured at $\sim n_0$ cannot give a stringent constraint for what takes place at the core density of compact stars $\sim (3-7) n_0$. This is because the change of degrees of freedom in effective field theory is involved. We discuss the implication of this on the recent PREX-II "dilemma" in the measured skin thickness of $^{208}$Pb. △ Less

Submitted 29 January, 2022; v1 submitted 5 July, 2021; originally announced July 2021.

Comments: Invited review with title change in Modern Physics Letters A

All-sky Search for Continuous Gravitational Waves from Isolated Neutron Stars in the Early O3 LIGO Data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1566 additional authors not shown)

Abstract: We report on an all-sky search for continuous gravitational waves in the frequency band 20-2000\,Hz and with a frequency time derivative in the range of $[-1.0, +0.1]\times10^{-8}$\,Hz/s. Such a signal could be produced by a nearby, spinning and slightly non-axisymmetric isolated neutron star in our galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Vi… ▽ More We report on an all-sky search for continuous gravitational waves in the frequency band 20-2000\,Hz and with a frequency time derivative in the range of $[-1.0, +0.1]\times10^{-8}$\,Hz/s. Such a signal could be produced by a nearby, spinning and slightly non-axisymmetric isolated neutron star in our galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Virgo's third observational run, O3. No periodic gravitational wave signals are observed, and 95\%\ confidence-level (CL) frequentist upper limits are placed on their strengths. The lowest upper limits on worst-case (linearly polarized) strain amplitude $h_0$ are $~1.7\times10^{-25}$ near 200\,Hz. For a circularly polarized source (most favorable orientation), the lowest upper limits are $\sim6.3\times10^{-26}$. These strict frequentist upper limits refer to all sky locations and the entire range of frequency derivative values. For a population-averaged ensemble of sky locations and stellar orientations, the lowest 95\%\ CL upper limits on the strain amplitude are $\sim1.\times10^{-25}$. These upper limits improve upon our previously published all-sky results, with the greatest improvement (factor of $\sim$2) seen at higher frequencies, in part because quantum squeezing has dramatically improved the detector noise level relative to the second observational run, O2. These limits are the most constraining to date over most of the parameter space searched. △ Less

Submitted 8 October, 2021; v1 submitted 1 July, 2021; originally announced July 2021.

Comments: 28 pages, 7 figures

Report number: LIGO-P2000334-v9

Journal ref: Phys. Rev. D 104, 082004 (2021)

Observation of gravitational waves from two neutron star-black hole coalescences

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1577 additional authors not shown)

Abstract: We report the observation of gravitational waves from two compact binary coalescences in LIGO's and Virgo's third observing run with properties consistent with neutron star-black hole (NSBH) binaries. The two events are named GW200105_162426 and GW200115_042309, abbreviated as GW200105 and GW200115; the first was observed by LIGO Livingston and Virgo, and the second by all three LIGO-Virgo detecto… ▽ More We report the observation of gravitational waves from two compact binary coalescences in LIGO's and Virgo's third observing run with properties consistent with neutron star-black hole (NSBH) binaries. The two events are named GW200105_162426 and GW200115_042309, abbreviated as GW200105 and GW200115; the first was observed by LIGO Livingston and Virgo, and the second by all three LIGO-Virgo detectors. The source of GW200105 has component masses $8.9^{+1.2}_{-1.5}\,M_\odot$ and $1.9^{+0.3}_{-0.2}\,M_\odot$, whereas the source of GW200115 has component masses $5.7^{+1.8}_{-2.1}\,M_\odot$ and $1.5^{+0.7}_{-0.3}\,M_\odot$ (all measurements quoted at the 90% credible level). The probability that the secondary's mass is below the maximal mass of a neutron star is 89%-96% and 87%-98%, respectively, for GW200105 and GW200115, with the ranges arising from different astrophysical assumptions. The source luminosity distances are $280^{+110}_{-110}$ Mpc and $300^{+150}_{-100}$ Mpc, respectively. The magnitude of the primary spin of GW200105 is less than 0.23 at the 90% credible level, and its orientation is unconstrained. For GW200115, the primary spin has a negative spin projection onto the orbital angular momentum at 88% probability. We are unable to constrain spin or tidal deformation of the secondary component for either event. We infer a NSBH merger rate density of $45^{+75}_{-33}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ when assuming GW200105 and GW200115 are representative of the NSBH population, or $130^{+112}_{-69}\,\mathrm{Gpc}^{-3} \mathrm{yr}^{-1}$ under the assumption of a broader distribution of component masses. △ Less

Submitted 29 June, 2021; originally announced June 2021.

Report number: LIGO Document P2000357

Journal ref: ApJL, 915, L5 (2021)

Weakly-supervised learning on Schrodinger equation

Authors: Kenta Shiina, Hwee Kuan Lee, Yutaka Okabe, Hiroyuki Mori

Abstract: We propose a machine learning method to solve Schrodinger equations for a Hamiltonian that consists of an unperturbed Hamiltonian and a perturbation. We focus on the cases where the unperturbed Hamiltonian can be solved analytically or solved numerically with some fast way. Given a potential function as input, our deep learning model predicts wave functions and energies using a weakly-supervised m… ▽ More We propose a machine learning method to solve Schrodinger equations for a Hamiltonian that consists of an unperturbed Hamiltonian and a perturbation. We focus on the cases where the unperturbed Hamiltonian can be solved analytically or solved numerically with some fast way. Given a potential function as input, our deep learning model predicts wave functions and energies using a weakly-supervised method. Information of first-order perturbation calculation for randomly chosen perturbations is used to train the model. In other words, no label (or exact solution) is necessary for the training, which is why the method is called weakly-supervised, not supervised. The trained model can be applied to calculation of wave functions and energies of Hamiltonian containing arbitrary perturbation. As an example, we calculated wave functions and energies of a harmonic oscillator with a perturbation and results were in good agreement with those obtained from exact diagonalization. △ Less

Submitted 22 June, 2021; originally announced June 2021.

An End-to-End Breast Tumour Classification Model Using Context-Based Patch Modelling- A BiLSTM Approach for Image Classification

Authors: Suvidha Tripathi, Satish Kumar Singh, Hwee Kuan Lee

Abstract: Researchers working on computational analysis of Whole Slide Images (WSIs) in histopathology have primarily resorted to patch-based modelling due to large resolution of each WSI. The large resolution makes WSIs infeasible to be fed directly into the machine learning models due to computational constraints. However, due to patch-based analysis, most of the current methods fail to exploit the underl… ▽ More Researchers working on computational analysis of Whole Slide Images (WSIs) in histopathology have primarily resorted to patch-based modelling due to large resolution of each WSI. The large resolution makes WSIs infeasible to be fed directly into the machine learning models due to computational constraints. However, due to patch-based analysis, most of the current methods fail to exploit the underlying spatial relationship among the patches. In our work, we have tried to integrate this relationship along with feature-based correlation among the extracted patches from the particular tumorous region. For the given task of classification, we have used BiLSTMs to model both forward and backward contextual relationship. RNN based models eliminate the limitation of sequence size by allowing the modelling of variable size images within a deep learning model. We have also incorporated the effect of spatial continuity by exploring different scanning techniques used to sample patches. To establish the efficiency of our approach, we trained and tested our model on two datasets, microscopy images and WSI tumour regions. After comparing with contemporary literature we achieved the better performance with accuracy of 90% for microscopy image dataset. For WSI tumour region dataset, we compared the classification results with deep learning networks such as ResNet, DenseNet, and InceptionV3 using maximum voting technique. We achieved the highest performance accuracy of 84%. We found out that BiLSTMs with CNN features have performed much better in modelling patches into an end-to-end Image classification network. Additionally, the variable dimensions of WSI tumour regions were used for classification without the need for resizing. This suggests that our method is independent of tumour image size and can process large dimensional images without losing the resolution details. △ Less

Submitted 5 June, 2021; originally announced June 2021.

Comments: 36 pages, 5 figures, 9 tables. Published in Computerized Medical Imaging and Graphics

Journal ref: Computerized Medical Imaging and Graphics, 87, 101838 (2021)

Thermodynamic uncertainty relation for underdamped dynamics driven by time-dependent protocols

Authors: Chulan Kwon, Youngchae Kwon, Hyun Keun Lee

Abstract: The thermodynamic uncertainty relation (TUR) for underdamped dynamics has intriguing problems while its counterpart for overdamped dynamics has recently been derived. Even for the case of steady states, a proper way to match underdamped and overdamped TURs has not been found. We derive the TUR for underdamped systems subject to general time-dependent protocols, that covers steady states, by using… ▽ More The thermodynamic uncertainty relation (TUR) for underdamped dynamics has intriguing problems while its counterpart for overdamped dynamics has recently been derived. Even for the case of steady states, a proper way to match underdamped and overdamped TURs has not been found. We derive the TUR for underdamped systems subject to general time-dependent protocols, that covers steady states, by using the Cramér-Rao inequality. We show the resultant TUR to give rise to the inequality of the product of the variance and entropy production. We prove it to approach to the known overdamped result for large viscosity limit. We present three examples to confirm our rigorous result. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 6 pages, 3 figures

Constraints on dark photon dark matter using data from LIGO's and Virgo's third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, F. Acernese, K. Ackley, C. Adams, N. Adhikari, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, A. Allocca, P. A. Altin, A. Amato , et al. (1605 additional authors not shown)

Abstract: We present a search for dark photon dark matter that could couple to gravitational-wave interferometers using data from Advanced LIGO and Virgo's third observing run. To perform this analysis, we use two methods, one based on cross-correlation of the strain channels in the two nearly aligned LIGO detectors, and one that looks for excess power in the strain channels of the LIGO and Virgo detectors.… ▽ More We present a search for dark photon dark matter that could couple to gravitational-wave interferometers using data from Advanced LIGO and Virgo's third observing run. To perform this analysis, we use two methods, one based on cross-correlation of the strain channels in the two nearly aligned LIGO detectors, and one that looks for excess power in the strain channels of the LIGO and Virgo detectors. The excess power method optimizes the Fourier Transform coherence time as a function of frequency, to account for the expected signal width due to Doppler modulations. We do not find any evidence of dark photon dark matter with a mass between $m_{\rm A} \sim 10^{-14}-10^{-11}$ eV/$c^2$, which corresponds to frequencies between 10-2000 Hz, and therefore provide upper limits on the square of the minimum coupling of dark photons to baryons, i.e. $U(1)_{\rm B}$ dark matter. For the cross-correlation method, the best median constraint on the squared coupling is $\sim2.65\times10^{-46}$ at $m_{\rm A}\sim4.31\times10^{-13}$ eV/$c^2$; for the other analysis, the best constraint is $\sim 2.4\times 10^{-47}$ at $m_{\rm A}\sim 5.7\times 10^{-13}$ eV/$c^2$. These limits improve upon those obtained in direct dark matter detection experiments by a factor of $\sim100$ for $m_{\rm A}\sim [2-4]\times 10^{-13}$ eV/$c^2$, and are, in absolute terms, the most stringent constraint so far in a large mass range $m_A\sim$ $2\times 10^{-13}-8\times 10^{-12}$ eV/$c^2$. △ Less

Submitted 6 May, 2024; v1 submitted 27 May, 2021; originally announced May 2021.

Comments: 20 pages, 7 figures; In the latest version, we integrated the changes reported in the published erratum (DOI: https://doi.org/10.1103/PhysRevD.109.089902). Essentially, we overestimated the sensitivity of the cross-correlation search to a dark photon dark matter signal and have corrected this, making the BSD limits the most stringent in this search at most dark photon masses

Report number: LIGO-P2100098

Journal ref: Phys. Rev. D 105, 063030, 2022

Searches for continuous gravitational waves from young supernova remnants in the early third observing run of Advanced LIGO and Virgo

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1567 additional authors not shown)

Abstract: We present results of three wide-band directed searches for continuous gravitational waves from 15 young supernova remnants in the first half of the third Advanced LIGO and Virgo observing run. We use three search pipelines with distinct signal models and methods of identifying noise artifacts. Without ephemerides of these sources, the searches are conducted over a frequency band spanning from 10~… ▽ More We present results of three wide-band directed searches for continuous gravitational waves from 15 young supernova remnants in the first half of the third Advanced LIGO and Virgo observing run. We use three search pipelines with distinct signal models and methods of identifying noise artifacts. Without ephemerides of these sources, the searches are conducted over a frequency band spanning from 10~Hz to 2~kHz. We find no evidence of continuous gravitational radiation from these sources. We set upper limits on the intrinsic signal strain at 95\% confidence level in sample sub-bands, estimate the sensitivity in the full band, and derive the corresponding constraints on the fiducial neutron star ellipticity and $r$-mode amplitude. The best 95\% confidence constraints placed on the signal strain are $7.7\times 10^{-26}$ and $7.8\times 10^{-26}$ near 200~Hz for the supernova remnants G39.2--0.3 and G65.7+1.2, respectively. The most stringent constraints on the ellipticity and $r$-mode amplitude reach $\lesssim 10^{-7}$ and $ \lesssim 10^{-5}$, respectively, at frequencies above $\sim 400$~Hz for the closest supernova remnant G266.2--1.2/Vela Jr. △ Less

Submitted 14 July, 2021; v1 submitted 24 May, 2021; originally announced May 2021.

Comments: https://dcc.ligo.org/P2000479

Constraints from LIGO O3 data on gravitational-wave emission due to r-modes in the glitching pulsar PSR J0537-6910

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1574 additional authors not shown)

Abstract: We present a search for continuous gravitational-wave emission due to r-modes in the pulsar PSR J0537-6910 using data from the LIGO-Virgo Collaboration observing run O3. PSR J0537-6910 is a young energetic X-ray pulsar and is the most frequent glitcher known. The inter-glitch braking index of the pulsar suggests that gravitational-wave emission due to r-mode oscillations may play an important role… ▽ More We present a search for continuous gravitational-wave emission due to r-modes in the pulsar PSR J0537-6910 using data from the LIGO-Virgo Collaboration observing run O3. PSR J0537-6910 is a young energetic X-ray pulsar and is the most frequent glitcher known. The inter-glitch braking index of the pulsar suggests that gravitational-wave emission due to r-mode oscillations may play an important role in the spin evolution of this pulsar. Theoretical models confirm this possibility and predict emission at a level that can be probed by ground-based detectors. In order to explore this scenario, we search for r-mode emission in the epochs between glitches by using a contemporaneous timing ephemeris obtained from NICER data. We do not detect any signals in the theoretically expected band of 86-97 Hz, and report upper limits on the amplitude of the gravitational waves. Our results improve on previous amplitude upper limits from r-modes in J0537-6910 by a factor of up to 3 and place stringent constraints on theoretical models for r-mode driven spin-down in PSR J0537-6910, especially for higher frequencies at which our results reach below the spin-down limit defined by energy conservation. △ Less

Submitted 7 January, 2022; v1 submitted 29 April, 2021; originally announced April 2021.

Comments: 28 pages, 19 figures, accepted in ApJ

Report number: LIGO-P2100069

Journal ref: ApJ 922 71 (2021)

Inverse Renormalization Group based on Image Super-Resolution using Deep Convolutional Networks

Authors: Kenta Shiina, Hiroyuki Mori, Yusuke Tomita, Hwee Kuan Lee, Yutaka Okabe

Abstract: The inverse renormalization group is studied based on the image super-resolution using the deep convolutional neural networks. We consider the improved correlation configuration instead of spin configuration for the spin models, such as the two-dimensional Ising and three-state Potts models. We propose a block-cluster transformation as an alternative to the block-spin transformation in dealing wit… ▽ More The inverse renormalization group is studied based on the image super-resolution using the deep convolutional neural networks. We consider the improved correlation configuration instead of spin configuration for the spin models, such as the two-dimensional Ising and three-state Potts models. We propose a block-cluster transformation as an alternative to the block-spin transformation in dealing with the improved estimators. In the framework of the dual Monte Carlo algorithm, the block-cluster transformation is regarded as a transformation in the graph degrees of freedom, whereas the block-spin transformation is that in the spin degrees of freedom. We demonstrate that the renormalized improved correlation configuration successfully reproduces the original configuration at all the temperatures by the super-resolution scheme. Using the rule of enlargement, we repeatedly make inverse renormalization procedure to generate larger correlation configurations. To connect thermodynamics, an approximate temperature rescaling is discussed. The enlarged systems generated using the super-resolution satisfy the finite-size scaling. △ Less

Submitted 9 April, 2021; originally announced April 2021.

Comments: accepted for publication in Scientific Reports

Journal ref: Sci. Rep. 11, 9617 (2021)

Collective steady-state patterns of swarmalators with finite-cutoff interaction distance

Authors: Hyun Keun Lee, Kangmo Yeo, Hyunsuk Hong

Abstract: We study the steady-state patterns of population of the coupled oscillators that sync and swarm, where the interaction distances among oscillators have finite-cutoff in interaction distance. We examine how the static patterns known in the infinite-cutoff are reproduced or deformed, and explore a new static pattern that does not appear until a finite-cutoff is considered. All steady-state patterns… ▽ More We study the steady-state patterns of population of the coupled oscillators that sync and swarm, where the interaction distances among oscillators have finite-cutoff in interaction distance. We examine how the static patterns known in the infinite-cutoff are reproduced or deformed, and explore a new static pattern that does not appear until a finite-cutoff is considered. All steady-state patterns of the infinite-cutoff, static sync, static async, and static phase wave are respectively repeated in space for proper finite-cutoff ranges. Their deformation in shape and density takes place for the other finite-cutoff ranges. Bar-like phase wave states are observed, which has not been the case for the infinite-cutoff. All the patterns are investigated via numerical and theoretical analysis. △ Less

Submitted 22 March, 2021; originally announced March 2021.

Comments: 9 pages, 8 figures

Journal ref: Chaos 31, 033134 (2021)

Search for anisotropic gravitational-wave backgrounds using data from Advanced LIGO and Advanced Virgo's first three observing runs

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1568 additional authors not shown)

Abstract: We report results from searches for anisotropic stochastic gravitational-wave backgrounds using data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. For the first time, we include Virgo data in our analysis and run our search with a new efficient pipeline called {\tt PyStoch} on data folded over one sidereal day. We use gravitational-wave radiometry (broadban… ▽ More We report results from searches for anisotropic stochastic gravitational-wave backgrounds using data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. For the first time, we include Virgo data in our analysis and run our search with a new efficient pipeline called {\tt PyStoch} on data folded over one sidereal day. We use gravitational-wave radiometry (broadband and narrow band) to produce sky maps of stochastic gravitational-wave backgrounds and to search for gravitational waves from point sources. A spherical harmonic decomposition method is employed to look for gravitational-wave emission from spatially-extended sources. Neither technique found evidence of gravitational-wave signals. Hence we derive 95\% confidence-level upper limit sky maps on the gravitational-wave energy flux from broadband point sources, ranging from $F_{α, Θ} < {\rm (0.013 - 7.6)} \times 10^{-8} {\rm erg \, cm^{-2} \, s^{-1} \, Hz^{-1}},$ and on the (normalized) gravitational-wave energy density spectrum from extended sources, ranging from $Ω_{α, Θ} < {\rm (0.57 - 9.3)} \times 10^{-9} \, {\rm sr^{-1}}$, depending on direction ($Θ$) and spectral index ($α$). These limits improve upon previous limits by factors of $2.9 - 3.5$. We also set 95\% confidence level upper limits on the frequency-dependent strain amplitudes of quasimonochromatic gravitational waves coming from three interesting targets, Scorpius X-1, SN 1987A and the Galactic Center, with best upper limits range from $h_0 < {\rm (1.7-2.1)} \times 10^{-25},$ a factor of $\geq 2.0$ improvement compared to previous stochastic radiometer searches. △ Less

Submitted 2 February, 2022; v1 submitted 15 March, 2021; originally announced March 2021.

Comments: 23 Pages, 9 Figures

Report number: LIGO-P2000500

Journal ref: Phys. Rev. D 104, 022005 (2021)

Explaining Adversarial Vulnerability with a Data Sparsity Hypothesis

Authors: Mahsa Paknezhad, Cuong Phuc Ngo, Amadeus Aristo Winarto, Alistair Cheong, Chuen Yang Beh, Jiayang Wu, Hwee Kuan Lee

Abstract: Despite many proposed algorithms to provide robustness to deep learning (DL) models, DL models remain susceptible to adversarial attacks. We hypothesize that the adversarial vulnerability of DL models stems from two factors. The first factor is data sparsity which is that in the high dimensional input data space, there exist large regions outside the support of the data distribution. The second fa… ▽ More Despite many proposed algorithms to provide robustness to deep learning (DL) models, DL models remain susceptible to adversarial attacks. We hypothesize that the adversarial vulnerability of DL models stems from two factors. The first factor is data sparsity which is that in the high dimensional input data space, there exist large regions outside the support of the data distribution. The second factor is the existence of many redundant parameters in the DL models. Owing to these factors, different models are able to come up with different decision boundaries with comparably high prediction accuracy. The appearance of the decision boundaries in the space outside the support of the data distribution does not affect the prediction accuracy of the model. However, it makes an important difference in the adversarial robustness of the model. We hypothesize that the ideal decision boundary is as far as possible from the support of the data distribution. In this paper, we develop a training framework to observe if DL models are able to learn such a decision boundary spanning the space around the class distributions further from the data points themselves. Semi-supervised learning was deployed during training by leveraging unlabeled data generated in the space outside the support of the data distribution. We measured adversarial robustness of the models trained using this training framework against well-known adversarial attacks and by using robustness metrics. We found that models trained using our framework, as well as other regularization methods and adversarial training support our hypothesis of data sparsity and that models trained with these methods learn to have decision boundaries more similar to the aforementioned ideal decision boundary. The code for our training framework is available at https://github.com/MahsaPaknezhad/AdversariallyRobustTraining. △ Less

Submitted 17 February, 2022; v1 submitted 1 March, 2021; originally announced March 2021.

Journal ref: Neurocomputing, 2022

Automated Deep Learning Analysis of Angiography Video Sequences for Coronary Artery Disease

Authors: Chengyang Zhou, Thao Vy Dinh, Heyi Kong, Jonathan Yap, Khung Keong Yeo, Hwee Kuan Lee, Kaicheng Liang

Abstract: The evaluation of obstructions (stenosis) in coronary arteries is currently done by a physician's visual assessment of coronary angiography video sequences. It is laborious, and can be susceptible to interobserver variation. Prior studies have attempted to automate this process, but few have demonstrated an integrated suite of algorithms for the end-to-end analysis of angiograms. We report an auto… ▽ More The evaluation of obstructions (stenosis) in coronary arteries is currently done by a physician's visual assessment of coronary angiography video sequences. It is laborious, and can be susceptible to interobserver variation. Prior studies have attempted to automate this process, but few have demonstrated an integrated suite of algorithms for the end-to-end analysis of angiograms. We report an automated analysis pipeline based on deep learning to rapidly and objectively assess coronary angiograms, highlight coronary vessels of interest, and quantify potential stenosis. We propose a 3-stage automated analysis method consisting of key frame extraction, vessel segmentation, and stenosis measurement. We combined powerful deep learning approaches such as ResNet and U-Net with traditional image processing and geometrical analysis. We trained and tested our algorithms on the Left Anterior Oblique (LAO) view of the right coronary artery (RCA) using anonymized angiograms obtained from a tertiary cardiac institution, then tested the generalizability of our technique to the Right Anterior Oblique (RAO) view. We demonstrated an overall improvement on previous work, with key frame extraction top-5 precision of 98.4%, vessel segmentation F1-Score of 0.891 and stenosis measurement 20.7% Type I Error rate. △ Less

Submitted 29 January, 2021; originally announced January 2021.

Constraints on cosmic strings using data from the third Advanced LIGO-Virgo observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1565 additional authors not shown)

Abstract: We search for gravitational-wave signals produced by cosmic strings in the Advanced LIGO and Virgo full O3 data set. Search results are presented for gravitational waves produced by cosmic string loop features such as cusps, kinks and, for the first time, kink-kink collisions.cA template-based search for short-duration transient signals does not yield a detection. We also use the stochastic gravit… ▽ More We search for gravitational-wave signals produced by cosmic strings in the Advanced LIGO and Virgo full O3 data set. Search results are presented for gravitational waves produced by cosmic string loop features such as cusps, kinks and, for the first time, kink-kink collisions.cA template-based search for short-duration transient signals does not yield a detection. We also use the stochastic gravitational-wave background energy density upper limits derived from the O3 data to constrain the cosmic string tension, $Gμ$, as a function of the number of kinks, or the number of cusps, for two cosmic string loop distribution models.cAdditionally, we develop and test a third model which interpolates between these two models. Our results improve upon the previous LIGO-Virgo constraints on $Gμ$ by one to two orders of magnitude depending on the model which is tested. In particular, for one loop distribution model, we set the most competitive constraints to date, $Gμ\lesssim 4\times 10^{-15}$. △ Less

Submitted 28 January, 2021; originally announced January 2021.

Comments: 20 pages, 10 figures

Report number: LIGO-P2000506

Journal ref: Phys. Rev. Lett. 126, 241102 (2021)

Upper Limits on the Isotropic Gravitational-Wave Background from Advanced LIGO's and Advanced Virgo's Third Observing Run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca, P. A. Altin , et al. (1566 additional authors not shown)

Abstract: We report results of a search for an isotropic gravitational-wave background (GWB) using data from Advanced LIGO's and Advanced Virgo's third observing run (O3) combined with upper limits from the earlier O1 and O2 runs. Unlike in previous observing runs in the advanced detector era, we include Virgo in the search for the GWB. The results are consistent with uncorrelated noise, and therefore we pl… ▽ More We report results of a search for an isotropic gravitational-wave background (GWB) using data from Advanced LIGO's and Advanced Virgo's third observing run (O3) combined with upper limits from the earlier O1 and O2 runs. Unlike in previous observing runs in the advanced detector era, we include Virgo in the search for the GWB. The results are consistent with uncorrelated noise, and therefore we place upper limits on the strength of the GWB. We find that the dimensionless energy density $Ω_{\rm GW}\leq 5.8\times 10^{-9}$ at the 95% credible level for a flat (frequency-independent) GWB, using a prior which is uniform in the log of the strength of the GWB, with 99% of the sensitivity coming from the band 20-76.6 Hz; $\leq 3.4 \times 10^{-9}$ at 25 Hz for a power-law GWB with a spectral index of 2/3 (consistent with expectations for compact binary coalescences), in the band 20-90.6 Hz; and $\leq 3.9 \times 10^{-10}$ at 25 Hz for a spectral index of 3, in the band 20-291.6 Hz. These upper limits improve over our previous results by a factor of 6.0 for a flat GWB. We also search for a GWB arising from scalar and vector modes, which are predicted by alternative theories of gravity; we place upper limits on the strength of GWBs with these polarizations. We demonstrate that there is no evidence of correlated noise of magnetic origin by performing a Bayesian analysis that allows for the presence of both a GWB and an effective magnetic background arising from geophysical Schumann resonances. We compare our upper limits to a fiducial model for the GWB from the merger of compact binaries. Finally, we combine our results with observations of individual mergers andshow that, at design sensitivity, this joint approach may yield stronger constraints on the merger rate of binary black holes at $z \lesssim 2$ than can be achieved with individually resolved mergers alone. [abridged] △ Less

Submitted 28 January, 2021; originally announced January 2021.

Comments: 25 pages, 7 figures, Abstract abridged for arxiv submission

Report number: LIGO-DCC-P2000314

Journal ref: Phys. Rev. D 104, 022004 (2021)

Diving below the spin-down limit: Constraints on gravitational waves from the energetic young pulsar PSR J0537-6910

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, T. D. Abbott, S. Abraham, F. Acernese, K. Ackley, A. Adams, C. Adams, R. X. Adhikari, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, K. M. Aleman, G. Allen, A. Allocca , et al. (1568 additional authors not shown)

Abstract: We present a search for continuous gravitational-wave signals from the young, energetic X-ray pulsar PSR J0537-6910 using data from the second and third observing runs of LIGO and Virgo. The search is enabled by a contemporaneous timing ephemeris obtained using NICER data. The NICER ephemeris has also been extended through 2020 October and includes three new glitches. PSR J0537-6910 has the larges… ▽ More We present a search for continuous gravitational-wave signals from the young, energetic X-ray pulsar PSR J0537-6910 using data from the second and third observing runs of LIGO and Virgo. The search is enabled by a contemporaneous timing ephemeris obtained using NICER data. The NICER ephemeris has also been extended through 2020 October and includes three new glitches. PSR J0537-6910 has the largest spin-down luminosity of any pulsar and is highly active with regards to glitches. Analyses of its long-term and inter-glitch braking indices provided intriguing evidence that its spin-down energy budget may include gravitational-wave emission from a time-varying mass quadrupole moment. Its 62 Hz rotation frequency also puts its possible gravitational-wave emission in the most sensitive band of LIGO/Virgo detectors. Motivated by these considerations, we search for gravitational-wave emission at both once and twice the rotation frequency. We find no signal, however, and report our upper limits. Assuming a rigidly rotating triaxial star, our constraints reach below the gravitational-wave spin-down limit for this star for the first time by more than a factor of two and limit gravitational waves from the $l=m=2$ mode to account for less than 14% of the spin-down energy budget. The fiducial equatorial ellipticity is limited to less than about 3e-5, which is the third best constraint for any young pulsar. △ Less

Submitted 10 June, 2021; v1 submitted 23 December, 2020; originally announced December 2020.

Comments: 21 pages, 5 figures, published in ApJL

Report number: LIGO-P2000407

Overview of KAGRA: Calibration, detector characterization, physical environmental monitors, and the geophysics interferometer

Authors: T. Akutsu, M. Ando, K. Arai, Y. Arai, S. Araki, A. Araya, N. Aritomi, H. Asada, Y. Aso, S. Bae, Y. Bae, L. Baiotti, R. Bajpai, M. A. Barton, K. Cannon, Z. Cao, E. Capocasa, M. Chan, C. Chen, K. Chen, Y. Chen, C-Y. Chiang, H. Chu, Y-K. Chu, S. Eguchi , et al. (218 additional authors not shown)

Abstract: KAGRA is a newly built gravitational wave observatory, a laser interferometer with a 3 km arm length, located in Kamioka, Gifu, Japan. In this series of articles, we present an overview of the baseline KAGRA, for which we finished installing the designed configuration in 2019. This article describes the method of calibration (CAL) used for reconstructing gravitational wave signals from the detecto… ▽ More KAGRA is a newly built gravitational wave observatory, a laser interferometer with a 3 km arm length, located in Kamioka, Gifu, Japan. In this series of articles, we present an overview of the baseline KAGRA, for which we finished installing the designed configuration in 2019. This article describes the method of calibration (CAL) used for reconstructing gravitational wave signals from the detector outputs, as well as the characterization of the detector (DET). We also review the physical environmental monitors (PEM) system and the geophysics interferometer (GIF). Both are used for characterizing and evaluating the data quality of the gravitational wave channel. They play important roles in utilizing the detector output for gravitational wave searches. These characterization investigations will be even more important in the near future, once gravitational wave detection has been achieved, and in using KAGRA in the gravitational wave astronomy era. △ Less

Submitted 9 February, 2021; v1 submitted 19 September, 2020; originally announced September 2020.

Comments: 2021/02/08 Accepted by PTEP

QCD vacuum and baryon masses

Authors: Youngman Kim, Igor A. Mazur, Masayasu Harada, Hyun Kyu Lee

Abstract: To study a possible role of the quantum chromodynamics (QCD) vacuum in nuclear and hadron physics, we evaluate a physical quantity in a candidate of the QCD vacuum. In this study we adopt the Copenhagen (spaghetti) picture of the QCD vacuum and calculate the ground-state baryon masses in a constituent quark model. We find that the calculated baryon mass does depend on a parameter that characterize… ▽ More To study a possible role of the quantum chromodynamics (QCD) vacuum in nuclear and hadron physics, we evaluate a physical quantity in a candidate of the QCD vacuum. In this study we adopt the Copenhagen (spaghetti) picture of the QCD vacuum and calculate the ground-state baryon masses in a constituent quark model. We find that the calculated baryon mass does depend on a parameter that characterizes the Copenhagen picture of the QCD vacuum and satisfies the Gell-Mann-Okubo mass relation for the baryon octet. We also observe that the effective constituent quark mass defined in this study contains a contribution attributed to the Copenhagen vacuum, that is the gluon background field. We then estimate the value of the background gluon field as a function of the up (down) constituent quark mass by using the baryon masses as inputs. △ Less

Submitted 29 November, 2023; v1 submitted 6 September, 2020; originally announced September 2020.

Comments: 13 pages, 1 figure

Overview of KAGRA : KAGRA science

Authors: KAGRA Collaboration, T. Akutsu, M. Ando, K. Arai, Y. Arai, S. Araki, A. Araya, N. Aritomi, H. Asada, Y. Aso, S. Bae, Y. Bae, L. Baiotti, R. Bajpai, M. A. Barton, K. Cannon, Z. Cao, E. Capocasa, M. Chan, C. Chen, K. Chen, Y. Chen, C-Y. Chiang, H. Chu, Y-K. Chu , et al. (222 additional authors not shown)

Abstract: KAGRA is a newly build gravitational-wave observatory, a laser interferometer with 3 km arm length, located in Kamioka, Gifu, Japan. In this paper in the series of KAGRA-featured articles, we discuss the science targets of KAGRA projects, considering not only the baseline KAGRA (current design) but also its future upgrade candidates (KAGRA+) for the near to middle term (~5 years). KAGRA is a newly build gravitational-wave observatory, a laser interferometer with 3 km arm length, located in Kamioka, Gifu, Japan. In this paper in the series of KAGRA-featured articles, we discuss the science targets of KAGRA projects, considering not only the baseline KAGRA (current design) but also its future upgrade candidates (KAGRA+) for the near to middle term (~5 years). △ Less

Submitted 6 August, 2020; originally announced August 2020.

Comments: 73 pages, 11 figures, accepted by Progress of Theoretical and Experimental Physics, in the series of KAGRA-featured articles

Machine-Learning Study using Improved Correlation Configuration and Application to Quantum Monte Carlo Simulation

Authors: Yusuke Tomita, Kenta Shiina, Yutaka Okabe, Hwee Kuan Lee

Abstract: We use the Fortuin-Kasteleyn representation based improved estimator of the correlation configuration as an alternative to the ordinary correlation configuration in the machine-learning study of the phase classification of spin models. The phases of classical spin models are classified using the improved estimators, and the method is also applied to the quantum Monte Carlo simulation using the loo… ▽ More We use the Fortuin-Kasteleyn representation based improved estimator of the correlation configuration as an alternative to the ordinary correlation configuration in the machine-learning study of the phase classification of spin models. The phases of classical spin models are classified using the improved estimators, and the method is also applied to the quantum Monte Carlo simulation using the loop algorithm. We analyze the Berezinskii-Kosterlitz-Thouless (BKT) transition of the spin 1/2 quantum XY model on the square lattice. We classify the BKT phase and the paramagnetic phase of the quantum XY model using the machine-learning approach. We show that the classification of the quantum XY model can be performed by using the training data of the classical XY model. △ Less

Submitted 29 July, 2020; originally announced July 2020.

Comments: 6 pages, 4 figures. arXiv admin note: text overlap with arXiv:2001.03989

Journal ref: Phys. Rev. E 102, 021302 (2020)

Studying The Effect of MIL Pooling Filters on MIL Tasks

Authors: Mustafa Umit Oner, Jared Marc Song Kye-Jet, Hwee Kuan Lee, Wing-Kin Sung

Abstract: There are different multiple instance learning (MIL) pooling filters used in MIL models. In this paper, we study the effect of different MIL pooling filters on the performance of MIL models in real world MIL tasks. We designed a neural network based MIL framework with 5 different MIL pooling filters: `max', `mean', `attention', `distribution' and `distribution with attention'. We also formulated 5… ▽ More There are different multiple instance learning (MIL) pooling filters used in MIL models. In this paper, we study the effect of different MIL pooling filters on the performance of MIL models in real world MIL tasks. We designed a neural network based MIL framework with 5 different MIL pooling filters: `max', `mean', `attention', `distribution' and `distribution with attention'. We also formulated 5 different MIL tasks on a real world lymph node metastases dataset. We found that the performance of our framework in a task is different for different filters. We also observed that the performances of the five pooling filters are also different from task to task. Hence, the selection of a correct MIL pooling filter for each MIL task is crucial for better performance. Furthermore, we noticed that models with `distribution' and `distribution with attention' pooling filters consistently perform well in almost all of the tasks. We attribute this phenomena to the amount of information captured by `distribution' based pooling filters. While point estimate based pooling filters, like `max' and `mean', produce point estimates of distributions, `distribution' based pooling filters capture the full information in distributions. Lastly, we compared the performance of our neural network model with `distribution' pooling filter with the performance of the best MIL methods in the literature on classical MIL datasets and our model outperformed the others. △ Less

Submitted 2 June, 2020; originally announced June 2020.

Comments: 16 pages

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

Authors: Kaicheng Liang, Xinyu Liu, Si Chen, Jun Xie, Wei Qing Lee, Linbo Liu, Hwee Kuan Lee

Abstract: A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh reso… ▽ More A resolution enhancement technique for optical coherence tomography (OCT), based on Generative Adversarial Networks (GANs), was developed and investigated. GANs have been previously used for resolution enhancement of photography and optical microscopy images. We have adapted and improved this technique for OCT image generation. Conditional GANs (cGANs) were trained on a novel set of ultrahigh resolution spectral domain OCT volumes, termed micro-OCT, as the high-resolution ground truth (~1$μ$m isotropic resolution). The ground truth was paired with a low-resolution image obtained by synthetically degrading resolution 4x in one of (1-D) or both axial and lateral axes (2-D). Cross-sectional image (B-scan) volumes obtained from in vivo imaging of human labial (lip) tissue and mouse skin were used in separate feasibility experiments. Accuracy of resolution enhancement compared to ground truth was quantified with human perceptual accuracy tests performed by an OCT expert. The GAN loss in the optimization objective, noise injection in both the generator and discriminator models, and multi-scale discrimination were found to be important for achieving realistic speckle appearance in the generated OCT images. The utility of high resolution speckle recovery was illustrated by an example of micro-OCT imaging of blood vessels in lip tissue. Qualitative examples applying the models to image data from outside of the training data distribution, namely human retina and mouse bladder, were also demonstrated, suggesting potential for cross-domain transferability. This preliminary study suggests that deep learning generative models trained on OCT images from high-performance prototype systems may have potential in enhancing lower resolution data from mainstream/commercial systems, thereby bringing cutting-edge technology to the masses at low cost. △ Less

Submitted 15 September, 2020; v1 submitted 12 March, 2020; originally announced March 2020.

Journal ref: Biomedical Optics Express (2020)