Showing 1–50 of 695 results for author: Thomas, P

Visible $\mathcal C^2$-smooth domains are pseudoconvex

Authors: Nikolai Nikolov, Ahmed Yekta Ökten, Pascal J. Thomas

Abstract: We show that a domain that satisfies the visibility property with $\mathcal C^2$-smooth boundary is pseudoconvex. We show that a domain that satisfies the visibility property with $\mathcal C^2$-smooth boundary is pseudoconvex. △ Less

Submitted 3 July, 2024; originally announced July 2024.

Comments: 6 pages

MSC Class: 32F45

Moment-based parameter inference with error guarantees for stochastic reaction networks

Authors: Zekai Li, Mauricio Barahona, Philipp Thomas

Abstract: Inferring parameters of models of biochemical kinetics from single-cell data remains challenging because of the uncertainty arising from the intractability of the likelihood function of stochastic reaction networks. Such uncertainty falls beyond current error quantification measures, which focus on the effects of finite sample size and identifiability but lack theoretical guarantees when likelihoo… ▽ More Inferring parameters of models of biochemical kinetics from single-cell data remains challenging because of the uncertainty arising from the intractability of the likelihood function of stochastic reaction networks. Such uncertainty falls beyond current error quantification measures, which focus on the effects of finite sample size and identifiability but lack theoretical guarantees when likelihood approximations are needed. Here, we propose an inference method for stochastic reaction networks with nonlinear and rational propensities at steady state that provides bounds on the parameters via convex optimisation over sets constrained by moment equations and moment matrices. Our approach takes observations from the stochastic reaction network and forms moment intervals, which are then used to constrain parameters through convex sets. The bounds on the parameters contain the true parameters under the condition that the moment intervals contain the true stationary moments, thus providing uncertainty quantification and error guarantees. Our approach does not need to predict moments and distributions for given parameters (i.e., it avoids solving or simulating the forward problem), and hence circumvents intractable likelihood computations or computationally expensive simulations. We demonstrate its use for uncertainty quantification, data integration and prediction of latent species statistics through synthetic data from common nonlinear biochemical models including the Schlögl model, the toggle switch and post-transcriptional regulation. △ Less

Submitted 25 June, 2024; originally announced June 2024.

Position: Benchmarking is Limited in Reinforcement Learning Research

Authors: Scott M. Jordan, Adam White, Bruno Castro da Silva, Martha White, Philip S. Thomas

Abstract: Novel reinforcement learning algorithms, or improvements on existing ones, are commonly justified by evaluating their performance on benchmark environments and are compared to an ever-changing set of standard algorithms. However, despite numerous calls for improvements, experimental practices continue to produce misleading or unsupported claims. One reason for the ongoing substandard practices is… ▽ More Novel reinforcement learning algorithms, or improvements on existing ones, are commonly justified by evaluating their performance on benchmark environments and are compared to an ever-changing set of standard algorithms. However, despite numerous calls for improvements, experimental practices continue to produce misleading or unsupported claims. One reason for the ongoing substandard practices is that conducting rigorous benchmarking experiments requires substantial computational time. This work investigates the sources of increased computation costs in rigorous experiment designs. We show that conducting rigorous performance benchmarks will likely have computational costs that are often prohibitive. As a result, we argue for using an additional experimentation paradigm to overcome the limitations of benchmarking. △ Less

Submitted 23 June, 2024; originally announced June 2024.

Comments: 19 pages, 13 figures, The Forty-first International Conference on Machine Learning (ICML 2024)

Lipschitzness of the width and diameter functions of convex bodies in $\mathbb R^n$

Authors: Oleg Mushkarov, Nikolai Nikolov, Pascal J. Thomas

Abstract: Lipschitz constants for the width and diameter functions of a convex body in $\mathbb R^n$ are found in terms of its diameter and thickness (maximum and minimum of both functions). Also, a dual approach to thickness is proposed. Lipschitz constants for the width and diameter functions of a convex body in $\mathbb R^n$ are found in terms of its diameter and thickness (maximum and minimum of both functions). Also, a dual approach to thickness is proposed. △ Less

Submitted 18 June, 2024; originally announced June 2024.

MSC Class: 52A20

ICU-Sepsis: A Benchmark MDP Built from Real Medical Data

Authors: Kartik Choudhary, Dhawal Gupta, Philip S. Thomas

Abstract: We present ICU-Sepsis, an environment that can be used in benchmarks for evaluating reinforcement learning (RL) algorithms. Sepsis management is a complex task that has been an important topic in applied RL research in recent years. Therefore, MDPs that model sepsis management can serve as part of a benchmark to evaluate RL algorithms on a challenging real-world problem. However, creating usable M… ▽ More We present ICU-Sepsis, an environment that can be used in benchmarks for evaluating reinforcement learning (RL) algorithms. Sepsis management is a complex task that has been an important topic in applied RL research in recent years. Therefore, MDPs that model sepsis management can serve as part of a benchmark to evaluate RL algorithms on a challenging real-world problem. However, creating usable MDPs that simulate sepsis care in the ICU remains a challenge due to the complexities involved in acquiring and processing patient data. ICU-Sepsis is a lightweight environment that models personalized care of sepsis patients in the ICU. The environment is a tabular MDP that is widely compatible and is challenging even for state-of-the-art RL algorithms, making it a valuable tool for benchmarking their performance. However, we emphasize that while ICU-Sepsis provides a standardized environment for evaluating RL algorithms, it should not be used to draw conclusions that guide medical practice. △ Less

Submitted 9 June, 2024; originally announced June 2024.

Comments: Reinforcement Learning Conference 2024

Euclid. II. The VIS Instrument

Authors: Euclid Collaboration, M. Cropper, A. Al-Bahlawan, J. Amiaux, S. Awan, R. Azzollini, K. Benson, M. Berthe, J. Boucher, E. Bozzo, C. Brockley-Blatt, G. P. Candini, C. Cara, R. A. Chaudery, R. E. Cole, P. Danto, J. Denniston, A. M. Di Giorgio, B. Dryer, J. Endicott, J. -P. Dubois, M. Farina, E. Galli, L. Genolet, J. P. D. Gow , et al. (403 additional authors not shown)

Abstract: This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift ran… ▽ More This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift range z=0.1-1.5 resulting from weak gravitational lensing, one of the two principal cosmology probes of Euclid. With photometric redshifts, the distribution of dark matter can be mapped in three dimensions, and, from how this has changed with look-back time, the nature of dark energy and theories of gravity can be constrained. The entire VIS focal plane will be transmitted to provide the largest images of the Universe from space to date, reaching m_AB>24.5 with S/N >10 in a single broad I_E~(r+i+z) band over a six year survey. The particularly challenging aspects of the instrument are the control and calibration of observational biases, which lead to stringent performance requirements and calibration regimes. With its combination of spatial resolution, calibration knowledge, depth, and area covering most of the extra-Galactic sky, VIS will also provide a legacy data set for many other fields. This paper discusses the rationale behind the VIS concept and describes the instrument design and development before reporting the pre-launch performance derived from ground calibrations and brief results from the in-orbit commissioning. VIS should reach fainter than m_AB=25 with S/N>10 for galaxies of full-width half-maximum of 0.3" in a 1.3" diameter aperture over the Wide Survey, and m_AB>26.4 for a Deep Survey that will cover more than 50 deg^2. The paper also describes how VIS works with the other Euclid components of survey, telescope, and science data processing to extract the cosmological information. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. I. Overview of the Euclid mission

Authors: Euclid Collaboration, Y. Mellier, Abdurro'uf, J. A. Acevedo Barroso, A. Achúcarro, J. Adamek, R. Adam, G. E. Addison, N. Aghanim, M. Aguena, V. Ajani, Y. Akrami, A. Al-Bahlawan, A. Alavi, I. S. Albuquerque, G. Alestas, G. Alguero, A. Allaoui, S. W. Allen, V. Allevato, A. V. Alonso-Tetilla, B. Altieri, A. Alvarez-Candal, A. Amara, L. Amendola , et al. (1086 additional authors not shown)

Abstract: The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14… ▽ More The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14,000 deg^2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue`Euclid on Sky'

LIGO operates with quantum noise below the Standard Quantum Limit

Authors: Wenxuan Jia, Victoria Xu, Kevin Kuns, Masayuki Nakano, Lisa Barsotti, Matthew Evans, Nergis Mavalvala, Rich Abbott, Ibrahim Abouelfettouh, Rana Adhikari, Alena Ananyeva, Stephen Appert, Koji Arai, Naoki Aritomi, Stuart Aston, Matthew Ball, Stefan Ballmer, David Barker, Beverly Berger, Joseph Betzwieser, Dripta Bhattacharjee, Garilynn Billingsley, Nina Bode, Edgard Bonilla, Vladimir Bossilkov , et al. (146 additional authors not shown)

Abstract: Precision measurements of space and time, like those made by the detectors of the Laser Interferometer Gravitational-wave Observatory (LIGO), are often confronted with fundamental limitations imposed by quantum mechanics. The Heisenberg uncertainty principle dictates that the position and momentum of an object cannot both be precisely measured, giving rise to an apparent limitation called the Stan… ▽ More Precision measurements of space and time, like those made by the detectors of the Laser Interferometer Gravitational-wave Observatory (LIGO), are often confronted with fundamental limitations imposed by quantum mechanics. The Heisenberg uncertainty principle dictates that the position and momentum of an object cannot both be precisely measured, giving rise to an apparent limitation called the Standard Quantum Limit (SQL). Reducing quantum noise below the SQL in gravitational-wave detectors, where photons are used to continuously measure the positions of freely falling mirrors, has been an active area of research for decades. Here we show how the LIGO A+ upgrade reduced the detectors' quantum noise below the SQL by up to 3 dB while achieving a broadband sensitivity improvement, more than two decades after this possibility was first presented. △ Less

Submitted 22 April, 2024; originally announced April 2024.

Report number: LIGO-P2400059

Phase-Amplitude Description of Stochastic Oscillators: A Parameterization Method Approach

Authors: Alberto Pérez-Cervera, Benjamin Lindner, Peter J. Thomas

Abstract: The parameterization method (PM) provides a broad theoretical and numerical foundation for computing invariant manifolds of dynamical systems. PM implements a change of variables in order to represent trajectories of a system of ordinary differential equations ``as simply as possible." In this paper we pursue a similar goal for stochastic oscillator systems. For planar nonlinear stochastic systems… ▽ More The parameterization method (PM) provides a broad theoretical and numerical foundation for computing invariant manifolds of dynamical systems. PM implements a change of variables in order to represent trajectories of a system of ordinary differential equations ``as simply as possible." In this paper we pursue a similar goal for stochastic oscillator systems. For planar nonlinear stochastic systems that are ``robustly oscillatory", we find a change of variables through which the dynamics are as simple as possible $\textit{in the mean}$. We prove existence and uniqueness of a deterministic vector field, the trajectories of which capture the local mean behavior of the stochastic oscillator. We illustrate the construction of such an ``effective vector field" for several examples, including a limit cycle oscillator perturbed by noise, an excitable system derived from a spiking neuron model, and a spiral sink with noise forcing (2D Ornstein-Uhlenbeck process). The latter examples comprise contingent oscillators that would not sustain rhythmic activity without noise forcing. Finally, we exploit the simplicity of the dynamics after the change of variables to obtain the effective diffusion constant of the resulting phase variable, and the stationary variance of the resulting amplitude (isostable) variable. △ Less

Submitted 13 April, 2024; originally announced April 2024.

First Light and Reionization Epoch Simulations (FLARES) -- XV: The physical properties of super-massive black holes and their impact on galaxies in the early universe

Authors: Stephen M. Wilkins, Jussi K. Kuusisto, Dimitrios Irodotou, Shihong Liao, Christopher C. Lovell, Sonja Soininen, Sabrina C. Berger, Sophie L. Newman, William J. Roper, Louise T. C. Seeyave, Peter A. Thomas, Aswin P. Vijayan

Abstract: Understanding the co-evolution of super-massive black holes (SMBHs) and their host galaxies remains a key challenge of extragalactic astrophysics, particularly the earliest stages at high-redshift. However, studying SMBHs at high-redshift with cosmological simulations, is challenging due to the large volumes and high-resolution required. Through its innovative simulation strategy, the First Light… ▽ More Understanding the co-evolution of super-massive black holes (SMBHs) and their host galaxies remains a key challenge of extragalactic astrophysics, particularly the earliest stages at high-redshift. However, studying SMBHs at high-redshift with cosmological simulations, is challenging due to the large volumes and high-resolution required. Through its innovative simulation strategy, the First Light And Reionisation Epoch Simulations (FLARES) suite of cosmological hydrodynamical zoom simulations allows us to simulate a much wider range of environments which contain SMBHs with masses extending to $M_{\bullet}>10^{9}\ M_{\odot}$ at $z=5$. In this paper, we use FLARES to study the physical properties of SMBHs and their hosts in the early Universe ($5\le\, z \le10$). FLARES predicts a sharply declining density with increasing redshift, decreasing by a factor of 100 over the range $z=5\to 10$. Comparison between our predicted bolometric luminosity function and pre-\emph{JWST} observations yield a good match. However, recent \emph{JWST} observations appear to suggest a larger contribution of SMBHs than previously observed, or predicted by FLARES. Finally, by using a re-simulation with AGN feedback disabled, we explore the impact of AGN feedback on their host galaxies. This reveals that AGN feedback results in a reduction of star formation activity, even at $z>5$, but only in the most massive galaxies. A deeper analysis reveals that AGN are also the cause of suppressed star formation in passive galaxies but that the presence of an AGN doesn't necessarily result in the suppression of star formation. △ Less

Submitted 9 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

Comments: 17 pages, 13 figures, to be submitted to the Open Journal of Astrophysics. The first two authors are joint primary authors. Updated with new observational constraints

Variational design of sensory feedback for powerstroke-recovery systems

Authors: Zhuojun Yu, Peter J. Thomas

Abstract: Although the raison d'etre of the brain is the survival of the body, there are relatively few theoretical studies of closed-loop rhythmic motor control systems. In this paper we provide a unified framework, based on variational analysis, for investigating the dual goals of performance and robustness in powerstroke-recovery systems. We augment two previously published closed-loop motor control mode… ▽ More Although the raison d'etre of the brain is the survival of the body, there are relatively few theoretical studies of closed-loop rhythmic motor control systems. In this paper we provide a unified framework, based on variational analysis, for investigating the dual goals of performance and robustness in powerstroke-recovery systems. We augment two previously published closed-loop motor control models by equip** each model with a performance measure based on the rate of progress of the system relative to a spatially extended external substrate -- such as progress relative to the ground for a locomotor task. The sensitivity measure quantifies the ability of the system to maintain performance in response to external perturbations. Motivated by a search for optimal design principles for feedback control achieving the complementary requirements of efficiency and robustness, we discuss the performance-sensitivity patterns of the systems featuring different sensory feedback architectures. In a paradigmatic half-center oscillator (HCO)-motor system, we observe that the excitation-inhibition property of feedback mechanisms determines the sensitivity pattern while the activation-inactivation property determines the performance pattern. Moreover, we show that the nonlinearity of the sigmoid activation of feedback signals allows the existence of optimal combinations of performance and sensitivity. In a detailed hindlimb locomotor system, we find that a force-dependent feedback can simultaneously optimize both performance and robustness, while length-dependent feedback variations result in significant performance-versus-sensitivity tradeoffs. Thus, this work provides an analytical framework for studying feedback control of oscillations in nonlinear dynamical systems, leading to several insights that have the potential to inform the design of control or rehabilitation systems. △ Less

Submitted 29 March, 2024; originally announced April 2024.

Comments: 48 pages, 17 figures, 3 tables

A Dataset for Pharmacovigilance in German, French, and Japanese: Annotating Adverse Drug Reactions across Languages

Authors: Lisa Raithel, Hui-Syuan Yeh, Shuntaro Yada, Cyril Grouin, Thomas Lavergne, Aurélie Névéol, Patrick Paroubek, Philippe Thomas, Tomohiro Nishiyama, Sebastian Möller, Eiji Aramaki, Yuji Matsumoto, Roland Roller, Pierre Zweigenbaum

Abstract: User-generated data sources have gained significance in uncovering Adverse Drug Reactions (ADRs), with an increasing number of discussions occurring in the digital world. However, the existing clinical corpora predominantly revolve around scientific articles in English. This work presents a multilingual corpus of texts concerning ADRs gathered from diverse sources, including patient fora, social m… ▽ More User-generated data sources have gained significance in uncovering Adverse Drug Reactions (ADRs), with an increasing number of discussions occurring in the digital world. However, the existing clinical corpora predominantly revolve around scientific articles in English. This work presents a multilingual corpus of texts concerning ADRs gathered from diverse sources, including patient fora, social media, and clinical reports in German, French, and Japanese. Our corpus contains annotations covering 12 entity types, four attribute types, and 13 relation types. It contributes to the development of real-world multilingual language models for healthcare. We provide statistics to highlight certain challenges associated with the corpus and conduct preliminary experiments resulting in strong baselines for extracting entities and relations between these entities, both within and across languages. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: Accepted at LREC-COLING 2024

Refined sheaf counting on local K3 surfaces

Authors: Richard P. Thomas

Abstract: We compute all refined sheaf counting invariants -- Vafa-Witten, reduced DT, stable pairs and Gopakumar-Vafa -- for all classes on local $K3$ surfaces. Along the way we develop rank 0 Vafa-Witten theory on $K3$ surfaces. An important feature of the calculation is that the ``instanton contribution" -- of sheaves supported scheme theoretically on $S$ -- to any of the invariants depends only on the… ▽ More We compute all refined sheaf counting invariants -- Vafa-Witten, reduced DT, stable pairs and Gopakumar-Vafa -- for all classes on local $K3$ surfaces. Along the way we develop rank 0 Vafa-Witten theory on $K3$ surfaces. An important feature of the calculation is that the ``instanton contribution" -- of sheaves supported scheme theoretically on $S$ -- to any of the invariants depends only on the square of the class, not its divisibility. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Comments: 16 pages

MSC Class: 14N35

Fusion of deterministically generated photonic graph states

Authors: Philip Thomas, Leonardo Ruscio, Olivier Morin, Gerhard Rempe

Abstract: Entanglement has evolved from an enigmatic concept of quantum physics to a key ingredient of quantum technology. It explains correlations between measurement outcomes that contradict classical physics, and has been widely explored with small sets of individual qubits. Multi-partite entangled states build up in gate-based quantum-computing protocols, and $\unicode{x2013}$ from a broader perspective… ▽ More Entanglement has evolved from an enigmatic concept of quantum physics to a key ingredient of quantum technology. It explains correlations between measurement outcomes that contradict classical physics, and has been widely explored with small sets of individual qubits. Multi-partite entangled states build up in gate-based quantum-computing protocols, and $\unicode{x2013}$ from a broader perspective $\unicode{x2013}$ were proposed as the main resource for measurement-based quantum-information processing. The latter requires the ex-ante generation of a multi-qubit entangled state described by a graph. Small graph states such as Bell or linear cluster states have been produced with photons, but the proposed quantum computing and quantum networking applications require fusion of such states into larger and more powerful states in a programmable fashion. Here we achieve this goal by employing an optical resonator containing two individually addressable atoms. Ring and tree graph states with up to eight qubits, with the names reflecting the entanglement topology, are efficiently fused from the photonic states emitted by the individual atoms. The fusion process itself employs a cavity-assisted gate between the two atoms. Our technique is in principle scalable to even larger numbers of qubits, and is the decisive step towards, for instance, a memory-less quantum repeater in a future quantum internet. △ Less

Submitted 4 June, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

Comments: 18 pages, 5 figures, 2 tables

Journal ref: Nature 629, 567-572 (2024)

Ultralight vector dark matter search using data from the KAGRA O3GK run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, H. Abe, I. Abouelfettouh, F. Acernese, K. Ackley, C. Adamcewicz, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi , et al. (1778 additional authors not shown)

Abstract: Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we prese… ▽ More Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we present the result of a search for $U(1)_{B-L}$ gauge boson DM using the KAGRA data from auxiliary length channels during the first joint observation run together with GEO600. By applying our search pipeline, which takes into account the stochastic nature of ultralight DM, upper bounds on the coupling strength between the $U(1)_{B-L}$ gauge boson and ordinary matter are obtained for a range of DM masses. While our constraints are less stringent than those derived from previous experiments, this study demonstrates the applicability of our method to the lower-mass vector DM search, which is made difficult in this measurement by the short observation time compared to the auto-correlation time scale of DM. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 20 pages, 5 figures

Report number: LIGO-P2300250

Quantum Lefschetz without curves

Authors: Jeongseok Oh, Richard P. Thomas

Abstract: Given one quasi-smooth derived space cut out of another by a section of a 2-term complex of bundles, we give two formulae for its virtual cycle. They are modelled on the the $p$-fields construction of Chang-Li and the Quantum Lefschetz principle, and recover these when applied to moduli spaces of (stable or quasi-) maps. When the complex is a single bundle we recover results of Kim-Kresch-Pantev… ▽ More Given one quasi-smooth derived space cut out of another by a section of a 2-term complex of bundles, we give two formulae for its virtual cycle. They are modelled on the the $p$-fields construction of Chang-Li and the Quantum Lefschetz principle, and recover these when applied to moduli spaces of (stable or quasi-) maps. When the complex is a single bundle we recover results of Kim-Kresch-Pantev. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 16 pages

Noise-induced survival resonances during fractional killing of cell populations

Authors: Francesco Puccioni, Johannes Pausch, Paul Piho, Philipp Thomas

Abstract: Fractional killing in response to drugs is a hallmark of non-genetic cellular heterogeneity. Yet how individual lineages evade drug treatment, as observed in bacteria and cancer cells, is not quantitatively understood. We analyse a stochastic population model with age-dependent division and death rates and characterise the emergence of fractional killing as a stochastic phenomenon under constant a… ▽ More Fractional killing in response to drugs is a hallmark of non-genetic cellular heterogeneity. Yet how individual lineages evade drug treatment, as observed in bacteria and cancer cells, is not quantitatively understood. We analyse a stochastic population model with age-dependent division and death rates and characterise the emergence of fractional killing as a stochastic phenomenon under constant and periodic drug environments. In constant environments, increasing cell cycle noise induces a phase transition from complete to fractional killing, while increasing death noise can induce the reverse transition. In periodic drug environments, we discover survival resonance phenomena that give rise to peaks in the survival probabilities at division or death times that are multiples of the environment duration not seen in unstructured populations. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Generalized dynamical phase reduction for stochastic oscillators

Authors: Pierre Houzelstein, Peter J. Thomas, Benjamin Lindner, Boris S. Gutkin, Alberto Pérez-Cervera

Abstract: Phase reduction is an important tool for studying coupled and driven oscillators. The question of how to generalize phase reduction to stochastic oscillators remains actively debated. In this work, we propose a method to derive a self-contained stochastic phase equation of the form $d\vartheta = a_\vartheta(\vartheta)dt + \sqrt{2D_\vartheta(\vartheta)}\,dW_\vartheta(t)$ that is valid not only for… ▽ More Phase reduction is an important tool for studying coupled and driven oscillators. The question of how to generalize phase reduction to stochastic oscillators remains actively debated. In this work, we propose a method to derive a self-contained stochastic phase equation of the form $d\vartheta = a_\vartheta(\vartheta)dt + \sqrt{2D_\vartheta(\vartheta)}\,dW_\vartheta(t)$ that is valid not only for noise-perturbed limit cycles, but also for noise-induced oscillations. We show that our reduction captures the asymptotic statistics of qualitatively different stochastic oscillators, and use it to infer their phase-response properties. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Comments: 12 pages, 7 figures

Report on 2023 CyberTraining PI Meeting, 26-27 September 2023

Authors: Geoffrey Fox, Mary P Thomas, Sajal Bhatia, Marisa Brazil, Nicole M Gasparini, Venkatesh Mohan Merwade, Henry J. Neeman, Jeff Carver, Henri Casanova, Vipin Chaudhary, Dirk Colbry, Lonnie Crosby, Prasun Dewan, Jessica Eisma, Nicole M Gasparini, Ahmed Irfan, Kate Kaehey, Qianqian Liu, Zhen Ni, Sushil Prasad, Apan Qasem, Erik Saule, Prabha Sundaravadivel, Karen Tomko

Abstract: This document describes a two-day meeting held for the Principal Investigators (PIs) of NSF CyberTraining grants. The report covers invited talks, panels, and six breakout sessions. The meeting involved over 80 PIs and NSF program managers (PMs). The lessons recorded in detail in the report are a wealth of information that could help current and future PIs, as well as NSF PMs, understand the futur… ▽ More This document describes a two-day meeting held for the Principal Investigators (PIs) of NSF CyberTraining grants. The report covers invited talks, panels, and six breakout sessions. The meeting involved over 80 PIs and NSF program managers (PMs). The lessons recorded in detail in the report are a wealth of information that could help current and future PIs, as well as NSF PMs, understand the future directions suggested by the PI community. The meeting was held simultaneously with that of the PIs of the NSF Cyberinfrastructure for Sustained Scientific Innovation (CSSI) program. This co-location led to two joint sessions: one with NSF speakers and the other on broader impact. Further, the joint poster and refreshment sessions benefited from the interactions between CSSI and CyberTraining PIs. △ Less

Submitted 28 December, 2023; v1 submitted 20 December, 2023; originally announced December 2023.

Comments: 38 pages, 3 main sections and 2 Appendix sections, 2 figures, 19 tables; updated version: author corrections

From Past to Future: Rethinking Eligibility Traces

Authors: Dhawal Gupta, Scott M. Jordan, Shreyas Chaudhari, Bo Liu, Philip S. Thomas, Bruno Castro da Silva

Abstract: In this paper, we introduce a fresh perspective on the challenges of credit assignment and policy evaluation. First, we delve into the nuances of eligibility traces and explore instances where their updates may result in unexpected credit assignment to preceding states. From this investigation emerges the concept of a novel value function, which we refer to as the \emph{bidirectional value functio… ▽ More In this paper, we introduce a fresh perspective on the challenges of credit assignment and policy evaluation. First, we delve into the nuances of eligibility traces and explore instances where their updates may result in unexpected credit assignment to preceding states. From this investigation emerges the concept of a novel value function, which we refer to as the \emph{bidirectional value function}. Unlike traditional state value functions, bidirectional value functions account for both future expected returns (rewards anticipated from the current state onward) and past expected returns (cumulative rewards from the episode's start to the present). We derive principled update equations to learn this value function and, through experimentation, demonstrate its efficacy in enhancing the process of policy evaluation. In particular, our results indicate that the proposed learning approach can, in certain challenging contexts, perform policy evaluation more rapidly than TD($λ$) -- a method that learns forward value functions, $v^π$, \emph{directly}. Overall, our findings present a new perspective on eligibility traces and potential advantages associated with the novel value function it inspires, especially for policy evaluation. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: Accepted in The 38th Annual AAAI Conference on Artificial Intelligence

Behavior Alignment via Reward Function Optimization

Authors: Dhawal Gupta, Yash Chandak, Scott M. Jordan, Philip S. Thomas, Bruno Castro da Silva

Abstract: Designing reward functions for efficiently guiding reinforcement learning (RL) agents toward specific behaviors is a complex task. This is challenging since it requires the identification of reward structures that are not sparse and that avoid inadvertently inducing undesirable behaviors. Naively modifying the reward structure to offer denser and more frequent feedback can lead to unintended outco… ▽ More Designing reward functions for efficiently guiding reinforcement learning (RL) agents toward specific behaviors is a complex task. This is challenging since it requires the identification of reward structures that are not sparse and that avoid inadvertently inducing undesirable behaviors. Naively modifying the reward structure to offer denser and more frequent feedback can lead to unintended outcomes and promote behaviors that are not aligned with the designer's intended goal. Although potential-based reward sha** is often suggested as a remedy, we systematically investigate settings where deploying it often significantly impairs performance. To address these issues, we introduce a new framework that uses a bi-level objective to learn \emph{behavior alignment reward functions}. These functions integrate auxiliary rewards reflecting a designer's heuristics and domain knowledge with the environment's primary rewards. Our approach automatically determines the most effective way to blend these types of feedback, thereby enhancing robustness against heuristic reward misspecification. Remarkably, it can also adapt an agent's policy optimization process to mitigate suboptimalities resulting from limitations and biases inherent in the underlying RL algorithms. We evaluate our method's efficacy on a diverse set of tasks, from small-scale experiments to high-dimensional control challenges. We investigate heuristic auxiliary rewards of varying quality -- some of which are beneficial and others detrimental to the learning process. Our results show that our framework offers a robust and principled way to integrate designer-specified heuristics. It not only addresses key shortcomings of existing approaches but also consistently leads to high-performing solutions, even when given misaligned or poorly-specified auxiliary reward functions. △ Less

Submitted 31 October, 2023; v1 submitted 29 October, 2023; originally announced October 2023.

Comments: (Spotlight) Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023)

Improved Panning on Non-Equidistant Loudspeakers with Direct Sound Level Compensation

Authors: Jan-Hendrik Hanschke, Daniel Arteaga, Giulio Cengarle, Joshua Lando, Mark R. P. Thomas, Alan Seefeldt

Abstract: Loudspeaker rendering techniques that create phantom sound sources often assume an equidistant loudspeaker layout. Typical home setups might not fulfill this condition as loudspeakers deviate from canonical positions, thus requiring a corresponding calibration. The standard approach is to compensate for delays and to match the loudness of each loudspeaker at the listener's location. It was found t… ▽ More Loudspeaker rendering techniques that create phantom sound sources often assume an equidistant loudspeaker layout. Typical home setups might not fulfill this condition as loudspeakers deviate from canonical positions, thus requiring a corresponding calibration. The standard approach is to compensate for delays and to match the loudness of each loudspeaker at the listener's location. It was found that a shift of the phantom image occurs when this calibration procedure is applied and one of a pair of loudspeakers is significantly closer to the listener than the other. In this paper, a novel approach to panning on non-equidistant loudspeaker layouts is presented whereby the panning position is governed by the direct sound and the perceived loudness is governed by the full impulse response. Subjective listening tests are presented that validate the approach and quantify the perceived effect of the compensation. In a setup where the standard calibration leads to an average error of 10 degrees, the proposed direct sound compensation largely returns the phantom source to its intended position. △ Less

Submitted 27 October, 2023; v1 submitted 25 October, 2023; originally announced October 2023.

Comments: 10 pages. Accepted for presentation in AES Convention 155 (2023)

Journal ref: Proceedings of the Audio Engineering Society Convention 155, New York, paper 10669 (October 2023). https://www.aes.org/e-lib/inst/browse.cfm?elib=22250

Learning Fair Representations with High-Confidence Guarantees

Authors: Yuhong Luo, Austin Hoag, Philip S. Thomas

Abstract: Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus important because it can prevent unfairness towards disadvantaged groups for all downstream prediction tasks. To prevent unfairness towards disadvantaged groups in all… ▽ More Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus important because it can prevent unfairness towards disadvantaged groups for all downstream prediction tasks. To prevent unfairness towards disadvantaged groups in all downstream tasks, it is crucial to provide representation learning algorithms that provide fairness guarantees. In this paper, we formally define the problem of learning representations that are fair with high confidence. We then introduce the Fair Representation learning with high-confidence Guarantees (FRG) framework, which provides high-confidence guarantees for limiting unfairness across all downstream models and tasks, with user-defined upper bounds. After proving that FRG ensures fairness for all downstream models and tasks with high probability, we present empirical evaluations that demonstrate FRG's effectiveness at upper bounding unfairness for multiple downstream models and tasks. △ Less

Submitted 23 October, 2023; originally announced October 2023.

The impact of binary stars on the dust and metal evolution of galaxies

Authors: Robert M. Yates, David Hendriks, Aswin P. Vijayan, Robert G. Izzard, Peter A. Thomas, Payel Das

Abstract: We present detailed implementations of (a) binary stellar evolution (using binary_c) and (b) dust production and destruction into the cosmological semi-analytic galaxy evolution simulation, L-Galaxies. This new version of L-Galaxies is compared to a version assuming only single stars and to global and spatially-resolved observational data across a range of redshifts ($z$). We find that binaries ha… ▽ More We present detailed implementations of (a) binary stellar evolution (using binary_c) and (b) dust production and destruction into the cosmological semi-analytic galaxy evolution simulation, L-Galaxies. This new version of L-Galaxies is compared to a version assuming only single stars and to global and spatially-resolved observational data across a range of redshifts ($z$). We find that binaries have a negligible impact on the stellar masses, gas masses, and star formation rates of galaxies only if the total mass ejected by massive stars is unchanged. This is because massive stars determine the strength of supernova (SN) feedback, which in turn regulates galaxy growth. Binary effects, such as common envelope ejection and novae, affect carbon and nitrogen enrichment in galaxies, however heavier alpha elements are more affected by the choice of SN and wind yields. Unlike many other simulations, the new L-Galaxies reproduces observed dust-to-metal (DTM) and dust-to-gas (DTG) ratios at $z\sim{}0-4$. This is mainly due to shorter dust accretion timescales in dust-rich environments. However, dust masses are under-predicted at $z>4$, highlighting the need for enhanced dust production at early times in simulations, possibly accompanied by increased star formation. On sub-galactic scales, there is very good agreement between L-Galaxies and observed dust and metal radial profiles at $z=0$. A drop in DTM ratio is also found in diffuse, low-metallicity regions, contradicting the assumption of a universal value. We hope that this work serves as a useful template for binary stellar evolution implementations in other cosmological simulations in future. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Comments: 19 pages, 10 figures. Submitted to MNRAS. Comments welcome!

Variational Quantum Harmonizer: Generating Chord Progressions and Other Sonification Methods with the VQE Algorithm

Authors: Paulo Vitor Itaboraí, Tim Schwägerl, María Aguado Yáñez, Arianna Crippa, Karl Jansen, Eduardo Reck Miranda, Peter Thomas

Abstract: This work investigates a case study of using physical-based sonification of Quadratic Unconstrained Binary Optimization (QUBO) problems, optimized by the Variational Quantum Eigensolver (VQE) algorithm. The VQE approximates the solution of the problem by using an iterative loop between the quantum computer and a classical optimization routine. This work explores the intermediary statevectors found… ▽ More This work investigates a case study of using physical-based sonification of Quadratic Unconstrained Binary Optimization (QUBO) problems, optimized by the Variational Quantum Eigensolver (VQE) algorithm. The VQE approximates the solution of the problem by using an iterative loop between the quantum computer and a classical optimization routine. This work explores the intermediary statevectors found in each VQE iteration as the means of sonifying the optimization process itself. The implementation was realised in the form of a musical interface prototype named Variational Quantum Harmonizer (VQH), providing potential design strategies for musical applications, focusing on chords, chord progressions, and arpeggios. The VQH can be used both to enhance data visualization or to create artistic pieces. The methodology is also relevant in terms of how an artist would gain intuition towards achieving a desired musical sound by carefully designing QUBO cost functions. Flexible map** strategies could supply a broad portfolio of sounds for QUBO and quantum-inspired musical compositions, as demonstrated in a case study composition, "Dependent Origination" by Peter Thomas and Paulo Itaborai. △ Less

Submitted 21 September, 2023; originally announced September 2023.

Comments: Manuscript Accepted to the 2nd International Symposium on Quantum Computing and Musical Creativity (ISQCMC Berlin). Link: https://indico.desy.de/event/38609/page/4475-information

Large language models can accurately predict searcher preferences

Authors: Paul Thomas, Seth Spielman, Nick Craswell, Bhaskar Mitra

Abstract: Relevance labels, which indicate whether a search result is valuable to a searcher, are key to evaluating and optimising search systems. The best way to capture the true preferences of users is to ask them for their careful feedback on which results would be useful, but this approach does not scale to produce a large number of labels. Getting relevance labels at scale is usually done with third-pa… ▽ More Relevance labels, which indicate whether a search result is valuable to a searcher, are key to evaluating and optimising search systems. The best way to capture the true preferences of users is to ask them for their careful feedback on which results would be useful, but this approach does not scale to produce a large number of labels. Getting relevance labels at scale is usually done with third-party labellers, who judge on behalf of the user, but there is a risk of low-quality data if the labeller doesn't understand user needs. To improve quality, one standard approach is to study real users through interviews, user studies and direct feedback, find areas where labels are systematically disagreeing with users, then educate labellers about user needs through judging guidelines, training and monitoring. This paper introduces an alternate approach for improving label quality. It takes careful feedback from real users, which by definition is the highest-quality first-party gold data that can be derived, and develops an large language model prompt that agrees with that data. We present ideas and observations from deploying language models for large-scale relevance labelling at Bing, and illustrate with data from TREC. We have found large language models can be effective, with accuracy as good as human labellers and similar capability to pick the hardest queries, best runs, and best groups. Systematic changes to the prompts make a difference in accuracy, but so too do simple paraphrases. To measure agreement with real searchers needs high-quality "gold" labels, but with these we find that models produce better labels than third-party workers, for a fraction of the cost, and these labels let us train notably better rankers. △ Less

Submitted 16 May, 2024; v1 submitted 19 September, 2023; originally announced September 2023.

A Joint Fermi-GBM and Swift-BAT Analysis of Gravitational-Wave Candidates from the Third Gravitational-wave Observing Run

Authors: C. Fletcher, J. Wood, R. Hamburg, P. Veres, C. M. Hui, E. Bissaldi, M. S. Briggs, E. Burns, W. H. Cleveland, M. M. Giles, A. Goldstein, B. A. Hristov, D. Kocevski, S. Lesage, B. Mailyan, C. Malacaria, S. Poolakkil, A. von Kienlin, C. A. Wilson-Hodge, The Fermi Gamma-ray Burst Monitor Team, M. Crnogorčević, J. DeLaunay, A. Tohuvavohu, R. Caputo, S. B. Cenko , et al. (1674 additional authors not shown)

Abstract: We present Fermi Gamma-ray Burst Monitor (Fermi-GBM) and Swift Burst Alert Telescope (Swift-BAT) searches for gamma-ray/X-ray counterparts to gravitational wave (GW) candidate events identified during the third observing run of the Advanced LIGO and Advanced Virgo detectors. Using Fermi-GBM on-board triggers and sub-threshold gamma-ray burst (GRB) candidates found in the Fermi-GBM ground analyses,… ▽ More We present Fermi Gamma-ray Burst Monitor (Fermi-GBM) and Swift Burst Alert Telescope (Swift-BAT) searches for gamma-ray/X-ray counterparts to gravitational wave (GW) candidate events identified during the third observing run of the Advanced LIGO and Advanced Virgo detectors. Using Fermi-GBM on-board triggers and sub-threshold gamma-ray burst (GRB) candidates found in the Fermi-GBM ground analyses, the Targeted Search and the Untargeted Search, we investigate whether there are any coincident GRBs associated with the GWs. We also search the Swift-BAT rate data around the GW times to determine whether a GRB counterpart is present. No counterparts are found. Using both the Fermi-GBM Targeted Search and the Swift-BAT search, we calculate flux upper limits and present joint upper limits on the gamma-ray luminosity of each GW. Given these limits, we constrain theoretical models for the emission of gamma-rays from binary black hole mergers. △ Less

Submitted 25 August, 2023; originally announced August 2023.

Search for Eccentric Black Hole Coalescences during the Third Observing Run of LIGO and Virgo

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, H. Abe, F. Acernese, K. Ackley, C. Adamcewicz, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi , et al. (1750 additional authors not shown)

Abstract: Despite the growing number of confident binary black hole coalescences observed through gravitational waves so far, the astrophysical origin of these binaries remains uncertain. Orbital eccentricity is one of the clearest tracers of binary formation channels. Identifying binary eccentricity, however, remains challenging due to the limited availability of gravitational waveforms that include effect… ▽ More Despite the growing number of confident binary black hole coalescences observed through gravitational waves so far, the astrophysical origin of these binaries remains uncertain. Orbital eccentricity is one of the clearest tracers of binary formation channels. Identifying binary eccentricity, however, remains challenging due to the limited availability of gravitational waveforms that include effects of eccentricity. Here, we present observational results for a waveform-independent search sensitive to eccentric black hole coalescences, covering the third observing run (O3) of the LIGO and Virgo detectors. We identified no new high-significance candidates beyond those that were already identified with searches focusing on quasi-circular binaries. We determine the sensitivity of our search to high-mass (total mass $M>70$ $M_\odot$) binaries covering eccentricities up to 0.3 at 15 Hz orbital frequency, and use this to compare model predictions to search results. Assuming all detections are indeed quasi-circular, for our fiducial population model, we place an upper limit for the merger rate density of high-mass binaries with eccentricities $0 < e \leq 0.3$ at $0.33$ Gpc$^{-3}$ yr$^{-1}$ at 90\% confidence level. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 24 pages, 5 figures

Report number: LIGO-P2300080

The LIGO HET Response (LIGHETR) Project to Discover and Spectroscopically Follow Optical Transients Associated with Neutron Star Mergers

Authors: M. J. Bustamante-Rosell, Greg Zeimann, J. Craig Wheeler, Karl Gebhardt, Aaron Zimmerman, Chris Fryer, Oleg Korobkin, Richard Matzner, V. Ashley Villar, S. Karthik Yadavalli, Kaylee M. de Soto, Matthew Shetrone, Steven Janowiecki, Pawan Kumar, David Pooley, Benjamin P. Thomas, Hsin-Yu Chen, Lifan Wang, Jozsef Vinko, David J. Sand, Ryan Wollaeger, Frederic V. Hessman, Kristen B. McQuinn

Abstract: The LIGO HET Response (LIGHETR) project is an enterprise to follow up optical transients (OT) discovered as gravitational wave merger sources by the LIGO/Virgo collaboration (LVC). Early spectroscopy has the potential to constrain crucial parameters such as the aspect angle. The LIGHETR collaboration also includes the capacity to model the spectroscopic evolution of mergers to facilitate a real-ti… ▽ More The LIGO HET Response (LIGHETR) project is an enterprise to follow up optical transients (OT) discovered as gravitational wave merger sources by the LIGO/Virgo collaboration (LVC). Early spectroscopy has the potential to constrain crucial parameters such as the aspect angle. The LIGHETR collaboration also includes the capacity to model the spectroscopic evolution of mergers to facilitate a real-time direct comparison of models with our data. The principal facility is the Hobby-Eberly Telescope. LIGHETR uses the massively-replicated VIRUS array of spectrographs to search for associated OTs and obtain early blue spectra and in a complementary role, the low-resolution LRS-2 spectrograph is used to obtain spectra of viable candidates as well as a densely-sampled series of spectra of true counterparts. Once an OT is identified, the anticipated cadence of spectra would match or considerably exceed anything achieved for GW170817 = AT2017gfo for which there were no spectra in the first 12 hours and thereafter only roughly once daily. We describe special HET-specific software written to facilitate the program and attempts to determine the flux limits to undetected sources. We also describe our campaign to follow up OT candidates during the third observational campaign of the LIGO and Virgo Scientific Collaborations. We obtained VIRUS spectroscopy of candidate galaxy hosts for 5 LVC gravitational wave events and LRS-2 spectra of one candidate for the OT associated with S190901ap. We identified that candidate, ZTF19abvionh = AT2019pip, as a possible Wolf-Rayet star in an otherwise unrecognized nearby dwarf galaxy. △ Less

Submitted 27 June, 2023; originally announced June 2023.

Comments: 26 pages, 15 figures

Non-polaritonic effects in cavity-modified photochemistry

Authors: Philip A. Thomas, Wai Jue Tan, Vasyl G. Kravets, Alexander N. Grigorenko, William L. Barnes

Abstract: Strong coupling of molecules to vacuum fields has been widely reported to lead to modified chemical properties such as reaction rates. However, some recent attempts to reproduce infrared strong coupling results have not been successful, suggesting that factors other than strong coupling may sometimes be involved. Here we re-examine the first of these vacuum-modified chemistry experiments in which… ▽ More Strong coupling of molecules to vacuum fields has been widely reported to lead to modified chemical properties such as reaction rates. However, some recent attempts to reproduce infrared strong coupling results have not been successful, suggesting that factors other than strong coupling may sometimes be involved. Here we re-examine the first of these vacuum-modified chemistry experiments in which changes to a molecular photoisomerisation process in the UV-vis spectral range were attributed to strong coupling of the molecules to visible light. We observed significant variations in photoisomerisation rates consistent with the original work; however, we found no evidence that these changes need to be attributed to strong coupling. Instead, we suggest that the photoisomerisation rates involved are most strongly influenced by the absorption of ultraviolet radiation in the cavity. Our results indicate that care must be taken to rule out non-polaritonic effects before invoking strong coupling to explain any changes of chemical properties arising in cavity-based experiments. △ Less

Submitted 14 July, 2023; v1 submitted 8 June, 2023; originally announced June 2023.

Comments: 33 pages, 17 figures

Journal ref: Adv. Mater. 2023, 2309393

Examination of Supernets to Facilitate International Trade for Indian Exports to Brazil

Authors: Evan Winter, Anupam Shah, Ujjwal Gupta, Anshul Kumar, Deepayan Mohanty, Juan Carlos Uribe, Aishwary Gupta, Mini P. Thomas

Abstract: The objective of this paper is to investigate a more efficient cross-border payment and document handling process for the export of Indian goods to Brazil. The paper is structured into two sections: first, to explain the problems unique to the India-Brazil international trade corridor by highlighting the obstacles of compliance, speed, and payments; and second, to propose a digital solution for In… ▽ More The objective of this paper is to investigate a more efficient cross-border payment and document handling process for the export of Indian goods to Brazil. The paper is structured into two sections: first, to explain the problems unique to the India-Brazil international trade corridor by highlighting the obstacles of compliance, speed, and payments; and second, to propose a digital solution for India-brazil trade utilizing Supernets, focusing on the use case of Indian exports. The solution assumes that stakeholders will be onboarded as permissioned actors (i.e. nodes) on a Polygon Supernet. By engaging trade and banking stakeholders, we ensure that the digital solution results in export benefits for Indian exporters, and a lawful channel to receive hard currency payments. The involvement of Brazilian and Indian banks ensures that Letter of Credit (LC) processing time and document handling occur at the speed of blockchain technology. The ultimate goal is to achieve faster settlement and negotiation period while maintaining a regulatory-compliant outcome, so that the end result is faster and easier, yet otherwise identical to the real-world process in terms of export benefits and compliance. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Comments: 22 pages

First Light And Reionisation Epoch Simulations (FLARES) XIII: The Lyman-continuum emission of high-redshift galaxies

Authors: Louise T. C. Seeyave, Stephen M. Wilkins, Jussi K. Kuusisto, Christopher C. Lovell, Dimitrios Irodotou, Charlotte Simmonds, Aswin P. Vijayan, Peter A. Thomas, William J. Roper, Conor M. Byrne, Gareth T. Jones, Jack C. Turner, Christopher J. Conselice

Abstract: The history of reionisation is highly dependent on the ionising properties of high-redshift galaxies. It is therefore important to have a solid understanding of how the ionising properties of galaxies are linked to physical and observable quantities. In this paper, we use the First Light and Reionisation Epoch Simulations (FLARES) to study the Lyman-continuum (LyC, i.e. hydrogen-ionising) emission… ▽ More The history of reionisation is highly dependent on the ionising properties of high-redshift galaxies. It is therefore important to have a solid understanding of how the ionising properties of galaxies are linked to physical and observable quantities. In this paper, we use the First Light and Reionisation Epoch Simulations (FLARES) to study the Lyman-continuum (LyC, i.e. hydrogen-ionising) emission of massive ($M_*>10^8\,\mathrm{M_\odot}$) galaxies at redshifts $z=5-10$. We find that the specific ionising emissivity (i.e. intrinsic ionising emissivity per unit stellar mass) decreases as stellar mass increases, due to the combined effects of increasing age and metallicity. FLARES predicts a median ionising photon production efficiency (i.e. intrinsic ionising emissivity per unit intrinsic far-UV luminosity) of $\log_{10}(ξ_{\rm ion}\rm{/erg^{-1}Hz})=25.40^{+0.16}_{-0.17}$, with values spanning the range $\log_{10}(ξ_{\rm ion}\rm{/erg^{-1}Hz})=25-25.75$. This is within the range of many observational estimates, but below some of the extremes observed. We compare the production efficiency with observable properties, and find a weak negative correlation with the UV-continuum slope, and a positive correlation with the OIII equivalent width. We also consider the dust-attenuated production efficiency (i.e. intrinsic ionising emissivity per unit dust-attenuated far-UV luminosity), and find a median of $\log_{10}(ξ_{\rm ion}\rm{/erg^{-1}Hz})\sim25.5$. Within our sample of $M_*>10^8\,\mathrm{M_\odot}$ galaxies, it is the stellar populations in low mass galaxies that contribute the most to the total ionising emissivity. Active galactic nuclei (AGN) emission accounts for $10-20$ % of the total emissivity at a given redshift, and extends the LyC luminosity function by $\sim0.5$ dex. △ Less

Submitted 21 August, 2023; v1 submitted 29 May, 2023; originally announced May 2023.

Comments: 19 pages, 17 figures, accepted for publication in MNRAS

Complex Kuranishi structures and counting sheaves on Calabi-Yau 4-folds, II

Authors: Jeongseok Oh, Richard P. Thomas

Abstract: We develop a theory of complex Kuranishi structures on projective schemes. These are sufficiently rigid to be equivalent to weak perfect obstruction theories, but sufficiently flexible to admit global complex Kuranishi charts. We apply the theory to projective moduli spaces M of stable sheaves on Calabi-Yau 4-folds. Using real derived differential geometry, Borisov-Joyce produced a virtual homol… ▽ More We develop a theory of complex Kuranishi structures on projective schemes. These are sufficiently rigid to be equivalent to weak perfect obstruction theories, but sufficiently flexible to admit global complex Kuranishi charts. We apply the theory to projective moduli spaces M of stable sheaves on Calabi-Yau 4-folds. Using real derived differential geometry, Borisov-Joyce produced a virtual homology cycle on M. In the prequel to this paper we constructed an algebraic virtual cycle on M. We prove the cycles coincide in homology after inverting 2 in the coefficients. And when Borisov-Joyce's real virtual dimension is odd, their virtual cycle is 2-torsion. △ Less

Submitted 1 March, 2024; v1 submitted 25 May, 2023; originally announced May 2023.

Comments: Incorrect proof (that Borisov-Joyce class is 2-torsion when virtual dimension is odd) replaced by a correct one. 63 pages

MSC Class: 14N35

Unsupervised Spiking Neural Network Model of Prefrontal Cortex to study Task Switching with Synaptic deficiency

Authors: Ashwin Viswanathan Kannan, Goutam Mylavarapu, Johnson P Thomas

Abstract: In this study, we build a computational model of Prefrontal Cortex (PFC) using Spiking Neural Networks (SNN) to understand how neurons adapt and respond to tasks switched under short and longer duration of stimulus changes. We also explore behavioral deficits arising out of the PFC lesions by simulating lesioned states in our Spiking architecture model. Although there are some computational models… ▽ More In this study, we build a computational model of Prefrontal Cortex (PFC) using Spiking Neural Networks (SNN) to understand how neurons adapt and respond to tasks switched under short and longer duration of stimulus changes. We also explore behavioral deficits arising out of the PFC lesions by simulating lesioned states in our Spiking architecture model. Although there are some computational models of the PFC, SNN's have not been used to model them. In this study, we use SNN's having parameters close to biologically plausible values and train the model using unsupervised Spike Timing Dependent Plasticity (STDP) learning rule. Our model is based on connectionist architectures and exhibits neural phenomena like sustained activity which helps in generating short-term or working memory. We use these features to simulate lesions by deactivating synaptic pathways and record the weight adjustments of learned patterns and capture the accuracy of learning tasks in such conditions. All our experiments are trained and recorded using a real-world Fashion MNIST (FMNIST) dataset and through this work, we bridge the gap between bio-realistic models and those that perform well in pattern recognition tasks △ Less

Submitted 23 May, 2023; originally announced May 2023.

Coagent Networks: Generalized and Scaled

Authors: James E. Kostas, Scott M. Jordan, Yash Chandak, Georgios Theocharous, Dhawal Gupta, Martha White, Bruno Castro da Silva, Philip S. Thomas

Abstract: Coagent networks for reinforcement learning (RL) [Thomas and Barto, 2011] provide a powerful and flexible framework for deriving principled learning rules for arbitrary stochastic neural networks. The coagent framework offers an alternative to backpropagation-based deep learning (BDL) that overcomes some of backpropagation's main limitations. For example, coagent networks can compute different par… ▽ More Coagent networks for reinforcement learning (RL) [Thomas and Barto, 2011] provide a powerful and flexible framework for deriving principled learning rules for arbitrary stochastic neural networks. The coagent framework offers an alternative to backpropagation-based deep learning (BDL) that overcomes some of backpropagation's main limitations. For example, coagent networks can compute different parts of the network \emph{asynchronously} (at different rates or at different times), can incorporate non-differentiable components that cannot be used with backpropagation, and can explore at levels higher than their action spaces (that is, they can be designed as hierarchical networks for exploration and/or temporal abstraction). However, the coagent framework is not just an alternative to BDL; the two approaches can be blended: BDL can be combined with coagent learning rules to create architectures with the advantages of both approaches. This work generalizes the coagent theory and learning rules provided by previous works; this generalization provides more flexibility for network architecture design within the coagent framework. This work also studies one of the chief disadvantages of coagent networks: high variance updates for networks that have many coagents and do not use backpropagation. We show that a coagent algorithm with a policy network that does not use backpropagation can scale to a challenging RL domain with a high-dimensional state and action space (the MuJoCo Ant environment), learning reasonable (although not state-of-the-art) policies. These contributions motivate and provide a more general theoretical foundation for future work that studies coagent networks. △ Less

Submitted 16 May, 2023; originally announced May 2023.

MultiTACRED: A Multilingual Version of the TAC Relation Extraction Dataset

Authors: Leonhard Hennig, Philippe Thomas, Sebastian Möller

Abstract: Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et al., 2017). To address this gap, we introduce the MultiTACRED dataset, covering 12 typologically diverse languages from 9 language families, which is created by… ▽ More Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et al., 2017). To address this gap, we introduce the MultiTACRED dataset, covering 12 typologically diverse languages from 9 language families, which is created by machine-translating TACRED instances and automatically projecting their entity annotations. We analyze translation and annotation projection quality, identify error categories, and experimentally evaluate fine-tuned pretrained mono- and multilingual language models in common transfer learning scenarios. Our analyses show that machine translation is a viable strategy to transfer RE instances, with native speakers judging more than 83% of the translated instances to be linguistically and semantically acceptable. We find monolingual RE model performance to be comparable to the English original for many of the target languages, and that multilingual models trained on a combination of English and target language data can outperform their monolingual counterparts. However, we also observe a variety of translation and annotation projection errors, both due to the MT systems and linguistic features of the target languages, such as pronoun-drop**, compounding and inflection, that degrade dataset quality and RE model performance. △ Less

Submitted 15 May, 2023; v1 submitted 8 May, 2023; originally announced May 2023.

Comments: Accepted at ACL 2023

Search for gravitational-lensing signatures in the full third observing run of the LIGO-Virgo network

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1670 additional authors not shown)

Abstract: Gravitational lensing by massive objects along the line of sight to the source causes distortions of gravitational wave-signals; such distortions may reveal information about fundamental physics, cosmology and astrophysics. In this work, we have extended the search for lensing signatures to all binary black hole events from the third observing run of the LIGO--Virgo network. We search for repeated… ▽ More Gravitational lensing by massive objects along the line of sight to the source causes distortions of gravitational wave-signals; such distortions may reveal information about fundamental physics, cosmology and astrophysics. In this work, we have extended the search for lensing signatures to all binary black hole events from the third observing run of the LIGO--Virgo network. We search for repeated signals from strong lensing by 1) performing targeted searches for subthreshold signals, 2) calculating the degree of overlap amongst the intrinsic parameters and sky location of pairs of signals, 3) comparing the similarities of the spectrograms amongst pairs of signals, and 4) performing dual-signal Bayesian analysis that takes into account selection effects and astrophysical knowledge. We also search for distortions to the gravitational waveform caused by 1) frequency-independent phase shifts in strongly lensed images, and 2) frequency-dependent modulation of the amplitude and phase due to point masses. None of these searches yields significant evidence for lensing. Finally, we use the non-detection of gravitational-wave lensing to constrain the lensing rate based on the latest merger-rate estimates and the fraction of dark matter composed of compact objects. △ Less

Submitted 17 April, 2023; originally announced April 2023.

Comments: 28 pages, 11 figures

Report number: LIGO-P2200031

Pattern Forming Mechanisms of Color Vision

Authors: Zily Burstein, David D. Reid, Peter J. Thomas, Jack D. Cowan

Abstract: While our understanding of the way single neurons process chromatic stimuli in the early visual pathway has advanced significantly in recent years, we do not yet know how these cells interact to form stable representations of hue. Drawing on physiological studies, we offer a dynamical model of how the primary visual cortex tunes for color, hinged on intracortical interactions and emergent network… ▽ More While our understanding of the way single neurons process chromatic stimuli in the early visual pathway has advanced significantly in recent years, we do not yet know how these cells interact to form stable representations of hue. Drawing on physiological studies, we offer a dynamical model of how the primary visual cortex tunes for color, hinged on intracortical interactions and emergent network effects. After detailing the evolution of network activity through analytical and numerical approaches, we discuss the effects of the model's cortical parameters on the selectivity of the tuning curves. In particular, we explore the role of the model's thresholding nonlinearity in enhancing hue selectivity by expanding the region of stability, allowing for the precise encoding of chromatic stimuli in early vision. Finally, in the absence of a stimulus, the model is capable of explaining hallucinatory color perception via a Turing-like mechanism of biological pattern formation. △ Less

Submitted 15 April, 2023; originally announced April 2023.

Comments: 21 pages, 15 figures

Using Dark Energy Explorers and Machine Learning to Enhance the Hobby-Eberly Telescope Dark Energy Experiment

Authors: Lindsay R. House, Karl Gebhardt, Keely Finkelstein, Erin Mentuch Cooper, Dustin Davis, Robin Ciardullo, Daniel J Farrow, Steven L. Finkelstein, Caryl Gronwall, Donghui Jeong, L. Clifton Johnson, Chenxu Liu, Benjamin P. Thomas, Gregory Zeimann

Abstract: We present analysis using a citizen science campaign to improve the cosmological measures from the Hobby-Eberly Telescope Dark Energy Experiment (HETDEX). The goal of HETDEX is to measure the Hubble expansion rate, $H(z)$, and angular diameter distance, $D_A(z)$, at $z =$ 2.4, each to percent-level accuracy. This accuracy is determined primarily from the total number of detected Lyman-$α$ emitters… ▽ More We present analysis using a citizen science campaign to improve the cosmological measures from the Hobby-Eberly Telescope Dark Energy Experiment (HETDEX). The goal of HETDEX is to measure the Hubble expansion rate, $H(z)$, and angular diameter distance, $D_A(z)$, at $z =$ 2.4, each to percent-level accuracy. This accuracy is determined primarily from the total number of detected Lyman-$α$ emitters (LAEs), the false positive rate due to noise, and the contamination due to [O II] emitting galaxies. This paper presents the citizen science project, Dark Energy Explorers, with the goal of increasing the number of LAEs, decreasing the number of false positives due to noise and the [O II] galaxies. Initial analysis shows that citizen science is an efficient and effective tool for classification most accurately done by the human eye, especially in combination with unsupervised machine learning. Three aspects from the citizen science campaign that have the most impact are 1) identifying individual problems with detections, 2) providing a clean sample with 100% visual identification above a signal-to-noise cut, and 3) providing labels for machine learning efforts. Since the end of 2022, Dark Energy Explorers has collected over three and a half million classifications by 11,000 volunteers in over 85 different countries around the world. By incorporating the results of the Dark Energy Explorers we expect to improve the accuracy on the $D_A(z)$ and $H(z)$ parameters at $z =$ 2.4 by 10 - 30%. While the primary goal is to improve on HETDEX, Dark Energy Explorers has already proven to be a uniquely powerful tool for science advancement and increasing accessibility to science worldwide. △ Less

Submitted 14 April, 2023; originally announced April 2023.

Comments: 14 pages, 6 figures, accepted for publication in The Astrophysical Journal

Driver Profiling and Bayesian Workload Estimation Using Naturalistic Peripheral Detection Study Data

Authors: Nermin Caber, Bashar I. Ahmad, Jiaming Liang, Simon Godsill, Alexandra Bremers, Philip Thomas, David Oxtoby, Lee Skrypchuk

Abstract: Monitoring drivers' mental workload facilitates initiating and maintaining safe interactions with in-vehicle information systems, and thus delivers adaptive human machine interaction with reduced impact on the primary task of driving. In this paper, we tackle the problem of workload estimation from driving performance data. First, we present a novel on-road study for collecting subjective workload… ▽ More Monitoring drivers' mental workload facilitates initiating and maintaining safe interactions with in-vehicle information systems, and thus delivers adaptive human machine interaction with reduced impact on the primary task of driving. In this paper, we tackle the problem of workload estimation from driving performance data. First, we present a novel on-road study for collecting subjective workload data via a modified peripheral detection task in naturalistic settings. Key environmental factors that induce a high mental workload are identified via video analysis, e.g. junctions and behaviour of vehicle in front. Second, a supervised learning framework using state-of-the-art time series classifiers (e.g. convolutional neural network and transform techniques) is introduced to profile drivers based on the average workload they experience during a journey. A Bayesian filtering approach is then proposed for sequentially estimating, in (near) real-time, the driver's instantaneous workload. This computationally efficient and flexible method can be easily personalised to a driver (e.g. incorporate their inferred average workload profile), adapted to driving/environmental contexts (e.g. road type) and extended with data streams from new sources. The efficacy of the presented profiling and instantaneous workload estimation approaches are demonstrated using the on-road study data, showing $F_{1}$ scores of up to 92% and 81%, respectively. △ Less

Submitted 8 September, 2023; v1 submitted 26 March, 2023; originally announced March 2023.

Comments: Accepted for IEEE Transactions on Intelligent Vehicles

The Early Light Curve of a Type Ia Supernova 2021hpr in NGC 3147: Progenitor Constraints with the Companion Interaction Model

Authors: Gu Lim, Myungshin Im, Gregory S. H. Paek, Sung-Chul Yoon, Changsu Choi, Sophia Kim, J. Craig Wheeler, Benjamin P. Thomas, Jozsef Vinkó, Dohyeong Kim, **guk Seo, Wonseok Kang, Taewoo Kim, Hyun-Il Sung, Yonggi Kim, Joh-Na Yoon, Haeun Kim, Jeongmook Kim, Hana Bae, Shuhrat Ehgamberdiev, Otabek Burhonov, Davron Mirzaqulov

Abstract: The progenitor system of Type Ia supernovae (SNe Ia) is expected to be a close binary system of a carbon/oxygen white dwarf (WD) and a non-degenerate star or another WD. Here, we present results from a high-cadence monitoring observation of SN 2021hpr in a spiral galaxy, NGC 3147, and constraints on the progenitor system based on its early multi-color light curve data. First, we classify SN 2021hp… ▽ More The progenitor system of Type Ia supernovae (SNe Ia) is expected to be a close binary system of a carbon/oxygen white dwarf (WD) and a non-degenerate star or another WD. Here, we present results from a high-cadence monitoring observation of SN 2021hpr in a spiral galaxy, NGC 3147, and constraints on the progenitor system based on its early multi-color light curve data. First, we classify SN 2021hpr as a normal SN Ia from its long-term photometric and spectroscopic data. More interestingly, we found a significant "early excess" in the light curve over a simple power-law $\sim t^{2}$ evolution. The early light curve evolves from blue to red and blue during the first week. To explain this, we fitted the early part of $BVRI$-band light curves with a two-component model of the ejecta-companion interaction and a simple power-law model. The early excess and its color can be explained by shock cooling emission due to a companion star having a radius of $8.84\pm0.58$$R_{\odot}$. We also examined HST pre-explosion images with no detection of a progenitor candidate, consistent with the above result. However, we could not detect signs of a significant amount of the stripped mass from a non-degenerate companion star ($\lesssim0.003\,M_{\odot}$ for H$α$ emission). The early excess light in the multi-band light curve supports a non-degenerate companion in the progenitor system of SN 2021hpr. At the same time, the non-detection of emission lines opens a door for other methods to explain this event. △ Less

Submitted 9 March, 2023; originally announced March 2023.

Comments: 26 pages, 13 figures + appendix, Accepted for publication in ApJ

First Light And Reionisation Epoch Simulations (FLARES) XII: The consequences of star-dust geometry on galaxies in the EoR

Authors: Aswin P. Vijayan, Peter A. Thomas, Christopher C. Lovell, Stephen M. Wilkins, Thomas R. Greve, Dimitrios Irodotou, William J. Roper, Louise T. C. Seeyave

Abstract: Using the First Light And Reionisation Epoch Simulations (${\rm F{\small LARES}}$), a suite of hydrodynamical simulations we explore the consequences of a realistic model for star--dust geometry on the observed properties of galaxies. We find that the UV attenuation declines rapidly from the central regions of galaxies, and bright galaxies have spatially extended star formation that suffers less o… ▽ More Using the First Light And Reionisation Epoch Simulations (${\rm F{\small LARES}}$), a suite of hydrodynamical simulations we explore the consequences of a realistic model for star--dust geometry on the observed properties of galaxies. We find that the UV attenuation declines rapidly from the central regions of galaxies, and bright galaxies have spatially extended star formation that suffers less obscuration than their fainter counterparts, demonstrating a non-linear relationship between the UV luminosity and the UV attenuation, giving a double power-law shape to the UVLF. Spatially distinct stellar populations within galaxies experience a wide range of dust attenuation due to variations in the dust optical depth along their line-of-sight; which can range from completely dust obscured to being fully unobscured. The overall attenuation curve of a galaxy is then a complex combination of various lines-of-sight within the galaxy. We explore the manifestation of this effect to study the reliability of line ratios to infer galaxy properties, in particular the Balmer decrement and the BPT diagram. We find the Balmer decrement predicted Balmer line attenuation to be higher (factor of $1$ to $\gtrsim10$) than expected from commonly used attenuation curves. The observed BPT line ratios deviate from their intrinsic values (median difference of 0.08 (0.02) and standard deviation of 0.2 (0.05) for log$_{10}$([N${\rm {\small II}}$]$λ6585/$H$_α$) (log$_{10}$([O${\rm {\small III}}$]$λ5008/$H$_β$)). Finally, we explore the variation in observed properties (UV attenuation, UV slope and Balmer decrement) with viewing angle, finding average differences of $\sim0.3$ magnitudes in the UV attenuation. △ Less

Submitted 11 December, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

Comments: 17 pages, 13 figures. Published MNRAS. Data available at https://flaresimulations.github.io

A Gehring-Hayman inequality for strongly pseudoconvex domains

Authors: Łukasz Kosiński, Nikolai Nikolov, Pascal J. Thomas

Abstract: We prove that in a strongly pseudoconvex domain with smooth boundary, then the length of a geodesic for the Kobayashi-Royden infinitesimal metric between two points is bounded by a constant multiple of the Euclidean distance between the points. We prove that in a strongly pseudoconvex domain with smooth boundary, then the length of a geodesic for the Kobayashi-Royden infinitesimal metric between two points is bounded by a constant multiple of the Euclidean distance between the points. △ Less

Submitted 5 October, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

A Universal Description of Stochastic Oscillators

Authors: Alberto Pérez-Cervera, Boris Gutkin, Peter J. Thomas, Benjamin Lindner

Abstract: Many systems in physics, chemistry and biology exhibit oscillations with a pronounced random component. Such stochastic oscillations can emerge via different mechanisms, for example linear dynamics of a stable focus with fluctuations, limit-cycle systems perturbed by noise, or excitable systems in which random inputs lead to a train of pulses. Despite their diverse origins, the phenomenology of ra… ▽ More Many systems in physics, chemistry and biology exhibit oscillations with a pronounced random component. Such stochastic oscillations can emerge via different mechanisms, for example linear dynamics of a stable focus with fluctuations, limit-cycle systems perturbed by noise, or excitable systems in which random inputs lead to a train of pulses. Despite their diverse origins, the phenomenology of random oscillations can be strikingly similar. Here we introduce a nonlinear transformation of stochastic oscillators to a new complex-valued function $Q^*_1(\textbf{x})$ that greatly simplifies and unifies the mathematical description of the oscillator's spontaneous activity, its response to an external time-dependent perturbation, and the correlation statistics of different oscillators that are weakly coupled. The function $Q^*_1(\textbf{x})$ is the eigenfunction of the Kolmogorov backward operator with the least negative (but non-vanishing) eigenvalue $λ_1=μ_1+iω_1$. The resulting power spectrum of the complex-valued function is exactly given by a Lorentz spectrum with peak frequency $ω_1$ and half-width $μ_1$; its susceptibility with respect to a weak external forcing is given by a simple one-pole filter, centered around $ω_1$; and the cross-spectrum between two coupled oscillators can be easily expressed by a combination of the spontaneous power spectra of the uncoupled systems and their susceptibilities. Our approach makes qualitatively different stochastic oscillators comparable, provides simple characteristics for the coherence of the random oscillation, and gives a framework for the description of weakly coupled oscillators. △ Less

Submitted 27 February, 2023; originally announced March 2023.

Journal ref: PNAS 120(29): e2303222120 (2023)

Asymptotically Unbiased Off-Policy Policy Evaluation when Reusing Old Data in Nonstationary Environments

Authors: Vincent Liu, Yash Chandak, Philip Thomas, Martha White

Abstract: In this work, we consider the off-policy policy evaluation problem for contextual bandits and finite horizon reinforcement learning in the nonstationary setting. Reusing old data is critical for policy evaluation, but existing estimators that reuse old data introduce large bias such that we can not obtain a valid confidence interval. Inspired from a related field called survey sampling, we introdu… ▽ More In this work, we consider the off-policy policy evaluation problem for contextual bandits and finite horizon reinforcement learning in the nonstationary setting. Reusing old data is critical for policy evaluation, but existing estimators that reuse old data introduce large bias such that we can not obtain a valid confidence interval. Inspired from a related field called survey sampling, we introduce a variant of the doubly robust (DR) estimator, called the regression-assisted DR estimator, that can incorporate the past data without introducing a large bias. The estimator unifies several existing off-policy policy evaluation methods and improves on them with the use of auxiliary information and a regression approach. We prove that the new estimator is asymptotically unbiased, and provide a consistent variance estimator to a construct a large sample confidence interval. Finally, we empirically show that the new estimator improves estimation for the current and future policy values, and provides a tight and valid interval estimation in several nonstationary recommendation environments. △ Less

Submitted 22 February, 2023; originally announced February 2023.

Comments: AISTATS 2023

Open data from the third observing run of LIGO, Virgo, KAGRA and GEO

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Al-Jodah, C. Alléné, A. Allocca , et al. (1719 additional authors not shown)

Abstract: The global network of gravitational-wave observatories now includes five detectors, namely LIGO Hanford, LIGO Livingston, Virgo, KAGRA, and GEO 600. These detectors collected data during their third observing run, O3, composed of three phases: O3a starting in April of 2019 and lasting six months, O3b starting in November of 2019 and lasting five months, and O3GK starting in April of 2020 and lasti… ▽ More The global network of gravitational-wave observatories now includes five detectors, namely LIGO Hanford, LIGO Livingston, Virgo, KAGRA, and GEO 600. These detectors collected data during their third observing run, O3, composed of three phases: O3a starting in April of 2019 and lasting six months, O3b starting in November of 2019 and lasting five months, and O3GK starting in April of 2020 and lasting 2 weeks. In this paper we describe these data and various other science products that can be freely accessed through the Gravitational Wave Open Science Center at https://gwosc.org. The main dataset, consisting of the gravitational-wave strain time series that contains the astrophysical signals, is released together with supporting data useful for their analysis and documentation, tutorials, as well as analysis software packages. △ Less

Submitted 7 February, 2023; originally announced February 2023.

Comments: 27 pages, 3 figures

Report number: LIGO-P2200316

Optimization using Parallel Gradient Evaluations on Multiple Parameters

Authors: Yash Chandak, Shiv Shankar, Venkata Gandikota, Philip S. Thomas, Arya Mazumdar

Abstract: We propose a first-order method for convex optimization, where instead of being restricted to the gradient from a single parameter, gradients from multiple parameters can be used during each step of gradient descent. This setup is particularly useful when a few processors are available that can be used in parallel for optimization. Our method uses gradients from multiple parameters in synergy to u… ▽ More We propose a first-order method for convex optimization, where instead of being restricted to the gradient from a single parameter, gradients from multiple parameters can be used during each step of gradient descent. This setup is particularly useful when a few processors are available that can be used in parallel for optimization. Our method uses gradients from multiple parameters in synergy to update these parameters together towards the optima. While doing so, it is ensured that the computational and memory complexity is of the same order as that of gradient descent. Empirical results demonstrate that even using gradients from as low as \textit{two} parameters, our method can often obtain significant acceleration and provide robustness to hyper-parameter settings. We remark that the primary goal of this work is less theoretical, and is instead aimed at exploring the understudied case of using multiple gradients during each step of optimization. △ Less

Submitted 6 February, 2023; originally announced February 2023.

Comments: Accepted at OPT workshop @ Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022)

Off-Policy Evaluation for Action-Dependent Non-Stationary Environments

Authors: Yash Chandak, Shiv Shankar, Nathaniel D. Bastian, Bruno Castro da Silva, Emma Brunskil, Philip S. Thomas

Abstract: Methods for sequential decision-making are often built upon a foundational assumption that the underlying decision process is stationary. This limits the application of such methods because real-world problems are often subject to changes due to external factors (passive non-stationarity), changes induced by interactions with the system itself (active non-stationarity), or both (hybrid non-station… ▽ More Methods for sequential decision-making are often built upon a foundational assumption that the underlying decision process is stationary. This limits the application of such methods because real-world problems are often subject to changes due to external factors (passive non-stationarity), changes induced by interactions with the system itself (active non-stationarity), or both (hybrid non-stationarity). In this work, we take the first steps towards the fundamental challenge of on-policy and off-policy evaluation amidst structured changes due to active, passive, or hybrid non-stationarity. Towards this goal, we make a higher-order stationarity assumption such that non-stationarity results in changes over time, but the way changes happen is fixed. We propose, OPEN, an algorithm that uses a double application of counterfactual reasoning and a novel importance-weighted instrument-variable regression to obtain both a lower bias and a lower variance estimate of the structure in the changes of a policy's past performances. Finally, we show promising results on how OPEN can be used to predict future performances for several domains inspired by real-world applications that exhibit non-stationarity. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Comments: Accepted at Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022)

First Light and Reionisation Epoch Simulations (FLARES) X: Environmental Galaxy Bias and Survey Variance at High Redshift

Authors: Peter A. Thomas, Christopher C. Lovell, Maxwell G. A. Maltz, Aswin P. Vijayan, Stephen M. Wilkins, Dimitrios Irodotou, William J. Roper, Louise Seeyave

Abstract: Upcoming deep galaxy surveys with JWST will probe galaxy evolution during the epoch of reionisation (EoR, $5\leq z\leq10$) over relatively compact areas (e.g. $\sim$ 300\,arcmin$^2$ for the JADES GTO survey). It is therefore imperative that we understand the degree of survey variance, to evaluate how representative the galaxy populations in these studies will be. We use the First Light And Reionis… ▽ More Upcoming deep galaxy surveys with JWST will probe galaxy evolution during the epoch of reionisation (EoR, $5\leq z\leq10$) over relatively compact areas (e.g. $\sim$ 300\,arcmin$^2$ for the JADES GTO survey). It is therefore imperative that we understand the degree of survey variance, to evaluate how representative the galaxy populations in these studies will be. We use the First Light And Reionisation Epoch Simulations (FLARES) to measure the galaxy bias of various tracers over an unprecedentedly large range in overdensity for a hydrodynamic simulation, and use these relations to assess the impact of bias and clustering on survey variance in the EoR. Star formation is highly biased relative to the underlying dark matter distribution, with the mean ratio of the stellar to dark matter density varying by a factor of 100 between regions of low and high matter overdensity (smoothed on a scale of 14$\,h^{-1}$cMpc). This is reflected in the galaxy distribution --the most massive galaxies are found solely in regions of high overdensity. As a consequence of the above, galaxies in the EoR are highly clustered, which can lead to large variance in survey number counts. For mean number counts $N\lesssim 100$ (1000), in a unit redshift slice of angular area 300\,arcmin$^2$ (1.4\,deg$^2$), the 2-sigma range in $N$ is roughly a factor of four (two). We present relations between the expected variance and survey area for different survey geometries; these relations will be of use to observers wishing to understand the impact of survey variance on their results. △ Less

Submitted 14 June, 2023; v1 submitted 23 January, 2023; originally announced January 2023.

Comments: Accepted version. Thanks to the referee contains more extensive description of testing, comparison to online Cosmic Variance Calculator, and greater range of survey areas than the original submission

FLARES IX: The Physical Mechanisms Driving Compact Galaxy Formation and Evolution

Authors: William J. Roper, Christopher C. Lovell, Aswin P. Vijayan, Dimitrios Irodotou, Jussi K. Kuusisto, Jasleen Matharu, Louise T. C. Seeyave, Peter A. Thomas, Stephen M. Wilkins

Abstract: In the FLARES (First Light And Reionisation Epoch Simulations) suite of hydrodynamical simulations, we find the high redshift ($z>5$) intrinsic size-luminosity relation is, surprisingly, negatively sloped. However, after including the effects of dust attenuation we find a positively sloped UV observed size-luminosity relation in good agreement with other simulated and observational studies. In thi… ▽ More In the FLARES (First Light And Reionisation Epoch Simulations) suite of hydrodynamical simulations, we find the high redshift ($z>5$) intrinsic size-luminosity relation is, surprisingly, negatively sloped. However, after including the effects of dust attenuation we find a positively sloped UV observed size-luminosity relation in good agreement with other simulated and observational studies. In this work, we extend this analysis to probe the underlying physical mechanisms driving the formation and evolution of the compact galaxies driving the negative size-mass/size-luminosity relation. We find the majority of compact galaxies ($R_{1/2, \star}< 1 \mathrm{pkpc}$), which drive the negative slope of the size-mass relation, have transitioned from extended to compact sizes via efficient centralised cooling, resulting in high specific star formation rates in their cores. These compact stellar systems are enshrouded by non-star forming gas distributions as much as $100\times$ larger than their stellar counterparts. By comparing with galaxies from the EAGLE simulation suite, we find that these extended gas distributions `turn on' and begin to form stars between $z=5$ and $z=0$ leading to increasing sizes, and thus the evolution of the size-mass relation from a negative to a positive slope. This explicitly demonstrates the process of inside-out galaxy formation in which compact bulges form earlier than the surrounding discs. △ Less

Submitted 6 February, 2023; v1 submitted 12 January, 2023; originally announced January 2023.