Showing 1–50 of 420 results for author: Perez, E

Studying single-electron traps in newly fabricated Skipper-CCDs for the Oscura experiment using the pocket-pum** technique

Authors: S. E. Perez, B. A. Cervantes-Vergara, J. Estrada, S. Holland, D. Rodrigues, J. Tiffenberg

Abstract: Understanding and characterizing very low-energy ($\sim$eV) background sources is a must in rare-event searches. Oscura, an experiment aiming to probe electron recoils from sub-GeV dark matter using a 10-kg skipper-CCD detector, has recently fabricated its first two batches of sensors. In this work, we present the characterization of defects/contaminants identified in the buried-channel region of… ▽ More Understanding and characterizing very low-energy ($\sim$eV) background sources is a must in rare-event searches. Oscura, an experiment aiming to probe electron recoils from sub-GeV dark matter using a 10-kg skipper-CCD detector, has recently fabricated its first two batches of sensors. In this work, we present the characterization of defects/contaminants identified in the buried-channel region of these newly fabricated skipper-CCDs. These defects/contaminants produce deferred charge from trap emission in the images next to particle tracks, which can be spatially resolved due to the sub-electron resolution achieved with these sensors. Using the trap-pum** technique, we measured the energy and cross section associated to these traps in three Oscura prototype sensors from different fabrication batches which underwent different gettering methods during fabrication. Results suggest that the type of defects/contaminants is more closely linked to the fabrication batch rather than to the gettering method used. The exposure-dependent single-electron rate (SER) of one of these sensors was measured $\sim$100~m underground, yielding $(1.8\pm 0.3)\times10^{-3}~e^-$/pix/day at 131K. The impact of the identified traps on the measured exposure-dependent SER is evaluated via a Monte Carlo simulation. Results suggest that the exposure-dependent SER of Oscura prototype sensors would be lower in lower background environments as expected. △ Less

Submitted 26 June, 2024; originally announced June 2024.

Single-photon gig in Betelgeuse's occultation

Authors: F. Prada, R. Gomez-Merchan, E. Pérez, J. E. Betancort-Rijo, J. A. Leñero-Bardallo, Á. Rodríguez-Vázquez, G. Glez-de-Rivera, S. Díaz-López, J. de Elias Cantalapiedra

Abstract: We present results from the occultation of Betelgeuse by asteroid (319) Leona on December 12, 2023, observed using a 64x64 pixel Single-Photon Avalanche Diode (SPAD) array mounted on a 10-inch telescope at the AstroCamp Observatory in Nerpio, Southeast of Spain, just a few kilometers from the center of the occultation shadow path. This study highlights remarkable advancements in applying SPAD tech… ▽ More We present results from the occultation of Betelgeuse by asteroid (319) Leona on December 12, 2023, observed using a 64x64 pixel Single-Photon Avalanche Diode (SPAD) array mounted on a 10-inch telescope at the AstroCamp Observatory in Nerpio, Southeast of Spain, just a few kilometers from the center of the occultation shadow path. This study highlights remarkable advancements in applying SPAD technology in astronomy. The SPAD array's asynchronous readout capacity and photon-counting timestamp mode enabled a temporal resolution of 1 microsecond in our light curve observations of Betelgeuse. Our data analysis addressed challenges inherent to SPAD arrays, such as optical cross-talk and afterpulses, which typically cause the photon statistics to deviate from a Poisson distribution. By adopting a generalized negative binomial distribution for photon statistics, we accurately describe the observational data. This method yielded an optical cross-talk estimation of 1.07% in our SPAD array and confirmed a negligible impact of spurious detected events due to afterpulses. The meticulous statistical examination of photon data underscores our SPAD-array's exceptional performance in conducting precise astronomical observations. The observations revealed a major decrease in Betelgeuse's intensity by 77.78% at the occultation's peak, allowing us to measure Betelgeuse's angular diameter at 57.26 mas in the SDSS g-band. This measurement, employing a simplified occultation model and considering the known properties of Leona, demonstrates the potential of SPAD technology for astronomy and sets a new standard for observing ultra-rapid transient celestial events, providing a valuable public dataset for the astronomical community. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Comments: 7 pages, 4 figures

Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

Authors: Carson Denison, Monte MacDiarmid, Fazl Barez, David Duvenaud, Shauna Kravec, Samuel Marks, Nicholas Schiefer, Ryan Soklaski, Alex Tamkin, Jared Kaplan, Buck Shlegeris, Samuel R. Bowman, Ethan Perez, Evan Hubinger

Abstract: In reinforcement learning, specification gaming occurs when AI systems learn undesired behaviors that are highly rewarded due to misspecified training goals. Specification gaming can range from simple behaviors like sycophancy to sophisticated and pernicious behaviors like reward-tampering, where a model directly modifies its own reward mechanism. However, these more pernicious behaviors may be to… ▽ More In reinforcement learning, specification gaming occurs when AI systems learn undesired behaviors that are highly rewarded due to misspecified training goals. Specification gaming can range from simple behaviors like sycophancy to sophisticated and pernicious behaviors like reward-tampering, where a model directly modifies its own reward mechanism. However, these more pernicious behaviors may be too complex to be discovered via exploration. In this paper, we study whether Large Language Model (LLM) assistants which find easily discovered forms of specification gaming will generalize to perform rarer and more blatant forms, up to and including reward-tampering. We construct a curriculum of increasingly sophisticated gameable environments and find that training on early-curriculum environments leads to more specification gaming on remaining environments. Strikingly, a small but non-negligible proportion of the time, LLM assistants trained on the full curriculum generalize zero-shot to directly rewriting their own reward function. Retraining an LLM not to game early-curriculum environments mitigates, but does not eliminate, reward-tampering in later environments. Moreover, adding harmlessness training to our gameable environments does not prevent reward-tampering. These results demonstrate that LLMs can generalize from common forms of specification gaming to more pernicious reward tampering and that such behavior may be nontrivial to remove. △ Less

Submitted 28 June, 2024; v1 submitted 14 June, 2024; originally announced June 2024.

Comments: Make it easier to find samples from the model, and highlight that our operational definition of reward tampering has false positives where the model attempts to complete the task honestly but edits the reward. Add paragraph to conclusion to this effect, and add sentence to figure 1 to this effect

Timing-based mass measurement of exotic long-lived particles at the FCC-ee

Authors: Roy Aleksan, Emmanuel Perez, Giacomo Polesello, Nicolò Valle

Abstract: The very high luminosity run foreseen at the $Z$-pole for the FCC-ee will allow the detection in $Z$ decays of new particles with very low couplings to the Standard Model. These particles will have measurable flight paths before they decay. If the timing and the position of the decay vertex can be measured with high precision, the mass of such particles can be measured by exploiting the constraine… ▽ More The very high luminosity run foreseen at the $Z$-pole for the FCC-ee will allow the detection in $Z$ decays of new particles with very low couplings to the Standard Model. These particles will have measurable flight paths before they decay. If the timing and the position of the decay vertex can be measured with high precision, the mass of such particles can be measured by exploiting the constrained kinematics of an $e^+e^-$ collider. The mass resolution achievable with this technique is studied through a detailed analysis in the framework of a parametrised simulation of the performance of the IDEA detector. The adopted benchmark model is the production of Heavy Neutral Leptons, which is one of the key channels for new physics discovery at the FCC-ee. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 16 pages, 11 figures, 1 table

Lattice Lipschitz superposition operators on Banach function spaces

Authors: Roger Arnau, Jose M. Calabuig, Ezgi Erdoğan, Enrique A. Sánchez Pérez

Abstract: We analyse and characterise the notion of lattice Lipschitz operator (a class of superposition operators, diagonal Lipschitz maps) when defined between Banach function spaces. After showing some general results, we restrict our attention to the case of those Lipschitz operators which are representable by pointwise composition with a strongly measurable function. Mimicking the classical definition… ▽ More We analyse and characterise the notion of lattice Lipschitz operator (a class of superposition operators, diagonal Lipschitz maps) when defined between Banach function spaces. After showing some general results, we restrict our attention to the case of those Lipschitz operators which are representable by pointwise composition with a strongly measurable function. Mimicking the classical definition and characterizations of (linear) multiplication operators between Banach function spaces, we show that under certain conditions the requirement for a diagonal Lipschitz operator to be well-defined between two such spaces $X(μ)$ and $Y(μ)$ is that it can be represented by a strongly measurable function which belongs to the Bochner space $\mathcal M(X,Y) \big(μ, Lip_0(\mathbb R) \big). $ Here, $\mathcal M(X,Y) $ is the space of multiplication operators between $X(μ)$ and $Y(μ),$ and $Lip_0(\mathbb R)$ is the space of real-valued Lipschitz maps with real variable that are equal to $0$ in $0. $ This opens the door to a better understanding of these maps, as well as finding the relation of these operators to some normed tensor products and other classes of maps. △ Less

Submitted 6 June, 2024; originally announced June 2024.

MSC Class: 47J10; 46E30; 26A16

The Low Dimensional Homology of Projective Linear Group of Rank Two

Authors: Behrooz Mirzaii, Elvis Torres Pérez

Abstract: In this article we study the low dimensional homology of the projective linear group $\textrm{PGL}_2(A)$ over a $\textrm{GE}_2$-ring $A$. In particular, we prove a Bloch-Wigner type exact sequence over local domains. As applications we prove that $H_2(\textrm{PGL}_2(A),\mathbb{Z}\left[\frac{1}{2}\right])\simeq K_2(A)\left[\frac{1}{2}\right]$ and… ▽ More In this article we study the low dimensional homology of the projective linear group $\textrm{PGL}_2(A)$ over a $\textrm{GE}_2$-ring $A$. In particular, we prove a Bloch-Wigner type exact sequence over local domains. As applications we prove that $H_2(\textrm{PGL}_2(A),\mathbb{Z}\left[\frac{1}{2}\right])\simeq K_2(A)\left[\frac{1}{2}\right]$ and $H_3(\textrm{PGL}_2(A),\mathbb{Z}\left[\frac{1}{2}\right])\simeq K_3^{\textrm{ind}}(A)\left[\frac{1}{2}\right]$. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Misspecification of Multiple Scattering in Scalar Wave Fields and its Impact in Ultrasound Tomography

Authors: Eduardo Pérez, Sebastian Semper, Sayako Kodera, Florian Römer, Giovanni Del Galdo

Abstract: In this work, we investigate the localization of targets in the presence of multiple scattering. We focus on the often omitted scenario in which measurement data is affected by multiple scattering, and a simpler model is employed in the estimation. We study the impact of such model mismatch by means of the Misspecified Cramér-Rao Bound (MCRB). In numerical simulations inspired by tomographic inspe… ▽ More In this work, we investigate the localization of targets in the presence of multiple scattering. We focus on the often omitted scenario in which measurement data is affected by multiple scattering, and a simpler model is employed in the estimation. We study the impact of such model mismatch by means of the Misspecified Cramér-Rao Bound (MCRB). In numerical simulations inspired by tomographic inspection in ultrasound nondestructive testing, the MCRB is shown to correctly describe the estimation variance of localization parameters under misspecification of the wave propagation model. We provide extensive discussion on the utility of the MCRB in the practical task of verifying whether a chosen misspecified model is suitable for localization based on the properties of the maximum likelihood estimator and the nuanced distinction between bias and parameter space differences. Finally, we highlight that careful interpretation is needed whenever employing the classical CRB in the presence of mismatch through numerical examples based on the Born approximation and other simplified propagation models stemming from it. △ Less

Submitted 3 May, 2024; v1 submitted 2 May, 2024; originally announced May 2024.

Comments: 17 pages, 7 figures

EVT-enriched Radio Maps for URLLC

Authors: Dian Echevarría Pérez, Onel L. Alcaraz López, Hirley Alves

Abstract: This paper introduces a sophisticated and adaptable framework combining extreme value theory with radio maps to spatially model extreme channel conditions accurately. Utilising existing signal-to-noise ratio (SNR) measurements and leveraging Gaussian processes, our approach predicts the tail of the SNR distribution, which entails estimating the parameters of a generalised Pareto distribution, at u… ▽ More This paper introduces a sophisticated and adaptable framework combining extreme value theory with radio maps to spatially model extreme channel conditions accurately. Utilising existing signal-to-noise ratio (SNR) measurements and leveraging Gaussian processes, our approach predicts the tail of the SNR distribution, which entails estimating the parameters of a generalised Pareto distribution, at unobserved locations. This innovative method offers a versatile solution adaptable to various resource allocation challenges in ultra-reliable low-latency communications. We evaluate the performance of this method in a rate maximisation problem with defined outage constraints and compare it with a benchmark in the literature. Notably, the proposed approach meets the outage demands in a larger percentage of the coverage area and reaches higher transmission rates. △ Less

Submitted 6 April, 2024; originally announced April 2024.

Comments: 8 pages, 11 figures, submitted to IEEE Transactions on Wireless Communications

Integrating AI in NDE: Techniques, Trends, and Further Directions

Authors: Eduardo Pérez, Cemil Emre Ardic, Ozan Çakıroğlu, Kevin Jacob, Sayako Kodera, Luca Pompa, Mohamad Rachid, Han Wang, Yiming Zhou, Cyril Zimmer, Florian Römer, Ahmad Osman

Abstract: The digital transformation is fundamentally changing our industries, affecting planning, execution as well as monitoring of production processes in a wide range of application fields. With product line-ups becoming more and more versatile and diverse, the necessary inspection and monitoring sparks significant novel requirements on the corresponding Nondestructive Evaluation (NDE) systems. The esta… ▽ More The digital transformation is fundamentally changing our industries, affecting planning, execution as well as monitoring of production processes in a wide range of application fields. With product line-ups becoming more and more versatile and diverse, the necessary inspection and monitoring sparks significant novel requirements on the corresponding Nondestructive Evaluation (NDE) systems. The establishment of increasingly powerful approaches to incorporate Artificial Intelligence (AI) may provide just the needed innovation to solve some of these challenges. In this paper we provide a comprehensive survey about the usage of AI methods in NDE in light of the recent innovations towards NDE 4.0. Since we cannot discuss each NDE modality in one paper, we limit our attention to magnetic methods, ultrasound, thermography, as well as optical inspection. In addition to reviewing recent AI developments in each field, we draw common connections by pointing out NDE-related tasks that have a common underlying mathematical problem and categorizing the state of the art according to the corresponding sub-tasks. In so doing, interdisciplinary connections are drawn that provide a more complete overall picture. △ Less

Submitted 4 April, 2024; originally announced April 2024.

A survey for variable stars with small telescopes: IX -- Evolution of Spot Properties on YSOs in IC5070

Authors: Carys Herbert, Dirk Froebrich, Siegfried Vanaverbeke, Aleks Scholz, Jochen Eislöffel, Thomas Urtly, Ivan L. Walton, Klaas Wiersema, Nick J. Quinn, Georg Piehler, Mario Morales Aimar, Rafael Castillo García, Tonny Vanmunster, Francisco C. Soldán Alfaro, Faustino García de la Cuesta, Domenico Licchelli, Alex Escartin Perez, Esteban Fernández Mañanes, Noelia Graciá Ribes, José Luis Salto González, Stephen R. L. Futcher, Tim Nelson, Shawn Dvorak, Dawid Moździerski, Krzysztof Kotysz , et al. (23 additional authors not shown)

Abstract: We present spot properties on 32 periodic young stellar objects in IC 5070. Long term, $\sim$5 yr, light curves in the $V$, $R$, and $I$-bands are obtained through the HOYS (Hunting Outbursting Young Stars) citizen science project. These are dissected into six months long slices, with 3 months oversampling, to measure 234 sets of amplitudes in all filters. We fit 180 of these with reliable spot so… ▽ More We present spot properties on 32 periodic young stellar objects in IC 5070. Long term, $\sim$5 yr, light curves in the $V$, $R$, and $I$-bands are obtained through the HOYS (Hunting Outbursting Young Stars) citizen science project. These are dissected into six months long slices, with 3 months oversampling, to measure 234 sets of amplitudes in all filters. We fit 180 of these with reliable spot solutions. Two thirds of spot solutions are cold spots, the lowest is 2150 K below the stellar temperature. One third are warm spots that are above the stellar temperature by less than $\sim$2000 K. Cold and warm spots have maximum surface coverage values of 40 percent, although only 16 percent of warm spots are above 20 percent surface coverage as opposed to 60 percent of the cold spots. Warm spots are most likely caused by a combination of plages and low density accretion columns, most common on objects without inner disc excess emission in $K-W2$. Five small hot spot solutions have $<3$ percent coverage and are 3000 - 5000 K above the stellar temperature. These are attributed to accretion, and four of them occur on the same object. The majority of our objects are likely to be accreting. However, we observe very few accretion hot spots as either the accretion is not stable on our timescale or the photometry is dominated by other features. We do not identify cyclical spot behaviour on the targets. We additionally identify and discuss a number of objects that have interesting amplitudes, phase changes, or spot properties. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: Accepted for publication by MNRAS. 17 + 7 pages, 7 + 23 figures, 1 table

Measurement of groomed event shape observables in deep-inelastic electron-proton scattering at HERA

Authors: The H1 collaboration, V. Andreev, M. Arratia, A. Baghdasaryan, A. Baty, K. Begzsuren, A. Bolz, V. Boudry, G. Brandt, D. Britzger, A. Buniatyan, L. Bystritskaya, A. J. Campbell, K. B. Cantun Avila, K. Cerny, V. Chekelian, Z. Chen, J. G. Contreras, J. Cvach, J. B. Dainton, K. Daum, A. Deshpande, C. Diaconu, A. Drees, G. Eckerlin , et al. (123 additional authors not shown)

Abstract: The H1 Collaboration at HERA reports the first measurement of groomed event shape observables in deep inelastic electron-proton scattering (DIS) at $\sqrt{s}=319$ GeV, using data recorded between the years 2003 and 2007 with an integrated luminosity of $351$ pb$^{-1}$. Event shapes provide incisive probes of perturbative and non-perturbative QCD. Grooming techniques have been used for jet measurem… ▽ More The H1 Collaboration at HERA reports the first measurement of groomed event shape observables in deep inelastic electron-proton scattering (DIS) at $\sqrt{s}=319$ GeV, using data recorded between the years 2003 and 2007 with an integrated luminosity of $351$ pb$^{-1}$. Event shapes provide incisive probes of perturbative and non-perturbative QCD. Grooming techniques have been used for jet measurements in hadronic collisions; this paper presents the first application of grooming to DIS data. The analysis is carried out in the Breit frame, utilizing the novel Centauro jet clustering algorithm that is designed for DIS event topologies. Events are required to have squared momentum-transfer $Q^2 > 150$ GeV$^2$ and inelasticity $ 0.2 < y < 0.7$. We report measurements of the production cross section of groomed event 1-jettiness and groomed invariant mass for several choices of grooming parameter. Monte Carlo model calculations and analytic calculations based on Soft Collinear Effective Theory are compared to the measurements. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: 32 pages, 17 tables, 7 figures, submitted to EPJ C

Report number: DESY-24-036

Measurement of the 1-jettiness event shape observable in deep-inelastic electron-proton scattering at HERA

Authors: The H1 collaboration, V. Andreev, M. Arratia, A. Baghdasaryan, A. Baty, K. Begzsuren, A. Bolz, V. Boudry, G. Brandt, D. Britzger, A. Buniatyan, L. Bystritskaya, A. J. Campbell, K. B. Cantun Avila, K. Cerny, V. Chekelian, Z. Chen, J. G. Contreras, J. Cvach, J. B. Dainton, K. Daum, A. Deshpande, C. Diaconu, A. Drees, G. Eckerlin , et al. (124 additional authors not shown)

Abstract: The H1 Collaboration reports the first measurement of the 1-jettiness event shape observable $τ_1^b$ in neutral-current deep-inelastic electron-proton scattering (DIS). The observable $τ_1^b$ is equivalent to a thrust observable defined in the Breit frame. The data sample was collected at the HERA $ep$ collider in the years 2003-2007 with center-of-mass energy of $\sqrt{s}=319\,\text{GeV}$, corres… ▽ More The H1 Collaboration reports the first measurement of the 1-jettiness event shape observable $τ_1^b$ in neutral-current deep-inelastic electron-proton scattering (DIS). The observable $τ_1^b$ is equivalent to a thrust observable defined in the Breit frame. The data sample was collected at the HERA $ep$ collider in the years 2003-2007 with center-of-mass energy of $\sqrt{s}=319\,\text{GeV}$, corresponding to an integrated luminosity of $351.1\,\text{pb}^{-1}$. Triple differential cross sections are provided as a function of $τ_1^b$, event virtuality $Q^2$, and inelasticity $y$, in the kinematic region $Q^2>150\,\text{GeV}^{2}$. Single differential cross section are provided as a function of $τ_1^b$ in a limited kinematic range. Double differential cross sections are measured, in contrast, integrated over $τ_1^b$ and represent the inclusive neutral-current DIS cross section measured as a function of $Q^2$ and $y$. The data are compared to a variety of predictions and include classical and modern Monte Carlo event generators, predictions in fixed-order perturbative QCD where calculations up to $\mathcal{O}(α_s^3)$ are available for $τ_1^b$ or inclusive DIS, and resummed predictions at next-to-leading logarithmic accuracy matched to fixed order predictions at $\mathcal{O}(α_s^2)$. These comparisons reveal sensitivity of the 1-jettiness observable to QCD parton shower and resummation effects, as well as the modeling of hadronization and fragmentation. Within their range of validity, the fixed-order predictions provide a good description of the data. Monte Carlo event generators are predictive over the full measured range and hence their underlying models and parameters can be constrained by comparing to the presented data. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: 45 pages, 38 tables, 13 figures

Report number: DESY-24-035

Efficient Convolutional Forward Modeling and Sparse Coding in Multichannel Imaging

Authors: Han Wang, Yhonatan Kvich, Eduardo Pérez, Florian Römer, Yonina C. Eldar

Abstract: This study considers the Block-Toeplitz structural properties inherent in traditional multichannel forward model matrices, using Full Matrix Capture (FMC) in ultrasonic testing as a case study. We propose an analytical convolutional forward model that transforms reflectivity maps into FMC data. Our findings demonstrate that the convolutional model excels over its matrix-based counterpart in terms… ▽ More This study considers the Block-Toeplitz structural properties inherent in traditional multichannel forward model matrices, using Full Matrix Capture (FMC) in ultrasonic testing as a case study. We propose an analytical convolutional forward model that transforms reflectivity maps into FMC data. Our findings demonstrate that the convolutional model excels over its matrix-based counterpart in terms of computational efficiency and storage requirements. This accelerated forward modeling approach holds significant potential for various inverse problems, notably enhancing Sparse Signal Recovery (SSR) within the context LASSO regression, which facilitates efficient Convolutional Sparse Coding (CSC) algorithms. Additionally, we explore the integration of Convolutional Neural Networks (CNNs) for the forward model, employing deep unfolding to implement the Learned Block Convolutional ISTA (BC-LISTA). △ Less

Submitted 14 March, 2024; originally announced March 2024.

Comments: 5 pages, 7 figures

Observation and differential cross section measurement of neutral current DIS events with an empty hemisphere in the Breit frame

Authors: The H1 collaboration, V. Andreev, M. Arratia, A. Baghdasaryan, A. Baty, K. Begzsuren, A. Bolz, V. Boudry, G. Brandt, D. Britzger, A. Buniatyan, L. Bystritskaya, A. J. Campbell, K. B. Cantun Avila, K. Cerny, V. Chekelian, Z. Chen, J. G. Contreras, J. Cvach, J. B. Dainton, K. Daum, A. Deshpande, C. Diaconu, A. Drees, G. Eckerlin , et al. (124 additional authors not shown)

Abstract: The Breit frame provides a natural frame to analyze lepton-proton scattering events. In this reference frame, the parton model hard interactions between a quark and an exchanged boson defines the coordinate system such that the struck quark is back-scattered along the virtual photon momentum direction. In Quantum Chromodynamics (QCD), higher order perturbative or non-perturbative effects can chang… ▽ More The Breit frame provides a natural frame to analyze lepton-proton scattering events. In this reference frame, the parton model hard interactions between a quark and an exchanged boson defines the coordinate system such that the struck quark is back-scattered along the virtual photon momentum direction. In Quantum Chromodynamics (QCD), higher order perturbative or non-perturbative effects can change this picture drastically. As Bjorken-$x$ decreases below one half, a rather peculiar event signature is predicted with increasing probability, where no radiation is present in one of the two Breit-frame hemispheres and all emissions are to be found in the other hemisphere. At higher orders in $α_s$ or in the presence of soft QCD effects, predictions of the rate of these events are far from trivial, and that motivates measurements with real data. We report on the first observation of the empty current hemisphere events in electron-proton collisions at the HERA collider using data recorded with the H1 detector at a center-of-mass energy of 319 GeV. The fraction of inclusive neutral-current DIS events with an empty hemisphere is found to be $0.0112 \pm 3.9\,\%_\text{stat} \pm 4.5\,\%_\text{syst} \pm 1.6\,\%_\text{mod}$ in the selected kinematic region of $150< Q^2<1500$ GeV$^2$ and inelasticity $0.14< y<0.7$. The data sample corresponds to an integrated luminosity of 351.1 pb$^{-1}$, sufficient to enable differential cross section measurements of these events. The results show an enhanced discriminating power at lower Bjorken-$x$ among different Monte Carlo event generator predictions. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: 13 pages, 5 figures, 2 Tables

Report number: DESY-24-034

Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-Thought

Authors: James Chua, Edward Rees, Hunar Batra, Samuel R. Bowman, Julian Michael, Ethan Perez, Miles Turpin

Abstract: While chain-of-thought prompting (CoT) has the potential to improve the explainability of language model reasoning, it can systematically misrepresent the factors influencing models' behavior--for example, rationalizing answers in line with a user's opinion without mentioning this bias. To mitigate this biased reasoning problem, we introduce bias-augmented consistency training (BCT), an unsupervis… ▽ More While chain-of-thought prompting (CoT) has the potential to improve the explainability of language model reasoning, it can systematically misrepresent the factors influencing models' behavior--for example, rationalizing answers in line with a user's opinion without mentioning this bias. To mitigate this biased reasoning problem, we introduce bias-augmented consistency training (BCT), an unsupervised fine-tuning scheme that trains models to give consistent reasoning across prompts with and without biasing features. We construct a suite testing nine forms of biased reasoning on seven question-answering tasks, and find that applying BCT to GPT-3.5-Turbo with one bias reduces the rate of biased reasoning by 86% on held-out tasks. Moreover, this model generalizes to other forms of bias, reducing biased reasoning on held-out biases by an average of 37%. As BCT generalizes to held-out biases and does not require gold labels, this method may hold promise for reducing biased reasoning from as-of-yet unknown biases and on tasks where supervision for ground truth reasoning is unavailable. △ Less

Submitted 8 March, 2024; originally announced March 2024.

Jointly Learning Selection Matrices For Transmitters, Receivers And Fourier Coefficients In Multichannel Imaging

Authors: Han Wang, Yiming Zhou, Eduardo Perez, Florian Roemer

Abstract: Strategic subsampling has become a focal point due to its effectiveness in compressing data, particularly in the Full Matrix Capture (FMC) approach in ultrasonic imaging. This paper introduces the Joint Deep Probabilistic Subsampling (J-DPS) method, which aims to learn optimal selection matrices simultaneously for transmitters, receivers, and Fourier coefficients. This task-based algorithm is real… ▽ More Strategic subsampling has become a focal point due to its effectiveness in compressing data, particularly in the Full Matrix Capture (FMC) approach in ultrasonic imaging. This paper introduces the Joint Deep Probabilistic Subsampling (J-DPS) method, which aims to learn optimal selection matrices simultaneously for transmitters, receivers, and Fourier coefficients. This task-based algorithm is realized by introducing a specialized measurement model and integrating a customized Complex Learned FISTA (CL-FISTA) network. We propose a parallel network architecture, partitioned into three segments corresponding to the three matrices, all working toward a shared optimization objective with adjustable loss allocation. A synthetic dataset is designed to reflect practical scenarios, and we provide quantitative comparisons with a traditional CRB-based algorithm, standard DPS, and J-DPS. △ Less

Submitted 29 February, 2024; originally announced February 2024.

The 10 antipodal pairings of strongly involutive polyhedra

Authors: Javier Bracho, Eric Paulí Pérez, Luis Montejano, Jorge Luis Ramírez-Alfonsín

Abstract: It is known that strongly involutive polyhedra are closely related to self-dual maps where the antipodal function acts as duality isomorphism. Such a family of polyhedra appears in different combinatorial, topological and geometric contexts, and is thus attractive to be studied. In this note, we determine the 10 antipodal pairings among the classification of the 24 self-dual pairings… ▽ More It is known that strongly involutive polyhedra are closely related to self-dual maps where the antipodal function acts as duality isomorphism. Such a family of polyhedra appears in different combinatorial, topological and geometric contexts, and is thus attractive to be studied. In this note, we determine the 10 antipodal pairings among the classification of the 24 self-dual pairings $Dual(G)\rhd Aut(G)$ of self-dual maps G. We also present the orbifold associated to each antipodal pairing and describe explicitly the corresponding fundamental regions. We finally explain how to construct two infinite families of strongly involutive polyhedra (one of them new) by using their doodles and the action of the corresponding orbifolds. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: 16 pages, 21 figures, 1 table

Moduli of Continuity in Metric Models and Extension of Liveability Indices

Authors: R. Arnau, J. M. Calabuig, Álvaro González, Enrique A. Sánchez Pérez

Abstract: Index spaces serve as valuable metric models for studying properties relevant to various applications, such as social science or economics. These properties are represented by real Lipschitz functions that describe the degree of association with each element within the underlying metric space. After determining the index value within a given sample subset, the classic McShane and Whitney formulas… ▽ More Index spaces serve as valuable metric models for studying properties relevant to various applications, such as social science or economics. These properties are represented by real Lipschitz functions that describe the degree of association with each element within the underlying metric space. After determining the index value within a given sample subset, the classic McShane and Whitney formulas allow a Lipschitz regression procedure to be performed to extend the index values over the entire metric space. To improve the adaptability of the metric model to specific scenarios, this paper introduces the concept of a composition metric, which involves composing a metric with an increasing, positive and subadditive function $φ$. The results presented here extend well-established results for Lipschitz indices on metric spaces to composition metrics. In addition, we establish the corresponding approximation properties that facilitate the use of this functional structure. To illustrate the power and simplicity of this mathematical framework, we provide a concrete application involving the modelling of livability indices in North American cities. △ Less

Submitted 19 February, 2024; originally announced February 2024.

Measuring the angle $α_{ds}$ of the flattest Unitary Triangle with $\overline{B}_{d}\to φ\overline{K}^{(*)0},\overline{B}_{s}\to φ{K}^{(*)0}$ decays

Authors: Roy Aleksan, Luis Oliver, Emmanuel Perez

Abstract: We show that the angle $α_{ds}$ of the ``flattest'' unitarity triange can be directly measured using the decays $\overline{B}_{d}\to φ\overline{K}^{(*)0}$ and $\overline{B}_{s}\to φ{K}^{(*)0}$. Using both $\overline{B}_{d}$ and $\overline{B}_{s}$ enables a further consistency test since the expected time-dependent CP violating asymmetries are identical though with opposite signs. Since large stati… ▽ More We show that the angle $α_{ds}$ of the ``flattest'' unitarity triange can be directly measured using the decays $\overline{B}_{d}\to φ\overline{K}^{(*)0}$ and $\overline{B}_{s}\to φ{K}^{(*)0}$. Using both $\overline{B}_{d}$ and $\overline{B}_{s}$ enables a further consistency test since the expected time-dependent CP violating asymmetries are identical though with opposite signs. Since large statistics of $\overline{B}_{d}$ and $\overline{B}_{s}$ are needed for accurate measurements, FCC-ee and its environment at the Z-pole is well suited for such studies. These measurements, the precision of which could reach the sub-degree level, will contribute to probe further the consistency of the CP sector of the Standard Model with unprecedented level of accuracy. The main detector requirements that are set by these measurements are also outlined. △ Less

Submitted 15 February, 2024; originally announced February 2024.

On the connections between the low dimensional homology groups of $\textrm{SL}_2$ and $\textrm{PSL}_2$

Authors: Behrooz Mirzaii, Elvis Torres Pérez

Abstract: In this article we study the low dimensional homology groups of the special linear group $\textrm{SL}_2(A)$ and the projective special linear group $\textrm{PSL}_2(A)$, $A$ a domain, through the natural surjective map $\textrm{SL}_2(A) \to \textrm{PSL}_2(A)$. In particular, we study the connection of the first, the second and the third homology groups of these groups over euclidean domains… ▽ More In this article we study the low dimensional homology groups of the special linear group $\textrm{SL}_2(A)$ and the projective special linear group $\textrm{PSL}_2(A)$, $A$ a domain, through the natural surjective map $\textrm{SL}_2(A) \to \textrm{PSL}_2(A)$. In particular, we study the connection of the first, the second and the third homology groups of these groups over euclidean domains $\mathbb{Z}[\frac{1}{m}]$, $m$ a square free integer, and local domains. △ Less

Submitted 18 June, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Debating with More Persuasive LLMs Leads to More Truthful Answers

Authors: Akbir Khan, John Hughes, Dan Valentine, Laura Ruis, Kshitij Sachan, Ansh Radhakrishnan, Edward Grefenstette, Samuel R. Bowman, Tim Rocktäschel, Ethan Perez

Abstract: Common methods for aligning large language models (LLMs) with desired behaviour heavily rely on human-labelled data. However, as models grow increasingly sophisticated, they will surpass human expertise, and the role of human evaluation will evolve into non-experts overseeing experts. In anticipation of this, we ask: can weaker models assess the correctness of stronger models? We investigate this… ▽ More Common methods for aligning large language models (LLMs) with desired behaviour heavily rely on human-labelled data. However, as models grow increasingly sophisticated, they will surpass human expertise, and the role of human evaluation will evolve into non-experts overseeing experts. In anticipation of this, we ask: can weaker models assess the correctness of stronger models? We investigate this question in an analogous setting, where stronger models (experts) possess the necessary information to answer questions and weaker models (non-experts) lack this information. The method we evaluate is debate, where two LLM experts each argue for a different answer, and a non-expert selects the answer. We find that debate consistently helps both non-expert models and humans answer questions, achieving 76% and 88% accuracy respectively (naive baselines obtain 48% and 60%). Furthermore, optimising expert debaters for persuasiveness in an unsupervised manner improves non-expert ability to identify the truth in debates. Our results provide encouraging empirical evidence for the viability of aligning models with debate in the absence of ground truth. △ Less

Submitted 30 May, 2024; v1 submitted 9 February, 2024; originally announced February 2024.

Comments: For code please check: https://github.com/ucl-dark/llm_debate

A survey for variable young stars with small telescopes: VIII -- Properties of 1687 Gaia selected members in 21 nearby clusters

Authors: Dirk Froebrich, Aleks Scholz, Justyn Campbell-White, Siegfried Vanaverbeke, Carys Herbert, Jochen Eislöffel, Thomas Urtly, Timothy P. Long, Ivan L. Walton, Klaas Wiersema, Nick J. Quinn, Tony Rodda, Juan-Luis González-Carballo, Mario Morales Aimar, Rafael Castillo García, Francisco C. Soldán Alfaro, Faustino García de la Cuesta, Domenico Licchelli, Alex Escartin Perez, José Luis Salto González, Marc Deldem, Stephen R. L. Futcher, Tim Nelson, Shawn Dvorak, Dawid Moździerski , et al. (38 additional authors not shown)

Abstract: The Hunting Outbursting Young Stars (HOYS) project performs long-term, optical, multi-filter, high cadence monitoring of 25 nearby young clusters and star forming regions. Utilising Gaia DR3 data we have identified about 17000 potential young stellar members in 45 coherent astrometric groups in these fields. Twenty one of them are clear young groups or clusters of stars within one kiloparsec and t… ▽ More The Hunting Outbursting Young Stars (HOYS) project performs long-term, optical, multi-filter, high cadence monitoring of 25 nearby young clusters and star forming regions. Utilising Gaia DR3 data we have identified about 17000 potential young stellar members in 45 coherent astrometric groups in these fields. Twenty one of them are clear young groups or clusters of stars within one kiloparsec and they contain 9143 Gaia selected potential members. The cluster distances, proper motions and membership numbers are determined. We analyse long term (about 7yr) V, R, and I-band light curves from HOYS for 1687 of the potential cluster members. One quarter of the stars are variable in all three optical filters, and two thirds of these have light curves that are symmetric around the mean. Light curves affected by obscuration from circumstellar materials are more common than those affected by accretion bursts, by a factor of 2-4. The variability fraction in the clusters ranges from 10 to almost 100 percent, and correlates positively with the fraction of stars with detectable inner disks, indicating that a lot of variability is driven by the disk. About one in six variables shows detectable periodicity, mostly caused by magnetic spots. Two thirds of the periodic variables with disk excess emission are slow rotators, and amongst the stars without disk excess two thirds are fast rotators - in agreement with rotation being slowed down by the presence of a disk. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Comments: accepted for publication in MNRAS, 1 table, 9 figures

Adiabatic Quantum Support Vector Machines

Authors: Prasanna Date, Dong Jun Woun, Kathleen Hamilton, Eduardo A. Coello Perez, Mayanka Chandra Shekhar, Francisco Rios, John Gounley, In-Saeng Suh, Travis Humble, Georgia Tourassi

Abstract: Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical ap… ▽ More Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with increasing number of features and number of data points in the training dataset. Our scalability results show that the quantum approach obtains a 3.5--4.5 times speedup over the classical approach on datasets with many (millions of) features. △ Less

Submitted 22 January, 2024; originally announced January 2024.

The abelianization of the elementary group of rank two

Authors: Behrooz Mirzaii, Elvis Torres Pérez

Abstract: For an arbitrary ring $A$, we study the abelianization of the elementary group $\textrm{E}_2(A)$. In particular, we show that for a commutative ring $A$ there exists an exact sequence \[ K_2(2,A)/C(2,A) \to A/M \to \textrm{E}_2(A)^\textrm{ab} \to 1, \] where $C(2,A)$ is the subgroup of the Steinberg group $\textrm{St}(2,A)$ generated by the Steinberg symbols and $M$ is the additive subgroup of… ▽ More For an arbitrary ring $A$, we study the abelianization of the elementary group $\textrm{E}_2(A)$. In particular, we show that for a commutative ring $A$ there exists an exact sequence \[ K_2(2,A)/C(2,A) \to A/M \to \textrm{E}_2(A)^\textrm{ab} \to 1, \] where $C(2,A)$ is the subgroup of the Steinberg group $\textrm{St}(2,A)$ generated by the Steinberg symbols and $M$ is the additive subgroup of $A$ generated by $x(a^2-1)$ and $3(b+1)(c+1)$, with $x\in A$, $a,b,c \in A^{\times}$. △ Less

Submitted 15 January, 2024; v1 submitted 11 January, 2024; originally announced January 2024.

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Authors: Evan Hubinger, Carson Denison, Jesse Mu, Mike Lambert, Meg Tong, Monte MacDiarmid, Tamera Lanham, Daniel M. Ziegler, Tim Maxwell, Newton Cheng, Adam Jermyn, Amanda Askell, Ansh Radhakrishnan, Cem Anil, David Duvenaud, Deep Ganguli, Fazl Barez, Jack Clark, Kamal Ndousse, Kshitij Sachan, Michael Sellitto, Mrinank Sharma, Nova DasSarma, Roger Grosse, Shauna Kravec , et al. (14 additional authors not shown)

Abstract: Humans are capable of strategically deceptive behavior: behaving helpfully in most situations, but then behaving very differently in order to pursue alternative objectives when given the opportunity. If an AI system learned such a deceptive strategy, could we detect it and remove it using current state-of-the-art safety training techniques? To study this question, we construct proof-of-concept exa… ▽ More Humans are capable of strategically deceptive behavior: behaving helpfully in most situations, but then behaving very differently in order to pursue alternative objectives when given the opportunity. If an AI system learned such a deceptive strategy, could we detect it and remove it using current state-of-the-art safety training techniques? To study this question, we construct proof-of-concept examples of deceptive behavior in large language models (LLMs). For example, we train models that write secure code when the prompt states that the year is 2023, but insert exploitable code when the stated year is 2024. We find that such backdoor behavior can be made persistent, so that it is not removed by standard safety training techniques, including supervised fine-tuning, reinforcement learning, and adversarial training (eliciting unsafe behavior and then training to remove it). The backdoor behavior is most persistent in the largest models and in models trained to produce chain-of-thought reasoning about deceiving the training process, with the persistence remaining even when the chain-of-thought is distilled away. Furthermore, rather than removing backdoors, we find that adversarial training can teach models to better recognize their backdoor triggers, effectively hiding the unsafe behavior. Our results suggest that, once a model exhibits deceptive behavior, standard techniques could fail to remove such deception and create a false impression of safety. △ Less

Submitted 17 January, 2024; v1 submitted 10 January, 2024; originally announced January 2024.

Comments: updated to add missing acknowledgements

The Third Homology of Projective Special Linear Group of Rank Two

Authors: Behrooz Mirzaii, Elvis Torres Pérez

Abstract: In this paper we investigate the third homology of the projective special linear group $\textrm{PSL}_2(A)$. As a result of our investigation we prove a projective refined Bloch-Wigner exact sequence over certain class of rings. The projective Bloch-Wigner exact sequence over algebraically closed fields is a classical result. In this paper we investigate the third homology of the projective special linear group $\textrm{PSL}_2(A)$. As a result of our investigation we prove a projective refined Bloch-Wigner exact sequence over certain class of rings. The projective Bloch-Wigner exact sequence over algebraically closed fields is a classical result. △ Less

Submitted 8 January, 2024; originally announced January 2024.

The Status and Prospects of Phytoremediation of Heavy Metals

Authors: Aniruddha Acharya, Enrique Perez, Miller Maddox-Mandolini, Hania De La Fuente

Abstract: The release of heavy metals into the agricultural soil and waterbodies has been accelerated due to anthropogenic activities. They are not usually required for biological functions thus, their accumulation in biological system poses serious threat to health and environment globally. Phytoremediation offers a safe, inexpensive, and ecologically sustainable technique to clean habitats contaminated wi… ▽ More The release of heavy metals into the agricultural soil and waterbodies has been accelerated due to anthropogenic activities. They are not usually required for biological functions thus, their accumulation in biological system poses serious threat to health and environment globally. Phytoremediation offers a safe, inexpensive, and ecologically sustainable technique to clean habitats contaminated with heavy metals. Though several plants have been identified and used as a potential candidate for such phytoremediation, the technique is still at its formative stage and has been mostly confined to laboratory and greenhouses. However, recently several field studies have shown promising results that can propel large-scale implementation of this technology in industrial sites and urban agriculture. Realistically, the commercialization of this technique is possible if interdisciplinary approach is employed to increase its efficiency. This review presents a comprehensive narration of the status and future of the technique. It illustrates the concept of phytoremediation, the ecological and commercial benefits, and the types of phytoremediation. The candidate plants and factors that influences phytoremediation has been discussed. Finally, the physiological and molecular mechanism along with the future of the technique has been described. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: 34 pages, 3 figures, 2 tables, review paper

SENSEI: First Direct-Detection Results on sub-GeV Dark Matter from SENSEI at SNOLAB

Authors: SENSEI Collaboration, Prakruth Adari, Itay M. Bloch, Ana M. Botti, Mariano Cababie, Gustavo Cancelo, Brenda A. Cervantes-Vergara, Michael Crisler, Miguel Daal, Ansh Desai, Alex Drlica-Wagner, Rouven Essig, Juan Estrada, Erez Etzion, Guillermo Fernandez Moroni, Stephen E. Holland, Yonatan Kehat, Yaron Korn, Ian Lawson, Steffon Luoma, Aviv Orly, Santiago E. Perez, Dario Rodrigues, Nathan A. Saffold, Silvia Scorza , et al. (12 additional authors not shown)

Abstract: We present the first results from a dark matter search using six Skipper-CCDs in the SENSEI detector operating at SNOLAB. With an exposure of 534.9 gram-days from well-performing sensors, we select events containing 2 to 10 electron-hole pairs. After aggressively masking images to remove backgrounds, we observe 55 two-electron events, 4 three-electron events, and no events containing 4 to 10 elect… ▽ More We present the first results from a dark matter search using six Skipper-CCDs in the SENSEI detector operating at SNOLAB. With an exposure of 534.9 gram-days from well-performing sensors, we select events containing 2 to 10 electron-hole pairs. After aggressively masking images to remove backgrounds, we observe 55 two-electron events, 4 three-electron events, and no events containing 4 to 10 electrons. The two-electron events are consistent with pileup from one-electron events. Among the 4 three-electron events, 2 appear in pixels that are likely impacted by detector defects, although not strongly enough to trigger our "hot-pixel" mask. We use these data to set world-leading constraints on sub-GeV dark matter interacting with electrons and nuclei. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 5 pages, 2 figures, + Supplemental Materials (5 pages, 5 figures) + References

Report number: YITP-SB-2023-30, FERMILAB-PUB-23-0824-CSAID-PPD

Towards Evaluating AI Systems for Moral Status Using Self-Reports

Authors: Ethan Perez, Robert Long

Abstract: As AI systems become more advanced and widely deployed, there will likely be increasing debate over whether AI systems could have conscious experiences, desires, or other states of potential moral significance. It is important to inform these discussions with empirical evidence to the extent possible. We argue that under the right circumstances, self-reports, or an AI system's statements about its… ▽ More As AI systems become more advanced and widely deployed, there will likely be increasing debate over whether AI systems could have conscious experiences, desires, or other states of potential moral significance. It is important to inform these discussions with empirical evidence to the extent possible. We argue that under the right circumstances, self-reports, or an AI system's statements about its own internal states, could provide an avenue for investigating whether AI systems have states of moral significance. Self-reports are the main way such states are assessed in humans ("Are you in pain?"), but self-reports from current systems like large language models are spurious for many reasons (e.g. often just reflecting what humans would say). To make self-reports more appropriate for this purpose, we propose to train models to answer many kinds of questions about themselves with known answers, while avoiding or limiting training incentives that bias self-reports. The hope of this approach is that models will develop introspection-like capabilities, and that these capabilities will generalize to questions about states of moral significance. We then propose methods for assessing the extent to which these techniques have succeeded: evaluating self-report consistency across contexts and between similar models, measuring the confidence and resilience of models' self-reports, and using interpretability to corroborate self-reports. We also discuss challenges for our approach, from philosophical difficulties in interpreting self-reports to technical reasons why our proposal might fail. We hope our discussion inspires philosophers and AI researchers to criticize and improve our proposed methodology, as well as to run experiments to test whether self-reports can be made reliable enough to provide information about states of moral significance. △ Less

Submitted 14 November, 2023; originally announced November 2023.

Lax-type pairs in the theory of bivariate orthogonal polynomials

Authors: Amílcar Branquinho, Ana Foulquié-Moreno, Teresa E. Pérez, Miguel A. Piñar

Abstract: Sequences of bivariate orthogonal polynomials written as vector polynomials of increasing size satisfy a couple of three term relations with matrix coefficients. In this work, introducing a time-dependent parameter, we analyse a Lax-type pair system for the coefficients of the three term relations. We also deduce several characterizations relating the Lax-type pair, the shape of the weight, Stielt… ▽ More Sequences of bivariate orthogonal polynomials written as vector polynomials of increasing size satisfy a couple of three term relations with matrix coefficients. In this work, introducing a time-dependent parameter, we analyse a Lax-type pair system for the coefficients of the three term relations. We also deduce several characterizations relating the Lax-type pair, the shape of the weight, Stieltjes function, moments, a differential equation for the weight, and the bidimensional Toda-type systems. △ Less

Submitted 10 November, 2023; originally announced November 2023.

MSC Class: 42C05; 33C50; 35Q53

Specific versus General Principles for Constitutional AI

Authors: Sandipan Kundu, Yuntao Bai, Saurav Kadavath, Amanda Askell, Andrew Callahan, Anna Chen, Anna Goldie, Avital Balwit, Azalia Mirhoseini, Brayden McLean, Catherine Olsson, Cassie Evraets, Eli Tran-Johnson, Esin Durmus, Ethan Perez, Jackson Kernion, Jamie Kerr, Kamal Ndousse, Karina Nguyen, Nelson Elhage, Newton Cheng, Nicholas Schiefer, Nova DasSarma, Oliver Rausch, Robin Larson , et al. (11 additional authors not shown)

Abstract: Human feedback can prevent overtly harmful utterances in conversational models, but may not automatically mitigate subtle problematic behaviors such as a stated desire for self-preservation or power. Constitutional AI offers an alternative, replacing human feedback with feedback from AI models conditioned only on a list of written principles. We find this approach effectively prevents the expressi… ▽ More Human feedback can prevent overtly harmful utterances in conversational models, but may not automatically mitigate subtle problematic behaviors such as a stated desire for self-preservation or power. Constitutional AI offers an alternative, replacing human feedback with feedback from AI models conditioned only on a list of written principles. We find this approach effectively prevents the expression of such behaviors. The success of simple principles motivates us to ask: can models learn general ethical behaviors from only a single written principle? To test this, we run experiments using a principle roughly stated as "do what's best for humanity". We find that the largest dialogue models can generalize from this short constitution, resulting in harmless assistants with no stated interest in specific motivations like power. A general principle may thus partially avoid the need for a long list of constitutions targeting potentially harmful behaviors. However, more detailed constitutions still improve fine-grained control over specific types of harms. This suggests both general and specific principles have value for steering AI safely. △ Less

Submitted 20 October, 2023; originally announced October 2023.

Towards Understanding Sycophancy in Language Models

Authors: Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Newton Cheng, Esin Durmus, Zac Hatfield-Dodds, Scott R. Johnston, Shauna Kravec, Timothy Maxwell, Sam McCandlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, Ethan Perez

Abstract: Human feedback is commonly utilized to finetune AI assistants. But human feedback may also encourage model responses that match user beliefs over truthful ones, a behaviour known as sycophancy. We investigate the prevalence of sycophancy in models whose finetuning procedure made use of human feedback, and the potential role of human preference judgments in such behavior. We first demonstrate that… ▽ More Human feedback is commonly utilized to finetune AI assistants. But human feedback may also encourage model responses that match user beliefs over truthful ones, a behaviour known as sycophancy. We investigate the prevalence of sycophancy in models whose finetuning procedure made use of human feedback, and the potential role of human preference judgments in such behavior. We first demonstrate that five state-of-the-art AI assistants consistently exhibit sycophancy across four varied free-form text-generation tasks. To understand if human preferences drive this broadly observed behavior, we analyze existing human preference data. We find that when a response matches a user's views, it is more likely to be preferred. Moreover, both humans and preference models (PMs) prefer convincingly-written sycophantic responses over correct ones a non-negligible fraction of the time. Optimizing model outputs against PMs also sometimes sacrifices truthfulness in favor of sycophancy. Overall, our results indicate that sycophancy is a general behavior of state-of-the-art AI assistants, likely driven in part by human preference judgments favoring sycophantic responses. △ Less

Submitted 27 October, 2023; v1 submitted 20 October, 2023; originally announced October 2023.

Comments: 32 pages, 20 figures

ACM Class: I.2.6

Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning

Authors: Juan Rocamonde, Victoriano Montesinos, Elvis Nava, Ethan Perez, David Lindner

Abstract: Reinforcement learning (RL) requires either manually specifying a reward function, which is often infeasible, or learning a reward model from a large amount of human feedback, which is often very expensive. We study a more sample-efficient alternative: using pretrained vision-language models (VLMs) as zero-shot reward models (RMs) to specify tasks via natural language. We propose a natural and gen… ▽ More Reinforcement learning (RL) requires either manually specifying a reward function, which is often infeasible, or learning a reward model from a large amount of human feedback, which is often very expensive. We study a more sample-efficient alternative: using pretrained vision-language models (VLMs) as zero-shot reward models (RMs) to specify tasks via natural language. We propose a natural and general approach to using VLMs as reward models, which we call VLM-RMs. We use VLM-RMs based on CLIP to train a MuJoCo humanoid to learn complex tasks without a manually specified reward function, such as kneeling, doing the splits, and sitting in a lotus position. For each of these tasks, we only provide a single sentence text prompt describing the desired task with minimal prompt engineering. We provide videos of the trained agents at: https://sites.google.com/view/vlm-rm. We can improve performance by providing a second "baseline" prompt and projecting out parts of the CLIP embedding space irrelevant to distinguish between goal and baseline. Further, we find a strong scaling effect for VLM-RMs: larger VLMs trained with more compute and data are better reward models. The failure modes of VLM-RMs we encountered are all related to known capability limitations of current VLMs, such as limited spatial reasoning ability or visually unrealistic environments that are far off-distribution for the VLM. We find that VLM-RMs are remarkably robust as long as the VLM is large enough. This suggests that future VLMs will become more and more useful reward models for a wide range of RL applications. △ Less

Submitted 14 March, 2024; v1 submitted 19 October, 2023; originally announced October 2023.

Comments: Presented at International Conference on Learning Representations (ICLR) 2024

Centrosymmetric and reverse matrices in bivariate orthogonal polynomials

Authors: Cleonice F. Bracciali, Glalco S. Costa, Teresa E. Pérez

Abstract: We introduce the concept of reflexive moment functional in two variables and the definition of reflexive orthogonal polynomial system. Also reverse matrices and their interesting algebraic properties are studied. Reverse matrices and reflexive polynomial systems are directly connected in the context of bivariate orthogonal polynomials. Centrosymmetric matrices, reverse matrices and their connectio… ▽ More We introduce the concept of reflexive moment functional in two variables and the definition of reflexive orthogonal polynomial system. Also reverse matrices and their interesting algebraic properties are studied. Reverse matrices and reflexive polynomial systems are directly connected in the context of bivariate orthogonal polynomials. Centrosymmetric matrices, reverse matrices and their connections with reflexive orthogonal polynomial systems are presented. Finally, several particular cases and examples are analysed. △ Less

Submitted 12 October, 2023; originally announced October 2023.

Comments: 24 pages

MSC Class: 42C05; 33C50; 15A09; 15B99

Unleashing quantum algorithms with Qinterpreter: bridging the gap between theory and practice across leading quantum computing platforms

Authors: Wilmer Contreras Sepúlveda, Ángel David Torres-Palencia, José Javier Sánchez Mondragón, Braulio Misael Villegas-Martínez, J. Jesús Escobedo-Alatorre, Sandra Gesing, Néstor Lozano-Crisóstomo, Julio César García-Melgarejo, Juan Carlos Sánchez Pérez, Eddie Nelson Palacios- Pérez, Omar PalilleroSandoval

Abstract: Quantum computing is a rapidly emerging and promising field that has the potential to revolutionize numerous research domains, including drug design, network technologies and sustainable energy. Due to the inherent complexity and divergence from classical computing, several major quantum computing libraries have been developed to implement quantum algorithms, namely IBM Qiskit, Amazon Braket, Cirq… ▽ More Quantum computing is a rapidly emerging and promising field that has the potential to revolutionize numerous research domains, including drug design, network technologies and sustainable energy. Due to the inherent complexity and divergence from classical computing, several major quantum computing libraries have been developed to implement quantum algorithms, namely IBM Qiskit, Amazon Braket, Cirq, PyQuil, and PennyLane. These libraries allow for quantum simulations on classical computers and facilitate program execution on corresponding quantum hardware, e.g., Qiskit programs on IBM quantum computers. While all platforms have some differences, the main concepts are the same. QInterpreter is a tool embedded in the Quantum Science Gateway QubitHub using Jupyter Notebooks that translates seamlessly programs from one library to the other and visualizes the results. It combines the five well-known quantum libraries: into a unified framework. Designed as an educational tool for beginners, Qinterpreter enables the development and execution of quantum circuits across various platforms in a straightforward way. The work highlights the versatility and accessibility of Qinterpreter in quantum programming and underscores our ultimate goal of pervading Quantum Computing through younger, less specialized, and diverse cultural and national communities. △ Less

Submitted 13 October, 2023; v1 submitted 10 October, 2023; originally announced October 2023.

The pluriclosed flow for $T^2$-invariant Vaisman metrics on the Kodaira-Thurston surface

Authors: Anna Fino, Gueo Grantcharov, Eddy Perez

Abstract: In this note we study $T^2$-invariant pluriclosed metrics on the Kodaira-Thurston surface. We obtain a characterization of $T^2$-invariant Vaisman metrics, and notice that the Kodaira-Thurston surface admits Vaisman metrics with non-constant scalar curvature. Then we study the behaviour of the Vaisman condition in relation to the pluriclosed flow. As a consequence, we show that if the initial metr… ▽ More In this note we study $T^2$-invariant pluriclosed metrics on the Kodaira-Thurston surface. We obtain a characterization of $T^2$-invariant Vaisman metrics, and notice that the Kodaira-Thurston surface admits Vaisman metrics with non-constant scalar curvature. Then we study the behaviour of the Vaisman condition in relation to the pluriclosed flow. As a consequence, we show that if the initial metric on the Kodaira-Thurston surface is a $T^2$-invariant Vaisman metric, then the pluriclosed flow preserves the Vaisman condition, extending to the non-constant scalar curvature case the previous results in [6]. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Extreme Value Theory-based Robust Minimum-Power Precoding for URLLC

Authors: Dian Echevarría Pérez, Onel L. Alcaraz López, Hirley Alves

Abstract: Channel state information (CSI) is crucial for achieving ultra-reliable low-latency communication (URLLC) in wireless networks. The main associated problems are the CSI acquisition time, which impacts the delay requirements of time-critical applications, and the estimation accuracy, which degrades the signal-to-interference-plus-noise ratio (SINR), thus, reducing reliability. In this work, we form… ▽ More Channel state information (CSI) is crucial for achieving ultra-reliable low-latency communication (URLLC) in wireless networks. The main associated problems are the CSI acquisition time, which impacts the delay requirements of time-critical applications, and the estimation accuracy, which degrades the signal-to-interference-plus-noise ratio (SINR), thus, reducing reliability. In this work, we formulate and solve a minimum-power precoding design problem simultaneously serving multiple URLLC users in the downlink with imperfect CSI availability. Specifically, we develop an algorithm that exploits state-of-the-art precoding schemes such as the maximal ratio transmission (MRT) and zero-forcing (ZF), and adjust the power of the precoders to compensate for the channel estimation error uncertainty based on the extreme value theory (EVT) framework. Finally, we evaluate the performance of our method and show its superiority concerning worst-case robust precoding, which is used as a benchmark. △ Less

Submitted 9 August, 2023; originally announced August 2023.

Comments: 11 pages, 9 figures, submitted to TWC

Studying Large Language Model Generalization with Influence Functions

Authors: Roger Grosse, Juhan Bae, Cem Anil, Nelson Elhage, Alex Tamkin, Amirhossein Tajdini, Benoit Steiner, Dustin Li, Esin Durmus, Ethan Perez, Evan Hubinger, Kamilė Lukošiūtė, Karina Nguyen, Nicholas Joseph, Sam McCandlish, Jared Kaplan, Samuel R. Bowman

Abstract: When trying to gain better visibility into a machine learning model in order to understand and mitigate the associated risks, a potentially valuable source of evidence is: which training examples most contribute to a given behavior? Influence functions aim to answer a counterfactual: how would the model's parameters (and hence its outputs) change if a given sequence were added to the training set?… ▽ More When trying to gain better visibility into a machine learning model in order to understand and mitigate the associated risks, a potentially valuable source of evidence is: which training examples most contribute to a given behavior? Influence functions aim to answer a counterfactual: how would the model's parameters (and hence its outputs) change if a given sequence were added to the training set? While influence functions have produced insights for small models, they are difficult to scale to large language models (LLMs) due to the difficulty of computing an inverse-Hessian-vector product (IHVP). We use the Eigenvalue-corrected Kronecker-Factored Approximate Curvature (EK-FAC) approximation to scale influence functions up to LLMs with up to 52 billion parameters. In our experiments, EK-FAC achieves similar accuracy to traditional influence function estimators despite the IHVP computation being orders of magnitude faster. We investigate two algorithmic techniques to reduce the cost of computing gradients of candidate training sequences: TF-IDF filtering and query batching. We use influence functions to investigate the generalization patterns of LLMs, including the sparsity of the influence patterns, increasing abstraction with scale, math and programming abilities, cross-lingual generalization, and role-playing behavior. Despite many apparently sophisticated forms of generalization, we identify a surprising limitation: influences decay to near-zero when the order of key phrases is flipped. Overall, influence functions give us a powerful new tool for studying the generalization properties of LLMs. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 119 pages, 47 figures, 22 tables

Measuring Faithfulness in Chain-of-Thought Reasoning

Authors: Tamera Lanham, Anna Chen, Ansh Radhakrishnan, Benoit Steiner, Carson Denison, Danny Hernandez, Dustin Li, Esin Durmus, Evan Hubinger, Jackson Kernion, Kamilė Lukošiūtė, Karina Nguyen, Newton Cheng, Nicholas Joseph, Nicholas Schiefer, Oliver Rausch, Robin Larson, Sam McCandlish, Sandipan Kundu, Saurav Kadavath, Shannon Yang, Thomas Henighan, Timothy Maxwell, Timothy Telleen-Lawton, Tristan Hume , et al. (5 additional authors not shown)

Abstract: Large language models (LLMs) perform better when they produce step-by-step, "Chain-of-Thought" (CoT) reasoning before answering a question, but it is unclear if the stated reasoning is a faithful explanation of the model's actual reasoning (i.e., its process for answering the question). We investigate hypotheses for how CoT reasoning may be unfaithful, by examining how the model predictions change… ▽ More Large language models (LLMs) perform better when they produce step-by-step, "Chain-of-Thought" (CoT) reasoning before answering a question, but it is unclear if the stated reasoning is a faithful explanation of the model's actual reasoning (i.e., its process for answering the question). We investigate hypotheses for how CoT reasoning may be unfaithful, by examining how the model predictions change when we intervene on the CoT (e.g., by adding mistakes or paraphrasing it). Models show large variation across tasks in how strongly they condition on the CoT when predicting their answer, sometimes relying heavily on the CoT and other times primarily ignoring it. CoT's performance boost does not seem to come from CoT's added test-time compute alone or from information encoded via the particular phrasing of the CoT. As models become larger and more capable, they produce less faithful reasoning on most tasks we study. Overall, our results suggest that CoT can be faithful if the circumstances such as the model size and task are carefully chosen. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning

Authors: Ansh Radhakrishnan, Karina Nguyen, Anna Chen, Carol Chen, Carson Denison, Danny Hernandez, Esin Durmus, Evan Hubinger, Jackson Kernion, Kamilė Lukošiūtė, Newton Cheng, Nicholas Joseph, Nicholas Schiefer, Oliver Rausch, Sam McCandlish, Sheer El Showk, Tamera Lanham, Tim Maxwell, Venkatesa Chandrasekaran, Zac Hatfield-Dodds, Jared Kaplan, Jan Brauner, Samuel R. Bowman, Ethan Perez

Abstract: As large language models (LLMs) perform more difficult tasks, it becomes harder to verify the correctness and safety of their behavior. One approach to help with this issue is to prompt LLMs to externalize their reasoning, e.g., by having them generate step-by-step reasoning as they answer a question (Chain-of-Thought; CoT). The reasoning may enable us to check the process that models use to perfo… ▽ More As large language models (LLMs) perform more difficult tasks, it becomes harder to verify the correctness and safety of their behavior. One approach to help with this issue is to prompt LLMs to externalize their reasoning, e.g., by having them generate step-by-step reasoning as they answer a question (Chain-of-Thought; CoT). The reasoning may enable us to check the process that models use to perform tasks. However, this approach relies on the stated reasoning faithfully reflecting the model's actual reasoning, which is not always the case. To improve over the faithfulness of CoT reasoning, we have models generate reasoning by decomposing questions into subquestions. Decomposition-based methods achieve strong performance on question-answering tasks, sometimes approaching that of CoT while improving the faithfulness of the model's stated reasoning on several recently-proposed metrics. By forcing the model to answer simpler subquestions in separate contexts, we greatly increase the faithfulness of model-generated reasoning over CoT, while still achieving some of the performance gains of CoT. Our results show it is possible to improve the faithfulness of model-generated reasoning; continued improvements may lead to reasoning that enables us to verify the correctness and safety of LLM behavior. △ Less

Submitted 25 July, 2023; v1 submitted 16 July, 2023; originally announced July 2023.

Comments: For few-shot examples and prompts, see https://github.com/anthropics/DecompositionFaithfulnessPaper

A Refined scissors congruence group and the third homology of $\textrm{SL}_2$

Authors: Behrooz Mirzaii, Elvis Torres Pérez

Abstract: There is a natural connection between the third homology of $\textrm{SL}_2(A)$ and the refined Bloch group $\mathcal{RB}(A)$ of a commutative ring $A$. In this article we investigate this connection and as the main result we show that if $A$ is a universal $\textrm{GE}_2$-domain such that $-1 \in A^{\times 2}$, then we have the exact sequence… ▽ More There is a natural connection between the third homology of $\textrm{SL}_2(A)$ and the refined Bloch group $\mathcal{RB}(A)$ of a commutative ring $A$. In this article we investigate this connection and as the main result we show that if $A$ is a universal $\textrm{GE}_2$-domain such that $-1 \in A^{\times 2}$, then we have the exact sequence $H_3(\textrm{SM}_2(A),\mathbb{Z}) \to H_3(\textrm{SL}_2(A),\mathbb{Z}) \to \mathcal{RB}(A) \to 0$, where $\textrm{SM}_2(A)$ is the group of monomial matrices in $\textrm{SL}_2(A)$. Moreover we show that $\mathcal{RP}_1(A)$, the refined scissors congruence group of $A$, naturally is isomorph with the relative homology group $H_3(\textrm{SL}_2(A), \textrm{SM}_2(A),\mathbb{Z})$. △ Less

Submitted 15 January, 2024; v1 submitted 17 July, 2023; originally announced July 2023.

Approximation of almost diagonal non-linear maps by lattice Lipschitz operators

Authors: Roger Arnau, Jose M. Calabuig, Ezgi Erdoğan, Enrique A. Sánchez Pérez

Abstract: Lattice Lipschitz operators define a new class of nonlinear Banach-lattice-valued maps that can be written as diagonal functions with respect to a certain basis. In the $n-$dimensional case, such a map can be represented as a vector of size $n$ of real-valued functions of one variable. In this paper we develop a method to approximate almost diagonal maps by means of lattice Lipschitz operators. Th… ▽ More Lattice Lipschitz operators define a new class of nonlinear Banach-lattice-valued maps that can be written as diagonal functions with respect to a certain basis. In the $n-$dimensional case, such a map can be represented as a vector of size $n$ of real-valued functions of one variable. In this paper we develop a method to approximate almost diagonal maps by means of lattice Lipschitz operators. The proposed technique is based on the approximation properties and error bounds obtained for these operators, together with a pointwise version of the interpolation of McShane and Whitney extension maps that can be applied to almost diagonal functions. In order to get the desired approximation, it is necessary to previously obtain an approximation to the set of eigenvectors of the original function. We focus on the explicit computation of error formulas and on illustrative examples to present our construction. △ Less

Submitted 3 July, 2023; originally announced July 2023.

MSC Class: 47J10

Description of Excitonic Absorption Using the Sommerfeld Enhancement Factor and Band-Fluctuations

Authors: K. Lizárraga, P. Llontop, L. A. Enrique-Morán, M. Piñeiro, E. Perez, E. Serquen, A. Tejada, F. Ruske, L. Korte, J. A. Guerra

Abstract: One of the challenges of excitonic materials is the accurate determination of the exciton binding energy and bandgap. The difficulty arises from the overlap of the discrete and continuous excitonic absorption at the band edge. Many researches have modeled the shape of the absorption edge of such materials on the Elliott model and its several modifications such as non-parabolic bands, magnetic pote… ▽ More One of the challenges of excitonic materials is the accurate determination of the exciton binding energy and bandgap. The difficulty arises from the overlap of the discrete and continuous excitonic absorption at the band edge. Many researches have modeled the shape of the absorption edge of such materials on the Elliott model and its several modifications such as non-parabolic bands, magnetic potentials and electro-hole-polaron interactions. However, exciton binding energies obtained from measured data often vary strongly depending on the chosen model. Here, we propose an alternative and rather simple approach, which has previously been successful in the determination of the optical bandgap of amorphous, direct and indirect semiconductors, based on the bands-fluctuations (BF) model. In this model, the fluctuations due to disorder, temperature or lattice vibrations give rise to the well known exponential distribution of band tail states (Urbach tails). This analysis results in an analytic equation with 5 parameters only. The binding energies and optical bandgaps of GaAs and the family of tri-halide perovskites ($\textrm{MAPbX}_{3}$), $\textrm{X=Br,I,Cl}$, over a wide range of temperatures, are obtained with this model. The results for the bandgap, linewidth and exciton binding energy are in good agreement with previous reports. Moreover, due to the polar nature of perovskites, the obtained binding energies can be compared with the ones computed with a theoretical model for polar materials via a model proposed by Kane et al. In this model, the exciton is surrounded by a cloud of virtual phonons interacting via the Fr$\ddot{\textrm{o}}$lich interaction. As a consequence, the upper bound for the binding energy of the exciton-polaron system is calculated. Coincidentally, these results are in good agreement with the optical constants obtained with the EBF model. △ Less

Submitted 29 June, 2023; originally announced June 2023.

Comments: Preprint submitted to: J. Phys. D: Appl. Phys

Constrained optimization of sensor placement for nuclear digital twins

Authors: Niharika Karnik, Mohammad G. Abdo, Carlos E. Estrada Perez, Jun Soo Yoo, Joshua J. Cogliati, Richard S. Skifton, Pattrick Calderoni, Steven L. Brunton, Krithika Manohar

Abstract: The deployment of extensive sensor arrays in nuclear reactors is infeasible due to challenging operating conditions and inherent spatial limitations. Strategically placing sensors within defined spatial constraints is essential for the reconstruction of reactor flow fields and the creation of nuclear digital twins. We develop a data-driven technique that incorporates constraints into an optimizati… ▽ More The deployment of extensive sensor arrays in nuclear reactors is infeasible due to challenging operating conditions and inherent spatial limitations. Strategically placing sensors within defined spatial constraints is essential for the reconstruction of reactor flow fields and the creation of nuclear digital twins. We develop a data-driven technique that incorporates constraints into an optimization framework for sensor placement, with the primary objective of minimizing reconstruction errors under noisy sensor measurements. The proposed greedy algorithm optimizes sensor locations over high-dimensional grids, adhering to user-specified constraints. We demonstrate the efficacy of optimized sensors by exhaustively computing all feasible configurations for a low-dimensional dynamical system. To validate our methodology, we apply the algorithm to the Out-of-Pile Testing and Instrumentation Transient Water Irradiation System (OPTI-TWIST) prototype capsule. This capsule is electrically heated to emulate the neutronics effect of the nuclear fuel. The TWIST prototype that will eventually be inserted in the Transient Reactor Test facility (TREAT) at the Idaho National Laboratory (INL), serves as a practical demonstration. The resulting sensor-based temperature reconstruction within OPTI-TWIST demonstrates minimized error, provides probabilistic bounds for noise-induced uncertainty, and establishes a foundation for communication between the digital twin and the experimental facility. △ Less

Submitted 16 February, 2024; v1 submitted 23 June, 2023; originally announced June 2023.

Inverse Scaling: When Bigger Isn't Better

Authors: Ian R. McKenzie, Alexander Lyzhov, Michael Pieler, Alicia Parrish, Aaron Mueller, Ameya Prabhu, Euan McLean, Aaron Kirtland, Alexis Ross, Alisa Liu, Andrew Gritsevskiy, Daniel Wurgaft, Derik Kauffman, Gabriel Recchia, Jiacheng Liu, Joe Cavanagh, Max Weiss, Sicong Huang, The Floating Droid, Tom Tseng, Tomasz Korbak, Xudong Shen, Yuhui Zhang, Zheng** Zhou, Najoung Kim , et al. (2 additional authors not shown)

Abstract: Work on scaling laws has found that large language models (LMs) show predictable improvements to overall loss with increased scale (model size, training data, and compute). Here, we present evidence for the claim that LMs may show inverse scaling, or worse task performance with increased scale, e.g., due to flaws in the training objective and data. We present empirical evidence of inverse scaling… ▽ More Work on scaling laws has found that large language models (LMs) show predictable improvements to overall loss with increased scale (model size, training data, and compute). Here, we present evidence for the claim that LMs may show inverse scaling, or worse task performance with increased scale, e.g., due to flaws in the training objective and data. We present empirical evidence of inverse scaling on 11 datasets collected by running a public contest, the Inverse Scaling Prize, with a substantial prize pool. Through analysis of the datasets, along with other examples found in the literature, we identify four potential causes of inverse scaling: (i) preference to repeat memorized sequences over following in-context instructions, (ii) imitation of undesirable patterns in the training data, (iii) tasks containing an easy distractor task which LMs could focus on, rather than the harder real task, and (iv) correct but misleading few-shot demonstrations of the task. We release the winning datasets at https://inversescaling.com/data to allow for further investigation of inverse scaling. Our tasks have helped drive the discovery of U-shaped and inverted-U scaling trends, where an initial trend reverses, suggesting that scaling trends are less reliable at predicting the behavior of larger-scale models than previously understood. Overall, our results suggest that there are tasks for which increased model scale alone may not lead to progress, and that more careful thought needs to go into the data and objectives for training language models. △ Less

Submitted 12 May, 2024; v1 submitted 15 June, 2023; originally announced June 2023.

Comments: Published in TMLR (2023), 39 pages

Journal ref: Transactions on Machine Learning Research (TMLR), 10/2023, https://openreview.net/forum?id=DwgRm72GQF

Confirmation of the spectral excess in DAMIC at SNOLAB with skipper CCDs

Authors: A. Aguilar-Arevalo, I. Arnquist, N. Avalos, L. Barak, D. Baxter, X. Bertou, I. M. Bloch, A. M. Botti, M. Cababie, G. Cancelo, N. Castelló-Mor, B. A. Cervantes-Vergara, A. E. Chavarria, J. Cortabitarte-Gutiérrez, M. Crisler, J. Cuevas-Zepeda, A. Dastgheibi-Fard, C. De Dominicis, O. Deligny, A. Drlica-Wagner, J. Duarte-Campderros, J. C. D'Olivo, R. Essig, E. Estrada, J. Estrada , et al. (47 additional authors not shown)

Abstract: We present results from a 3.25 kg-day target exposure of two silicon charge-coupled devices (CCDs), each with 24 megapixels and skipper readout, deployed in the DAMIC setup at SNOLAB. With a reduction in pixel readout noise of a factor of 10 relative to the previous detector, we investigate the excess population of low-energy events in the CCD bulk previously observed above expected backgrounds. W… ▽ More We present results from a 3.25 kg-day target exposure of two silicon charge-coupled devices (CCDs), each with 24 megapixels and skipper readout, deployed in the DAMIC setup at SNOLAB. With a reduction in pixel readout noise of a factor of 10 relative to the previous detector, we investigate the excess population of low-energy events in the CCD bulk previously observed above expected backgrounds. We address the dominant systematic uncertainty of the previous analysis through a depth fiducialization designed to reject surface backgrounds on the CCDs. The measured bulk ionization spectrum confirms the presence of an excess population of low-energy events in the CCD target with characteristic rate of ${\sim}7$ events per kg-day and electron-equivalent energies of ${\sim}80~$eV, whose origin remains unknown. △ Less

Submitted 26 March, 2024; v1 submitted 2 June, 2023; originally announced June 2023.

Comments: 8 pages, 4 figures

Report number: FERMILAB-PUB-23-256-PPD

Journal ref: Phys. Rev. D 109, 062007 (2024)

Direct-Laser-Written Polymer Nanowire Waveguides for Broadband Single Photon Collection from Epitaxial Quantum Dots into a Gaussian-like Mode

Authors: Edgar Perez, Cori Haws, Marcelo Davanco, **dong Song, Luca Sapienza, Kartik Srinivasan

Abstract: Single epitaxial quantum dots (QDs) embedded in nanophotonic geometries are a leading technology for quantum light generation. However, efficiently coupling their emission into a single mode fiber or Gaussian beam often remains challenging. Here, we use direct laser writing (DLW) to address this challenge by fabricating 1 $μ$m diameter polymer nanowires (PNWs) in-contact-with and perpendicular-to… ▽ More Single epitaxial quantum dots (QDs) embedded in nanophotonic geometries are a leading technology for quantum light generation. However, efficiently coupling their emission into a single mode fiber or Gaussian beam often remains challenging. Here, we use direct laser writing (DLW) to address this challenge by fabricating 1 $μ$m diameter polymer nanowires (PNWs) in-contact-with and perpendicular-to a QD-containing GaAs layer. QD emission is coupled to the PNW's HE$_{11}$ waveguide mode, enhancing collection efficiency into a single-mode fiber. PNW fabrication does not alter the QD device layer, making PNWs well-suited for augmenting preexisting in-plane geometries. We study standalone PNWs and PNWs in conjunction with metallic nanoring devices that have been previously established for increasing extraction of QD emission. We report methods that mitigate standing wave reflections and heat, caused by GaAs's absorption/reflection of the lithography beam, which otherwise prevent PNW fabrication. We observe a factor of $(3.0 \pm 0.7)\times$ improvement in a nanoring system with a PNW compared to the same system without a PNW, in line with numerical results, highlighting the PNW's ability to waveguide QD emission and increase collection efficiency simultaneously. These results demonstrate new DLW functionality in service of quantum emitter photonics that maintains compatibility with existing top-down fabrication approaches. △ Less

Submitted 26 May, 2023; v1 submitted 10 May, 2023; originally announced May 2023.

Comments: Comments welcomed

SENSEI: Search for Millicharged Particles produced in the NuMI Beam

Authors: Liron Barak, Itay M. Bloch, Ana M. Botti, Mariano Cababie, Gustavo Cancelo, Luke Chaplinsky, Michael Crisler, Alex Drlica-Wagner, Rouven Essig, Juan Estrada, Erez Etzion, Guillermo Fernandez Moroni, Roni Harnik, Stephen E. Holland, Yaron Korn, Zhen Liu, Sravan Munagavalasa, Aviv Orly, Santiago E. Perez, Ryan Plestid, Dario Rodrigues, Nathan A. Saffold, Silvia Scorza, Aman Singal, Miguel Sofo Haro , et al. (6 additional authors not shown)

Abstract: Millicharged particles appear in several extensions of the Standard Model, but have not yet been detected. These hypothetical particles could be produced by an intense proton beam striking a fixed target. We use data collected in 2020 by the SENSEI experiment in the MINOS cavern at the Fermi National Accelerator Laboratory to search for ultra-relativistic millicharged particles produced in collisi… ▽ More Millicharged particles appear in several extensions of the Standard Model, but have not yet been detected. These hypothetical particles could be produced by an intense proton beam striking a fixed target. We use data collected in 2020 by the SENSEI experiment in the MINOS cavern at the Fermi National Accelerator Laboratory to search for ultra-relativistic millicharged particles produced in collisions of protons in the NuMI beam with a fixed graphite target. The absence of any ionization events with 3 to 6 electrons in the SENSEI data allow us to place world-leading constraints on millicharged particles for masses between 30 MeV to 380 MeV. This work also demonstrates the potential of utilizing low-threshold detectors to investigate new particles in beam-dump experiments, and motivates a future experiment designed specifically for this purpose. △ Less

Submitted 24 May, 2023; v1 submitted 8 May, 2023; originally announced May 2023.

Comments: 7 pages, 5 figures

Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting

Authors: Miles Turpin, Julian Michael, Ethan Perez, Samuel R. Bowman

Abstract: Large Language Models (LLMs) can achieve strong performance on many tasks by producing step-by-step reasoning before giving a final output, often referred to as chain-of-thought reasoning (CoT). It is tempting to interpret these CoT explanations as the LLM's process for solving a task. This level of transparency into LLMs' predictions would yield significant safety benefits. However, we find that… ▽ More Large Language Models (LLMs) can achieve strong performance on many tasks by producing step-by-step reasoning before giving a final output, often referred to as chain-of-thought reasoning (CoT). It is tempting to interpret these CoT explanations as the LLM's process for solving a task. This level of transparency into LLMs' predictions would yield significant safety benefits. However, we find that CoT explanations can systematically misrepresent the true reason for a model's prediction. We demonstrate that CoT explanations can be heavily influenced by adding biasing features to model inputs--e.g., by reordering the multiple-choice options in a few-shot prompt to make the answer always "(A)"--which models systematically fail to mention in their explanations. When we bias models toward incorrect answers, they frequently generate CoT explanations rationalizing those answers. This causes accuracy to drop by as much as 36% on a suite of 13 tasks from BIG-Bench Hard, when testing with GPT-3.5 from OpenAI and Claude 1.0 from Anthropic. On a social-bias task, model explanations justify giving answers in line with stereotypes without mentioning the influence of these social biases. Our findings indicate that CoT explanations can be plausible yet misleading, which risks increasing our trust in LLMs without guaranteeing their safety. Building more transparent and explainable systems will require either improving CoT faithfulness through targeted efforts or abandoning CoT in favor of alternative methods. △ Less

Submitted 9 December, 2023; v1 submitted 7 May, 2023; originally announced May 2023.

Comments: NeurIPS 2023

Confirmation of the standard cosmological model from red massive galaxies $\sim600$ Myr after the Big Bang

Authors: Francisco Prada, Peter Behroozi, Tomoaki Ishiyama, Anatoly Klypin, Enrique Pérez

Abstract: In their recent study, Labbé et al. used multi-band infrared images captured by the James Webb Space Telescope (JWST) to discover a population of red massive galaxies that formed approximately 600 million years after the Big Bang. The authors reported an extraordinarily large density of these galaxies, with stellar masses exceeding $10^{10}$ solar masses, which, if confirmed, challenges the standa… ▽ More In their recent study, Labbé et al. used multi-band infrared images captured by the James Webb Space Telescope (JWST) to discover a population of red massive galaxies that formed approximately 600 million years after the Big Bang. The authors reported an extraordinarily large density of these galaxies, with stellar masses exceeding $10^{10}$ solar masses, which, if confirmed, challenges the standard cosmological model as suggested by recent studies. However, this conclusion is disputed. We contend that during the early epochs of the universe the stellar mass-to-light ratio could not have reached the values reported by Labbé et al. A model of galaxy formation based on standard cosmology provides support for this hypothesis, predicting the formation of massive galaxies with higher ultraviolet (UV) luminosity, which produce several hundred solar masses of stars per year and containing significant dust. These forecasts are consistent with the abundance of JWST/HST galaxies selected photometrically in the rest-frame UV wavelengths and with the properties of the recent spectroscopically-confirmed JWST/HST galaxies formed during that era. Discrepancies with Labbé et al. may arise from overestimation of the stellar masses, systematic uncertainties, absence of JWST/MIRI data, heavy dust extinction affecting UV luminosities, or misidentification of faint red AGN galaxies at closer redshifts. The current JWST/HST results, combined with a realistic galaxy formation model, provide strong confirmation of the standard cosmology. △ Less

Submitted 24 April, 2023; originally announced April 2023.

Comments: Submitted to Nature, matters arising