-
Activation Addition: Steering Language Models Without Optimization
Authors:
Alexander Matt Turner,
Lisa Thiergart,
Gavin Leech,
David Udell,
Juan J. Vazquez,
Ulisse Mini,
Monte MacDiarmid
Abstract:
Reliably controlling the behavior of large language models is a pressing open problem. Existing methods include supervised finetuning, reinforcement learning from human feedback, prompt engineering and guided decoding. We instead investigate activation engineering: modifying activations at inference-time to predictably alter model behavior. We bias the forward pass with a 'steering vector' implici…
▽ More
Reliably controlling the behavior of large language models is a pressing open problem. Existing methods include supervised finetuning, reinforcement learning from human feedback, prompt engineering and guided decoding. We instead investigate activation engineering: modifying activations at inference-time to predictably alter model behavior. We bias the forward pass with a 'steering vector' implicitly specified through natural language. Past work learned these steering vectors; our Activation Addition (ActAdd) method instead computes them by taking activation differences resulting from pairs of prompts. We demonstrate ActAdd on a range of LLMs (LLaMA-3, OPT, GPT-2, and GPT-J), obtaining SOTA on detoxification and negative-to-positive sentiment control. Our approach yields inference-time control over high-level properties of output like topic and sentiment while preserving performance on off-target tasks. ActAdd takes far less compute and implementation effort than finetuning or RLHF, allows users control through natural language, and its computational overhead (as a fraction of inference time) appears stable or improving over increasing model size.
△ Less
Submitted 4 June, 2024; v1 submitted 20 August, 2023;
originally announced August 2023.
-
Sensitivity of the Cherenkov Telescope Array for probing cosmology and fundamental physics with gamma-ray propagation
Authors:
The Cherenkov Telescope Array Consortium,
:,
H. Abdalla,
H. Abe,
F. Acero,
A. Acharyya,
R. Adam,
I. Agudo,
A. Aguirre-Santaella,
R. Alfaro,
J. Alfaro,
C. Alispach,
R. Aloisio,
R. Alves B,
L. Amati,
E. Amato,
G. Ambrosi,
E. O. Angüner,
A. Araudo,
T. Armstrong,
F. Arqueros,
L. Arrabito,
K. Asano,
Y. Ascasíbar,
M. Ashley
, et al. (474 additional authors not shown)
Abstract:
The Cherenkov Telescope Array (CTA), the new-generation ground-based observatory for $γ$-ray astronomy, provides unique capabilities to address significant open questions in astrophysics, cosmology, and fundamental physics. We study some of the salient areas of $γ$-ray cosmology that can be explored as part of the Key Science Projects of CTA, through simulated observations of active galactic nucle…
▽ More
The Cherenkov Telescope Array (CTA), the new-generation ground-based observatory for $γ$-ray astronomy, provides unique capabilities to address significant open questions in astrophysics, cosmology, and fundamental physics. We study some of the salient areas of $γ$-ray cosmology that can be explored as part of the Key Science Projects of CTA, through simulated observations of active galactic nuclei (AGN) and of their relativistic jets. Observations of AGN with CTA will enable a measurement of $γ$-ray absorption on the extragalactic background light with a statistical uncertainty below 15% up to a redshift $z=2$ and to constrain or detect $γ$-ray halos up to intergalactic-magnetic-field strengths of at least 0.3pG. Extragalactic observations with CTA also show promising potential to probe physics beyond the Standard Model. The best limits on Lorentz invariance violation from $γ$-ray astronomy will be improved by a factor of at least two to three. CTA will also probe the parameter space in which axion-like particles could constitute a significant fraction, if not all, of dark matter. We conclude on the synergies between CTA and other upcoming facilities that will foster the growth of $γ$-ray cosmology.
△ Less
Submitted 26 February, 2021; v1 submitted 3 October, 2020;
originally announced October 2020.
-
Monte Carlo studies for the optimisation of the Cherenkov Telescope Array layout
Authors:
A. Acharyya,
I. Agudo,
E. O. Angüner,
R. Alfaro,
J. Alfaro,
C. Alispach,
R. Aloisio,
R. Alves Batista,
J. -P. Amans,
L. Amati,
E. Amato,
G. Ambrosi,
L. A. Antonelli,
C. Aramo,
T. Armstrong,
F. Arqueros,
L. Arrabito,
K. Asano,
H. Ashkar,
C. Balazs,
M. Balbo,
B. Balmaverde,
P. Barai,
A. Barbano,
M. Barkov
, et al. (445 additional authors not shown)
Abstract:
The Cherenkov Telescope Array (CTA) is the major next-generation observatory for ground-based very-high-energy gamma-ray astronomy. It will improve the sensitivity of current ground-based instruments by a factor of five to twenty, depending on the energy, greatly improving both their angular and energy resolutions over four decades in energy (from 20 GeV to 300 TeV). This achievement will be possi…
▽ More
The Cherenkov Telescope Array (CTA) is the major next-generation observatory for ground-based very-high-energy gamma-ray astronomy. It will improve the sensitivity of current ground-based instruments by a factor of five to twenty, depending on the energy, greatly improving both their angular and energy resolutions over four decades in energy (from 20 GeV to 300 TeV). This achievement will be possible by using tens of imaging Cherenkov telescopes of three successive sizes. They will be arranged into two arrays, one per hemisphere, located on the La Palma island (Spain) and in Paranal (Chile). We present here the optimised and final telescope arrays for both CTA sites, as well as their foreseen performance, resulting from the analysis of three different large-scale Monte Carlo productions.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
Extracting gamma-ray information from images with convolutional neural network methods on simulated Cherenkov Telescope Array data
Authors:
S. Mangano,
C. Delgado,
M. Bernardos,
M. Lallena,
J. J. Rodríguez Vázquez
Abstract:
The Cherenkov Telescope Array (CTA) will be the world's leading ground-based gamma-ray observatory allowing us to study very high energy phenomena in the Universe. CTA will produce huge data sets, of the order of petabytes, and the challenge is to find better alternative data analysis methods to the already existing ones. Machine learning algorithms, like deep learning techniques, give encouraging…
▽ More
The Cherenkov Telescope Array (CTA) will be the world's leading ground-based gamma-ray observatory allowing us to study very high energy phenomena in the Universe. CTA will produce huge data sets, of the order of petabytes, and the challenge is to find better alternative data analysis methods to the already existing ones. Machine learning algorithms, like deep learning techniques, give encouraging results in this direction. In particular, convolutional neural network methods on images have proven to be effective in pattern recognition and produce data representations which can achieve satisfactory predictions. We test the use of convolutional neural networks to discriminate signal from background images with high rejections factors and to provide reconstruction parameters from gamma-ray events. The networks are trained and evaluated on artificial data sets of images. The results show that neural networks trained with simulated data can be useful to extract gamma-ray information. Such networks would help us to make the best use of large quantities of real data coming in the next decades.
△ Less
Submitted 1 October, 2018;
originally announced October 2018.
-
Science with the Cherenkov Telescope Array
Authors:
The Cherenkov Telescope Array Consortium,
:,
B. S. Acharya,
I. Agudo,
I. Al Samarai,
R. Alfaro,
J. Alfaro,
C. Alispach,
R. Alves Batista,
J. -P. Amans,
E. Amato,
G. Ambrosi,
E. Antolini,
L. A. Antonelli,
C. Aramo,
M. Araya,
T. Armstrong,
F. Arqueros,
L. Arrabito,
K. Asano,
M. Ashley,
M. Backes,
C. Balazs,
M. Balbo,
O. Ballester
, et al. (558 additional authors not shown)
Abstract:
The Cherenkov Telescope Array, CTA, will be the major global observatory for very high energy gamma-ray astronomy over the next decade and beyond. The scientific potential of CTA is extremely broad: from understanding the role of relativistic cosmic particles to the search for dark matter. CTA is an explorer of the extreme universe, probing environments from the immediate neighbourhood of black ho…
▽ More
The Cherenkov Telescope Array, CTA, will be the major global observatory for very high energy gamma-ray astronomy over the next decade and beyond. The scientific potential of CTA is extremely broad: from understanding the role of relativistic cosmic particles to the search for dark matter. CTA is an explorer of the extreme universe, probing environments from the immediate neighbourhood of black holes to cosmic voids on the largest scales. Covering a huge range in photon energy from 20 GeV to 300 TeV, CTA will improve on all aspects of performance with respect to current instruments.
The observatory will operate arrays on sites in both hemispheres to provide full sky coverage and will hence maximize the potential for the rarest phenomena such as very nearby supernovae, gamma-ray bursts or gravitational wave transients. With 99 telescopes on the southern site and 19 telescopes on the northern site, flexible operation will be possible, with sub-arrays available for specific tasks. CTA will have important synergies with many of the new generation of major astronomical and astroparticle observatories. Multi-wavelength and multi-messenger approaches combining CTA data with those from other instruments will lead to a deeper understanding of the broad-band non-thermal properties of target sources.
The CTA Observatory will be operated as an open, proposal-driven observatory, with all data available on a public archive after a pre-defined proprietary period. Scientists from institutions worldwide have combined together to form the CTA Consortium. This Consortium has prepared a proposal for a Core Programme of highly motivated observations. The programme, encompassing approximately 40% of the available observing time over the first ten years of CTA operation, is made up of individual Key Science Projects (KSPs), which are presented in this document.
△ Less
Submitted 21 January, 2018; v1 submitted 22 September, 2017;
originally announced September 2017.
-
Cherenkov Telescope Array Contributions to the 35th International Cosmic Ray Conference (ICRC2017)
Authors:
F. Acero,
B. S. Acharya,
V. Acín Portella,
C. Adams,
I. Agudo,
F. Aharonian,
I. Al Samarai,
A. Alberdi,
M. Alcubierre,
R. Alfaro,
J. Alfaro,
C. Alispach,
R. Aloisio,
R. Alves Batista,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
M. Anduze,
E. O. Angüner,
E. Antolini,
L. A. Antonelli,
V. Antonuccio
, et al. (1117 additional authors not shown)
Abstract:
List of contributions from the Cherenkov Telescope Array Consortium presented at the 35th International Cosmic Ray Conference, July 12-20 2017, Busan, Korea.
List of contributions from the Cherenkov Telescope Array Consortium presented at the 35th International Cosmic Ray Conference, July 12-20 2017, Busan, Korea.
△ Less
Submitted 24 October, 2017; v1 submitted 11 September, 2017;
originally announced September 2017.
-
Prospects for CTA observations of the young SNR RX J1713.7-3946
Authors:
The CTA Consortium,
:,
F. Acero,
R. Aloisio,
J. Amans,
E. Amato,
L. A. Antonelli,
C. Aramo,
T. Armstrong,
F. Arqueros,
K. Asano,
M. Ashley,
M. Backes,
C. Balazs,
A. Balzer,
A. Bamba,
M. Barkov,
J. A. Barrio,
W. Benbow,
K. Bernlöhr,
V. Beshley,
C. Bigongiari,
A. Biland,
A. Bilinsky,
E. Bissaldi
, et al. (359 additional authors not shown)
Abstract:
We perform simulations for future Cherenkov Telescope Array (CTA) observations of RX~J1713.7$-$3946, a young supernova remnant (SNR) and one of the brightest sources ever discovered in very-high-energy (VHE) gamma rays. Special attention is paid to explore possible spatial (anti-)correlations of gamma rays with emission at other wavelengths, in particular X-rays and CO/H{\sc i} emission. We presen…
▽ More
We perform simulations for future Cherenkov Telescope Array (CTA) observations of RX~J1713.7$-$3946, a young supernova remnant (SNR) and one of the brightest sources ever discovered in very-high-energy (VHE) gamma rays. Special attention is paid to explore possible spatial (anti-)correlations of gamma rays with emission at other wavelengths, in particular X-rays and CO/H{\sc i} emission. We present a series of simulated images of RX J1713.7$-$3946 for CTA based on a set of observationally motivated models for the gamma-ray emission. In these models, VHE gamma rays produced by high-energy electrons are assumed to trace the non-thermal X-ray emission observed by {\it XMM-Newton}, whereas those originating from relativistic protons delineate the local gas distributions. The local atomic and molecular gas distributions are deduced by the NANTEN team from CO and H{\sc i} observations. Our primary goal is to show how one can distinguish the emission mechanism(s) of the gamma rays (i.e., hadronic vs leptonic, or a mixture of the two) through information provided by their spatial distribution, spectra, and time variation. This work is the first attempt to quantitatively evaluate the capabilities of CTA to achieve various proposed scientific goals by observing this important cosmic particle accelerator.
△ Less
Submitted 13 April, 2017;
originally announced April 2017.
-
Contributions of the Cherenkov Telescope Array (CTA) to the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016)
Authors:
The CTA Consortium,
:,
A. Abchiche,
U. Abeysekara,
Ó. Abril,
F. Acero,
B. S. Acharya,
C. Adams,
G. Agnetta,
F. Aharonian,
A. Akhperjanian,
A. Albert,
M. Alcubierre,
J. Alfaro,
R. Alfaro,
A. J. Allafort,
R. Aloisio,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
M. Anduze,
E. O. Angüner
, et al. (1387 additional authors not shown)
Abstract:
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
CTA Contributions to the 34th International Cosmic Ray Conference (ICRC2015)
Authors:
The CTA Consortium,
:,
A. Abchiche,
U. Abeysekara,
Ó. Abril,
F. Acero,
B. S. Acharya,
M. Actis,
G. Agnetta,
J. A. Aguilar,
F. Aharonian,
A. Akhperjanian,
A. Albert,
M. Alcubierre,
R. Alfaro,
E. Aliu,
A. J. Allafort,
D. Allan,
I. Allekotte,
R. Aloisio,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio
, et al. (1290 additional authors not shown)
Abstract:
List of contributions from the CTA Consortium presented at the 34th International Cosmic Ray Conference, 30 July - 6 August 2015, The Hague, The Netherlands.
List of contributions from the CTA Consortium presented at the 34th International Cosmic Ray Conference, 30 July - 6 August 2015, The Hague, The Netherlands.
△ Less
Submitted 11 September, 2015; v1 submitted 24 August, 2015;
originally announced August 2015.
