Showing 1–11 of 11 results for author: Aitchison, M

Evaluating Frontier Models for Dangerous Capabilities

Authors: Mary Phuong, Matthew Aitchison, Elliot Catt, Sarah Cogan, Alexandre Kaskasoli, Victoria Krakovna, David Lindner, Matthew Rahtz, Yannis Assael, Sarah Hodkinson, Heidi Howard, Tom Lieberum, Ramana Kumar, Maria Abi Raad, Albert Webson, Lewis Ho, Sharon Lin, Sebastian Farquhar, Marcus Hutter, Gregoire Deletang, Anian Ruoss, Seliem El-Sayed, Sasha Brown, Anca Dragan, Rohin Shah , et al. (2 additional authors not shown)

Abstract: To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous… ▽ More To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models. △ Less

Submitted 5 April, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

Learning Universal Predictors

Authors: Jordi Grau-Moya, Tim Genewein, Marcus Hutter, Laurent Orseau, Grégoire Delétang, Elliot Catt, Anian Ruoss, Li Kevin Wenliang, Christopher Mattern, Matthew Aitchison, Joel Veness

Abstract: Meta-learning has emerged as a powerful approach to train neural networks to learn new tasks quickly from limited data. Broad exposure to different tasks leads to versatile representations enabling general problem solving. But, what are the limits of meta-learning? In this work, we explore the potential of amortizing the most powerful universal predictor, namely Solomonoff Induction (SI), into neu… ▽ More Meta-learning has emerged as a powerful approach to train neural networks to learn new tasks quickly from limited data. Broad exposure to different tasks leads to versatile representations enabling general problem solving. But, what are the limits of meta-learning? In this work, we explore the potential of amortizing the most powerful universal predictor, namely Solomonoff Induction (SI), into neural networks via leveraging meta-learning to its limits. We use Universal Turing Machines (UTMs) to generate training data used to expose networks to a broad range of patterns. We provide theoretical analysis of the UTM data generation processes and meta-training protocols. We conduct comprehensive experiments with neural architectures (e.g. LSTMs, Transformers) and algorithmic data generators of varying complexity and universality. Our results suggest that UTM data is a valuable resource for meta-learning, and that it can be used to train neural networks capable of learning universal prediction strategies. △ Less

Submitted 26 January, 2024; originally announced January 2024.

Comments: 32 pages, 11 figures

Gemini: A Family of Highly Capable Multimodal Models

Authors: Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul R. Barham, Tom Hennigan, Benjamin Lee , et al. (1325 additional authors not shown)

Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr… ▽ More This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI. △ Less

Submitted 17 June, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Distributional Bellman Operators over Mean Embeddings

Authors: Li Kevin Wenliang, Grégoire Delétang, Matthew Aitchison, Marcus Hutter, Anian Ruoss, Arthur Gretton, Mark Rowland

Abstract: We propose a novel algorithmic framework for distributional reinforcement learning, based on learning finite-dimensional mean embeddings of return distributions. We derive several new algorithms for dynamic programming and temporal-difference learning based on this framework, provide asymptotic convergence theory, and examine the empirical performance of the algorithms on a suite of tabular tasks.… ▽ More We propose a novel algorithmic framework for distributional reinforcement learning, based on learning finite-dimensional mean embeddings of return distributions. We derive several new algorithms for dynamic programming and temporal-difference learning based on this framework, provide asymptotic convergence theory, and examine the empirical performance of the algorithms on a suite of tabular tasks. Further, we show that this approach can be straightforwardly combined with deep reinforcement learning, and obtain a new deep RL agent that improves over baseline distributional approaches on the Arcade Learning Environment. △ Less

Submitted 4 March, 2024; v1 submitted 9 December, 2023; originally announced December 2023.

Language Modeling Is Compression

Authors: Grégoire Delétang, Anian Ruoss, Paul-Ambroise Duquenne, Elliot Catt, Tim Genewein, Christopher Mattern, Jordi Grau-Moya, Li Kevin Wenliang, Matthew Aitchison, Laurent Orseau, Marcus Hutter, Joel Veness

Abstract: It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training increasingly large and powerful self-supervised (language) models. Since these large language models exhibit impressive predictive capabilities, they are well-positioned to be strong compressors. In th… ▽ More It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training increasingly large and powerful self-supervised (language) models. Since these large language models exhibit impressive predictive capabilities, they are well-positioned to be strong compressors. In this work, we advocate for viewing the prediction problem through the lens of compression and evaluate the compression capabilities of large (foundation) models. We show that large language models are powerful general-purpose predictors and that the compression viewpoint provides novel insights into scaling laws, tokenization, and in-context learning. For example, Chinchilla 70B, while trained primarily on text, compresses ImageNet patches to 43.4% and LibriSpeech samples to 16.4% of their raw size, beating domain-specific compressors like PNG (58.5%) or FLAC (30.3%), respectively. Finally, we show that the prediction-compression equivalence allows us to use any compressor (like gzip) to build a conditional generative model. △ Less

Submitted 18 March, 2024; v1 submitted 19 September, 2023; originally announced September 2023.

Atari-5: Distilling the Arcade Learning Environment down to Five Games

Authors: Matthew Aitchison, Penny Sweetser, Marcus Hutter

Abstract: The Arcade Learning Environment (ALE) has become an essential benchmark for assessing the performance of reinforcement learning algorithms. However, the computational cost of generating results on the entire 57-game dataset limits ALE's use and makes the reproducibility of many results infeasible. We propose a novel solution to this problem in the form of a principled methodology for selecting sma… ▽ More The Arcade Learning Environment (ALE) has become an essential benchmark for assessing the performance of reinforcement learning algorithms. However, the computational cost of generating results on the entire 57-game dataset limits ALE's use and makes the reproducibility of many results infeasible. We propose a novel solution to this problem in the form of a principled methodology for selecting small but representative subsets of environments within a benchmark suite. We applied our method to identify a subset of five ALE games, called Atari-5, which produces 57-game median score estimates within 10% of their true values. Extending the subset to 10-games recovers 80% of the variance for log-scores for all games within the 57-game set. We show this level of compression is possible due to a high degree of correlation between many of the games in ALE. △ Less

Submitted 5 October, 2022; originally announced October 2022.

Learning to Deceive in Multi-Agent Hidden Role Games

Authors: Matthew Aitchison, Lyndon Benke, Penny Sweetser

Abstract: Deception is prevalent in human social settings. However, studies into the effect of deception on reinforcement learning algorithms have been limited to simplistic settings, restricting their applicability to complex real-world problems. This paper addresses this by introducing a new mixed competitive-cooperative multi-agent reinforcement learning (MARL) environment inspired by popular role-based… ▽ More Deception is prevalent in human social settings. However, studies into the effect of deception on reinforcement learning algorithms have been limited to simplistic settings, restricting their applicability to complex real-world problems. This paper addresses this by introducing a new mixed competitive-cooperative multi-agent reinforcement learning (MARL) environment inspired by popular role-based deception games such as Werewolf, Avalon, and Among Us. The environment's unique challenge lies in the necessity to cooperate with other agents despite not knowing if they are friend or foe. Furthermore, we introduce a model of deception, which we call Bayesian belief manipulation (BBM) and demonstrate its effectiveness at deceiving other agents in this environment while also increasing the deceiving agent's performance. △ Less

Submitted 4 September, 2022; originally announced September 2022.

Journal ref: In: Deceptive AI. DeceptECAI DeceptAI 2020 2021. Communications in Computer and Information Science, vol 1296. Springer, Cham (2021)

DNA: Proximal Policy Optimization with a Dual Network Architecture

Authors: Matthew Aitchison, Penny Sweetser

Abstract: This paper explores the problem of simultaneously learning a value function and policy in deep actor-critic reinforcement learning models. We find that the common practice of learning these functions jointly is sub-optimal, due to an order-of-magnitude difference in noise levels between these two tasks. Instead, we show that learning these tasks independently, but with a constrained distillation p… ▽ More This paper explores the problem of simultaneously learning a value function and policy in deep actor-critic reinforcement learning models. We find that the common practice of learning these functions jointly is sub-optimal, due to an order-of-magnitude difference in noise levels between these two tasks. Instead, we show that learning these tasks independently, but with a constrained distillation phase, significantly improves performance. Furthermore, we find that the policy gradient noise levels can be decreased by using a lower \textit{variance} return estimate. Whereas, the value learning noise level decreases with a lower \textit{bias} estimate. Together these insights inform an extension to Proximal Policy Optimization we call \textit{Dual Network Architecture} (DNA), which significantly outperforms its predecessor. DNA also exceeds the performance of the popular Rainbow DQN algorithm on four of the five environments tested, even under more difficult stochastic control settings. △ Less

Submitted 13 November, 2022; v1 submitted 20 June, 2022; originally announced June 2022.

Comments: Published at NeurIPS 2022

Impact of chemical structure on the dynamics of mass transfer of water in conjugated microporous polymers: A neutron spectroscopy study

Authors: Anne A. Y. Guilbert, Yang Bai, Catherine M. Aitchison, Reiner S. Sprick, Mohamed Zbiri

Abstract: Hydrogen fuel can contribute as a masterpiece in conceiving a robust carbon-free economic puzzle if cleaner methods to produce hydrogen become technically efficient and economically viable. Organic photocatalytic materials such as conjugated microporous materials (CMPs) are potential attractive candidates for water splitting as their energy levels and optical bandgap as well as porosity are tunabl… ▽ More Hydrogen fuel can contribute as a masterpiece in conceiving a robust carbon-free economic puzzle if cleaner methods to produce hydrogen become technically efficient and economically viable. Organic photocatalytic materials such as conjugated microporous materials (CMPs) are potential attractive candidates for water splitting as their energy levels and optical bandgap as well as porosity are tunable through chemical synthesis. The performances of CMPs depend also on the mass transfer of reactants, intermediates and products. Here, we study the mass transfer of water (H2O and D2O), and of triethylamine used as a hole scavenger for hydrogen evolution, by means of neutron spectroscopy. We find that the stiffness of the nodes of the CMPs is correlated with an increase in trapped water, reflected by motions too slow to be quantified by quasi-elastic neutron scattering (QENS). Our study highlights that the addition of the polar sulfone group results in additional interactions between water and the CMP, as evidenced by inelastic neutron scattering (INS), leading to changes in the translational diffusion of water, as determined from the QENS measurements. No changes in triethylamine motions could be observed within CMPs from the present investigations. △ Less

Submitted 14 February, 2021; v1 submitted 13 July, 2020; originally announced July 2020.

Journal ref: ACS Appl. Polym. Mater. 3 (2021) 765-776

Probing dynamics of water mass transfer in organic porous photocatalyst water-splitting materials by neutron spectroscopy

Authors: Mohamed Zbiri, Catherine M. Aitchison, Reiner S. Sprick, Andrew I. Cooper, Anne A. Y. Guilbert

Abstract: The quest for efficient and economically accessible cleaner methods to develop sustainable carbon-free energy sources induced a keen interest in the production of hydrogen fuel. This can be achieved via the water-splitting process exploiting solar energy but requiring the use of adequate photocatalysts. Covalent triazine-based frameworks (CTFs) are target photocatalysts for water-splitting. Both e… ▽ More The quest for efficient and economically accessible cleaner methods to develop sustainable carbon-free energy sources induced a keen interest in the production of hydrogen fuel. This can be achieved via the water-splitting process exploiting solar energy but requiring the use of adequate photocatalysts. Covalent triazine-based frameworks (CTFs) are target photocatalysts for water-splitting. Both electronic and structural characteristics of CTFs, optical bandgaps and porosity, are directly relevant for water-splitting. These can be engineered through chemical design. Porosity can be beneficial to water-splitting by providing larger surface area for the catalytic reactions. However, porosity can also affect both charge transport within the photocatalyst and mass transfer of both reactants and products, thus impacting the overall kinetics of the reaction. We focus on the link between chemical design and water (reactants) mass transfer, playing a key role in the water uptake process and the subsequent hydrogen generation. We use neutron spectroscopy to study water mass transfer in two porous CTFs, CTF-CN and CTF-2, that differ in the polarity of their struts. Quasi-elastic neutron scattering (QENS) is used to quantify the amount of bound water and the translational diffusion of water. Inelastic neutron scattering measurements complement QENS and provides insights into the softness of the CTF structures and the changes in librational degrees of freedom of water in CTFs. We show that CTF-CN exhibits smaller surface area and water uptake due to a softer structure than CTF-2. The current study leads to new insights into the structure-dynamics-property relationship of CTF photo-catalysts that pave the road for a better understanding of the guest-host interaction at the basis of water splitting applications. △ Less

Submitted 23 February, 2021; v1 submitted 27 June, 2020; originally announced June 2020.

Journal ref: Chemistry of Materials, 33 (2021) 1363

Optimal Use of Experience in First Person Shooter Environments

Authors: Matthew Aitchison

Abstract: Although reinforcement learning has made great strides recently, a continuing limitation is that it requires an extremely high number of interactions with the environment. In this paper, we explore the effectiveness of reusing experience from the experience replay buffer in the Deep Q-Learning algorithm. We test the effectiveness of applying learning update steps multiple times per environmental s… ▽ More Although reinforcement learning has made great strides recently, a continuing limitation is that it requires an extremely high number of interactions with the environment. In this paper, we explore the effectiveness of reusing experience from the experience replay buffer in the Deep Q-Learning algorithm. We test the effectiveness of applying learning update steps multiple times per environmental step in the VizDoom environment and show first, this requires a change in the learning rate, and second that it does not improve the performance of the agent. Furthermore, we show that updating less frequently is effective up to a ratio of 4:1, after which performance degrades significantly. These results quantitatively confirm the widespread practice of performing learning updates every 4th environmental step. △ Less

Submitted 24 June, 2019; originally announced June 2019.