-
Gemini: A Family of Highly Capable Multimodal Models
Authors:
Gemini Team,
Rohan Anil,
Sebastian Borgeaud,
Jean-Baptiste Alayrac,
Jiahui Yu,
Radu Soricut,
Johan Schalkwyk,
Andrew M. Dai,
Anja Hauth,
Katie Millican,
David Silver,
Melvin Johnson,
Ioannis Antonoglou,
Julian Schrittwieser,
Amelia Glaese,
Jilin Chen,
Emily Pitler,
Timothy Lillicrap,
Angeliki Lazaridou,
Orhan Firat,
James Molloy,
Michael Isard,
Paul R. Barham,
Tom Hennigan,
Benjamin Lee
, et al. (1325 additional authors not shown)
Abstract:
This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr…
▽ More
This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.
△ Less
Submitted 17 June, 2024; v1 submitted 18 December, 2023;
originally announced December 2023.
-
The Mouse Set Theorem Just Past Projective
Authors:
Mitch Rudominer
Abstract:
We identify a particular mouse, $M^{\text{ld}}$, the minimal ladder mouse, that sits in the mouse order just past $M_n^{\sharp}$ for all $n$, and we show that $\mathbb{R}\cap M^{\text{ld}} = Q_{ω+1}$, the set of reals that are $Δ^1_{ω+1}$ in a countable ordinal. Thus $Q_{ω+1}$ is a mouse set. This is analogous to the fact that $\mathbb{R}\cap M^{\sharp}_1 = Q_3$ where $M^{\sharp}_1$ is the the sha…
▽ More
We identify a particular mouse, $M^{\text{ld}}$, the minimal ladder mouse, that sits in the mouse order just past $M_n^{\sharp}$ for all $n$, and we show that $\mathbb{R}\cap M^{\text{ld}} = Q_{ω+1}$, the set of reals that are $Δ^1_{ω+1}$ in a countable ordinal. Thus $Q_{ω+1}$ is a mouse set. This is analogous to the fact that $\mathbb{R}\cap M^{\sharp}_1 = Q_3$ where $M^{\sharp}_1$ is the the sharp for the minimal inner model with a Woodin cardinal, and $Q_3$ is the set of reals that are $Δ^1_3$ in a countable ordinal. More generally $\mathbb{R}\cap M^{\sharp}_{2n+1} = Q_{2n+3}$. The mouse $M^{\text{ld}}$ and the set $Q_{ω+1}$ compose the next natural pair to consider in this series of results. Thus we are proving the mouse set theorem just past projective. Some of this is not new. $\mathbb{R}\cap M^{\text{ld}} \subseteq Q_{ω+1}$ was known in the 1990's. But $Q_{ω+1} \subseteq M^{\text{ld}}$ was open until Woodin found a proof in 2018. The main goal of this paper is to give Woodin's proof.
△ Less
Submitted 23 October, 2023; v1 submitted 6 February, 2023;
originally announced February 2023.
-
Prochlo: Strong Privacy for Analytics in the Crowd
Authors:
Andrea Bittau,
Úlfar Erlingsson,
Petros Maniatis,
Ilya Mironov,
Ananth Raghunathan,
David Lie,
Mitch Rudominer,
Usharsee Kode,
Julien Tinnes,
Bernhard Seefeld
Abstract:
The large-scale monitoring of computer users' software activities has become commonplace, e.g., for application telemetry, error reporting, or demographic profiling. This paper describes a principled systems architecture---Encode, Shuffle, Analyze (ESA)---for performing such monitoring with high utility while also protecting user privacy. The ESA design, and its Prochlo implementation, are informe…
▽ More
The large-scale monitoring of computer users' software activities has become commonplace, e.g., for application telemetry, error reporting, or demographic profiling. This paper describes a principled systems architecture---Encode, Shuffle, Analyze (ESA)---for performing such monitoring with high utility while also protecting user privacy. The ESA design, and its Prochlo implementation, are informed by our practical experiences with an existing, large deployment of privacy-preserving software monitoring.
(cont.; see the paper)
△ Less
Submitted 2 October, 2017;
originally announced October 2017.
-
The Largest Countable Inductive Set is a Mouse Set
Authors:
Mitch Rudominer
Abstract:
Let kappa be the least ordinal alpha such that L_{alpha}(R) is admissible. Let A be the set of reals x such that x is ordinal definable in L_α(R), for some alpha<kappa. It is well known that (assuming determinacy) A is the largest countable inductive set of reals. Let T be the following theory:
ZFC - Replacement + "There exists $ω$ Woodin cardinals which are cofinal in the ordinals." T has con…
▽ More
Let kappa be the least ordinal alpha such that L_{alpha}(R) is admissible. Let A be the set of reals x such that x is ordinal definable in L_α(R), for some alpha<kappa. It is well known that (assuming determinacy) A is the largest countable inductive set of reals. Let T be the following theory:
ZFC - Replacement + "There exists $ω$ Woodin cardinals which are cofinal in the ordinals." T has consistency strength weaker than that of the theory
ZFC + "There exists omega Woodin cardinals", but stronger than that of the theory
ZFC + "There exists n Woodin Cardinals", for each n. Let M be the canonical, minimal inner model for the theory T. In this paper we show that A is equal to the set of reals in M. Since M is a "mouse", we say that A is a "mouse set." As an application, we use our characterization of A to give an inner-model-theoretic proof of Martin's theorem that A is equal to the set of reals which are Sigma^*_n for some n.
△ Less
Submitted 15 September, 1996;
originally announced September 1996.
-
Mouse Sets
Authors:
Mitch Rudominer
Abstract:
In this paper we explore a connection between descriptive set theory and inner model theory. From descriptive set theory, we will take a countable, definable set of reals, A. We will then show that A is equal to the reals of M, where M is a canonical model from inner model theory. In technical terms, M is a ''mouse''. Consequently, we say that A is a mouse set. For a concrete example of the type…
▽ More
In this paper we explore a connection between descriptive set theory and inner model theory. From descriptive set theory, we will take a countable, definable set of reals, A. We will then show that A is equal to the reals of M, where M is a canonical model from inner model theory. In technical terms, M is a ''mouse''. Consequently, we say that A is a mouse set. For a concrete example of the type of set A we are working with, let OD(n) be the set of reals which are Sigma-n definable over the omega-first level of the model L(R), from an ordinal parameter. In this paper we will show that for all n, OD(n) is a mouse set. Our work extends some similar results due to D.A. Martin, J.R. Steel, and H. Woodin. Several interesting questions in this area remain open.
△ Less
Submitted 17 June, 1996;
originally announced June 1996.