-
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models
Authors:
Aleksandar Botev,
Soham De,
Samuel L Smith,
Anushan Fernando,
George-Cristian Muraru,
Ruba Haroun,
Leonard Berrada,
Razvan Pascanu,
Pier Giuseppe Sessa,
Robert Dadashi,
Léonard Hussenot,
Johan Ferret,
Sertan Girgin,
Olivier Bachem,
Alek Andreev,
Kathleen Kenealy,
Thomas Mesnard,
Cassidy Hardin,
Surya Bhupatiraju,
Shreya Pathak,
Laurent Sifre,
Morgane Rivière,
Mihir Sanjay Kale,
Juliette Love,
Pouya Tafti
, et al. (37 additional authors not shown)
Abstract:
We introduce RecurrentGemma, an open language model which uses Google's novel Griffin architecture. Griffin combines linear recurrences with local attention to achieve excellent performance on language. It has a fixed-sized state, which reduces memory use and enables efficient inference on long sequences. We provide a pre-trained model with 2B non-embedding parameters, and an instruction tuned var…
▽ More
We introduce RecurrentGemma, an open language model which uses Google's novel Griffin architecture. Griffin combines linear recurrences with local attention to achieve excellent performance on language. It has a fixed-sized state, which reduces memory use and enables efficient inference on long sequences. We provide a pre-trained model with 2B non-embedding parameters, and an instruction tuned variant. Both models achieve comparable performance to Gemma-2B despite being trained on fewer tokens.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
A forced Boussinesq model with a sponge layer
Authors:
L. G. Martins,
M. V. Flamarion,
R. Ribeiro-Jr
Abstract:
The movement of water waves is a topic of interest to researchers from different areas. While their propagation is described by Euler equations, there are instances where simplified models can also provide accurate approximations. A well-known reduced model employed to study the wave dynamics is the Boussinesq model. Despite being extensively studied, to our knowledge, there is no research availab…
▽ More
The movement of water waves is a topic of interest to researchers from different areas. While their propagation is described by Euler equations, there are instances where simplified models can also provide accurate approximations. A well-known reduced model employed to study the wave dynamics is the Boussinesq model. Despite being extensively studied, to our knowledge, there is no research available on a Boussinesq model featuring a sponge layer. Therefore, in this work, we present a Boussinesq model with a sponge layer. Furthermore, we carry out a numerical investigation to explore the advantages and limitations of the proposed model. For this purpose, we compare the numerical solutions of the model with and without the sponge in three different scenarios. The numerical solutions are computed by a pseudospectral method. Our results show that the Boussinesq model with a sponge layer is numerically stable and advantageous because it is able to absorb low-amplitude waves, allowing it to run the numerical simulations for long periods of time without requiring a large spatial domain, but it is not able to absorb high-amplitude waves.
△ Less
Submitted 23 December, 2023;
originally announced December 2023.
-
Signatures of pressure-enhanced helimagnetic order in van der Waals multiferroic NiI$_2$
Authors:
Connor A. Occhialini,
Luiz G. P. Martins,
Qian Song,
Jesse S. Smith,
Jesse Kapeghian,
Danila Amoroso,
Joshua J. Sanchez,
Paolo Barone,
Bertrand Dupé,
Matthieu j. Verstraete,
**g Kong,
Antia S. Botana,
Riccardo Comin
Abstract:
The van der Waals (vdW) type-II multiferroic NiI$_2$ has emerged as a candidate for exploring non-collinear magnetism and magnetoelectric effects in the 2D limit. Frustrated intralayer exchange interactions on a triangular lattice result in a helimagnetic ground state, with spin-induced improper ferroelectricity stabilized by the interlayer interactions. Here we investigate the magnetic and struct…
▽ More
The van der Waals (vdW) type-II multiferroic NiI$_2$ has emerged as a candidate for exploring non-collinear magnetism and magnetoelectric effects in the 2D limit. Frustrated intralayer exchange interactions on a triangular lattice result in a helimagnetic ground state, with spin-induced improper ferroelectricity stabilized by the interlayer interactions. Here we investigate the magnetic and structural phase transitions in bulk NiI$_2$, using high-pressure Raman spectroscopy, optical linear dichroism, and x-ray diffraction. We obtain evidence for a significant pressure enhancement of the antiferromagnetic and helimagnetic transition temperatures, at rates of $\sim15.3/14.4$ K/GPa, respectively. These enhancements are attributed to a cooperative effect of pressure-enhanced interlayer and third-nearest-neighbor intralayer exchange. These results reveal a general path for obtaining high-temperature type-II multiferroicity via high pressures in vdW materials.
△ Less
Submitted 20 June, 2023;
originally announced June 2023.
-
Effects of Pressure on the Electronic and Magnetic Properties of Bulk NiI$_{2}$
Authors:
Jesse Kapeghian,
Danila Amoroso,
Connor A. Occhialini,
Luiz G. P. Martins,
Qian Song,
Jesse S. Smith,
Joshua J. Sanchez,
**g Kong,
Riccardo Comin,
Paolo Barone,
Bertrand Dupé,
Matthieu J. Verstraete,
Antia S. Botana
Abstract:
Transition metal dihalides have recently garnered interest in the context of two-dimensional van der Waals magnets as their underlying geometrically frustrated triangular lattice leads to interesting competing exchange interactions. In particular, NiI$_{2}$ is a magnetic semiconductor that has been long known for its exotic helimagnetism in the bulk. Recent experiments have shown that the helimagn…
▽ More
Transition metal dihalides have recently garnered interest in the context of two-dimensional van der Waals magnets as their underlying geometrically frustrated triangular lattice leads to interesting competing exchange interactions. In particular, NiI$_{2}$ is a magnetic semiconductor that has been long known for its exotic helimagnetism in the bulk. Recent experiments have shown that the helimagnetic state survives down to the monolayer limit with a layer-dependent magnetic transition temperature that suggests a relevant role of the interlayer coupling. Here, we explore the effects of hydrostatic pressure as a means to enhance this interlayer exchange and ultimately tune the electronic and magnetic response of NiI$_{2}$. We study first the evolution of the structural parameters as a function of external pressure using first-principles calculations combined with x-ray diffraction measurements. We then examine the evolution of the electronic structure and magnetic exchange interactions via first-principles calculations and Monte Carlo simulations. We find that the leading interlayer coupling is an antiferromagnetic second-nearest neighbor interaction that increases monotonically with pressure. The ratio between isotropic third- and first-nearest neighbor intralayer exchanges, which controls the magnetic frustration and determines the magnetic propagation vector $\mathbf{q}$ of the helimagnetic ground state, is also enhanced by pressure. As a consequence, our Monte Carlo simulations show a monotonic increase in the magnetic transition temperature, indicating that pressure is an effective means to tune the magnetic response of NiI$_{2}$.
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
Strain-modulated anisotropic electronic structure in superconducting RuO$_2$ films
Authors:
Connor A. Occhialini,
Luiz G. P. Martins,
Shiyu Fan,
Valentina Bisogni,
Takahiro Yasunami,
Maki Musashi,
Masashi Kawasaki,
Masaki Uchida,
Riccardo Comin,
Jonathan Pelliciari
Abstract:
The binary ruthenate, RuO$_2$, has been the subject of intense interest due to its itinerant antiferromagnetism and strain-induced superconductivity. The strain mechanism and its effect on the microscopic electronic states leading to the normal and superconducting state, however, remain undisclosed. Here, we investigate highly-strained epitaxial (110) RuO$_2$ films using polarization-dependent oxy…
▽ More
The binary ruthenate, RuO$_2$, has been the subject of intense interest due to its itinerant antiferromagnetism and strain-induced superconductivity. The strain mechanism and its effect on the microscopic electronic states leading to the normal and superconducting state, however, remain undisclosed. Here, we investigate highly-strained epitaxial (110) RuO$_2$ films using polarization-dependent oxygen K-edge X-ray absorption spectroscopy (XAS). Through the detection of pre-edge peaks, arising from O:$2p$ - Ru:$4d$ hybridization, we uncover the effects of epitaxial strain on the orbital/electronic structure near the Fermi level. Our data show robust strain-induced shifts of orbital levels and a reduction of hybridization strength. Furthermore, we reveal a pronounced in-plane anisotropy of the electronic structure along the $[110]/[1\bar{1}0]$ directions naturally stemming from the symmetry-breaking epitaxial strain of the substrate. The $B_{2g}$ symmetry component of the epitaxially-enforced strain breaks a sublattice degeneracy, resulting in an increase of the density of states at the Fermi level ($E_F$), possibly paving the way to superconductivity. These results underscore the importance of the effective reduction from tetragonal to orthorhombic lattice symmetry in (110) RuO$_2$ films and its relevance towards the superconducting and magnetic properties.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
Quantization of the interior of the black hole
Authors:
Laysa G. Martins,
K. Luz-Burgoa,
José A. C. Nogales
Abstract:
In this work we study the Schwarzschild metric in the context of canonical quantum gravity inside the horizon, close of horizon and near the black hole singularity. Using this standard quantization procedure, we show that the horizon is quantized and the black hole singularity disappears. For the first case, quantization of the Schwarzschild radius was obtained in terms of the Planck length…
▽ More
In this work we study the Schwarzschild metric in the context of canonical quantum gravity inside the horizon, close of horizon and near the black hole singularity. Using this standard quantization procedure, we show that the horizon is quantized and the black hole singularity disappears. For the first case, quantization of the Schwarzschild radius was obtained in terms of the Planck length $l_{Pl}$, a positive integer $n$ and the ordering factor of the operator $p$. From the quantization of the Schwarzschild radius it was possible to determine the area of the black hole event horizon, its mass and the quantum energy of the Hawking radiation as well as its frequency. For the solution close to the interior black hole singularity, the wave function was determined and applied the DeBroglie-Bohm interpretation. The Bohm's trajectory was found near to the singularity. It which describes how the spacetime evolves over time and depends on the ordering factor of the operator $p$. Thus, for the case where $|1-p|\neq0,3$, the Bohm's trajectory is finite and regular, that is, the singularity is removed. For the case where $|1-p|=3$, the Bohm's trajectory assumes an exponential behavior, never going to zero, avoiding the singularity.That result allows that spacetime be extended beyond the classical singularity.
△ Less
Submitted 15 January, 2020; v1 submitted 18 November, 2019;
originally announced November 2019.
-
Evidence for a pressure-induced phase transition of few-layer graphene to 2D diamond
Authors:
Luiz G. Pimenta Martins,
Diego L. Silva,
Jesse S. Smith,
Ang-Yu Lu,
Cong Su,
Marek Hempel,
Connor Occhialini,
Xiang Ji,
Ricardo Pablo,
Rafael S. Alencar,
Alan C. R. Souza,
Alan B. de Oliveira,
Ronaldo J. C. Batista,
Tomás Palacios,
Matheus J. S. Matos,
Mário S. C. Mazzoni,
Riccardo Comin,
**g Kong,
Luiz G. Cançado
Abstract:
We unveil the diamondization mechanism of few-layer graphene compressed in the presence of water, providing robust evidence for the pressure-induced formation of 2D diamond. High-pressure Raman spectroscopy provides evidence of a phase transition occurring in the range of 4-7 GPa for 5-layer graphene and graphite. The pressure-induced phase is partially transparent and indents the silicon substrat…
▽ More
We unveil the diamondization mechanism of few-layer graphene compressed in the presence of water, providing robust evidence for the pressure-induced formation of 2D diamond. High-pressure Raman spectroscopy provides evidence of a phase transition occurring in the range of 4-7 GPa for 5-layer graphene and graphite. The pressure-induced phase is partially transparent and indents the silicon substrate. Our combined theoretical and experimental results indicate a gradual top-bottom diamondization mechanism, consistent with the formation of diamondene, a 2D ferromagnetic semiconductor. High-pressure x-ray diffraction on graphene indicates the formation of hexagonal diamond, consistent with the bulk limit of eclipsed-conformed diamondene.
△ Less
Submitted 16 October, 2019; v1 submitted 3 October, 2019;
originally announced October 2019.
-
Quantum cosmology of a Hořava-Lifshitz model coupled to radiation
Authors:
G. Oliveira-Neto,
L. G. Martins,
G. A. Monerat,
E. V. Corrêa Silva
Abstract:
In the present paper, we canonically quantize an homogeneous and isotropic Hořava-Lifshitz cosmological model, with constant positive spatial sections and coupled to radiation. We consider the projectable version of that gravitational theory without the detailed balance condition. We use the ADM formalism to write the gravitational Hamiltonian of the model and the Schutz variational formalism to w…
▽ More
In the present paper, we canonically quantize an homogeneous and isotropic Hořava-Lifshitz cosmological model, with constant positive spatial sections and coupled to radiation. We consider the projectable version of that gravitational theory without the detailed balance condition. We use the ADM formalism to write the gravitational Hamiltonian of the model and the Schutz variational formalism to write the perfect fluid Hamiltonian. We find the Wheeler-DeWitt equation for the model, which depends on several parameters. We study the case in which parameter values are chosen so that the solutions to the Wheeler-DeWitt equation are bounded. Initially, we solve it using the {\it Many Worlds} interpretation. Using wavepackets computed with the solutions to the Wheeler-DeWitt equation, we obtain the scalar factor expected value $\left<a\right>$. We show that this quantity oscillates between finite maximum and minimum values and never vanishes. Such result indicates that the model is free from singularities, at the quantum level. We reinforce this indication by showing that by subtracting one standard deviation unit from the expected value $\left<a\right>$, the latter remains positive. Then, we use the {\it DeBroglie-Bohm} interpretation. Initially, we compute the Bohm's trajectories for the scale factor and show that they never vanish. Then, we show that each trajectory agrees with the corresponding $\left<a\right>$. Finally, we compute the quantum potential, which helps understanding why the scale factor never vanishes.
△ Less
Submitted 1 April, 2019; v1 submitted 14 January, 2019;
originally announced January 2019.
-
DeBroglie-Bohm interpretation of a Hořava-Lifshitz quantum cosmology model
Authors:
G. Oliveira-Neto,
L. G. Martins,
G. A. Monerat,
E. V. Corrêa Silva
Abstract:
In the present letter, we consider the DeBroglie-Bohm interpretation of a Hořava-Lifshitz quantum cosmology model in the presence of a radiation perfect fluid. We compute the Bohm's trajectories for the scale factor and show that it never goes to zero. That result gives a strong indication that this model is free from singularities, at the quantum level. We also compute the quantum potential. That…
▽ More
In the present letter, we consider the DeBroglie-Bohm interpretation of a Hořava-Lifshitz quantum cosmology model in the presence of a radiation perfect fluid. We compute the Bohm's trajectories for the scale factor and show that it never goes to zero. That result gives a strong indication that this model is free from singularities, at the quantum level. We also compute the quantum potential. That quantity helps understanding why the scale factor never vanishes.
△ Less
Submitted 10 October, 2017;
originally announced October 2017.
-
Quantum Hořava-Lifshitz cosmology and the quantum nature of coupling corrections of HL gravity
Authors:
Laysa G. Martins,
José A. C. Nogales
Abstract:
In this work were studied quantum models of a Friedmann-Robertson-Walker (FRW) cosmology in the framework of the gravity's theory proposed by Hořava, the so-called Hořava-Lifshitz theory of the gravity. It was used the Hořava theory for the projectable Hořava-Lifshitz (HL) gravity without the detailed balance condition. Following the quantization of the model in the context of Wheeler-DeWitt appro…
▽ More
In this work were studied quantum models of a Friedmann-Robertson-Walker (FRW) cosmology in the framework of the gravity's theory proposed by Hořava, the so-called Hořava-Lifshitz theory of the gravity. It was used the Hořava theory for the projectable Hořava-Lifshitz (HL) gravity without the detailed balance condition. Following the quantization of the model in the context of Wheeler-DeWitt approach and taking in account the ordering factor for operators were found the cosmological wave function. Solutions were studied and the results were discussed for some particular cases close of initial singularity. The resulting wave functions were used to investigate the possibility of to avoid the classical singularities due to quantum effects and for analyzing the entanglement entropy. In the ultraviolet phase were found the existence of cosmological wave function with a relation between the ordering factor and coupling constants showing their quantum nature, then it was possible to provide an explicit evolution of the cosmological entanglement entropy in this stage. The interpretation of Bohm-De Broglie was used to discussion of the solutions.
△ Less
Submitted 3 December, 2015;
originally announced December 2015.
-
Structural analysis of polycrystalline graphene systems by Raman spectroscopy
Authors:
J. Ribeiro-Soares,
M. E. Oliveros,
C. Garin,
M. V. David,
L. G. P. Martins,
C. A. Almeida,
E. H. Martins-Ferreira,
K. Takai,
T. Enoki,
R. Magalhães-Paniago,
A. Malachias,
A. Jorio,
B. S. Archanjo,
C. A. Achete,
L. G. Cançado
Abstract:
A theoretical model supported by experimental results explains the dependence of the Raman scattering signal on the evolution of structural parameters along the amorphization trajectory of polycrystalline graphene systems. Four parameters rule the scattering efficiencies, two structural and two related to the scattering dynamics. With the crystallite sizes previously defined from X-ray diffraction…
▽ More
A theoretical model supported by experimental results explains the dependence of the Raman scattering signal on the evolution of structural parameters along the amorphization trajectory of polycrystalline graphene systems. Four parameters rule the scattering efficiencies, two structural and two related to the scattering dynamics. With the crystallite sizes previously defined from X-ray diffraction and microscopy experiments, the three other parameters (the average grain boundaries width, the phonon coherence length, and the electron coherence length) are extracted from the Raman data with the geometrical model proposed here. The broadly used intensity ratio between the C-C stretching (G band) and the defect-induced (D band) modes can be used to measure crystallite sizes only for samples with sizes larger than the phonon coherence length, which is found equal to 32 nm. The Raman linewidth of the G band is ideal to characterize the crystallite sizes below the phonon coherence length, down to the average grain boundaries width, which is found to be 2.8 nm. "Ready-to-use" equations to determine the crystallite dimensions based on Raman spectroscopy data are given.
△ Less
Submitted 20 November, 2015;
originally announced November 2015.
-
The dynamics of a rotating ellipsoid
Authors:
Laysa G. Martins,
José A. C. Nogales
Abstract:
An interesting physical phenomenon, which contradicts our common sense, is concerned with the dynamics of motion of a spinning ellipsoid in a non smooth surface. A hard-boiled egg spinning on a table with a rough surface is an example. In this article, we present a theoretical explanation, of the dynamics of motion of this ellipsoid, that describes the axis raising phenomenon, from the horizontal…
▽ More
An interesting physical phenomenon, which contradicts our common sense, is concerned with the dynamics of motion of a spinning ellipsoid in a non smooth surface. A hard-boiled egg spinning on a table with a rough surface is an example. In this article, we present a theoretical explanation, of the dynamics of motion of this ellipsoid, that describes the axis raising phenomenon, from the horizontal to the vertical. The equations of motion were obtained with Lagrangian formalism.
△ Less
Submitted 16 May, 2013;
originally announced May 2013.