-
Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models
Authors:
Neha Sengupta,
Sunil Kumar Sahu,
Bokang Jia,
Satheesh Katipomu,
Haonan Li,
Fajri Koto,
William Marshall,
Gurpreet Gosal,
Cynthia Liu,
Zhiming Chen,
Osama Mohammed Afzal,
Samta Kamboj,
Onkar Pandit,
Rahul Pal,
Lalit Pradhan,
Zain Muhammad Mujahid,
Massa Baali,
Xudong Han,
Sondos Mahmoud Bsharat,
Alham Fikri Aji,
Zhiqiang Shen,
Zhengzhong Liu,
Natalia Vassilieva,
Joel Hestness,
Andy Hock
, et al. (7 additional authors not shown)
Abstract:
We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric foundation and instruction-tuned open generative large language models (LLMs). The models are based on the GPT-3 decoder-only architecture and are pretrained on a mixture of Arabic and English texts, including source code in various programming languages. With 13 billion parameters, they demonstrate better knowledge and reasoning…
▽ More
We introduce Jais and Jais-chat, new state-of-the-art Arabic-centric foundation and instruction-tuned open generative large language models (LLMs). The models are based on the GPT-3 decoder-only architecture and are pretrained on a mixture of Arabic and English texts, including source code in various programming languages. With 13 billion parameters, they demonstrate better knowledge and reasoning capabilities in Arabic than any existing open Arabic and multilingual models by a sizable margin, based on extensive evaluation. Moreover, the models are competitive in English compared to English-centric open models of similar size, despite being trained on much less English data. We provide a detailed description of the training, the tuning, the safety alignment, and the evaluation of the models. We release two open versions of the model -- the foundation Jais model, and an instruction-tuned Jais-chat variant -- with the aim of promoting research on Arabic LLMs. Available at https://huggingface.co/inception-mbzuai/jais-13b-chat
△ Less
Submitted 29 September, 2023; v1 submitted 30 August, 2023;
originally announced August 2023.
-
Oscillatory Edge Modes in Two Dimensional Spin-Torque Oscillator Arrays
Authors:
Shivam Kamboj,
Rembert A. Duine,
Benedetta Flebus,
Hilary M. Hurst
Abstract:
Spin torque oscillators (STOs) are dissipative magnetic systems that provide a natural platform for exploring non-Hermitian phenomena. We theoretically study a two-dimensional (2d) array of STOs and show that its dynamics can be mapped to a 2d, non-Hermitian Su-Schrieffer-Heeger (SSH) model. We calculate the energy spectrum and identify the one-dimensional (1d) edge states of our model, correspond…
▽ More
Spin torque oscillators (STOs) are dissipative magnetic systems that provide a natural platform for exploring non-Hermitian phenomena. We theoretically study a two-dimensional (2d) array of STOs and show that its dynamics can be mapped to a 2d, non-Hermitian Su-Schrieffer-Heeger (SSH) model. We calculate the energy spectrum and identify the one-dimensional (1d) edge states of our model, corresponding to auto-oscillation of STOs on the boundary of the system while the bulk oscillators do not activate. We show that tuning the Gilbert dam**, injected spin current, and coupling between STOs allows for exploring the edge state properties under different parameter regimes. Furthermore, this system admits 1d edge states with non-uniform probability density, and we explore their properties in systems of different sizes. Additional symmetry analysis indicates that these states are not topologically protected but are nevertheless confined to the edge of the system, as the bulk is protected by PT-symmetry. These results indicate that 2d arrays of STOs may be useful to explore novel edge state behavior in dissipative systems.
△ Less
Submitted 25 July, 2023;
originally announced July 2023.
-
Field induced hysteretic structural phase switching and possible CDW in Re-doped MoTe$_2$
Authors:
Aastha Vasdev,
Suman Kamboj,
Anshu Sirohi,
Manasi Mandal,
Sourav Marik,
Ravi Prakash Singh,
Goutam Sheet
Abstract:
Novel electronic systems displaying exotic physical properties can be derived from complex topological materials through chemical do**. MoTe$_2$, the candidate type-II Weyl semimetal shows dramatically enhanced superconductivity up to 4.1 K upon Re do** in Mo sites. Based on bulk transport and local scanning tunneling microscopy (STM) here we show that Re do** also leads to the emergence of…
▽ More
Novel electronic systems displaying exotic physical properties can be derived from complex topological materials through chemical do**. MoTe$_2$, the candidate type-II Weyl semimetal shows dramatically enhanced superconductivity up to 4.1 K upon Re do** in Mo sites. Based on bulk transport and local scanning tunneling microscopy (STM) here we show that Re do** also leads to the emergence of a possible charge density wave (CDW) phase in Re$_{0.2}$Mo$_{0.8}$Te$_2$. In addition, the tunneling $I-V$ characteristics display non-linearity and hysteresis which is commensurate with a hysteresis observed in the change in tip-height ($z$) as a function of applied voltage $V$. The observations indicate an electric field induced hysteretic switching consistent with piezoelectricity and possible ferroelectricity.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
High spin-polarization in the low Curie temperature complex itinerant ferromagnet EuTi$_{1-x}$Nb$_x$O$_3$
Authors:
Suman Kamboj,
Deepak K. Roy,
Susmita Roy,
Rajeswari Roy Chowdhury,
Prabhat Mandal,
Mukul Kabir,
Goutam Sheet
Abstract:
The physical systems with ferromagnetism and "bad" metallicity hosting unusual transport properties are playgrounds of novel quantum phenomena. Recently EuTi$_{1-x}$Nb$_x$O$_3$ emerged as a ferromagnetic system where non-trivial temperature dependent transport properties are observed due to coexistence and competition of various magnetic and non-magnetic scattering processes. In the ferromagnetic…
▽ More
The physical systems with ferromagnetism and "bad" metallicity hosting unusual transport properties are playgrounds of novel quantum phenomena. Recently EuTi$_{1-x}$Nb$_x$O$_3$ emerged as a ferromagnetic system where non-trivial temperature dependent transport properties are observed due to coexistence and competition of various magnetic and non-magnetic scattering processes. In the ferromagnetic state, the resistivity shows a $T^2$ temperature dependence possibly due to electron-magnon scattering and above the Curie temperature $T_c$, the dependence changes to $T^{3/2}$ behaviour indicating a correlation between transport and magnetic properties. In this paper, we show that the transport spin-polarization in EuTi$_{1-x}$Nb$_x$O$_3$, a low Curie temperature ferromagnet, is as high ($\sim 40\%$) as that in some of the metallic ferromagnets with high Curie temperatures. In addition, owing to the low Curie temperature of EuTi$_{1-x}$Nb$_x$O$_3$, the temperature ($T$) dependence of $P_t$ could be measured systematically up to $T_c$ which revealed a proportionate relationship with magnetization $M_s$ vs. $T$. This indicates that such proportionality is far more universally valid than the ferromagnets with ideal parabolic bands. Furthermore, our band structure calculations not only helped understand the origin of such high spin polarization in EuTi$_{1-x}$Nb$_x$O$_3$ but also provided a route to estimate the Hubbard $U$ parameter in complex metallic ferromagnets in general using experimental inputs.
△ Less
Submitted 28 March, 2019;
originally announced March 2019.
-
Generation of strain-induced pseudo-magnetic field in a doped type-II Weyl semimetal
Authors:
Suman Kamboj,
Partha Sarathi Rana,
Anshu Sirohi,
Aastha Vasdev,
Manasi Mandal,
Sourav Marik,
Ravi Prakash Singh,
Tanmoy Das,
Goutam Sheet
Abstract:
In Weyl semimetals, there is an intriguing possibility of realizing a pseudo-magnetic field in presence of small strain due to certain special cases of static deformations. This pseudo-magnetic field can be large enough to form quantized Landau levels and thus become observable in Weyl semimetals. In this paper, we experimentally show the emergence of a pseudo-magnetic field (~ 3 Tesla) by Scannin…
▽ More
In Weyl semimetals, there is an intriguing possibility of realizing a pseudo-magnetic field in presence of small strain due to certain special cases of static deformations. This pseudo-magnetic field can be large enough to form quantized Landau levels and thus become observable in Weyl semimetals. In this paper, we experimentally show the emergence of a pseudo-magnetic field (~ 3 Tesla) by Scanning Tunneling Spectroscopy (STS) on the doped Weyl semimetal Re-MoTe2, where distinct Landau level oscillations in the tunneling conductance are clearly resolved. The crystal lattice is intrinsically strained where large area STM imaging of the surface reveals differently strained domains where atomic scale deformations exist forming topographic ripples with varying periodicity in the real space. The effect of pseudo-magnetic field is clearly resolved in areas under maximum strain.
△ Less
Submitted 14 March, 2019;
originally announced March 2019.
-
Suppression of transport spin-polarization of surface states with emergence of ferromagnetism in Mn-doped Bi2Se3
Authors:
Suman Kamboj,
Shekhar Das,
Anshu Sirohi,
Rajeswari Roy Chowdhury,
Sirshendu Gayen,
Vishal K. Maurya,
Satyabrata Patnaik,
Goutam Sheet
Abstract:
The surface states of topological insulators (TI) are protected by time reversal symmetry and they display intrinsic spin helicity where the momentum of the charge carriers decides their spin states. As a consequence, a current injected through the surface states becomes spin polarized and this transport spin-polarization leads to a proportionate suppression of Andreev reflection in superconductor…
▽ More
The surface states of topological insulators (TI) are protected by time reversal symmetry and they display intrinsic spin helicity where the momentum of the charge carriers decides their spin states. As a consequence, a current injected through the surface states becomes spin polarized and this transport spin-polarization leads to a proportionate suppression of Andreev reflection in superconductor/TI junctions. Here we show that upon do** Bi2Se3 with Mn, the transport spin-polarization is seen to be monotonically suppressed. The parent compound Bi2Se3 is found to exhibit a transport spin-polarization of about 63% whereas crystals with 10% Mn do** show transport spin-polarization of about 48%. This suppression is accompanied by an increasing ferromagnetic order of the crystals with Mn do**. Scanning tunneling spectroscopy shows that the topological protection of the surface states reduce due to Mn do**. The net measured transport spin-polarization is due to a competition of this effect with the increased magnetization on Mn do**. The present results provide important insights for the choice of magnetic topological insulators for spintronic applications.
△ Less
Submitted 18 July, 2018;
originally announced July 2018.
-
Dynamic Surface Modification due to Effusion of Na in Na$_2$IrO$_3$
Authors:
Aastha Vasdev,
Lalit Yadav,
Suman Kamboj,
Kavita Mehlawat,
Yogesh Singh,
Goutam Sheet
Abstract:
The honeycomb lattice iridate Na$_2$IrO$_3$ shows frustrated magnetism and can potentially display Kitaev-like exchange interactions. Recently, it was shown that the electronic properties of the surface of crystalline Na$_2$IrO$_3$ can be tuned by Ar plasma treatment in a controlled manner leading to various phases of matter ranging from a fully gapped to a metallic surface, where the possibility…
▽ More
The honeycomb lattice iridate Na$_2$IrO$_3$ shows frustrated magnetism and can potentially display Kitaev-like exchange interactions. Recently, it was shown that the electronic properties of the surface of crystalline Na$_2$IrO$_3$ can be tuned by Ar plasma treatment in a controlled manner leading to various phases of matter ranging from a fully gapped to a metallic surface, where the possibility of a charge-density wave (CDW) like transition is also expected. Here, through direct imaging with an atomic force microscope (AFM) in air, we show that the surface of crystalline Na$_2$IrO$_3$ evolves rapidly as elemental Na effuses out of the interleave planes to the surface and undergoes sublimation thereby disappearing from the surface gradually over time. Using conductive AFM we recorded a series of topographs and surface current maps simultaneously and found that the modification of the surface leads to change in the electronic properties in a dynamic fashion until the whole system reaches a dynamic equilibrium. These observations are important in the context of the exotic electronic and magnetic properties that the surface of Na$_2$IrO$_3$ displays.
△ Less
Submitted 14 February, 2018;
originally announced February 2018.
-
Discovery of highly spin-polarized conducting surface states in the strong spin-orbit coupling semiconductor Sb$_2$Se$_3$
Authors:
Shekhar Das,
Suman Kamboj,
Anshu Sirohi,
Aastha Vasdev,
Sirshendu Gayen,
Prasenjit Guptasarma,
Goutam Sheet
Abstract:
Majority of the A$_2$B$_3$ type chalcogenide systems with strong spin-orbit coupling, like Bi$_2$Se$_3$, Bi$_2$Te$_3$ and Sb$_2$Te$_3$ etc., are topological insulators. One important exception is Sb$_2$Se$_3$, where a topological non-trivial phase was argued to be possible under ambient conditions, but such a phase could be detected to exist only under pressure. In this Letter, we show that like B…
▽ More
Majority of the A$_2$B$_3$ type chalcogenide systems with strong spin-orbit coupling, like Bi$_2$Se$_3$, Bi$_2$Te$_3$ and Sb$_2$Te$_3$ etc., are topological insulators. One important exception is Sb$_2$Se$_3$, where a topological non-trivial phase was argued to be possible under ambient conditions, but such a phase could be detected to exist only under pressure. In this Letter, we show that like Bi$_2$Se$_3$, Sb$_2$Se$_3$, displays generation of highly spin-polarized current under mesoscopic superconducting point contacts as measured by point contact Andreev reflection spectroscopy. In addition, we observe a large negative and anisotropic magnetoresistance in Sb$_2$Se$_3$, when the field is rotated in the basal plane. However, unlike in Bi$_2$Se$_3$, in case of Sb$_2$Se$_3$ a prominent quasiparticle interference (QPI) pattern around the defects could be obtained in STM conductance imaging. Thus, our experiments indicate that Sb$_2$Se$_3$ is a regular band insulator under ambient conditions, but due to it's high spin-orbit coupling, non-trivial spin-texture exists on the surface and the system could be on the verge of a topological insulator phase.
△ Less
Submitted 3 January, 2018;
originally announced January 2018.
-
Performance Analysis of QoS in PMP Mode WiMax Networks
Authors:
Maninder Singh kamboj,
Harwinder Singh
Abstract:
IEEE 802.16 standard supports two different topologies: point to multipoint (PMP) and Mesh. In this paper, a QoS mechanism for point to multipoint of IEEE 802.16 and BS scheduler for PMP Mode is proposed. This paper also describes quality of service over WiMAX networks. Average WiMAX delay, Average WiMAX load and Average WiMAX throughput at base station is analyzed and compared by applying differe…
▽ More
IEEE 802.16 standard supports two different topologies: point to multipoint (PMP) and Mesh. In this paper, a QoS mechanism for point to multipoint of IEEE 802.16 and BS scheduler for PMP Mode is proposed. This paper also describes quality of service over WiMAX networks. Average WiMAX delay, Average WiMAX load and Average WiMAX throughput at base station is analyzed and compared by applying different scheduler at Base station and at fixed nodes.
△ Less
Submitted 14 June, 2010;
originally announced June 2010.
