-
Elastic Gossip: Distributing Neural Network Training Using Gossip-like Protocols
Authors:
Siddharth Pramod
Abstract:
Distributing Neural Network training is of particular interest for several reasons including scaling using computing clusters, training at data sources such as IOT devices and edge servers, utilizing underutilized resources across heterogeneous environments, and so on. Most contemporary approaches primarily address scaling using computing clusters and require high network bandwidth and frequent co…
▽ More
Distributing Neural Network training is of particular interest for several reasons including scaling using computing clusters, training at data sources such as IOT devices and edge servers, utilizing underutilized resources across heterogeneous environments, and so on. Most contemporary approaches primarily address scaling using computing clusters and require high network bandwidth and frequent communication. This thesis presents an overview of standard approaches to distribute training and proposes a novel technique involving pairwise-communication using Gossip-like protocols, called Elastic Gossip. This approach builds upon an existing technique known as Elastic Averaging SGD (EASGD), and is similar to another technique called Gossi** SGD which also uses Gossip-like protocols. Elastic Gossip is empirically evaluated against Gossi** SGD using the MNIST digit recognition and CIFAR-10 classification tasks, using commonly used Neural Network architectures spanning Multi-Layer Perceptrons (MLPs) and Convolutional Neural Networks (CNNs). It is found that Elastic Gossip, Gossi** SGD, and All-reduce SGD perform quite comparably, even though the latter entails a substantially higher communication cost. While Elastic Gossip performs better than Gossi** SGD in these experiments, it is possible that a more thorough search over hyper-parameter space, specific to a given application, may yield configurations of Gossi** SGD that work better than Elastic Gossip.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
A high-performance optical lattice clock based on bosonic atoms
Authors:
Stefano Origlia,
Mysore Srinivas Pramod,
Stephan Schiller,
Yeshpal Singh,
Kai Bongs,
Roman Schwarz,
Ali Al-Masoudi,
Sören Dörscher,
Sofia Herbers,
Sebastian Häfner,
Uwe Sterr,
Christian Lisdat
Abstract:
Optical lattice clocks with uncertainty and instability in the $10^{-17}$-range and below have so far been demonstrated exclusively using fermions. Here, we demonstrate a bosonic optical lattice clock with $3\times 10^{-18}$ instability and $2.0\times 10^{-17}$ accuracy, both values improving on previous work by a factor 30. This was enabled by probing the clock transition with an ultra-long inter…
▽ More
Optical lattice clocks with uncertainty and instability in the $10^{-17}$-range and below have so far been demonstrated exclusively using fermions. Here, we demonstrate a bosonic optical lattice clock with $3\times 10^{-18}$ instability and $2.0\times 10^{-17}$ accuracy, both values improving on previous work by a factor 30. This was enabled by probing the clock transition with an ultra-long interrogation time of 4 s, using the long coherence time provided by a cryogenic silicon resonator, by careful stabilization of relevant operating parameters, and by operating at low atom density. This work demonstrates that bosonic clocks, in combination with highly coherent interrogation lasers, are suitable for high-accuracy applications with particular requirements, such as high reliability, transportability, operation in space, or suitability for particular fundamental physics topics. As an example, we determine the $^{88}\textrm{Sr} - ^{87}$Sr isotope shift with 12 mHz uncertainty.
△ Less
Submitted 8 March, 2018;
originally announced March 2018.
-
Quasi Hyperrigidity and Weak Peak Points for Non-Commutative Operator Systems
Authors:
M. N. N. Namboodiri,
S. Pramod,
P. Shankar,
A. K. Vijayarajan
Abstract:
In this article, we introduce the notions of weak boundary repre- sentation, quasi hyperrigidity and weak peak points in the non-commutative setting for operator systems in C* algebras. An analogue of Saskin theorem relating quasi hyperrigidity and weak Choquet boundary for particular classes of C* algebras is proved. We also show that, if an irreducible representation is a weak boundary represent…
▽ More
In this article, we introduce the notions of weak boundary repre- sentation, quasi hyperrigidity and weak peak points in the non-commutative setting for operator systems in C* algebras. An analogue of Saskin theorem relating quasi hyperrigidity and weak Choquet boundary for particular classes of C* algebras is proved. We also show that, if an irreducible representation is a weak boundary representation and weak peak then it is a boundary repre- sentation. Several examples are provided to illustrate these notions. It is also observed that isometries on Hilbert spaces play an important role in the study of certain operator systems.
△ Less
Submitted 7 October, 2016;
originally announced October 2016.
-
Development of a strontium optical lattice clock for the SOC mission on the ISS
Authors:
S. Origlia,
S. Schiller,
M. S. Pramod,
L. Smith,
Y. Singh,
W. He,
S. Viswam,
D. Świerad,
J. Hughes,
K. Bongs,
U. Sterr,
Ch. Lisdat,
S. Vogt,
S. Bize,
J. Lodewyck,
R. Le Targat,
D. Holleville,
B. Venon,
P. Gill,
G. Barwood,
I. R. Hill,
Y. Ovchinnikov,
A. Kulosa,
W. Ertmer,
E. -M. Rasel
, et al. (3 additional authors not shown)
Abstract:
The ESA mission "Space Optical Clock" project aims at operating an optical lattice clock on the ISS in approximately 2023. The scientific goals of the mission are to perform tests of fundamental physics, to enable space-assisted relativistic geodesy and to intercompare optical clocks on the ground using microwave and optical links. The performance goal of the space clock is less than…
▽ More
The ESA mission "Space Optical Clock" project aims at operating an optical lattice clock on the ISS in approximately 2023. The scientific goals of the mission are to perform tests of fundamental physics, to enable space-assisted relativistic geodesy and to intercompare optical clocks on the ground using microwave and optical links. The performance goal of the space clock is less than $1 \times 10^{-17}$ uncertainty and $1 \times 10^{-15} τ^{-1/2}$ instability. Within an EU-FP7-funded project, a strontium optical lattice clock demonstrator has been developed. Goal performances are instability below $1 \times 10^{-15} τ^{-1/2}$ and fractional inaccuracy $5 \times 10^{-17}$. For the design of the clock, techniques and approaches suitable for later space application are used, such as modular design, diode lasers, low power consumption subunits, and compact dimensions. The Sr clock apparatus is fully operational, and the clock transition in $^{88}$Sr was observed with linewidth as small as 9 Hz.
△ Less
Submitted 19 March, 2016;
originally announced March 2016.
-
Linear and nonlinear magneto-optical rotation on the narrow strontium intercombination line
Authors:
K. Pandey,
C. C. Kwong,
M. S. Pramod,
D. Wilkowski
Abstract:
In the presence of an external static magnetic field, an atomic gas becomes optically active, showing magneto-optical rotation. In the saturated regime, the coherences among the excited substates give a nonlinear contribution to the rotation of the light polarization. In contrast with the linear magneto-optical rotation, the nonlinear counterpart is insensitive to Doppler broadening. By varying th…
▽ More
In the presence of an external static magnetic field, an atomic gas becomes optically active, showing magneto-optical rotation. In the saturated regime, the coherences among the excited substates give a nonlinear contribution to the rotation of the light polarization. In contrast with the linear magneto-optical rotation, the nonlinear counterpart is insensitive to Doppler broadening. By varying the temperature of a cold strontium gas, we observe both regimes by driving the $J=0\rightarrow J=1$ transition on the intercombination line. For this narrow transition, the sensitivity to the static magnetic field is typically three orders of magnitude larger than for a standard broad alkali transition.
△ Less
Submitted 17 March, 2016;
originally announced March 2016.
-
A high flux source of cold strontium atoms
Authors:
T. Yang,
K. Pandey,
M. S. Pramod,
F. Leroux,
C. C. Kwong,
E. Hajiyev,
Z. Y. Chia,
B. Fang,
D. Wilkowski
Abstract:
We describe an experimental apparatus capable of achieving a high loading rate of strontium atoms in a magneto-optical trap operating in a high vacuum environment. A key innovation of this setup is a two dimensional magneto-optical trap deflector located after a Zeeman slower. We find a loading rate of 6x10^9/s whereas the lifetime of the magnetically trapped atoms in the 3P2 state is 54s.
We describe an experimental apparatus capable of achieving a high loading rate of strontium atoms in a magneto-optical trap operating in a high vacuum environment. A key innovation of this setup is a two dimensional magneto-optical trap deflector located after a Zeeman slower. We find a loading rate of 6x10^9/s whereas the lifetime of the magnetically trapped atoms in the 3P2 state is 54s.
△ Less
Submitted 3 November, 2015; v1 submitted 18 May, 2015;
originally announced May 2015.
-
Detecting Epileptic Seizures from EEG Data using Neural Networks
Authors:
Siddharth Pramod,
Adam Page,
Tinoosh Mohsenin,
Tim Oates
Abstract:
We explore the use of neural networks trained with dropout in predicting epileptic seizures from electroencephalographic data (scalp EEG). The input to the neural network is a 126 feature vector containing 9 features for each of the 14 EEG channels obtained over 1-second, non-overlap** windows. The models in our experiments achieved high sensitivity and specificity on patient records not used in…
▽ More
We explore the use of neural networks trained with dropout in predicting epileptic seizures from electroencephalographic data (scalp EEG). The input to the neural network is a 126 feature vector containing 9 features for each of the 14 EEG channels obtained over 1-second, non-overlap** windows. The models in our experiments achieved high sensitivity and specificity on patient records not used in the training process. This is demonstrated using leave-one-out-cross-validation across patient records, where we hold out one patient's record as the test set and use all other patients' records for training; repeating this procedure for all patients in the database.
△ Less
Submitted 3 February, 2019; v1 submitted 19 December, 2014;
originally announced December 2014.
-
Cooperative Emission of a Coherent Superflash of Light
Authors:
C. C. Kwong,
T. Yang,
M. S. Pramod,
K. Pandey,
D. Delande,
R. Pierrat,
D. Wilkowski
Abstract:
We investigate the transient coherent transmission of light through an optically thick cold stron-tium gas. We observe a coherent superflash just after an abrupt probe extinction, with peak intensity more than three times the incident one. We show that this coherent superflash is a direct signature of the cooperative forward emission of the atoms. By engineering fast transient phenomena on the inc…
▽ More
We investigate the transient coherent transmission of light through an optically thick cold stron-tium gas. We observe a coherent superflash just after an abrupt probe extinction, with peak intensity more than three times the incident one. We show that this coherent superflash is a direct signature of the cooperative forward emission of the atoms. By engineering fast transient phenomena on the incident field, we give a clear and simple picture of the physical mechanisms at play.
△ Less
Submitted 4 December, 2014; v1 submitted 21 May, 2014;
originally announced May 2014.
