-
Inductive Generalization in Reinforcement Learning from Specifications
Authors:
Vignesh Subramanian,
Rohit Kushwah,
Subhajit Roy,
Suguman Bansal
Abstract:
We present a novel inductive generalization framework for RL from logical specifications. Many interesting tasks in RL environments have a natural inductive structure. These inductive tasks have similar overarching goals but they differ inductively in low-level predicates and distributions. We present a generalization procedure that leverages this inductive relationship to learn a higher-order fun…
▽ More
We present a novel inductive generalization framework for RL from logical specifications. Many interesting tasks in RL environments have a natural inductive structure. These inductive tasks have similar overarching goals but they differ inductively in low-level predicates and distributions. We present a generalization procedure that leverages this inductive relationship to learn a higher-order function, a policy generator, that generates appropriately adapted policies for instances of an inductive task in a zero-shot manner. An evaluation of the proposed approach on a set of challenging control benchmarks demonstrates the promise of our framework in generalizing to unseen policies for long-horizon tasks.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
The design and performance of CUBES -- a CubeSat X-ray detector
Authors:
Rakhee Kushwah,
Theodor A. Stana,
Mark Pearce
Abstract:
CUBES is a X-ray detector payload which will be installed on the KTH 3U CubeSat mission, MIST. The detector comprises cerium-doped Gd3Al2Ga3O12 (GAGG) scintillators read out with silicon photomultipliers through a Citiroc Application-Specific Integrated Circuit. The detector operates in the energy range $\sim$35-800 keV. The aim of the CUBES mission is to provide experience in the operation of the…
▽ More
CUBES is a X-ray detector payload which will be installed on the KTH 3U CubeSat mission, MIST. The detector comprises cerium-doped Gd3Al2Ga3O12 (GAGG) scintillators read out with silicon photomultipliers through a Citiroc Application-Specific Integrated Circuit. The detector operates in the energy range $\sim$35-800 keV. The aim of the CUBES mission is to provide experience in the operation of these relatively new technologies in a high-inclination low earth orbit, thereby providing confidence for component selection in more complex satellite missions. The design of the CUBES detector is described, and results from performance characterisation tests carried out on a prototype of CUBES, called Proto-CUBES, are reported. Proto-CUBES was flown on a stratospheric balloon platform from Timmins, Canada, in August 2019. During the $\sim$12 hour long flight, the performance of Proto-CUBES was studied in the near-space environment. As well as measuring the X-ray counts spectra at different atmospheric depths, a 511 keV line from positron annihilation was observed.
△ Less
Submitted 20 July, 2021;
originally announced July 2021.
-
Handwritten Digit Recognition using Machine and Deep Learning Algorithms
Authors:
Samay Pashine,
Ritik Dixit,
Rishika Kushwah
Abstract:
The reliance of humans over machines has never been so high such that from object classification in photographs to adding sound to silent movies everything can be performed with the help of deep learning and machine learning algorithms. Likewise, Handwritten text recognition is one of the significant areas of research and development with a streaming number of possibilities that could be attained.…
▽ More
The reliance of humans over machines has never been so high such that from object classification in photographs to adding sound to silent movies everything can be performed with the help of deep learning and machine learning algorithms. Likewise, Handwritten text recognition is one of the significant areas of research and development with a streaming number of possibilities that could be attained. Handwriting recognition (HWR), also known as Handwritten Text Recognition (HTR), is the ability of a computer to receive and interpret intelligible handwritten input from sources such as paper documents, photographs, touch-screens and other devices [1]. Apparently, in this paper, we have performed handwritten digit recognition with the help of MNIST datasets using Support Vector Machines (SVM), Multi-Layer Perceptron (MLP) and Convolution Neural Network (CNN) models. Our main objective is to compare the accuracy of the models stated above along with their execution time to get the best possible model for digit recognition.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
A Compton polarimeter using scintillators read out with MPPCs through Citiroc ASIC
Authors:
Rakhee Kushwah,
Nirmal K. Iyer,
Mózsi Kiss,
Theodor A. Stana,
Mark Pearce
Abstract:
In recent years, a number of purpose-built scintillator-based polarimeters have studied bright astronomical sources for the first time in the hard X-ray band (tens to hundreds of keV). The addition of polarimetry can help data interpretation by resolving model-dependent degeneracies. The typical instrument approach is that incident X-rays scatter off a plastic scintillator into an adjacent scintil…
▽ More
In recent years, a number of purpose-built scintillator-based polarimeters have studied bright astronomical sources for the first time in the hard X-ray band (tens to hundreds of keV). The addition of polarimetry can help data interpretation by resolving model-dependent degeneracies. The typical instrument approach is that incident X-rays scatter off a plastic scintillator into an adjacent scintillator cell. In all missions to date, the scintillators are read out using traditional vacuum tube photo-multipliers (PMTs). The advent of solid-state PMTs ("silicon PM" or "MPPC") is attractive for space-based instruments since the devices are compact, robust and require a low bias voltage. We have characterised the plastic scintillator, EJ-248M, optically coupled to a multi-pixel photon counter (MPPC) and read out with the Citiroc ASIC. A light-yield of 1.6 photoelectrons/keV has been obtained, with a low energy detection threshold of $\lesssim$5 keV at room temperature. We have also constructed an MPPC-based polarimeter-demonstrator in order to investigate the feasibility of such an approach for future instruments. Incident X-rays scatter from a plastic-scintillator bar to surrounding cerium-doped GAGG (Gadolinium Aluminium Gallium Garnet) scintillators yielding time-coincident signals in the scintillators. We have determined the polarimetric response of this set-up using both unpolarised and polarised $\sim$50 keV X-rays. We observe a clear asymmetry in the GAGG counting rates for the polarised beam. The low-energy detection threshold in the plastic scintillator can be further reduced using a coincidence technique. The demonstrated polarimeter design shows promise as a space-based Compton polarimeter and we discuss ways in which our polarimeter can be adapted for such a mission.
△ Less
Submitted 21 July, 2019;
originally announced July 2019.
-
Science prospects for SPHiNX - a small satellite GRB polarimetry mission
Authors:
M. Pearce,
L. Eliasson,
N. Kumar Iyer,
M. Kiss,
R. Kushwah,
J. Larsson,
C. Lundman,
V. Mikhalev,
F. Ryde,
T. -A. Stana,
H. Takahashi,
F. Xie
Abstract:
Gamma-ray bursts (GRBs) are exceptionally bright electromagnetic events occurring daily on the sky. The prompt emission is dominated by X-/$γ$-rays. Since their discovery over 50 years ago, GRBs are primarily studied through spectral and temporal measurements. The properties of the emission jets and underlying processes are not well understood. A promising way forward is the development of mission…
▽ More
Gamma-ray bursts (GRBs) are exceptionally bright electromagnetic events occurring daily on the sky. The prompt emission is dominated by X-/$γ$-rays. Since their discovery over 50 years ago, GRBs are primarily studied through spectral and temporal measurements. The properties of the emission jets and underlying processes are not well understood. A promising way forward is the development of missions capable of characterising the linear polarisation of the high-energy emission. For this reason, the SPHiNX mission has been developed for a small-satellite platform. The polarisation properties of incident high-energy radiation (50-600 keV) are determined by reconstructing Compton scattering interactions in a segmented array of plastic and Gd$_3$Al$_2$Ga$_3$O$_{12}$(Ce) (GAGG(Ce)) scintillators. During a two-year mission, $\sim$200 GRBs will be observed, with $\sim$50 yielding measurements where the polarisation fraction is determined with a relative error $\leq$10%. This is a significant improvement compared to contemporary missions. This performance, combined with the ability to reconstruct GRB localisation and spectral properties, will allow discrimination between leading classes of emission models.
△ Less
Submitted 16 August, 2018;
originally announced August 2018.
