-
Isometric Neural Machine Translation using Phoneme Count Ratio Reward-based Reinforcement Learning
Authors:
Shivam Ratnakant Mhaskar,
Nirmesh J. Shah,
Mohammadi Zaki,
Ashishkumar P. Gudmalwar,
Pankaj Wasnik,
Rajiv Ratn Shah
Abstract:
Traditional Automatic Video Dubbing (AVD) pipeline consists of three key modules, namely, Automatic Speech Recognition (ASR), Neural Machine Translation (NMT), and Text-to-Speech (TTS). Within AVD pipelines, isometric-NMT algorithms are employed to regulate the length of the synthesized output text. This is done to guarantee synchronization with respect to the alignment of video and audio subseque…
▽ More
Traditional Automatic Video Dubbing (AVD) pipeline consists of three key modules, namely, Automatic Speech Recognition (ASR), Neural Machine Translation (NMT), and Text-to-Speech (TTS). Within AVD pipelines, isometric-NMT algorithms are employed to regulate the length of the synthesized output text. This is done to guarantee synchronization with respect to the alignment of video and audio subsequent to the dubbing process. Previous approaches have focused on aligning the number of characters and words in the source and target language texts of Machine Translation models. However, our approach aims to align the number of phonemes instead, as they are closely associated with speech duration. In this paper, we present the development of an isometric NMT system using Reinforcement Learning (RL), with a focus on optimizing the alignment of phoneme counts in the source and target language sentence pairs. To evaluate our models, we propose the Phoneme Count Compliance (PCC) score, which is a measure of length compliance. Our approach demonstrates a substantial improvement of approximately 36% in the PCC score compared to the state-of-the-art models when applied to English-Hindi language pairs. Moreover, we propose a student-teacher architecture within the framework of our RL approach to maintain a trade-off between the phoneme count and translation quality.
△ Less
Submitted 20 March, 2024;
originally announced March 2024.
-
Vector Measurements Using All Optical Scalar Atomic Magnetometers
Authors:
Rui Zhang,
Rahul Mhaskar,
Ken Smith,
Easswar Balasubramaniam,
Mark Prouty
Abstract:
Vector field measurement is demonstrated with an all-optical scalar atomic magnetometer using intrinsic parameters related to its scalar operation. The Bell-Bloom type atomic magnetometer measures the Larmor precession of cesium atoms through on-resonant absorption of a probe beam. While the AC component of the probe signal is used for the field magnitude measurement, the probe DC signal contains…
▽ More
Vector field measurement is demonstrated with an all-optical scalar atomic magnetometer using intrinsic parameters related to its scalar operation. The Bell-Bloom type atomic magnetometer measures the Larmor precession of cesium atoms through on-resonant absorption of a probe beam. While the AC component of the probe signal is used for the field magnitude measurement, the probe DC signal contains information about the polar angle, defined as the angle between the magnetic field and the probe beam. Additional polar angle information is obtained from the light-shift-induced magnetic field caused by the frequency modulation of the probe beam. With a measurement time of 100 milliseconds, better than 0.02 degree sensitivity has been achieved using a commercial miniaturized sensor at the optimal sensor orientation. The angle measurement accuracy is checked against an optical encoder over the entire polar angle range of 0 to 180 degrees. Better than 1 degree error is recorded over most set polar angles. Azimuthal angle measurement is also exhibited with two orthogonally oriented sensors.
△ Less
Submitted 29 January, 2021; v1 submitted 17 November, 2020;
originally announced November 2020.
-
Portable Intrinsic Gradiometer for Ultra-Sensitive Detection of Magnetic Gradient in Unshielded Environment
Authors:
Rui Zhang,
Rahul Mhaskar,
Ken Smith,
Mark Prouty
Abstract:
We demonstrate a portable all-optical intrinsic scalar magnetic gradiometer composed of miniaturized cesium vapor cells and vertical-cavity surface-emitting lasers (VCSELs). Two cells, with an inner dimension of 5 mm x 5 mm x 5 mm and separated by a baseline of 5 cm, are driven by one VCSEL and the resulting Larmor precessions are probed by a second VCSEL through optical rotation. The off-resonant…
▽ More
We demonstrate a portable all-optical intrinsic scalar magnetic gradiometer composed of miniaturized cesium vapor cells and vertical-cavity surface-emitting lasers (VCSELs). Two cells, with an inner dimension of 5 mm x 5 mm x 5 mm and separated by a baseline of 5 cm, are driven by one VCSEL and the resulting Larmor precessions are probed by a second VCSEL through optical rotation. The off-resonant linearly polarized probe light interrogates two cells at the same time and the output of the intrinsic gradiometer is proportional to the magnetic field gradient measured over the given baseline. This intrinsic gradiometer scheme has the advantage of avoiding added noise from combining two scalar magnetometers. We achieve better than 18 fT/cm/rt-Hz sensitivity in the gradient measurement. Ultra-sensitive short-baseline magnetic gradiometers can potentially play an important role in many practical applications, such as nondestructive evaluation and unexploded ordnance (UXO) detection. Another application of the gradiometer is for magnetocardiography (MCG) in an unshielded environment. Real-time MCG signals can be extracted from the raw gradiometer readings. The demonstrated gradiometer greatly simplifies the MCG setup and may lead to ubiquitous MCG measurement in the future.
△ Less
Submitted 8 April, 2020; v1 submitted 13 February, 2020;
originally announced February 2020.
-
Subpicotesla Scalar Atomic Magnetometer with a Microfabricated Cell
Authors:
Rui Zhang,
Terry Dyer,
Nathan Brockie,
Roozbeh Parsa,
Rahul Mhaskar
Abstract:
We demonstrated a scalar atomic magnetometer using a micro-fabricated Cs vapor cell. The atomic spin precession is driven by an amplitude-modulated circularly-polarized pump laser resonant on D1 transition of Cs atoms and detected by an off-resonant linearly-polarized probe laser using a balanced polarimeter setup. Under a magnetic field with amplitude in the Earth's magnetic field range, the magn…
▽ More
We demonstrated a scalar atomic magnetometer using a micro-fabricated Cs vapor cell. The atomic spin precession is driven by an amplitude-modulated circularly-polarized pump laser resonant on D1 transition of Cs atoms and detected by an off-resonant linearly-polarized probe laser using a balanced polarimeter setup. Under a magnetic field with amplitude in the Earth's magnetic field range, the magnetometer in the gradiometer mode can reach sensitivities below 150 fT/rt-Hz, which shows that the magnetometer by itself can achieve sub-100 fT/rt-Hz sensitivities. In addition to its high sensitivity, the magnetometer has a bandwidth close to 1 kHz due to the broad magnetic resonance inside the small vapor cell. Our experiment suggests the feasibility of a portable, low-power and high-performance magnetometer which can be operated in the Earth's magnetic field. Such a device will greatly reduce the restrictions on the operating environment and expand the range of applications for atomic magnetometers, such as detection of nuclear magnetic resonance (NMR) in low magnetic fields.
△ Less
Submitted 3 October, 2019;
originally announced October 2019.
-
Pain Analysis, in Premature Infants, Using Near Infrared Spectroscopy (NIRS)
Authors:
Matthew Compton,
Ghada Zamzmi,
Rahul Mhaskar,
Maria Gieron,
Marcia Kneusel,
Judy Zarit,
Terri Ashmeade
Abstract:
Background: The role of neonatal pain on the develo** nervous system is not completely understood, but evidence suggests that sensory pathways are influenced by an infants pain experience. Research has shown that an infants previous pain experiences lead to an increased, and likely abnormal, response to subsequent painful stimuli. We are working to improve neonatal pain detection through automat…
▽ More
Background: The role of neonatal pain on the develo** nervous system is not completely understood, but evidence suggests that sensory pathways are influenced by an infants pain experience. Research has shown that an infants previous pain experiences lead to an increased, and likely abnormal, response to subsequent painful stimuli. We are working to improve neonatal pain detection through automated devices that continuously monitor an infant. The current study outlines some of the initial steps we have taken to evaluate Near Infrared Spectroscopy (NIRS) as a technology to detect neonatal pain. Our findings may provide neonatal intensive care unit (NICU) practitioners with the data necessary to monitor and perhaps better manage an abnormal pain response. Methods: A prospective pilot study was conducted to evaluate nociceptive evoked cortical activity in preterm infants. NIRS data were recorded for approximately 10 minutes prior to an acute painful procedure and for approximately 10 minutes after the procedure. Individual data collection events were performed at a weekly maximum frequency. Eligible infants included those admitted to the Tampa General Hospital (TGH) NICU with a birth gestational age of less than 37 weeks. Results: A total of 15 infants were enrolled and 25 individual studies were completed. Analysis demonstrated a statistically significant difference between the median of the pre- and post-painful procedure data sets in each infants first NIRS collection (p value = 0.01). Conclusions: Initial analysis shows NIRS may be useful in detecting acute pain. An acute painful procedure is typically followed by a negative deflection in NIRS readings.
△ Less
Submitted 21 August, 2019;
originally announced August 2019.
-
Role of the Mean-field in Bloch Oscillations of a Bose-Einstein Condensate in an Optical Lattice and Harmonic Trap
Authors:
R. Zhang,
R. E. Sapiro,
R. R. Mhaskar,
G. Raithel
Abstract:
Using the Crank-Nicholson method, we study the evolution of a Bose-Einstein condensate in an optical lattice and harmonic trap. The condensate is excited by displacing it from the center of the harmonic trap. The mean field plays an important role in the Bloch-like oscillations that occur after sufficiently large initial displacement. We find that a moderate mean field significantly suppresses t…
▽ More
Using the Crank-Nicholson method, we study the evolution of a Bose-Einstein condensate in an optical lattice and harmonic trap. The condensate is excited by displacing it from the center of the harmonic trap. The mean field plays an important role in the Bloch-like oscillations that occur after sufficiently large initial displacement. We find that a moderate mean field significantly suppresses the dispersion of the condensate in momentum space. When the mean field becomes large, soliton and vortex structures appear in the condensate wavefunction.
△ Less
Submitted 30 June, 2008;
originally announced June 2008.
