-
Applications of Machine Learning in Chemical and Biological Oceanography
Authors:
Balamurugan Sadaiappan,
Preethiya Balakrishnan,
Vishal CR,
Neethu T Vijayan,
Mahendran Subramanian,
Mangesh U Gauns
Abstract:
Machine learning (ML) refers to computer algorithms that predict a meaningful output or categorize complex systems based on a large amount of data. ML is applied in various areas including natural science, engineering, space exploration, and even gaming development. This review focuses on the use of machine learning in the field of chemical and biological oceanography. In the prediction of global…
▽ More
Machine learning (ML) refers to computer algorithms that predict a meaningful output or categorize complex systems based on a large amount of data. ML is applied in various areas including natural science, engineering, space exploration, and even gaming development. This review focuses on the use of machine learning in the field of chemical and biological oceanography. In the prediction of global fixed nitrogen levels, partial carbon dioxide pressure, and other chemical properties, the application of ML is a promising tool. Machine learning is also utilized in the field of biological oceanography to detect planktonic forms from various images (i.e., microscopy, FlowCAM, and video recorders), spectrometers, and other signal processing techniques. Moreover, ML successfully classified the mammals using their acoustics, detecting endangered mammalian and fish species in a specific environment. Most importantly, using environmental data, the ML proved to be an effective method for predicting hypoxic conditions and harmful algal bloom events, an essential measurement in terms of environmental monitoring. Furthermore, machine learning was used to construct a number of databases for various species that will be useful to other researchers, and the creation of new algorithms will help the marine research community better comprehend the chemistry and biology of the ocean.
△ Less
Submitted 29 May, 2023; v1 submitted 23 September, 2022;
originally announced September 2022.
-
A policy gradient approach for optimization of smooth risk measures
Authors:
Nithia Vijayan,
Prashanth L. A
Abstract:
We propose policy gradient algorithms for solving a risk-sensitive reinforcement learning (RL) problem in on-policy as well as off-policy settings. We consider episodic Markov decision processes, and model the risk using the broad class of smooth risk measures of the cumulative discounted reward. We propose two template policy gradient algorithms that optimize a smooth risk measure in on-policy an…
▽ More
We propose policy gradient algorithms for solving a risk-sensitive reinforcement learning (RL) problem in on-policy as well as off-policy settings. We consider episodic Markov decision processes, and model the risk using the broad class of smooth risk measures of the cumulative discounted reward. We propose two template policy gradient algorithms that optimize a smooth risk measure in on-policy and off-policy RL settings, respectively. We derive non-asymptotic bounds that quantify the rate of convergence of our proposed algorithms to a stationary point of the smooth risk measure. As special cases, we establish that our algorithms apply to optimization of mean-variance and distortion risk measures, respectively.
△ Less
Submitted 23 June, 2024; v1 submitted 22 February, 2022;
originally announced February 2022.
-
Policy Gradient Methods for Distortion Risk Measures
Authors:
Nithia Vijayan,
Prashanth L. A
Abstract:
We propose policy gradient algorithms which learn risk-sensitive policies in a reinforcement learning (RL) framework. Our proposed algorithms maximize the distortion risk measure (DRM) of the cumulative reward in an episodic Markov decision process in on-policy and off-policy RL settings, respectively. We derive a variant of the policy gradient theorem that caters to the DRM objective, and integra…
▽ More
We propose policy gradient algorithms which learn risk-sensitive policies in a reinforcement learning (RL) framework. Our proposed algorithms maximize the distortion risk measure (DRM) of the cumulative reward in an episodic Markov decision process in on-policy and off-policy RL settings, respectively. We derive a variant of the policy gradient theorem that caters to the DRM objective, and integrate it with a likelihood ratio-based gradient estimation scheme. We derive non-asymptotic bounds that establish the convergence of our proposed algorithms to an approximate stationary point of the DRM objective.
△ Less
Submitted 4 February, 2024; v1 submitted 9 July, 2021;
originally announced July 2021.
-
Smoothed functional-based gradient algorithms for off-policy reinforcement learning: A non-asymptotic viewpoint
Authors:
Nithia Vijayan,
Prashanth L. A
Abstract:
We propose two policy gradient algorithms for solving the problem of control in an off-policy reinforcement learning (RL) context. Both algorithms incorporate a smoothed functional (SF) based gradient estimation scheme. The first algorithm is a straightforward combination of importance sampling-based off-policy evaluation with SF-based gradient estimation. The second algorithm, inspired by the sto…
▽ More
We propose two policy gradient algorithms for solving the problem of control in an off-policy reinforcement learning (RL) context. Both algorithms incorporate a smoothed functional (SF) based gradient estimation scheme. The first algorithm is a straightforward combination of importance sampling-based off-policy evaluation with SF-based gradient estimation. The second algorithm, inspired by the stochastic variance-reduced gradient (SVRG) algorithm, incorporates variance reduction in the update iteration. For both algorithms, we derive non-asymptotic bounds that establish convergence to an approximate stationary point. From these results, we infer that the first algorithm converges at a rate that is comparable to the well-known REINFORCE algorithm in an off-policy RL context, while the second algorithm exhibits an improved rate of convergence.
△ Less
Submitted 23 June, 2024; v1 submitted 6 January, 2021;
originally announced January 2021.
-
Au9+ swift heavy ion irradiation of Zn[CS(NH2)2]3SO4 crystal: Crystalline perfection and optical properties
Authors:
S. K. Kushwaha,
K. K. Maurya,
N. Vijayan,
A. K. Gupta,
D. Haranath,
B. Kumar,
D. Kanjilal,
G. Bhagavannarayana
Abstract:
The single crystal of tris(thiourea)zinc sulphate (Zn[CS(NH2)2]3SO4) was irradiated by 150 MeV Au9+ swift heavy ions and analyzed in comparison with pure crystal for crystalline perfection and optical properties. The Fourier transform infrared and x-ray powder diffraction inferred that swift ions lead the disordering and breaking of molecular bonds in lattice without formation of new structural ph…
▽ More
The single crystal of tris(thiourea)zinc sulphate (Zn[CS(NH2)2]3SO4) was irradiated by 150 MeV Au9+ swift heavy ions and analyzed in comparison with pure crystal for crystalline perfection and optical properties. The Fourier transform infrared and x-ray powder diffraction inferred that swift ions lead the disordering and breaking of molecular bonds in lattice without formation of new structural phases. High resolution X-ray diffraction (HRXRD) revealed the abundance of point defects, and formation of mosaics and low angle grain boundaries in the irradiated region of crystal. The swift ion irradiation found to affect the lattice vibrational modes and functional groups significantly. The defects induced by heavy ions act as the color centers and resulted in enhance of photoluminescence emission intensity. The optical transparency and band gap found to be decreased.
△ Less
Submitted 12 August, 2014;
originally announced August 2014.
-
Growth by SR method and characterization of bis(thiourea)zinc(II) chloride single crystals
Authors:
S. K. Kushwaha,
N. Vijayan,
G. Bhagavannarayana
Abstract:
Large size single crystals of bis(thiourea)zinc(II) chloride (BTZC), a potential nonlinear optical material, have been grown successfully by the Sankaranarayanan Ramasamy (SR) method. Powder X-ray diffraction and Fourier transform infrared analyses confirmed the material of the grown crystal. Thermal stability was assessed by the thermogravimetric differential thermal analysis. The high-resolution…
▽ More
Large size single crystals of bis(thiourea)zinc(II) chloride (BTZC), a potential nonlinear optical material, have been grown successfully by the Sankaranarayanan Ramasamy (SR) method. Powder X-ray diffraction and Fourier transform infrared analyses confirmed the material of the grown crystal. Thermal stability was assessed by the thermogravimetric differential thermal analysis. The high-resolution X-ray diffraction and dielectric measurements indicate that the crystal grown by the SR method has good crystalline perfection and low density of defects.
△ Less
Submitted 19 March, 2014;
originally announced March 2014.
-
Rare-earth free yellow-green emitting NaZnPO4:Mn phosphor for lighting applications
Authors:
D. Haranath,
S. Mishra,
S. Yadav,
R. K. Sharma,
L. M. Kandpal,
N. Vijayan,
M. K. Dalai,
G. Sehgal,
Virendra Shanker
Abstract:
Manganese doped sodium zinc phosphate phosphor with exceptional features having ultra-violet (UV) to visible absorption (300-470 nm), yellow-green (~543 nm) broad-band photoluminescence (PL) and appreciable color co-ordinates (x=0.39, y=0.58) is reported. It has a crystal structure consists of discrete PO4 tetrahedra linked by ZnO4 and NaO4 distorted tetrahedral such that three tetrahedra, one of…
▽ More
Manganese doped sodium zinc phosphate phosphor with exceptional features having ultra-violet (UV) to visible absorption (300-470 nm), yellow-green (~543 nm) broad-band photoluminescence (PL) and appreciable color co-ordinates (x=0.39, y=0.58) is reported. It has a crystal structure consists of discrete PO4 tetrahedra linked by ZnO4 and NaO4 distorted tetrahedral such that three tetrahedra, one of each kind, share one corner. The presence of UV sensitive Zn-O-Zn bonds efficient energy transfer to Mn2+ ions resulted in brightest PL and external quantum yield of 63% at 418 nm. Our experiment demonstrated the possibility of producing inexpensive white-light emitting devices for future.
△ Less
Submitted 16 November, 2012; v1 submitted 11 October, 2012;
originally announced October 2012.
-
Probing the structure, morphology and multifold blue absorption of a new red-emitting nanophosphor for LEDs
Authors:
Savvi Mishra,
Isha Bharti,
N. Vijayan,
R. K. Sharma,
L. M. Kandpal,
V. Shanker,
M. K. Dalai,
R. Rajeswari,
C. K. Jayasankar,
S. Surendra Babu,
D. Haranath
Abstract:
There has been a stringent demand for blue (~450-470 nm) absorbing and red (~611 nm) emitting material system in phosphor converted white light emitting diodes (WLEDs) available in the market. Conventionally used red-emitting Y2O3:Eu3+phosphor has negligible absorption for blue light produced by GaInN based LED chip. To address this issue, a new red-emitting Gd2CaZnO5:Eu3+ (GCZO:Eu3+) nanophosphor…
▽ More
There has been a stringent demand for blue (~450-470 nm) absorbing and red (~611 nm) emitting material system in phosphor converted white light emitting diodes (WLEDs) available in the market. Conventionally used red-emitting Y2O3:Eu3+phosphor has negligible absorption for blue light produced by GaInN based LED chip. To address this issue, a new red-emitting Gd2CaZnO5:Eu3+ (GCZO:Eu3+) nanophosphor system having exceptionally strong absorption for blue (~465 nm) and significant red (~611 nm) photoluminescence (PL) is presented. This is attributed to a dominant f-f transition (5D0\rightarrow7F2) of Eu3+ ions, aroused due to an efficient energy transfer from the Gd3+ sites of the host lattice to Eu3+ ions. X-ray diffraction and microscopy observations revealed the nanocrystalline nature and a bit elongated morphology of the sample respectively. While the energy dispersive x-ray analysis identified the chemical constituents of the GCZO:Eu3+ nanophosphor, the color overlay imaging confirmed the substitution of Eu3+ for Gd3+ ions. It is highly anticipated that the multifold absorption at ~465 nm would certainly improve the color rendering properties of existing WLEDs.
△ Less
Submitted 15 August, 2012;
originally announced August 2012.
