Autonomous Industrial Management via Reinforcement Learning: Self-Learning Agents for Decision-Making -- A Review
Authors:
Leonardo A. Espinosa Leal,
Magnus Westerlund,
Anthony Chapman
Abstract:
Industry has always been in the pursuit of becoming more economically efficient and the current focus has been to reduce human labour using modern technologies. Even with cutting edge technologies, which range from packaging robots to AI for fault detection, there is still some ambiguity on the aims of some new systems, namely, whether they are automated or autonomous. In this paper we indicate th…
▽ More
Industry has always been in the pursuit of becoming more economically efficient and the current focus has been to reduce human labour using modern technologies. Even with cutting edge technologies, which range from packaging robots to AI for fault detection, there is still some ambiguity on the aims of some new systems, namely, whether they are automated or autonomous. In this paper we indicate the distinctions between automated and autonomous system as well as review the current literature and identify the core challenges for creating learning mechanisms of autonomous agents. We discuss using different types of extended realities, such as digital twins, to train reinforcement learning agents to learn specific tasks through generalization. Once generalization is achieved, we discuss how these can be used to develop self-learning agents. We then introduce self-play scenarios and how they can be used to teach self-learning agents through a supportive environment which focuses on how the agents can adapt to different real-world environments.
△ Less
Submitted 20 October, 2019;
originally announced October 2019.
On the interaction between gold and silver metal atoms and DNA/RNA nucleobases -- a comprehensive computational study of ground state properties
Authors:
Leonardo Andres Espinosa Leal,
Olga Lopez-Acevedo
Abstract:
The interaction between metal atoms and nucleobases has been a topic of high interest due to the wide scientific and technological implications. Combining density functional theory simulations with a literature overview, we achieved an exhaustive study of the ground state electronic properties of DNA/RNA nucleobases interacting with gold and silver atoms at three charge states: neutral, cationic,…
▽ More
The interaction between metal atoms and nucleobases has been a topic of high interest due to the wide scientific and technological implications. Combining density functional theory simulations with a literature overview, we achieved an exhaustive study of the ground state electronic properties of DNA/RNA nucleobases interacting with gold and silver atoms at three charge states: neutral, cationic, and anionic. We describe the nature of the stability and electronic properties in each hybrid metallic structure. In addition to the metal interacting with the five isolated nucleobases, we included their respective DNA-WC base pairs and one case with the protonated sugar-phosphate backbone. As a general trend, we discerned that the energetic ordering of isomers follows simple electrostatic rules as expected from previous studies. Also, we found that although the metal localizes almost all of the extra charge in the anionic system, a donation of charge is shared almost equally in the cationic system. Furthermore, the frontier orbitals of the cationic system tend to have more effects from the pairing and inclusion of the backbone than the anionic system. Finally, the electronic gap varies greatly among all of the considered structures and could be further used as a fingerprint when searching DNA-metal hybrid structures.
△ Less
Submitted 7 February, 2020; v1 submitted 14 March, 2014;
originally announced March 2014.
