Showing 1–2 of 2 results for author: Okamoto, W

Reinforcement Learning with Adaptive Curriculum Dynamics Randomization for Fault-Tolerant Robot Control

Authors: Wataru Okamoto, Hiroshi Kera, Kazuhiko Kawamoto

Abstract: This study is aimed at addressing the problem of fault tolerance of quadruped robots to actuator failure, which is critical for robots operating in remote or extreme environments. In particular, an adaptive curriculum reinforcement learning algorithm with dynamics randomization (ACDR) is established. The ACDR algorithm can adaptively train a quadruped robot in random actuator failure conditions an… ▽ More This study is aimed at addressing the problem of fault tolerance of quadruped robots to actuator failure, which is critical for robots operating in remote or extreme environments. In particular, an adaptive curriculum reinforcement learning algorithm with dynamics randomization (ACDR) is established. The ACDR algorithm can adaptively train a quadruped robot in random actuator failure conditions and formulate a single robust policy for fault-tolerant robot control. It is noted that the hard2easy curriculum is more effective than the easy2hard curriculum for quadruped robot locomotion. The ACDR algorithm can be used to build a robot system that does not require additional modules for detecting actuator failures and switching policies. Experimental results show that the ACDR algorithm outperforms conventional algorithms in terms of the average reward and walking distance. △ Less

Submitted 18 November, 2021; originally announced November 2021.

Comments: 8 pages, 9 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

sPEGG: high throughput eco-evolutionary simulations on commodity graphics processors

Authors: Kenichi W. Okamoto, Priyanga Amarasekare

Abstract: Integrating population genetics into community ecology theory is a major goal in ecology and evolution, but analyzing the resulting models is computationally daunting. Here we describe sPEGG ($\underline{\textrm{s}}\textrm{imulating}$ $\underline{\textrm{P}}\textrm{henotypic}$ $\underline{\textrm{E}}\textrm{volution}$ on $\underline{\textrm{G}}\textrm{eneral Purpose}$… ▽ More Integrating population genetics into community ecology theory is a major goal in ecology and evolution, but analyzing the resulting models is computationally daunting. Here we describe sPEGG ($\underline{\textrm{s}}\textrm{imulating}$ $\underline{\textrm{P}}\textrm{henotypic}$ $\underline{\textrm{E}}\textrm{volution}$ on $\underline{\textrm{G}}\textrm{eneral Purpose}$ $\underline{\textrm{G}}\textrm{raphics Processing Units}$ (GPGPUs)), an open-source, multi-species forward-time population genetics simulator. Using a single commodity GPGPU instead of a single central processor, we find sPEGG can accelerate eco-evolutionary simulations by a factor of over 200, comparable to performance on a small-to-medium sized computer cluster. △ Less

Submitted 30 March, 2016; originally announced March 2016.