-
Performance Comparison of ROS2 Middlewares for Multi-robot Mesh Networks in Planetary Exploration
Authors:
Loïck Pierre Chovet,
Gabriel Manuel Garcia,
Abhishek Bera,
Antoine Richard,
Kazuya Yoshida,
Miguel Angel Olivares-Mendez
Abstract:
Recent advancements in Multi-Robot Systems (MRS) and mesh network technologies pave the way for innovative approaches to explore extreme environments. The Artemis Accords, a series of international agreements, have further catalyzed this progress by fostering cooperation in space exploration, emphasizing the use of cutting-edge technologies. In parallel, the widespread adoption of the Robot Operat…
▽ More
Recent advancements in Multi-Robot Systems (MRS) and mesh network technologies pave the way for innovative approaches to explore extreme environments. The Artemis Accords, a series of international agreements, have further catalyzed this progress by fostering cooperation in space exploration, emphasizing the use of cutting-edge technologies. In parallel, the widespread adoption of the Robot Operating System 2 (ROS 2) by companies across various sectors underscores its robustness and versatility. This paper evaluates the performances of available ROS 2 MiddleWare (RMW), such as FastRTPS, CycloneDDS and Zenoh, over a mesh network with a dynamic topology. The final choice of RMW is determined by the one that would fit the most the scenario: an exploration of the extreme extra-terrestrial environment using a MRS. The conducted study in a real environment highlights Zenoh as a potential solution for future applications, showing a reduced delay, reachability, and CPU usage while being competitive on data overhead and RAM usage over a dynamic mesh topology
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Space Debris Reliable Capturing by a Dual-Arm Orbital Robot: Detumbling and Caging
Authors:
Akiyoshi Uchida,
Kentaro Uno,
Kazuya Yoshida
Abstract:
A chaser satellite equipped with robotic arms can capture space debris and manipulate it for use in more advanced missions such as refueling and deorbiting. To facilitate capturing, a caging-based strategy has been proposed to simplify the control system. Caging involves geometrically constraining the motion of the target debris, and is achieved via position control. However, if the target is spin…
▽ More
A chaser satellite equipped with robotic arms can capture space debris and manipulate it for use in more advanced missions such as refueling and deorbiting. To facilitate capturing, a caging-based strategy has been proposed to simplify the control system. Caging involves geometrically constraining the motion of the target debris, and is achieved via position control. However, if the target is spinning at a high speed, direct caging may result in unsuccessful constraints or hardware destruction; therefore, the target should be de-tumbled before capture. To address this problem, this study proposes a repeated contact-based method that uses impedance control to mitigate the momentum of the target. In this study, we analyzed the proposed detumbling technique from the perspective of impedance parameters. We investigated their effects through a parametric analysis and demonstrated the successful detumbling and caging sequence of a microsatellite as representative of space debris. The contact forces decreased during the detumbling sequence compared with direct caging. Further, the proposed detumbling and caging sequence was validated through simulations and experiments using a dual-arm air-floating robot in two-dimensional microgravity emulating testbed.
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
Risk-Aware Coverage Path Planning for Lunar Micro-Rovers Leveraging Global and Local Environmental Data
Authors:
Shreya Santra,
Kentaro Uno,
Gen Kudo,
Kazuya Yoshida
Abstract:
This paper presents a novel 3D myopic coverage path planning algorithm for lunar micro-rovers that can explore unknown environments with limited sensing and computational capabilities. The algorithm expands upon traditional non-graph path planning methods to accommodate the complexities of lunar terrain, utilizing global data with local topographic features into motion cost calculations. The algor…
▽ More
This paper presents a novel 3D myopic coverage path planning algorithm for lunar micro-rovers that can explore unknown environments with limited sensing and computational capabilities. The algorithm expands upon traditional non-graph path planning methods to accommodate the complexities of lunar terrain, utilizing global data with local topographic features into motion cost calculations. The algorithm also integrates localization and map** to update the rover's pose and map the environment. The resulting environment map's accuracy is evaluated and tested in a 3D simulator. Outdoor field tests were conducted to validate the algorithm's efficacy in sim-to-real scenarios. The results showed that the algorithm could achieve high coverage with low energy consumption and computational cost, while incrementally exploring the terrain and avoiding obstacles. This study contributes to the advancement of path planning methodologies for space exploration, paving the way for efficient, scalable and autonomous exploration of lunar environments by small rovers.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Tightly-Coupled LiDAR-IMU-Wheel Odometry with Online Calibration of a Kinematic Model for Skid-Steering Robots
Authors:
Taku Okawara,
Kenji Koide,
Shuji Oishi,
Masashi Yokozuka,
Atsuhiko Banno,
Kentaro Uno,
Kazuya Yoshida
Abstract:
Tunnels and long corridors are challenging environments for mobile robots because a LiDAR point cloud should degenerate in these environments. To tackle point cloud degeneration, this study presents a tightly-coupled LiDAR-IMU-wheel odometry algorithm with an online calibration for skid-steering robots. We propose a full linear wheel odometry factor, which not only serves as a motion constraint bu…
▽ More
Tunnels and long corridors are challenging environments for mobile robots because a LiDAR point cloud should degenerate in these environments. To tackle point cloud degeneration, this study presents a tightly-coupled LiDAR-IMU-wheel odometry algorithm with an online calibration for skid-steering robots. We propose a full linear wheel odometry factor, which not only serves as a motion constraint but also performs the online calibration of kinematic models for skid-steering robots. Despite the dynamically changing kinematic model (e.g., wheel radii changes caused by tire pressures) and terrain conditions, our method can address the model error via online calibration. Moreover, our method enables an accurate localization in cases of degenerated environments, such as long and straight corridors, by calibration while the LiDAR-IMU fusion sufficiently operates. Furthermore, we estimate the uncertainty (i.e., covariance matrix) of the wheel odometry online for creating a reasonable constraint. The proposed method is validated through three experiments. The first indoor experiment shows that the proposed method is robust in severe degeneracy cases (long corridors) and changes in the wheel radii. The second outdoor experiment demonstrates that our method accurately estimates the sensor trajectory despite being in rough outdoor terrain owing to online uncertainty estimation of wheel odometry. The third experiment shows the proposed online calibration enables robust odometry estimation in changing terrains.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Towards Understanding Variants of Invariant Risk Minimization through the Lens of Calibration
Authors:
Kotaro Yoshida,
Hiroki Naganuma
Abstract:
Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as out-of-distribution (OOD) generalization, challenges conventional models. Invariant Risk Minimization (IRM) emerges as a solution that aims to identify invariant feature…
▽ More
Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution often differs from training. This problem, known as out-of-distribution (OOD) generalization, challenges conventional models. Invariant Risk Minimization (IRM) emerges as a solution that aims to identify invariant features across different environments to enhance OOD robustness. However, IRM's complexity, particularly its bi-level optimization, has led to the development of various approximate methods. Our study investigates these approximate IRM techniques, using the consistency and variance of calibration across environments as metrics to measure the invariance aimed for by IRM. Calibration, which measures the reliability of model prediction, serves as an indicator of whether models effectively capture environment-invariant features by showing how uniformly over-confident the model remains across varied environments. Through a comparative analysis of datasets with distributional shifts, we observe that Information Bottleneck-based IRM achieves consistent calibration across different environments. This observation suggests that information compression techniques, such as IB, are potentially effective in achieving model invariance. Furthermore, our empirical evidence indicates that models exhibiting consistent calibration across environments are also well-calibrated. This demonstrates that invariance and cross-environment calibration are empirically equivalent. Additionally, we underscore the necessity for a systematic approach to evaluating OOD generalization. This approach should move beyond traditional metrics, such as accuracy and F1 scores, which fail to account for the model's degree of over-confidence, and instead focus on the nuanced interplay between accuracy, calibration, and model invariance.
△ Less
Submitted 17 June, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
Reliability of Smartphone-Based Vibration Threshold Measurements
Authors:
Rachel A. G. Adenekan,
Kyle T. Yoshida,
Anis Benyoucef,
Alejandrina Gonzalez Reyes,
Adeyinka E. Adenekan,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Smartphone-based measurement platforms can collect data on human sensory function in an accessible manner. We developed a smartphone app that measures vibration perception thresholds by commanding vibrations with varying amplitudes and recording user responses via (1) a staircase method that adjusts a variable stimulus, and (2) a decay method that measures the time a user feels a decaying stimulus…
▽ More
Smartphone-based measurement platforms can collect data on human sensory function in an accessible manner. We developed a smartphone app that measures vibration perception thresholds by commanding vibrations with varying amplitudes and recording user responses via (1) a staircase method that adjusts a variable stimulus, and (2) a decay method that measures the time a user feels a decaying stimulus. We conducted two studies with healthy adults to assess the reliability and usability of the app when the smartphone was applied to the hand and foot. The staircase mode had good reliability for repeated measurements, both with and without the support of an in-person experimenter. The app has the potential to be used at home in unguided scenarios.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
A Comparative Analysis of Smartphone and Standard Tools for Touch Perception Assessment Across Multiple Body Sites
Authors:
Rachel A. G. Adenekan,
Alejandrina Gonzalez Reyes,
Kyle T. Yoshida,
Sreela Kodali,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Tactile perception plays an important role in activities of daily living, and it can be impaired in individuals with certain medical conditions. The most common tools used to assess tactile sensation, the Semmes-Weinstein monofilaments and the 128 Hz tuning fork, have poor repeatability and resolution. Long term, we aim to provide a repeatable, high-resolution testing platform that can be used to…
▽ More
Tactile perception plays an important role in activities of daily living, and it can be impaired in individuals with certain medical conditions. The most common tools used to assess tactile sensation, the Semmes-Weinstein monofilaments and the 128 Hz tuning fork, have poor repeatability and resolution. Long term, we aim to provide a repeatable, high-resolution testing platform that can be used to assess vibrotactile perception through smartphones without the need for an experimenter to be present to conduct the test. We present a smartphone-based vibration perception measurement platform and compare its performance to measurements from standard monofilament and tuning fork tests. We conducted a user study with 36 healthy adults in which we tested each tool on the hand, wrist, and foot, to assess how well our smartphone-based vibration perception thresholds (VPTs) detect known trends obtained from standard tests. The smartphone platform detected statistically significant changes in VPT between the index finger and foot and also between the feet of younger adults and older adults. Our smartphone-based VPT had a moderate correlation to tuning fork-based VPT. Our overarching objective is to develop an accessible smartphone-based platform that can eventually be used to measure disease progression and regression.
△ Less
Submitted 25 January, 2024; v1 submitted 14 January, 2024;
originally announced January 2024.
-
Lower Gravity Demonstratable Testbed for Space Robot Experiments
Authors:
Kentaro Uno,
Kazuki Takada,
Keita Nagaoka,
Takuya Kato,
Arthur Candalot,
Kazuya Yoshida
Abstract:
In develo** mobile robots for exploration on the planetary surface, it is crucial to evaluate the robot's performance, demonstrating the harsh environment in which the robot will actually be deployed. Repeatable experiments in a controlled testing environment that can reproduce various terrain and gravitational conditions are essential. This paper presents the development of a minimal and space-…
▽ More
In develo** mobile robots for exploration on the planetary surface, it is crucial to evaluate the robot's performance, demonstrating the harsh environment in which the robot will actually be deployed. Repeatable experiments in a controlled testing environment that can reproduce various terrain and gravitational conditions are essential. This paper presents the development of a minimal and space-saving indoor testbed, which can simulate steep slopes, uneven terrain, and lower gravity, employing a three-dimensional target tracking mechanism (active xy and passive z) with a counterweight.
△ Less
Submitted 22 October, 2023; v1 submitted 18 September, 2023;
originally announced September 2023.
-
OmniLRS: A Photorealistic Simulator for Lunar Robotics
Authors:
Antoine Richard,
Junnosuke Kamohara,
Kentaro Uno,
Shreya Santra,
Dave van der Meer,
Miguel Olivares-Mendez,
Kazuya Yoshida
Abstract:
Develo** algorithms for extra-terrestrial robotic exploration has always been challenging. Along with the complexity associated with these environments, one of the main issues remains the evaluation of said algorithms. With the regained interest in lunar exploration, there is also a demand for quality simulators that will enable the development of lunar robots. % In this paper, we explain how we…
▽ More
Develo** algorithms for extra-terrestrial robotic exploration has always been challenging. Along with the complexity associated with these environments, one of the main issues remains the evaluation of said algorithms. With the regained interest in lunar exploration, there is also a demand for quality simulators that will enable the development of lunar robots. % In this paper, we explain how we built a Lunar simulator based on Isaac Sim, Nvidia's robotic simulator. In this paper, we propose Omniverse Lunar Robotic-Sim (OmniLRS) that is a photorealistic Lunar simulator based on Nvidia's robotic simulator. This simulation provides fast procedural environment generation, multi-robot capabilities, along with synthetic data pipeline for machine-learning applications. It comes with ROS1 and ROS2 bindings to control not only the robots, but also the environments. This work also performs sim-to-real rock instance segmentation to show the effectiveness of our simulator for image-based perception. Trained on our synthetic data, a yolov8 model achieves performance close to a model trained on real-world data, with 5% performance gap. When finetuned with real data, the model achieves 14% higher average precision than the model trained on real-world data, demonstrating our simulator's photorealism.% to realize sim-to-real. The code is fully open-source, accessible here: https://github.com/AntoineRichard/LunarSim, and comes with demonstrations.
△ Less
Submitted 16 September, 2023;
originally announced September 2023.
-
Integration of Vision-based Object Detection and Gras** for Articulated Manipulator in Lunar Conditions
Authors:
Camille Boucher,
Gustavo H. Diaz,
Shreya Santra,
Kentaro Uno,
Kazuya Yoshida
Abstract:
The integration of vision-based frameworks to achieve lunar robot applications faces numerous challenges such as terrain configuration or extreme lighting conditions. This paper presents a generic task pipeline using object detection, instance segmentation and grasp detection, that can be used for various applications by using the results of these vision-based systems in a different way. We achiev…
▽ More
The integration of vision-based frameworks to achieve lunar robot applications faces numerous challenges such as terrain configuration or extreme lighting conditions. This paper presents a generic task pipeline using object detection, instance segmentation and grasp detection, that can be used for various applications by using the results of these vision-based systems in a different way. We achieve a rock stacking task on a non-flat surface in difficult lighting conditions with a very good success rate of 92%. Eventually, we present an experiment to assemble 3D printed robot components to initiate more complex tasks in the future.
△ Less
Submitted 2 September, 2023;
originally announced September 2023.
-
Enabling Faster Locomotion of Planetary Rovers with a Mechanically-Hybrid Suspension
Authors:
David Rodríguez-Martínez,
Kentaro Uno,
Kenta Sawa,
Masahiro Uda,
Gen Kudo,
Gustavo Hernan Diaz,
Ayumi Umemura,
Shreya Santra,
Kazuya Yoshida
Abstract:
The exploration of the lunar poles and the collection of samples from the martian surface are characterized by shorter time windows demanding increased autonomy and speeds. Autonomous mobile robots must intrinsically cope with a wider range of disturbances. Faster off-road navigation has been explored for terrestrial applications but the combined effects of increased speeds and reduced gravity fie…
▽ More
The exploration of the lunar poles and the collection of samples from the martian surface are characterized by shorter time windows demanding increased autonomy and speeds. Autonomous mobile robots must intrinsically cope with a wider range of disturbances. Faster off-road navigation has been explored for terrestrial applications but the combined effects of increased speeds and reduced gravity fields are yet to be fully studied. In this paper, we design and demonstrate a novel fully passive suspension design for wheeled planetary robots, which couples for the first time a high-range passive rocker with elastic in-wheel coil-over shock absorbers. The design was initially conceived and verified in a reduced-gravity (1.625 m/s${^2}$) simulated environment, where three different passive suspension configurations were evaluated against steep slopes and unexpected obstacles, and later prototyped and validated in a series of field tests. The proposed mechanically-hybrid suspension proves to mitigate more effectively the negative effects (high-frequency/high-amplitude vibrations and impact loads) of faster locomotion (~1\,m/s) over unstructured terrains under varied gravity fields.
△ Less
Submitted 23 November, 2023; v1 submitted 10 July, 2023;
originally announced July 2023.
-
Mobility Strategy of Multi-Limbed Climbing Robots for Asteroid Exploration
Authors:
Warley F. R. Ribeiro,
Kentaro Uno,
Masazumi Imai,
Koki Murase,
Barış Can Yalçın,
Matteo El Hariry,
Miguel A. Olivares-Mendez,
Kazuya Yoshida
Abstract:
Mobility on asteroids by multi-limbed climbing robots is expected to achieve our exploration goals in such challenging environments. We propose a mobility strategy to improve the locomotion safety of climbing robots in such harsh environments that picture extremely low gravity and highly uneven terrain. Our method plans the gait by decoupling the base and limbs' movements and adjusting the main bo…
▽ More
Mobility on asteroids by multi-limbed climbing robots is expected to achieve our exploration goals in such challenging environments. We propose a mobility strategy to improve the locomotion safety of climbing robots in such harsh environments that picture extremely low gravity and highly uneven terrain. Our method plans the gait by decoupling the base and limbs' movements and adjusting the main body pose to avoid ground collisions. The proposed approach includes a motion planning that reduces the reactions generated by the robot's movement by optimizing the swinging trajectory and distributing the momentum. Lower motion reactions decrease the pulling forces on the grippers, avoiding the slippage and flotation of the robot. Dynamic simulations and experiments demonstrate that the proposed method could improve the robot's mobility on the surface of asteroids.
△ Less
Submitted 22 June, 2023; v1 submitted 13 June, 2023;
originally announced June 2023.
-
The effects of increasing velocity on the tractive performance of planetary rovers
Authors:
David Rodríguez-Martínez,
Fabian Buse,
Michel Van Winnendael,
Kazuya Yoshida
Abstract:
An emerging paradigm is being embraced in the conceptualization of future planetary exploration missions. Ambitious objectives and increasingly demanding mission constraints stress the importance associated with faster surface mobility. Driving speeds approaching or surpassing 1 m/s have been rarely used and their effect on performance is today unclear. This study presents experimental evidence an…
▽ More
An emerging paradigm is being embraced in the conceptualization of future planetary exploration missions. Ambitious objectives and increasingly demanding mission constraints stress the importance associated with faster surface mobility. Driving speeds approaching or surpassing 1 m/s have been rarely used and their effect on performance is today unclear. This study presents experimental evidence and preliminary observations on the impact that increasing velocity has on the tractive performance of planetary rovers. Single-wheel driving tests were conducted using two different metallic, grousered wheels-one rigid and one flexible-over two different soils, olivine sand and CaCO3-based silty soil. Experiments were conducted at speeds between 0.01-1 m/s throughout an ample range of slip ratios (5-90%). Three performance metrics were evaluated: drawbar pull coefficient, wheel sinkage, and tractive efficiency. Results showed similar data trends among all the cases investigated. Drawbar pull and tractive efficiency considerably decreased for speeds beyond 0.2 m/s. Wheel sinkage, unlike what published evidence suggested, increased with increasing velocities. The flexible wheel performed the best at 1m/s, exhibiting 2 times higher drawbar pull and efficiency with 18% lower sinkage under low slip conditions. Although similar data trends were obtained, a different wheel-soil interactive behavior was observed when driving over the different soils. Overall, despite the performance reduction experienced at higher velocities, a speed in the range of 0.2-0.3 m/s would enable 5-10 times faster traverses, compared to current rovers driving capability, while only diminishing drawbar pull and efficiency by 7%. The measurements collected and the analysis presented here lay the groundwork for initial stages in the development of new locomotion subsystems for planetary surface exploration. At the same time...
△ Less
Submitted 3 June, 2023;
originally announced June 2023.
-
Exploring Human Response Times to Combinations of Audio, Haptic, and Visual Stimuli from a Mobile Device
Authors:
Kyle T. Yoshida,
Joel X. Kiernan,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Auditory, haptic, and visual stimuli provide alerts, notifications, and information for a wide variety of applications ranging from virtual reality to wearable and hand-held devices. Response times to these stimuli have been used to assess motor control and design human-computer interaction systems. In this study, we investigate human response times to 26 combinations of auditory, haptic, and visu…
▽ More
Auditory, haptic, and visual stimuli provide alerts, notifications, and information for a wide variety of applications ranging from virtual reality to wearable and hand-held devices. Response times to these stimuli have been used to assess motor control and design human-computer interaction systems. In this study, we investigate human response times to 26 combinations of auditory, haptic, and visual stimuli at three levels (high, low, and off). We developed an iOS app that presents these stimuli in random intervals and records response times on an iPhone 11. We conducted a user study with 20 participants and found that response time decreased with more types and higher levels of stimuli. The low visual condition had the slowest mean response time (mean +/- standard deviation, 528 +/- 105 ms) and the condition with high levels of audio, haptic, and visual stimuli had the fastest mean response time (320 +/- 43 ms). This work quantifies response times to multi-modal stimuli, identifies interactions between different stimuli types and levels, and introduces an app-based method that can be widely distributed to measure response time. Understanding preferences and response times for stimuli can provide insight into designing devices for human-machine interaction.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Cognitive and Physical Activities Impair Perception of Smartphone Vibrations
Authors:
Kyle T. Yoshida,
Joel X. Kiernan,
Rachel A. G. Adenekan,
Steven H. Trinh,
Alexis J. Lowber,
Allison M. Okamura,
Cara M. Nunez
Abstract:
Vibration feedback is common in everyday devices, from virtual reality systems to smartphones. However, cognitive and physical activities may impede our ability to sense vibrations from devices. In this study, we develop and characterize a smartphone platform to investigate how a shape-memory task (cognitive activity) and walking (physical activity) impair human perception of smartphone vibrations…
▽ More
Vibration feedback is common in everyday devices, from virtual reality systems to smartphones. However, cognitive and physical activities may impede our ability to sense vibrations from devices. In this study, we develop and characterize a smartphone platform to investigate how a shape-memory task (cognitive activity) and walking (physical activity) impair human perception of smartphone vibrations. We measured how Apple's Core Haptics Framework parameters can be used for haptics research, namely how hapticIntensity modulates amplitudes of 230 Hz vibrations. A 23-person user study found that physical (p<0.001) and cognitive (p=0.004) activity increase vibration perception thresholds. Cognitive activity also increases vibration response time (p<0.001). This work also introduces a smartphone platform that can be used for out-of-lab vibration perception testing. Researchers can use our smartphone platform and results to design better haptic devices for diverse, unique populations.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
RAMP: Reaction-Aware Motion Planning of Multi-Legged Robots for Locomotion in Microgravity
Authors:
Warley F. R. Ribeiro,
Kentaro Uno,
Masazumi Imai,
Koki Murase,
Kazuya Yoshida
Abstract:
Robotic mobility in microgravity is necessary to expand human utilization and exploration of outer space. Bio-inspired multi-legged robots are a possible solution for safe and precise locomotion. However, a dynamic motion of a robot in microgravity can lead to failures due to gripper detachment caused by excessive motion reactions. We propose a novel Reaction-Aware Motion Planning (RAMP) to improv…
▽ More
Robotic mobility in microgravity is necessary to expand human utilization and exploration of outer space. Bio-inspired multi-legged robots are a possible solution for safe and precise locomotion. However, a dynamic motion of a robot in microgravity can lead to failures due to gripper detachment caused by excessive motion reactions. We propose a novel Reaction-Aware Motion Planning (RAMP) to improve locomotion safety in microgravity, decreasing the risk of losing contact with the terrain surface by reducing the robot's momentum change. RAMP minimizes the swing momentum with a Low-Reaction Swing Trajectory (LRST) while distributing this momentum to the whole body, ensuring zero velocity for the supporting grippers and minimizing motion reactions. We verify the proposed approach with dynamic simulations indicating the capability of RAMP to generate a safe motion without detachment of the supporting grippers, resulting in the robot reaching its specified location. We further validate RAMP in experiments with an air-floating system, demonstrating a significant reduction in reaction forces and improved mobility in microgravity.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
-
Deep Learning Classification of Touch Gestures Using Distributed Normal and Shear Force
Authors:
Hojung Choi,
Dane Brouwer,
Michael A. Lin,
Kyle T. Yoshida,
Carine Rognon,
Benjamin Stephens-Fripp,
Allison M. Okamura,
Mark R. Cutkosky
Abstract:
When humans socially interact with another agent (e.g., human, pet, or robot) through touch, they do so by applying varying amounts of force with different directions, locations, contact areas, and durations. While previous work on touch gesture recognition has focused on the spatio-temporal distribution of normal forces, we hypothesize that the addition of shear forces will permit more reliable c…
▽ More
When humans socially interact with another agent (e.g., human, pet, or robot) through touch, they do so by applying varying amounts of force with different directions, locations, contact areas, and durations. While previous work on touch gesture recognition has focused on the spatio-temporal distribution of normal forces, we hypothesize that the addition of shear forces will permit more reliable classification. We present a soft, flexible skin with an array of tri-axial tactile sensors for the arm of a person or robot. We use it to collect data on 13 touch gesture classes through user studies and train a Convolutional Neural Network (CNN) to learn spatio-temporal features from the recorded data. The network achieved a recognition accuracy of 74% with normal and shear data, compared to 66% using only normal force data. Adding distributed shear data improved classification accuracy for 11 out of 13 touch gesture classes.
△ Less
Submitted 30 September, 2022;
originally announced October 2022.
-
Feasibility of Smartphone Vibrations as a Sensory Diagnostic Tool
Authors:
Rachel A. G. Adenekan,
Alexis J. Lowber,
Bryce N. Huerta,
Allison M. Okamura,
Kyle T. Yoshida,
Cara M. Nunez
Abstract:
Traditionally, clinicians use tuning forks as a binary measure to assess vibrotactile sensory perception. This approach has low measurement resolution, and the vibrations are highly variable. Therefore, we propose using vibrations from a smartphone to deliver a consistent and precise sensory test. First, we demonstrate that a smartphone has more consistent vibrations compared to a tuning fork. The…
▽ More
Traditionally, clinicians use tuning forks as a binary measure to assess vibrotactile sensory perception. This approach has low measurement resolution, and the vibrations are highly variable. Therefore, we propose using vibrations from a smartphone to deliver a consistent and precise sensory test. First, we demonstrate that a smartphone has more consistent vibrations compared to a tuning fork. Then we develop an app and conduct a validation study to show that the smartphone can precisely measure a user's absolute threshold. This finding motivates future work to use smartphones to assess vibrotactile perception, allowing for increased monitoring and widespread accessibility.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
-
SegVisRL: Visuomotor Development for a Lunar Rover for Hazard Avoidance using Camera Images
Authors:
Tamir Blum,
Gabin Paillet,
Watcharawut Masawat,
Mickael Laine,
Kazuya Yoshida
Abstract:
The visuomotor system of any animal is critical for its survival, and the development of a complex one within humans is large factor in our success as a species on Earth. This system is an essential part of our ability to adapt to our environment. We use this system continuously throughout the day, when picking something up, or walking around while avoiding bum** into objects. Equip** robots w…
▽ More
The visuomotor system of any animal is critical for its survival, and the development of a complex one within humans is large factor in our success as a species on Earth. This system is an essential part of our ability to adapt to our environment. We use this system continuously throughout the day, when picking something up, or walking around while avoiding bum** into objects. Equip** robots with such capabilities will help produce more intelligent locomotion with the ability to more easily understand their surroundings and to move safely. In particular, such capabilities are desirable for traversing the lunar surface, as it is full of hazardous obstacles, such as rocks. These obstacles need to be identified and avoided in real time. This paper seeks to demonstrate the development of a visuomotor system within a robot for navigation and obstacle avoidance, with complex rock shaped objects representing hazards. Our approach uses deep reinforcement learning with only image data. In this paper, we compare the results from several neural network architectures and a preprocessing methodology which includes producing a segmented image and downsampling.
△ Less
Submitted 26 March, 2021;
originally announced March 2021.
-
RL STaR Platform: Reinforcement Learning for Simulation based Training of Robots
Authors:
Tamir Blum,
Gabin Paillet,
Mickael Laine,
Kazuya Yoshida
Abstract:
Reinforcement learning (RL) is a promising field to enhance robotic autonomy and decision making capabilities for space robotics, something which is challenging with traditional techniques due to stochasticity and uncertainty within the environment. RL can be used to enable lunar cave exploration with infrequent human feedback, faster and safer lunar surface locomotion or the coordination and coll…
▽ More
Reinforcement learning (RL) is a promising field to enhance robotic autonomy and decision making capabilities for space robotics, something which is challenging with traditional techniques due to stochasticity and uncertainty within the environment. RL can be used to enable lunar cave exploration with infrequent human feedback, faster and safer lunar surface locomotion or the coordination and collaboration of multi-robot systems. However, there are many hurdles making research challenging for space robotic applications using RL and machine learning, particularly due to insufficient resources for traditional robotics simulators like CoppeliaSim. Our solution to this is an open source modular platform called Reinforcement Learning for Simulation based Training of Robots, or RL STaR, that helps to simplify and accelerate the application of RL to the space robotics research field. This paper introduces the RL STaR platform, and how researchers can use it through a demonstration.
△ Less
Submitted 20 September, 2020;
originally announced September 2020.
-
PPMC RL Training Algorithm: Rough Terrain Intelligent Robots through Reinforcement Learning
Authors:
Tamir Blum,
Kazuya Yoshida
Abstract:
Robots can now learn how to make decisions and control themselves, generalizing learned behaviors to unseen scenarios. In particular, AI powered robots show promise in rough environments like the lunar surface, due to the environmental uncertainties. We address this critical generalization aspect for robot locomotion in rough terrain through a training algorithm we have created called the Path Pla…
▽ More
Robots can now learn how to make decisions and control themselves, generalizing learned behaviors to unseen scenarios. In particular, AI powered robots show promise in rough environments like the lunar surface, due to the environmental uncertainties. We address this critical generalization aspect for robot locomotion in rough terrain through a training algorithm we have created called the Path Planning and Motion Control (PPMC) Training Algorithm. This algorithm is coupled with any generic reinforcement learning algorithm to teach robots how to respond to user commands and to travel to designated locations on a single neural network. In this paper, we show that the algorithm works independent of the robot structure, demonstrating that it works on a wheeled rover in addition the past results on a quadruped walking robot. Further, we take several big steps towards real world practicality by introducing a rough highly uneven terrain. Critically, we show through experiments that the robot learns to generalize to new rough terrain maps, retaining a 100% success rate. To the best of our knowledge, this is the first paper to introduce a generic training algorithm teaching generalized PPMC in rough environments to any robot, with just the use of reinforcement learning.
△ Less
Submitted 13 March, 2020; v1 submitted 2 March, 2020;
originally announced March 2020.
-
Human Interface for Teleoperated Object Manipulation with a Soft Growing Robot
Authors:
Fabio Stroppa,
Ming Luo,
Kyle Yoshida,
Margaret M. Coad,
Laura H. Blumenschein,
Allison M. Okamura
Abstract:
Soft growing robots are proposed for use in applications such as complex manipulation tasks or navigation in disaster scenarios. Safe interaction and ease of production promote the usage of this technology, but soft robots can be challenging to teleoperate due to their unique degrees of freedom. In this paper, we propose a human-centered interface that allows users to teleoperate a soft growing ro…
▽ More
Soft growing robots are proposed for use in applications such as complex manipulation tasks or navigation in disaster scenarios. Safe interaction and ease of production promote the usage of this technology, but soft robots can be challenging to teleoperate due to their unique degrees of freedom. In this paper, we propose a human-centered interface that allows users to teleoperate a soft growing robot for manipulation tasks using arm movements. A study was conducted to assess the intuitiveness of the interface and the performance of our soft robot, involving a pick-and-place manipulation task. The results show that users completed the task with a success rate of 97%, achieving placement errors below 2 cm on average. These results demonstrate that our body-movement-based interface is an effective method for control of a soft growing robot manipulator.
△ Less
Submitted 28 October, 2019;
originally announced October 2019.
-
Deep Learned Path Planning via Randomized Reward-Linked-Goals and Potential Space Applications
Authors:
Tamir Blum,
William Jones,
Kazuya Yoshida
Abstract:
Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well as low-level tasks, like motion control, which are critical components for mission efficiency and success. Using deep reinforcement end-to-end learning with ran…
▽ More
Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well as low-level tasks, like motion control, which are critical components for mission efficiency and success. Using deep reinforcement end-to-end learning with randomized reward function parameters during training, we teach a simulated 8 degree-of-freedom quadruped ant-like robot to travel anywhere within a perimeter, conducting path plan and motion control on a single neural network, without any system model or prior knowledge of the terrain or environment. Our approach also allows for user specified waypoints, which could translate well to either fully autonomous or semi-autonomous/teleoperated space applications that encounter delay times. We trained the agent using randomly generated waypoints linked to the reward function and passed waypoint coordinates as inputs to the neural network. Such applications show promise on a variety of space exploration robots, including high speed rovers for fast locomotion and legged cave robots for rough terrain.
△ Less
Submitted 13 September, 2019;
originally announced September 2019.
-
Adversarial Image Translation: Unrestricted Adversarial Examples in Face Recognition Systems
Authors:
Kazuya Kakizaki,
Kosuke Yoshida
Abstract:
Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial examples, raising concerns about the robustness of such systems. Adversarial examples that are not restricted to small perturbations could be more serious since co…
▽ More
Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial examples, raising concerns about the robustness of such systems. Adversarial examples that are not restricted to small perturbations could be more serious since conventional certified defenses might be ineffective against them. To shed light on the vulnerability to such adversarial examples, we propose a flexible and efficient method for generating unrestricted adversarial examples using image translation techniques. Our method enables us to translate a source image into any desired facial appearance with large perturbations to deceive target face recognition systems. Our experimental results indicate that our method achieved about $90$ and $80\%$ attack success rates under white- and black-box settings, respectively, and that the translated images are perceptually realistic and maintain the identifiability of the individual while the perturbations are large enough to bypass certified defenses.
△ Less
Submitted 28 January, 2020; v1 submitted 8 May, 2019;
originally announced May 2019.
-
Neural Joking Machine : Humorous image captioning
Authors:
Kota Yoshida,
Munetaka Minoguchi,
Kenichiro Wani,
Akio Nakamura,
Hirokatsu Kataoka
Abstract:
What is an effective expression that draws laughter from human beings? In the present paper, in order to consider this question from an academic standpoint, we generate an image caption that draws a "laugh" by a computer. A system that outputs funny captions based on the image caption proposed in the computer vision field is constructed. Moreover, we also propose the Funny Score, which flexibly gi…
▽ More
What is an effective expression that draws laughter from human beings? In the present paper, in order to consider this question from an academic standpoint, we generate an image caption that draws a "laugh" by a computer. A system that outputs funny captions based on the image caption proposed in the computer vision field is constructed. Moreover, we also propose the Funny Score, which flexibly gives weights according to an evaluation database. The Funny Score more effectively brings out "laughter" to optimize a model. In addition, we build a self-collected BoketeDB, which contains a theme (image) and funny caption (text) posted on "Bokete", which is an image Ogiri website. In an experiment, we use BoketeDB to verify the effectiveness of the proposed method by comparing the results obtained using the proposed method and those obtained using MS COCO Pre-trained CNN+LSTM, which is the baseline and idiot created by humans. We refer to the proposed method, which uses the BoketeDB pre-trained model, as the Neural Joking Machine (NJM).
△ Less
Submitted 30 May, 2018;
originally announced May 2018.
-
Artificial Wrestling: A Dynamical Formulation of Autonomous Agents Fighting in a Coupled Inverted Pendula Framework
Authors:
Katsutoshi Yoshida,
Shigeki Matsumoto,
Yoichi Matsue
Abstract:
We develop autonomous agents fighting with each other, inspired by human wrestling. For this purpose, we propose a coupled inverted pendula (CIP) framework in which: 1) tips of two inverted pendulums are linked by a connection rod, 2) each pendulum is primarily stabilized by a PD-controller, 3) and is additionally equipped with an intelligent controller. Based on this framework, we dynamically for…
▽ More
We develop autonomous agents fighting with each other, inspired by human wrestling. For this purpose, we propose a coupled inverted pendula (CIP) framework in which: 1) tips of two inverted pendulums are linked by a connection rod, 2) each pendulum is primarily stabilized by a PD-controller, 3) and is additionally equipped with an intelligent controller. Based on this framework, we dynamically formulate an intelligent controller designed to store dynamical correspondence from initial states to final states of the CIP model, to receive state vectors of the model, and to output impulsive control forces to produce desired final states of the model. Develo** a quantized and reduced order design of this controller, we have a practical control procedure based on an off-line learning method. We then conduct numerical simulations to investigate individual performance of the intelligent controller, showing that the performance can be improved by adding a delay element into the intelligent controller. The result shows that the performance depends not only on quantization resolutions of learning data but also on delay time of the delay element. Finally, we install the intelligent controllers into both pendulums in the proposed framework to demonstrate autonomous competitive behavior between inverted pendulums.
△ Less
Submitted 19 October, 2015; v1 submitted 28 May, 2014;
originally announced May 2014.
-
Effects of Mechanical Coupling on the Dynamics of Balancing Tasks
Authors:
Katsutoshi Yoshida,
Atsushi Higeta,
Shinichi Watanabe
Abstract:
Coupled human balancing tasks are investigated based on both pseudo-neural controllers characterized by time-delayed feedback with random gain and natural human balancing tasks. It is shown numerically that, compared to single balancing tasks, balancing tasks coupled by mechanical structures exhibit enhanced stability against balancing errors in terms of both amplitude and velocity and also improv…
▽ More
Coupled human balancing tasks are investigated based on both pseudo-neural controllers characterized by time-delayed feedback with random gain and natural human balancing tasks. It is shown numerically that, compared to single balancing tasks, balancing tasks coupled by mechanical structures exhibit enhanced stability against balancing errors in terms of both amplitude and velocity and also improve the tracking ability of the controllers. We then perform an experiment in which numerical pseudo-neural controllers are replaced with natural human balancing tasks carried out using computer mice. The results reveal that the coupling structure generates asymmetric tracking abilities in subjects whose tracking abilities are nearly symmetric in their single balancing tasks.
△ Less
Submitted 4 July, 2010; v1 submitted 3 September, 2009;
originally announced September 2009.
