-
Robotic Test Tube Rearrangement Using Combined Reinforcement Learning and Motion Planning
Authors:
Hao Chen,
Weiwei Wan,
Masaki Matsushita,
Takeyuki Kotaka,
Kensuke Harada
Abstract:
A combined task-level reinforcement learning and motion planning framework is proposed in this paper to address a multi-class in-rack test tube rearrangement problem. At the task level, the framework uses reinforcement learning to infer a sequence of swap actions while ignoring robotic motion details. At the motion level, the framework accepts the swap** action sequences inferred by task-level a…
▽ More
A combined task-level reinforcement learning and motion planning framework is proposed in this paper to address a multi-class in-rack test tube rearrangement problem. At the task level, the framework uses reinforcement learning to infer a sequence of swap actions while ignoring robotic motion details. At the motion level, the framework accepts the swap** action sequences inferred by task-level agents and plans the detailed robotic pick-and-place motion. The task and motion-level planning form a closed loop with the help of a condition set maintained for each rack slot, which allows the framework to perform replanning and effectively find solutions in the presence of low-level failures. Particularly for reinforcement learning, the framework leverages a distributed deep Q-learning structure with the Dueling Double Deep Q Network (D3QN) to acquire near-optimal policies and uses an A${}^\star$-based post-processing technique to amplify the collected training data. The D3QN and distributed learning help increase training efficiency. The post-processing helps complete unfinished action sequences and remove redundancy, thus making the training data more effective. We carry out both simulations and real-world studies to understand the performance of the proposed framework. The results verify the performance of the RL and post-processing and show that the closed-loop combination improves robustness. The framework is ready to incorporate various sensory feedback. The real-world studies also demonstrated the incorporation.
△ Less
Submitted 18 January, 2024;
originally announced January 2024.
-
In-Rack Test Tube Pose Estimation Using RGB-D Data
Authors:
Hao Chen,
Weiwei Wan,
Masaki Matsushita,
Takeyuki Kotaka,
Kensuke Harada
Abstract:
Accurate robotic manipulation of test tubes in biology and medical industries is becoming increasingly important to address workforce shortages and improve worker safety. The detection and localization of test tubes are essential for the robots to successfully manipulate test tubes. In this paper, we present a framework to detect and estimate poses for the in-rack test tubes using color and depth…
▽ More
Accurate robotic manipulation of test tubes in biology and medical industries is becoming increasingly important to address workforce shortages and improve worker safety. The detection and localization of test tubes are essential for the robots to successfully manipulate test tubes. In this paper, we present a framework to detect and estimate poses for the in-rack test tubes using color and depth data. The methodology involves the utilization of a YOLO object detector to effectively classify and localize both the test tubes and the tube racks within the provided image data. Subsequently, the pose of the tube rack is estimated through point cloud registration techniques. During the process of estimating the poses of the test tubes, we capitalize on constraints derived from the arrangement of rack slots. By employing an optimization-based algorithm, we effectively evaluate and refine the pose of the test tubes. This strategic approach ensures the robustness of pose estimation, even when confronted with noisy and incomplete point cloud data.
△ Less
Submitted 20 August, 2023;
originally announced August 2023.
-
Automatically Prepare Training Data for YOLO Using Robotic In-Hand Observation and Synthesis
Authors:
Hao Chen,
Weiwei Wan,
Masaki Matsushita,
Takeyuki Kotaka,
Kensuke Harada
Abstract:
Deep learning methods have recently exhibited impressive performance in object detection. However, such methods needed much training data to achieve high recognition accuracy, which was time-consuming and required considerable manual work like labeling images. In this paper, we automatically prepare training data using robots. Considering the low efficiency and high energy consumption in robot mot…
▽ More
Deep learning methods have recently exhibited impressive performance in object detection. However, such methods needed much training data to achieve high recognition accuracy, which was time-consuming and required considerable manual work like labeling images. In this paper, we automatically prepare training data using robots. Considering the low efficiency and high energy consumption in robot motion, we proposed combining robotic in-hand observation and data synthesis to enlarge the limited data set collected by the robot. We first used a robot with a depth sensor to collect images of objects held in the robot's hands and segment the object pictures. Then, we used a copy-paste method to synthesize the segmented objects with rack backgrounds. The collected and synthetic images are combined to train a deep detection neural network. We conducted experiments to compare YOLOv5x detectors trained with images collected using the proposed method and several other methods. The results showed that combined observation and synthetic images led to comparable performance to manual data preparation. They provided a good guide on optimizing data configurations and parameter settings for training detectors. The proposed method required only a single process and was a low-cost way to produce the combined data. Interested readers may find the data sets and trained models from the following GitHub repository: github.com/wrslab/tubedet
△ Less
Submitted 3 January, 2023;
originally announced January 2023.
-
Arranging Test Tubes in Racks Using Combined Task and Motion Planning
Authors:
Weiwei Wan,
Takeyuki Kotaka,
Kensuke Harada
Abstract:
The paper develops a robotic manipulation system to treat the pressing needs for handling a large number of test tubes in clinical examination and replace or reduce human labor. It presents the technical details of the system, which separates and arranges test tubes in racks with the help of 3D vision and artificial intelligence (AI) reasoning/planning. The developed system only requires a person…
▽ More
The paper develops a robotic manipulation system to treat the pressing needs for handling a large number of test tubes in clinical examination and replace or reduce human labor. It presents the technical details of the system, which separates and arranges test tubes in racks with the help of 3D vision and artificial intelligence (AI) reasoning/planning. The developed system only requires a person to put a rack with mixed and non-arranged tubes in front of a robot. The robot autonomously performs recognition, reasoning, planning, manipulation, etc., and returns a rack with separated and arranged tubes. The system is simple-to-use, and there are no requests for expert knowledge in robotics. We expect such a system to play an important role in hel** managing public health and hope similar systems could be extended to other clinical manipulation like handling mixers and pipettes in the future.
△ Less
Submitted 7 May, 2020;
originally announced May 2020.
-
Performance measurement of HARPO: a Time Projection Chamber as a gamma-ray telescope and polarimeter
Authors:
P. Gros,
S. Amano,
D. Attié,
P. Baron,
D. Baudin,
D. Bernard,
P. Bruel,
D. Calvet,
P. Colas,
S. Daté,
A. Delbart,
M. Frotin,
Y. Geerebaert,
B. Giebels,
D. Götz,
S. Hashimoto,
D. Horan,
T. Kotaka,
M. Louzir,
F. Magniette,
Y. Minamiyama,
S. Miyamoto,
H. Ohkuma,
P. Poilleux,
I. Semeniouk
, et al. (5 additional authors not shown)
Abstract:
We analyse the performance of a gas time projection chamber (TPC) as a high-performance gamma-ray telescope and polarimeter in the e$^+$e$^-$ pair creation regime. We use data collected at a gamma-ray beam of known polarisation. The TPC provides two orthogonal projections $(x,z)$ and $(y,z)$ of the tracks induced by each conversion in the gas volume. We use a simple vertex finder in which vertices…
▽ More
We analyse the performance of a gas time projection chamber (TPC) as a high-performance gamma-ray telescope and polarimeter in the e$^+$e$^-$ pair creation regime. We use data collected at a gamma-ray beam of known polarisation. The TPC provides two orthogonal projections $(x,z)$ and $(y,z)$ of the tracks induced by each conversion in the gas volume. We use a simple vertex finder in which vertices and pseudo-tracks exiting from them are identified.
We study the various contributions to the single-photon angular resolution using Monte Carlo simulations and compare them with the experimental data and find that they are in excellent agreement. The distribution of the azimutal angle of pair conversions shows a bias due to the non-cylindrical-symmetric structure of the detector. This bias would average out for a long duration exposure on a space mission, but for this pencil-beam characterisation we have ensured its accurate simulation by a double systematics control scheme, data taking with the detector rotated at several angles with respect to the beam polarisation direction and systematics control with a non-polarised beam.
We measure, for the first time, the polarisation asymmetry of a linearly polarised gamma-ray beam in the low energy pair creation regime. This sub-GeV energy range is critical for cosmic sources as their spectra are power laws which fall quickly as a function of increasing energy.
This work could pave the way to extending polarised gamma-ray astronomy beyond the MeV energy regime.
△ Less
Submitted 30 August, 2017; v1 submitted 20 June, 2017;
originally announced June 2017.
-
First measurement of polarisation asymmetry of a gamma-ray beam between 1.74 to 74 MeV with the HARPO TPC
Authors:
Philippe Gros,
Sho Amano,
David Attié,
Denis Bernard,
Philippe Bruel,
Denis Calvet,
Paul Colas,
Schin Daté,
Alain Delbart,
Mickael Frotin,
Yannick Geerebaert,
Berrie Giebels,
Diego Götz,
S. Hashimoto,
Deirdr Horan,
T. Kotaka,
Marc Louzir,
Y. Minamiyama,
Shuji Miyamoto,
H. Ohkuma,
Patrick Poilleux,
Igor Semeniouk,
Patrick Sizun,
A. Takemoto,
M. Yamaguchi
, et al. (1 additional authors not shown)
Abstract:
Current $γ$-ray telescopes suffer from a gap in sensitivity in the energy range between 100keV and 100MeV, and no polarisation measurement has ever been done on cosmic sources above 1MeV. Past and present e$^+$e$^-$ pair telescopes are limited at lower energies by the multiple scattering of electrons in passive tungsten converter plates. This results in low angular resolution, and, consequently, a…
▽ More
Current $γ$-ray telescopes suffer from a gap in sensitivity in the energy range between 100keV and 100MeV, and no polarisation measurement has ever been done on cosmic sources above 1MeV. Past and present e$^+$e$^-$ pair telescopes are limited at lower energies by the multiple scattering of electrons in passive tungsten converter plates. This results in low angular resolution, and, consequently, a drop in sensitivity to point sources below 1GeV. The polarisation information, which is carried by the azimuthal angle of the conversion plane, is lost for the same reasons.
HARPO (Hermetic ARgon POlarimeter) is an R\&D program to characterise the operation of a gaseous detector (a Time Projection Chamber or TPC) as a high angular-resolution and sensitivity telescope and polarimeter for $γ$ rays from cosmic sources. It represents a first step towards a future space instrument in the MeV-GeV range.
We built and characterised a 30cm cubic demonstrator [SPIE 91441M], and put it in a polarised $γ$-ray beam at the NewSUBARU accelerator in Japan. Data were taken at photon energies from 1.74MeV to 74MeV, and with different polarisation configurations.
We describe the experimental setup in beam. We then describe the software we developed to reconstruct the photon conversion events, with special focus on low energies. We also describe the thorough simulation of the detector used to compare results. Finally we will present the performance of the detector as extracted from this analysis and preliminary measurements of the polarisation asymmetry.
This beam-test qualification of a gas TPC prototype in a $γ$-ray beam could open the way to high-performance $γ$-ray astronomy and polarimetry in the MeV-GeV energy range in the near future.
△ Less
Submitted 30 June, 2016;
originally announced June 2016.
-
Measurement of 1.7 to 74 MeV polarised gamma rays with the HARPO TPC
Authors:
Y. Geerebaert,
Ph. Gros,
S. Amano,
D. Attié,
D. Bernard,
P. Bruel,
D. Calvet,
P. Colas,
S. Daté,
A. Delbart,
M. Frotin,
B. Giebels,
D. Götz,
S. Hashimoto,
D. Horan,
T. Kotaka,
M. Louzir,
Y. Minamiyama,
S. Miyamoto,
H. Ohkuma,
P. Poilleux,
I. Semeniouk,
P. Sizun,
A. Takemoto,
M. Yamaguchi
, et al. (1 additional authors not shown)
Abstract:
Current γ-ray telescopes based on photon conversions to electron-positron pairs, such as Fermi, use tungsten converters. They suffer of limited angular resolution at low energies, and their sensitivity drops below 1 GeV. The low multiple scattering in a gaseous detector gives access to higher angular resolution in the MeV-GeV range, and to the linear polarisation of the photons through the azimuth…
▽ More
Current γ-ray telescopes based on photon conversions to electron-positron pairs, such as Fermi, use tungsten converters. They suffer of limited angular resolution at low energies, and their sensitivity drops below 1 GeV. The low multiple scattering in a gaseous detector gives access to higher angular resolution in the MeV-GeV range, and to the linear polarisation of the photons through the azimuthal angle of the electron-positron pair.
HARPO is an R&D program to characterise the operation of a TPC (Time Projection Chamber) as a high angular-resolution and sensitivity telescope and polarimeter for γ rays from cosmic sources. It represents a first step towards a future space instrument. A 30 cm cubic TPC demonstrator was built, and filled with 2 bar argon-based gas. It was put in a polarised γ-ray beam at the NewSUBARU accelerator in Japan in November 2014. Data were taken at different photon energies from 1.7 MeV to 74 MeV, and with different polarisation configurations. The electronics setup is described, with an emphasis on the trigger system. The event reconstruction algorithm is quickly described, and preliminary measurements of the polarisation of 11 MeVphotons are shown.
△ Less
Submitted 22 March, 2016;
originally announced March 2016.
-
HARPO: beam characterization of a TPC for gamma-ray polarimetry and high angular-resolution astronomy in the MeV-GeV range
Authors:
Shaobo Wang,
Denis Bernard,
Philippe Bruel,
Mickael Frotin,
Yannick Geerebaert,
Berrie Giebels,
Philippe Gros,
Deirdre Horan,
Marc Louzir,
Patrick Poilleux,
Igor Semeniouk,
David Attié,
Denis Calvet,
Paul Colas,
Alain Delbart,
Patrick Sizun,
Diego Götz,
Sho Amano,
Takuya Kotaka,
Satoshi Hashimoto,
Yasuhito Minamiyama,
Akinori Takemoto,
Masashi Yamaguchi,
Shuji Miyamoto,
Schin Daté
, et al. (1 additional authors not shown)
Abstract:
A time projection chamber (TPC) can be used to measure the polarization of gamma rays with excellent angular precision and sensitivity in the MeV-GeV energy range through the conversion of photons to e+e- pairs. The Hermetic ARgon POlarimeter (HARPO) prototype was built to demonstrate this concept. It was recently tested in the polarized photon beam at the NewSUBARU facility in Japan. We present t…
▽ More
A time projection chamber (TPC) can be used to measure the polarization of gamma rays with excellent angular precision and sensitivity in the MeV-GeV energy range through the conversion of photons to e+e- pairs. The Hermetic ARgon POlarimeter (HARPO) prototype was built to demonstrate this concept. It was recently tested in the polarized photon beam at the NewSUBARU facility in Japan. We present this data-taking run, which demonstrated the excellent performance of the HARPO TPC.
△ Less
Submitted 12 March, 2015;
originally announced March 2015.
