-
Robot Goes Fishing: Rapid, High-Resolution Biological Hotspot Map** in Coral Reefs with Vision-Guided Autonomous Underwater Vehicles
Authors:
Daniel Yang,
Levi Cai,
Stewart Jamieson,
Yogesh Girdhar
Abstract:
Coral reefs are fast-changing and complex ecosystems that are crucial to monitor and study. Biological hotspot detection can help coral reef managers prioritize limited resources for monitoring and intervention tasks. Here, we explore the use of autonomous underwater vehicles (AUVs) with cameras, coupled with visual detectors and photogrammetry, to map and identify these hotspots. This approach ca…
▽ More
Coral reefs are fast-changing and complex ecosystems that are crucial to monitor and study. Biological hotspot detection can help coral reef managers prioritize limited resources for monitoring and intervention tasks. Here, we explore the use of autonomous underwater vehicles (AUVs) with cameras, coupled with visual detectors and photogrammetry, to map and identify these hotspots. This approach can provide high spatial resolution information in fast feedback cycles. To the best of our knowledge, we present one of the first attempts at using an AUV to gather visually-observed, fine-grain biological hotspot maps in concert with topography of a coral reefs. Our hotspot maps correlate with rugosity, an established proxy metric for coral reef biodiversity and abundance, as well as with our visual inspections of the 3D reconstruction. We also investigate issues of scaling this approach when applied to new reefs by using these visual detectors pre-trained on large public datasets.
△ Less
Submitted 1 February, 2024; v1 submitted 3 May, 2023;
originally announced May 2023.
-
DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methods
Authors:
Stewart Jamieson,
Jonathan P. How,
Yogesh Girdhar
Abstract:
Successful applications of complex vision-based behaviours underwater have lagged behind progress in terrestrial and aerial domains. This is largely due to the degraded image quality resulting from the physical phenomena involved in underwater image formation. Spectrally-selective light attenuation drains some colors from underwater images while backscattering adds others, making it challenging to…
▽ More
Successful applications of complex vision-based behaviours underwater have lagged behind progress in terrestrial and aerial domains. This is largely due to the degraded image quality resulting from the physical phenomena involved in underwater image formation. Spectrally-selective light attenuation drains some colors from underwater images while backscattering adds others, making it challenging to perform vision-based tasks underwater. State-of-the-art methods for underwater color correction optimize the parameters of image formation models to restore the full spectrum of color to underwater imagery. However, these methods have high computational complexity that is unfavourable for realtime use by autonomous underwater vehicles (AUVs), as a result of having been primarily designed for offline color correction. Here, we present DeepSeeColor, a novel algorithm that combines a state-of-the-art underwater image formation model with the computational efficiency of deep learning frameworks. In our experiments, we show that DeepSeeColor offers comparable performance to the popular "Sea-Thru" algorithm (Akkaynak & Treibitz, 2019) while being able to rapidly process images at up to 60Hz, thus making it suitable for use onboard AUVs as a preprocessing step to enable more robust vision-based behaviours.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
CUREE: A Curious Underwater Robot for Ecosystem Exploration
Authors:
Yogesh Girdhar,
Nathan McGuire,
Levi Cai,
Stewart Jamieson,
Seth McCammon,
Brian Claus,
John E. San Soucie,
Jessica E. Todd,
T. Aran Mooney
Abstract:
The current approach to exploring and monitoring complex underwater ecosystems, such as coral reefs, is to conduct surveys using diver-held or static cameras, or deploying sensor buoys. These approaches often fail to capture the full variation and complexity of interactions between different reef organisms and their habitat. The CUREE platform presented in this paper provides a unique set of capab…
▽ More
The current approach to exploring and monitoring complex underwater ecosystems, such as coral reefs, is to conduct surveys using diver-held or static cameras, or deploying sensor buoys. These approaches often fail to capture the full variation and complexity of interactions between different reef organisms and their habitat. The CUREE platform presented in this paper provides a unique set of capabilities in the form of robot behaviors and perception algorithms to enable scientists to explore different aspects of an ecosystem. Examples of these capabilities include low-altitude visual surveys, soundscape surveys, habitat characterization, and animal following. We demonstrate these capabilities by describing two field deployments on coral reefs in the US Virgin Islands. In the first deployment, we show that CUREE can identify the preferred habitat type of snap** shrimp in a reef through a combination of a visual survey, habitat characterization, and a soundscape survey. In the second deployment, we demonstrate CUREE's ability to follow arbitrary animals by separately following a barracuda and stingray for several minutes each in midwater and benthic environments, respectively.
△ Less
Submitted 20 April, 2023; v1 submitted 7 March, 2023;
originally announced March 2023.
-
Multi-Robot Distributed Semantic Map** in Unfamiliar Environments through Online Matching of Learned Representations
Authors:
Stewart Jamieson,
Kaveh Fathian,
Kasra Khosoussi,
Jonathan P. How,
Yogesh Girdhar
Abstract:
We present a solution to multi-robot distributed semantic map** of novel and unfamiliar environments. Most state-of-the-art semantic map** systems are based on supervised learning algorithms that cannot classify novel observations online. While unsupervised learning algorithms can invent labels for novel observations, approaches to detect when multiple robots have independently developed their…
▽ More
We present a solution to multi-robot distributed semantic map** of novel and unfamiliar environments. Most state-of-the-art semantic map** systems are based on supervised learning algorithms that cannot classify novel observations online. While unsupervised learning algorithms can invent labels for novel observations, approaches to detect when multiple robots have independently developed their own labels for the same new class are prone to erroneous or inconsistent matches. These issues worsen as the number of robots in the system increases and prevent fusing the local maps produced by each robot into a consistent global map, which is crucial for cooperative planning and joint mission summarization. Our proposed solution overcomes these obstacles by having each robot learn an unsupervised semantic scene model online and use a multiway matching algorithm to identify consistent sets of matches between learned semantic labels belonging to different robots. Compared to the state of the art, the proposed solution produces 20-60% higher quality global maps that do not degrade even as many more local maps are fused.
△ Less
Submitted 27 March, 2021;
originally announced March 2021.
-
Active Reward Learning for Co-Robotic Vision Based Exploration in Bandwidth Limited Environments
Authors:
Stewart Jamieson,
Jonathan P. How,
Yogesh Girdhar
Abstract:
We present a novel POMDP problem formulation for a robot that must autonomously decide where to go to collect new and scientifically relevant images given a limited ability to communicate with its human operator. From this formulation we derive constraints and design principles for the observation model, reward model, and communication strategy of such a robot, exploring techniques to deal with th…
▽ More
We present a novel POMDP problem formulation for a robot that must autonomously decide where to go to collect new and scientifically relevant images given a limited ability to communicate with its human operator. From this formulation we derive constraints and design principles for the observation model, reward model, and communication strategy of such a robot, exploring techniques to deal with the very high-dimensional observation space and scarcity of relevant training data. We introduce a novel active reward learning strategy based on making queries to help the robot minimize path "regret" online, and evaluate it for suitability in autonomous visual exploration through simulations. We demonstrate that, in some bandwidth-limited environments, this novel regret-based criterion enables the robotic explorer to collect up to 17% more reward per mission than the next-best criterion.
△ Less
Submitted 10 March, 2020;
originally announced March 2020.
-
Streaming Scene Maps for Co-Robotic Exploration in Bandwidth Limited Environments
Authors:
Yogesh Girdhar,
Levi Cai,
Stewart Jamieson,
Nathan McGuire,
Genevieve Flaspohler,
Stefano Suman,
Brian Claus
Abstract:
This paper proposes a bandwidth tunable technique for real-time probabilistic scene modeling and map** to enable co-robotic exploration in communication constrained environments such as the deep sea. The parameters of the system enable the user to characterize the scene complexity represented by the map, which in turn determines the bandwidth requirements. The approach is demonstrated using an u…
▽ More
This paper proposes a bandwidth tunable technique for real-time probabilistic scene modeling and map** to enable co-robotic exploration in communication constrained environments such as the deep sea. The parameters of the system enable the user to characterize the scene complexity represented by the map, which in turn determines the bandwidth requirements. The approach is demonstrated using an underwater robot that learns an unsupervised scene model of the environment and then uses this scene model to communicate the spatial distribution of various high-level semantic scene constructs to a human operator. Preliminary experiments in an artificially constructed tank environment as well as simulated missions over a 10m$\times$10m coral reef using real data show the tunability of the maps to different bandwidth constraints and science interests. To our knowledge this is the first paper to quantify how the free parameters of the unsupervised scene model impact both the scientific utility of and bandwidth required to communicate the resulting scene model.
△ Less
Submitted 7 March, 2019;
originally announced March 2019.
-
High-resolution (p,t) reaction measurements as spectroscopic tests of {\it ab-initio} theory in the mid $pf$-shell
Authors:
K. G. Leach,
J. D. Holt,
P. E. Garrett,
S. R. Stroberg,
G. C. Ball,
P. C. Bender,
V. Bildstein,
A. Diaz Varela,
R. Dunlop,
T. Faestermann,
B. Hadinia,
R. Hertenberger,
D. S. Jamieson,
B. Jigmeddorj,
R. Krücken,
A. T. Laffoley,
A. J. Radich,
E. T. Rand,
C. E. Svensson,
S. Triambak,
H. -F. Wirth
Abstract:
Detailed spectroscopic measurements of excited states in $^{50}$Cr and $^{62}$Zn were performed using 24~MeV (p,t) transfer reactions on $^{52}$Cr and $^{64}$Zn, respectively. In total, forty-five states in $^{50}$Cr and sixty-seven states in $^{62}$Zn were observed up to excitation energies of 5.5~MeV, including several previously unobserved states. These experimental results are compared to {\it…
▽ More
Detailed spectroscopic measurements of excited states in $^{50}$Cr and $^{62}$Zn were performed using 24~MeV (p,t) transfer reactions on $^{52}$Cr and $^{64}$Zn, respectively. In total, forty-five states in $^{50}$Cr and sixty-seven states in $^{62}$Zn were observed up to excitation energies of 5.5~MeV, including several previously unobserved states. These experimental results are compared to {\it ab-initio} shell-model calculations using chiral effective field theory ($χ$-EFT) with the valence-space in-medium similarity renormalization group (VS-IMSRG) method. This comparison demonstrates good agreement in the level orderings with these new theoretical methods, albeit with a slight over binding in the calculations. This work is part of a continued push to benchmark {\it ab-initio} theoretical techniques to nuclear structure data in $0^+\rightarrow0^+$ superallowed Fermi $β$ decay systems.
△ Less
Submitted 28 September, 2018;
originally announced October 2018.
-
The $2_1^+ \to 3_1^+$ gamma width in $^{22}$Na and second class currents
Authors:
S. Triambak,
L. Phuthu,
A. García,
G. C. Harper,
J. N. Orce,
D. A. Short,
S. P. R. Steininger,
A. Diaz Varela,
R. Dunlop,
D. S. Jamieson,
W. A. Richter,
G. C. Ball,
P. E. Garrett,
C. E. Svensson,
C. Wrede
Abstract:
A previous measurement of the $β-γ$ directional coefficient in $^{22}$Na $β$ decay was used to extract recoil-order form factors. The data indicate the requirement of a significant induced-tensor matrix element for the decay.This conclusion largely relies on a Standard-Model-allowed weak magnetism form factor which was determined using an unpublished value of the analog $2_1^+\to3_1^+$ $γ$ branch…
▽ More
A previous measurement of the $β-γ$ directional coefficient in $^{22}$Na $β$ decay was used to extract recoil-order form factors. The data indicate the requirement of a significant induced-tensor matrix element for the decay.This conclusion largely relies on a Standard-Model-allowed weak magnetism form factor which was determined using an unpublished value of the analog $2_1^+\to3_1^+$ $γ$ branch in $^{22}$Na, with the further assumption that the transition is dominated by its isovector $M1$ component. We obtain for the first time an unambiguous determination of the $2_1^+ \to 3_1^+$ branch in $^{22}$Na to be $0.45(8)\%$. Using the Conserved Vector Current (CVC) hypothesis, our branch determines the weak magnetism form factor for $^{22}$Na $β$ decay to be $|b/Ac_1| = 8.7(1.1)$. Together with the $β-γ$ angular correlation coefficient, we obtain a large induced-tensor form factor for the decay that continues to disagree with theoretical predictions. Two plausible explanations are suggested.
△ Less
Submitted 19 January, 2017;
originally announced January 2017.
-
A Search for $0^+$ States in $^{50}$Cr: Implications for the Superallowed $β$-decay of $^{50}$Mn
Authors:
K. G. Leach,
P. E. Garrett,
G. C. Ball,
P. C. Bender,
V. Bildstein,
B. A. Brown,
C. Burbadge,
T. Faestermann,
B. Hadinia,
J. D. Holt,
A. T. Laffoley,
D. S. Jamieson,
B. Jigmeddorj,
A. J. Radich,
E. T. Rand,
S. R. Stroberg,
C. E. Svensson,
I. S. Towner,
H. -F. Wirth
Abstract:
A $^{52}$Cr$(p,t)$$^{50}$Cr two-neutron pickup reaction was performed using the Q3D magnetic spectrograph at the Maier-Leibnitz-Laboratorium in Garching, Germany. Excited states in $^{50}$Cr were observed up to an excitation energy of 5.3 MeV. Despite significantly increased sensitivity and resolution over previous work, no evidence of the previously assigned first excited $0^+$ state was found. A…
▽ More
A $^{52}$Cr$(p,t)$$^{50}$Cr two-neutron pickup reaction was performed using the Q3D magnetic spectrograph at the Maier-Leibnitz-Laboratorium in Garching, Germany. Excited states in $^{50}$Cr were observed up to an excitation energy of 5.3 MeV. Despite significantly increased sensitivity and resolution over previous work, no evidence of the previously assigned first excited $0^+$ state was found. As a result, the $0^+_2$ state is reassigned at an excitation energy of $E_x=3895.0(5)$ keV in $^{50}$Cr. This reassignment directly impacts direct searches for a non-analogue Fermi $β^+$ decay branch in $^{50}$Mn. These results also show better systematic agreement with the theoretical predictions for the $0^+$ state spectrum in $^{50}$Cr using the same formalism as the isospin-symmetry-breaking correction calculations for superallowed nuclei. The experimental data are also compared to $ab$-$initio$ shell-model predictions using the IM-SRG formalism based on $NN$ and $3N$ forces from chiral-EFT in the $pf$-shell for the first time.
△ Less
Submitted 8 July, 2016;
originally announced July 2016.
