Showing 1–13 of 13 results for author: Chen, S W

Spatio-temporal Downscaling Emulator for Regional Climate Models: a Comparative Study

Authors: Luis A. Barboza, Shu Wei Chou Chen, Marcela Alfaro Córdoba, Eric J. Alfaro, Hugo G. Hidalgo

Abstract: Regional Climate Models (RCM) describe the meso scale global atmospheric and oceanic dynamics and serve as dynamical downscaling models. In other words, RCMs use atmospheric and oceanic climate output from General Circulation Models (GCM) to develop a higher resolution climate output. They are computationally demanding and, depending on the application, require several orders of magnitude of compu… ▽ More Regional Climate Models (RCM) describe the meso scale global atmospheric and oceanic dynamics and serve as dynamical downscaling models. In other words, RCMs use atmospheric and oceanic climate output from General Circulation Models (GCM) to develop a higher resolution climate output. They are computationally demanding and, depending on the application, require several orders of magnitude of computer time more than statistical climate downscaling. In this paper we describe how to use a spatio-temporal statistical model with varying coefficients (VC), as a downscaling emulator for a RCM using varying coefficients. In order to estimate the proposed model, two options are compared: INLA, and varycoef. We set up a simulation to compare the performance of both methods for building a statistical downscaling emulator for RCM, and then show that the emulator works properly for NARCCAP data. The results show that the model is able to estimate non-stationary marginal effects, which means that the downscaling output can vary over space. Furthermore, the model has flexibility to estimate the mean of any variable in space and time, and has good prediction results. INLA was the fastest method for all the cases, and the approximation with best accuracy to estimate the different parameters from the model and the posterior distribution of the response variable. △ Less

Submitted 13 March, 2023; v1 submitted 8 June, 2022; originally announced June 2022.

MSC Class: 62P12

Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy

Authors: Xu Liu, Guilherme V. Nardari, Fernando Cladera Ojeda, Yuezhan Tao, Alex Zhou, Thomas Donnelly, Chao Qu, Steven W. Chen, Roseli A. F. Romero, Camillo J. Taylor, Vijay Kumar

Abstract: Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage-efficient, less ambiguous, and more informative, thus facilitating large-scale autonomy and the acquisition of actionable information in highly unstructured, GPS-denied environments. In this letter, we propose an integrated system that can perform large-scale autonomous flights an… ▽ More Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage-efficient, less ambiguous, and more informative, thus facilitating large-scale autonomy and the acquisition of actionable information in highly unstructured, GPS-denied environments. In this letter, we propose an integrated system that can perform large-scale autonomous flights and real-time semantic map** in challenging under-canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. The autonomous navigation module utilizes a multi-level planning and map** framework and computes dynamically feasible trajectories that lead the UAV to build a semantic map of the user-defined region of interest in a computationally and storage efficient manner. A drift-compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability. This leads the UAV to execute its mission accurately and safely at scale. △ Less

Submitted 15 August, 2023; v1 submitted 14 September, 2021; originally announced September 2021.

Comments: Xu Liu and Guilherme V. Nardari contributed equally to this work

Journal ref: IEEE Robotics and Automation Letters ( Volume: 7, Issue: 2, April 2022)

Place Recognition in Forests with Urquhart Tessellations

Authors: Guilherme V. Nardari, Avraham Cohen, Steven W. Chen, Xu Liu, Vaibhav Arcot, Roseli A. F. Romero, Vijay Kumar

Abstract: In this letter, we present a novel descriptor based on Urquhart tessellations derived from the position of trees in a forest. We propose a framework that uses these descriptors to detect previously seen observations and landmark correspondences, even with partial overlap and noise. We run loop closure detection experiments in simulation and real-world data map-merging from different flights of an… ▽ More In this letter, we present a novel descriptor based on Urquhart tessellations derived from the position of trees in a forest. We propose a framework that uses these descriptors to detect previously seen observations and landmark correspondences, even with partial overlap and noise. We run loop closure detection experiments in simulation and real-world data map-merging from different flights of an Unmanned Aerial Vehicle (UAV) in a pine tree forest and show that our method outperforms state-of-the-art approaches in accuracy and robustness. △ Less

Submitted 16 November, 2020; v1 submitted 23 September, 2020; originally announced October 2020.

Comments: 9 pages, 6 Figures

SLOAM: Semantic Lidar Odometry and Map** for Forest Inventory

Authors: Steven W. Chen, Guilherme V. Nardari, Elijah S. Lee, Chao Qu, Xu Liu, Roseli A. F. Romero, Vijay Kumar

Abstract: This paper describes an end-to-end pipeline for tree diameter estimation based on semantic segmentation and lidar odometry and map**. Accurate map** of this type of environment is challenging since the ground and the trees are surrounded by leaves, thorns and vines, and the sensor typically experiences extreme motion. We propose a semantic feature based pose optimization that simultaneously re… ▽ More This paper describes an end-to-end pipeline for tree diameter estimation based on semantic segmentation and lidar odometry and map**. Accurate map** of this type of environment is challenging since the ground and the trees are surrounded by leaves, thorns and vines, and the sensor typically experiences extreme motion. We propose a semantic feature based pose optimization that simultaneously refines the tree models while estimating the robot pose. The pipeline utilizes a custom virtual reality tool for labeling 3D scans that is used to train a semantic segmentation network. The masked point cloud is used to compute a trellis graph that identifies individual instances and extracts relevant features that are used by the SLAM module. We show that traditional lidar and image based methods fail in the forest environment on both Unmanned Aerial Vehicle (UAV) and hand-carry systems, while our method is more robust, scalable, and automatically generates tree diameter estimations. △ Less

Submitted 29 December, 2019; originally announced December 2019.

Comments: 8 pages, 5 figures, IEEE Robotics and Automation Letters

Large Scale Model Predictive Control with Neural Networks and Primal Active Sets

Authors: Steven W. Chen, Tianyu Wang, Nikolay Atanasov, Vijay Kumar, Manfred Morari

Abstract: This work presents an explicit-implicit procedure to compute a model predictive control (MPC) law with guarantees on recursive feasibility and asymptotic stability. The approach combines an offline-trained fully-connected neural network with an online primal active set solver. The neural network provides a control input initialization while the primal active set method ensures recursive feasibilit… ▽ More This work presents an explicit-implicit procedure to compute a model predictive control (MPC) law with guarantees on recursive feasibility and asymptotic stability. The approach combines an offline-trained fully-connected neural network with an online primal active set solver. The neural network provides a control input initialization while the primal active set method ensures recursive feasibility and asymptotic stability. The neural network is trained with a primal-dual loss function, aiming to generate control sequences that are primal feasible and meet a desired level of suboptimality. Since the neural network alone does not guarantee constraint satisfaction, its output is used to warm start the primal active set method online. We demonstrate that this approach scales to large problems with thousands of optimization variables, which are challenging for current approaches. Our method achieves a 2x reduction in online inference time compared to the best method in a benchmark suite of different solver and initialization strategies. △ Less

Submitted 5 July, 2021; v1 submitted 23 October, 2019; originally announced October 2019.

DFuseNet: Deep Fusion of RGB and Sparse Depth Information for Image Guided Dense Depth Completion

Authors: Shreyas S. Shivakumar, Ty Nguyen, Ian D. Miller, Steven W. Chen, Vijay Kumar, Camillo J. Taylor

Abstract: In this paper we propose a convolutional neural network that is designed to upsample a series of sparse range measurements based on the contextual cues gleaned from a high resolution intensity image. Our approach draws inspiration from related work on super-resolution and in-painting. We propose a novel architecture that seeks to pull contextual cues separately from the intensity image and the dep… ▽ More In this paper we propose a convolutional neural network that is designed to upsample a series of sparse range measurements based on the contextual cues gleaned from a high resolution intensity image. Our approach draws inspiration from related work on super-resolution and in-painting. We propose a novel architecture that seeks to pull contextual cues separately from the intensity image and the depth features and then fuse them later in the network. We argue that this approach effectively exploits the relationship between the two modalities and produces accurate results while respecting salient image structures. We present experimental results to demonstrate that our approach is comparable with state of the art methods and generalizes well across multiple datasets. △ Less

Submitted 10 July, 2019; v1 submitted 2 February, 2019; originally announced February 2019.

Comments: 8 pages

Decentralization of Multiagent Policies by Learning What to Communicate

Authors: James Paulos, Steven W. Chen, Daigo Shishika, Vijay Kumar

Abstract: Effective communication is required for teams of robots to solve sophisticated collaborative tasks. In practice it is typical for both the encoding and semantics of communication to be manually defined by an expert; this is true regardless of whether the behaviors themselves are bespoke, optimization based, or learned. We present an agent architecture and training methodology using neural networks… ▽ More Effective communication is required for teams of robots to solve sophisticated collaborative tasks. In practice it is typical for both the encoding and semantics of communication to be manually defined by an expert; this is true regardless of whether the behaviors themselves are bespoke, optimization based, or learned. We present an agent architecture and training methodology using neural networks to learn task-oriented communication semantics based on the example of a communication-unaware expert policy. A perimeter defense game illustrates the system's ability to handle dynamically changing numbers of agents and its graceful degradation in performance as communication constraints are tightened or the expert's observability assumptions are broken. △ Less

Submitted 25 March, 2019; v1 submitted 24 January, 2019; originally announced January 2019.

Comments: 7 pages

Monocular Camera Based Fruit Counting and Map** with Semantic Data Association

Authors: Xu Liu, Steven W. Chen, Chenhao Liu, Shreyas S. Shivakumar, Jnaneshwar Das, Camillo J. Taylor, James Underwood, Vijay Kumar

Abstract: We present a cheap, lightweight, and fast fruit counting pipeline that uses a single monocular camera. Our pipeline that relies only on a monocular camera, achieves counting performance comparable to state-of-the-art fruit counting system that utilizes an expensive sensor suite including LiDAR and GPS/INS on a mango dataset. Our monocular camera pipeline begins with a fruit detection component tha… ▽ More We present a cheap, lightweight, and fast fruit counting pipeline that uses a single monocular camera. Our pipeline that relies only on a monocular camera, achieves counting performance comparable to state-of-the-art fruit counting system that utilizes an expensive sensor suite including LiDAR and GPS/INS on a mango dataset. Our monocular camera pipeline begins with a fruit detection component that uses a deep neural network. It then uses semantic structure from motion (SFM) to convert these detections into fruit counts by estimating landmark locations of the fruit in 3D, and using these landmarks to identify double counting scenarios. There are many benefits of develo** a low cost and lightweight fruit counting system, including applicability to agriculture in develo** countries, where monetary constraints or unstructured environments necessitate cheaper hardware solutions. △ Less

Submitted 18 March, 2019; v1 submitted 4 November, 2018; originally announced November 2018.

Comments: Accepted in IEEE Robotics and Automation Letters (RA-L), 8 pages

Robust Fruit Counting: Combining Deep Learning, Tracking, and Structure from Motion

Authors: Xu Liu, Steven W. Chen, Shreyas Aditya, Nivedha Sivakumar, Sandeep Dcunha, Chao Qu, Camillo J. Taylor, Jnaneshwar Das, Vijay Kumar

Abstract: We present a novel fruit counting pipeline that combines deep segmentation, frame to frame tracking, and 3D localization to accurately count visible fruits across a sequence of images. Our pipeline works on image streams from a monocular camera, both in natural light, as well as with controlled illumination at night. We first train a Fully Convolutional Network (FCN) and segment video frame images… ▽ More We present a novel fruit counting pipeline that combines deep segmentation, frame to frame tracking, and 3D localization to accurately count visible fruits across a sequence of images. Our pipeline works on image streams from a monocular camera, both in natural light, as well as with controlled illumination at night. We first train a Fully Convolutional Network (FCN) and segment video frame images into fruit and non-fruit pixels. We then track fruits across frames using the Hungarian Algorithm where the objective cost is determined from a Kalman Filter corrected Kanade-Lucas-Tomasi (KLT) Tracker. In order to correct the estimated count from tracking process, we combine tracking results with a Structure from Motion (SfM) algorithm to calculate relative 3D locations and size estimates to reject outliers and double counted fruit tracks. We evaluate our algorithm by comparing with ground-truth human-annotated visual counts. Our results demonstrate that our pipeline is able to accurately and reliably count fruits across image sequences, and the correction step can significantly improve the counting accuracy and robustness. Although discussed in the context of fruit counting, our work can extend to detection, tracking, and counting of a variety of other stationary features of interest such as leaf-spots, wilt, and blossom. △ Less

Submitted 2 August, 2018; v1 submitted 1 April, 2018; originally announced April 2018.

Comments: Accepted in IROS 2018 (2018 IEEE/RSJ International Conference on Intelligent Robots and Systems)

Low temperature magnetic properties of Nd2Ru2O7

Authors: S. T. Ku, Dinesh Kumar, M. R. Lees, W-T. Lee, R. Aldus, A. Studer, P. Imperia, S. Asai, T. Masuda, S. W. Chen, J. M. Chen, L. J. Chang

Abstract: We present magnetic susceptibility, heat capacity, and neutron diffraction measurements of polycrystalline Nd2Ru2O7 down to 0.4 K. Three anomalies in the magnetic susceptibility measurements at 146, 21 and 1.8 K are associated with an antiferromagnetic ordering of the Ru4+ moments, a weak ferromagnetic signal attributed to a canting of the Ru4+ and Nd3+ moments, and a long-range-ordering of the Nd… ▽ More We present magnetic susceptibility, heat capacity, and neutron diffraction measurements of polycrystalline Nd2Ru2O7 down to 0.4 K. Three anomalies in the magnetic susceptibility measurements at 146, 21 and 1.8 K are associated with an antiferromagnetic ordering of the Ru4+ moments, a weak ferromagnetic signal attributed to a canting of the Ru4+ and Nd3+ moments, and a long-range-ordering of the Nd3+ moments, respectively. The long-range order of the Nd3+ moments was observed in all the measurements, indicating that the ground state of the compound is not a spin glass. The magnetic entropy of Rln2 accumulated up to 5 K, suggests the Nd3+ has a doublet ground state. Lattice distortions accompany the transitions, as revealed by neutron diffraction measurements, and in agreement with earlier synchrotron x-ray studies. The magnetic moment of the Nd3+ ion at 0.4 K is estimated to be 1.54(2)μB and the magnetic structure is all-in all-out as determined by our neutron diffraction measurements. △ Less

Submitted 20 March, 2018; originally announced March 2018.

Comments: 21 pages, 6 figures

Journal ref: J. Phys.: Condens. Matter 30 (2018) 155601 (11pp)

Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model

Authors: Ty Nguyen, Steven W. Chen, Shreyas S. Shivakumar, Camillo J. Taylor, Vijay Kumar

Abstract: Homography estimation between multiple aerial images can provide relative pose estimation for collaborative autonomous exploration and monitoring. The usage on a robotic system requires a fast and robust homography estimation algorithm. In this study, we propose an unsupervised learning algorithm that trains a Deep Convolutional Neural Network to estimate planar homographies. We compare the propos… ▽ More Homography estimation between multiple aerial images can provide relative pose estimation for collaborative autonomous exploration and monitoring. The usage on a robotic system requires a fast and robust homography estimation algorithm. In this study, we propose an unsupervised learning algorithm that trains a Deep Convolutional Neural Network to estimate planar homographies. We compare the proposed algorithm to traditional feature-based and direct methods, as well as a corresponding supervised learning algorithm. Our empirical results demonstrate that compared to traditional approaches, the unsupervised algorithm achieves faster inference speed, while maintaining comparable or better accuracy and robustness to illumination variation. In addition, on both a synthetic dataset and representative real-world aerial dataset, our unsupervised method has superior adaptability and performance compared to the supervised deep learning method. △ Less

Submitted 20 February, 2018; v1 submitted 12 September, 2017; originally announced September 2017.

Comments: 8 pages, 6 figures

Neural Network Memory Architectures for Autonomous Robot Navigation

Authors: Steven W Chen, Nikolay Atanasov, Arbaaz Khan, Konstantinos Karydis, Daniel D. Lee, Vijay Kumar

Abstract: This paper highlights the significance of including memory structures in neural networks when the latter are used to learn perception-action loops for autonomous robot navigation. Traditional navigation approaches rely on global maps of the environment to overcome cul-de-sacs and plan feasible motions. Yet, maintaining an accurate global map may be challenging in real-world settings. A possible wa… ▽ More This paper highlights the significance of including memory structures in neural networks when the latter are used to learn perception-action loops for autonomous robot navigation. Traditional navigation approaches rely on global maps of the environment to overcome cul-de-sacs and plan feasible motions. Yet, maintaining an accurate global map may be challenging in real-world settings. A possible way to mitigate this limitation is to use learning techniques that forgo hand-engineered map representations and infer appropriate control responses directly from sensed information. An important but unexplored aspect of such approaches is the effect of memory on their performance. This work is a first thorough study of memory structures for deep-neural-network-based robot navigation, and offers novel tools to train such networks from supervision and quantify their ability to generalize to unseen scenarios. We analyze the separation and generalization abilities of feedforward, long short-term memory, and differentiable neural computer networks. We introduce a new method to evaluate the generalization ability by estimating the VC-dimension of networks with a final linear readout layer. We validate that the VC estimates are good predictors of actual test performance. The reported method can be applied to deep learning problems beyond robotics. △ Less

Submitted 22 May, 2017; originally announced May 2017.

Thermodynamic consistency, quark mass scaling, and properties of strange matter

Authors: C. J. Xia, G. X. Peng, S. W. Chen, Z. Y. Lu, J. F. Xu

Abstract: The previous thermodynamic treatment for models with density and/or temperature dependent quark masses is shown to be inconsistent with the requirement of fundamental thermodynamics. We therefore study a fully self-consistent one according to the fundamental differential equation of thermodynamics. After obtaining a new quark mass scaling with the inclusion of both confinement and leading-order pe… ▽ More The previous thermodynamic treatment for models with density and/or temperature dependent quark masses is shown to be inconsistent with the requirement of fundamental thermodynamics. We therefore study a fully self-consistent one according to the fundamental differential equation of thermodynamics. After obtaining a new quark mass scaling with the inclusion of both confinement and leading-order perturbative interactions, we investigate properties of strange quark matter in the fully consistent thermodynamic treatment. It is found that the equation of state become stiffer, and accordingly, the maximum mass of strange stars is as large as about 2 times the solar mass, if strange quark matter is absolutely or metastable. △ Less

Submitted 13 May, 2014; originally announced May 2014.

Journal ref: Phys. Rev. D 89, 105027 (2014)