-
Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making
Authors:
Min Hun Lee,
Chong Jun Chew
Abstract:
Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model instead of achieving human AI complementary performance. In this work, we utilized salient feature explanations along with what-if, counterfactual explanations t…
▽ More
Artificial intelligence (AI) is increasingly being considered to assist human decision-making in high-stake domains (e.g. health). However, researchers have discussed an issue that humans can over-rely on wrong suggestions of the AI model instead of achieving human AI complementary performance. In this work, we utilized salient feature explanations along with what-if, counterfactual explanations to make humans review AI suggestions more analytically to reduce overreliance on AI and explored the effect of these explanations on trust and reliance on AI during clinical decision-making. We conducted an experiment with seven therapists and ten laypersons on the task of assessing post-stroke survivors' quality of motion, and analyzed their performance, agreement level on the task, and reliance on AI without and with two types of AI explanations. Our results showed that the AI model with both salient features and counterfactual explanations assisted therapists and laypersons to improve their performance and agreement level on the task when `right' AI outputs are presented. While both therapists and laypersons over-relied on `wrong' AI outputs, counterfactual explanations assisted both therapists and laypersons to reduce their over-reliance on `wrong' AI outputs by 21\% compared to salient feature explanations. Specifically, laypersons had higher performance degrades by 18.0 f1-score with salient feature explanations and 14.0 f1-score with counterfactual explanations than therapists with performance degrades of 8.6 and 2.8 f1-scores respectively. Our work discusses the potential of counterfactual explanations to better estimate the accuracy of an AI model and reduce over-reliance on `wrong' AI outputs and implications for improving human-AI collaborative decision-making.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
Real-time Digital Double Framework to Predict Collapsible Terrains for Legged Robots
Authors:
Garen Haddeler,
Hari P. Palanivelu,
Yung Chuen Ng,
Fabien Colonnier,
Albertus H. Adiwahono,
Zhibin Li,
Chee-Meng Chew,
Meng Yee,
Chuah
Abstract:
Inspired by the digital twinning systems, a novel real-time digital double framework is developed to enhance robot perception of the terrain conditions. Based on the very same physical model and motion control, this work exploits the use of such simulated digital double synchronized with a real robot to capture and extract discrepancy information between the two systems, which provides high dimens…
▽ More
Inspired by the digital twinning systems, a novel real-time digital double framework is developed to enhance robot perception of the terrain conditions. Based on the very same physical model and motion control, this work exploits the use of such simulated digital double synchronized with a real robot to capture and extract discrepancy information between the two systems, which provides high dimensional cues in multiple physical quantities to represent differences between the modelled and the real world. Soft, non-rigid terrains cause common failures in legged locomotion, whereby visual perception solely is insufficient in estimating such physical properties of terrains. We used digital double to develop the estimation of the collapsibility, which addressed this issue through physical interactions during dynamic walking. The discrepancy in sensory measurements between the real robot and its digital double are used as input of a learning-based algorithm for terrain collapsibility analysis. Although trained only in simulation, the learned model can perform collapsibility estimation successfully in both simulation and real world. Our evaluation of results showed the generalization to different scenarios and the advantages of the digital double to reliably detect nuances in ground conditions.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Traversability analysis with vision and terrain probing for safe legged robot navigation
Authors:
Garen Haddeler,
Meng Yee,
Chuah,
Yangwei You,
Jianle Chan,
Albertus H. Adiwahono,
Wei Yun Yau,
Chee-Meng Chew
Abstract:
Inspired by human behavior when traveling over unknown terrain, this study proposes the use of probing strategies and integrates them into a traversability analysis framework to address safe navigation on unknown rough terrain. Our framework integrates collapsibility information into our existing traversability analysis, as vision and geometric information alone could be misled by unpredictable no…
▽ More
Inspired by human behavior when traveling over unknown terrain, this study proposes the use of probing strategies and integrates them into a traversability analysis framework to address safe navigation on unknown rough terrain. Our framework integrates collapsibility information into our existing traversability analysis, as vision and geometric information alone could be misled by unpredictable non-rigid terrains such as soft soil, bush area, or water puddles. With the new traversability analysis framework, our robot has a more comprehensive assessment of unpredictable terrain, which is critical for its safety in outdoor environments. The pipeline first identifies the terrain's geometric and semantic properties using an RGB-D camera and desired probing locations on questionable terrains. These regions are probed using a force sensor to determine the risk of terrain collapsing when the robot steps over it. This risk is formulated as a collapsibility metric, which estimates an unpredictable region's ground collapsibility. Thereafter, the collapsibility metric, together with geometric and semantic spatial data, is combined and analyzed to produce global and local traversability grid maps. These traversability grid maps tell the robot whether it is safe to step over different regions of the map. The grid maps are then utilized to generate optimal paths for the robot to safely navigate to its goal. Our approach has been successfully verified on a quadrupedal robot in both simulation and real-world experiments.
△ Less
Submitted 1 September, 2022;
originally announced September 2022.
-
Fast Numerical Integration Techniques for 2.5-Dimensional Inverse Problems
Authors:
Mert Hidayetoglu,
Michael Oelze,
Erhan Kudeki,
Weng Cho Chew
Abstract:
Inverse scattering involving microwave and ultrasound waves require numerical solution of nonlinear optimization problem. To alleviate the computational burden of a full three-dimensional (3-D) inverse problem, it is a common practice to approximate the object as two-dimensional (2-D) and treat the transmitter and receiver sensors as 3-D, through a Fourier integration of 2-D modes of scattering. T…
▽ More
Inverse scattering involving microwave and ultrasound waves require numerical solution of nonlinear optimization problem. To alleviate the computational burden of a full three-dimensional (3-D) inverse problem, it is a common practice to approximate the object as two-dimensional (2-D) and treat the transmitter and receiver sensors as 3-D, through a Fourier integration of 2-D modes of scattering. The resulting integral is singular, and hence requires a prohibitively large number of integration points, where each point corresponds to a 2-D solution. To reduce the computational complexity, this paper proposes fast integration approaches by a set of transformations. We model the object in 2-D but the transmit and receiver pairs as 3-D; hence, we term the solution as a 2.5-D inverse problem. Convergence results indicate that the proposed integration techniques have exponential convergence and hence have a reduces the computational complexity to compute 2.5-D Green's function to solve inverse scattering problems.
△ Less
Submitted 12 July, 2022;
originally announced July 2022.
-
An A-Phi Formulation Solver in Electromagnetics Based on Discrete Exterior Calculus
Authors:
Boyuan Zhang,
Dong-Yeop Na,
Dan Jiao,
Weng Cho Chew
Abstract:
An efficient numerical solver for the A-Phi formulation in electromagnetics based on the discrete exterior calculus (DEC) is proposed in this paper. The A-Phi formulation is immune to low-frequency breakdown and ideal for broadband and multi-scale analysis. The generalized Lorenz gauge is used in this paper, which decouples the A equation and the Phi equation. The A-Phi formulation is discretized…
▽ More
An efficient numerical solver for the A-Phi formulation in electromagnetics based on the discrete exterior calculus (DEC) is proposed in this paper. The A-Phi formulation is immune to low-frequency breakdown and ideal for broadband and multi-scale analysis. The generalized Lorenz gauge is used in this paper, which decouples the A equation and the Phi equation. The A-Phi formulation is discretized by using the DEC, which is the discretized version of the exterior calculus in differential geometry. In general, DEC can be viewed as a generalized version of the finite difference method, where Stokes' theorem and Gauss's theorem are naturally preserved. Furthermore, compared with finite difference method, where rectangular grids are applied, DEC can be implemented with unstructured mesh schemes, such as tetrahedral meshes. Thus, the proposed DEC A-Phi solver is inherently stable, free of spurious solutions and can capture highly complex structures efficiently. In this paper, the background knowledge about the A-Phi formulation and DEC is introduced, as well as technical details in implementing the DEC A-Phi solver with different boundary conditions. Numerical examples are provided for validation purposes as well.
△ Less
Submitted 5 July, 2022;
originally announced July 2022.
-
A Versatile Agent for Fast Learning from Human Instructors
Authors:
Yiwen Chen,
Zedong Zhang,
Haofeng Liu,
Jiayi Tan,
Chee-Meng Chew,
Marcelo Ang
Abstract:
In recent years, a myriad of superlative works on intelligent robotics policies have been done, thanks to advances in machine learning. However, inefficiency and lack of transfer ability hindered algorithms from pragmatic applications, especially in human-robot collaboration, when few-shot fast learning and high flexibility become a wherewithal. To surmount this obstacle, we refer to a "Policy Poo…
▽ More
In recent years, a myriad of superlative works on intelligent robotics policies have been done, thanks to advances in machine learning. However, inefficiency and lack of transfer ability hindered algorithms from pragmatic applications, especially in human-robot collaboration, when few-shot fast learning and high flexibility become a wherewithal. To surmount this obstacle, we refer to a "Policy Pool", containing pre-trained skills that can be easily accessed and reused. An agent is employed to govern the "Policy Pool" by unfolding requisite skills in a flexible sequence, contingent on task specific predilection. This predilection can be automatically interpreted from one or few human expert demonstrations. Under this hierarchical setting, our algorithm is able to pick up a sparse-reward, multi-stage knack with only one demonstration in a Mini-Grid environment, showing the potential for instantly mastering complex robotics skills from human instructors. Additionally, the innate quality of our algorithm also allows for lifelong learning, making it a versatile agent.
△ Less
Submitted 22 September, 2022; v1 submitted 1 March, 2022;
originally announced March 2022.
-
PointAtrousGraph: Deep Hierarchical Encoder-Decoder with Point Atrous Convolution for Unorganized 3D Points
Authors:
Liang Pan,
Chee-Meng Chew,
Gim Hee Lee
Abstract:
Motivated by the success of encoding multi-scale contextual information for image analysis, we propose our PointAtrousGraph (PAG) - a deep permutation-invariant hierarchical encoder-decoder for efficiently exploiting multi-scale edge features in point clouds. Our PAG is constructed by several novel modules, such as Point Atrous Convolution (PAC), Edge-preserved Pooling (EP) and Edge-preserved Unpo…
▽ More
Motivated by the success of encoding multi-scale contextual information for image analysis, we propose our PointAtrousGraph (PAG) - a deep permutation-invariant hierarchical encoder-decoder for efficiently exploiting multi-scale edge features in point clouds. Our PAG is constructed by several novel modules, such as Point Atrous Convolution (PAC), Edge-preserved Pooling (EP) and Edge-preserved Unpooling (EU). Similar with atrous convolution, our PAC can effectively enlarge receptive fields of filters and thus densely learn multi-scale point features. Following the idea of non-overlap** max-pooling operations, we propose our EP to preserve critical edge features during subsampling. Correspondingly, our EU modules gradually recover spatial information for edge features. In addition, we introduce chained skip subsampling/upsampling modules that directly propagate edge features to the final stage. Particularly, our proposed auxiliary loss functions can further improve our performance. Experimental results show that our PAG outperform previous state-of-the-art methods on various 3D semantic perception applications.
△ Less
Submitted 13 September, 2019; v1 submitted 23 July, 2019;
originally announced July 2019.
-
Pixel and Feature Level Based Domain Adaption for Object Detection in Autonomous Driving
Authors:
Yuhu Shan,
Wen Feng Lu,
Chee Meng Chew
Abstract:
Annotating large scale datasets to train modern convolutional neural networks is prohibitively expensive and time-consuming for many real tasks. One alternative is to train the model on labeled synthetic datasets and apply it in the real scenes. However, this straightforward method often fails to generalize well mainly due to the domain bias between the synthetic and real datasets. Many unsupervis…
▽ More
Annotating large scale datasets to train modern convolutional neural networks is prohibitively expensive and time-consuming for many real tasks. One alternative is to train the model on labeled synthetic datasets and apply it in the real scenes. However, this straightforward method often fails to generalize well mainly due to the domain bias between the synthetic and real datasets. Many unsupervised domain adaptation (UDA) methods are introduced to address this problem but most of them only focus on the simple classification task. In this paper, we present a novel UDA model to solve the more complex object detection problem in the context of autonomous driving. Our model integrates both pixel level and feature level based transformtions to fulfill the cross domain detection task and can be further trained end-to-end to pursue better performance. We employ objectives of the generative adversarial network and the cycle consistency loss for image translation in the pixel space. To address the potential semantic inconsistency problem, we propose region proposal based feature adversarial training to preserve the semantics of our target objects as well as further minimize the domain shifts. Extensive experiments are conducted on several different datasets, and the results demonstrate the robustness and superiority of our method.
△ Less
Submitted 11 August, 2019; v1 submitted 30 September, 2018;
originally announced October 2018.
-
Object Detection and Motion Planning for Automated Welding of Tubular Joints
Authors:
Syeda Mariam Ahmed,
Yan Zhi Tan,
Gim Hee Lee,
Chee Meng Chew,
Chee Khiang Pang
Abstract:
Automatic welding of tubular TKY joints is an important and challenging task for the marine and offshore industry. In this paper, a framework for tubular joint detection and motion planning is proposed. The pose of the real tubular joint is detected using RGB-D sensors, which is used to obtain a real-to-virtual map** for positioning the workpiece in a virtual environment. For motion planning, a…
▽ More
Automatic welding of tubular TKY joints is an important and challenging task for the marine and offshore industry. In this paper, a framework for tubular joint detection and motion planning is proposed. The pose of the real tubular joint is detected using RGB-D sensors, which is used to obtain a real-to-virtual map** for positioning the workpiece in a virtual environment. For motion planning, a Bi-directional Transition based Rapidly exploring Random Tree (BiTRRT) algorithm is used to generate trajectories for reaching the desired goals. The complete framework is verified with experiments, and the results show that the robot welding torch is able to transit without collision to desired goals which are close to the tubular joint.
△ Less
Submitted 27 September, 2018;
originally announced September 2018.
-
Edge and Corner Detection for Unorganized 3D Point Clouds with Application to Robotic Welding
Authors:
Syeda Mariam Ahmed,
Yan Zhi Tan,
Chee Meng Chew,
Abdullah Al Mamun,
Fook Seng Wong
Abstract:
In this paper, we propose novel edge and corner detection algorithms for unorganized point clouds. Our edge detection method evaluates symmetry in a local neighborhood and uses an adaptive density based threshold to differentiate 3D edge points. We extend this algorithm to propose a novel corner detector that clusters curvature vectors and uses their geometrical statistics to classify a point as c…
▽ More
In this paper, we propose novel edge and corner detection algorithms for unorganized point clouds. Our edge detection method evaluates symmetry in a local neighborhood and uses an adaptive density based threshold to differentiate 3D edge points. We extend this algorithm to propose a novel corner detector that clusters curvature vectors and uses their geometrical statistics to classify a point as corner. We perform rigorous evaluation of the algorithms on RGB-D semantic segmentation and 3D washer models from the ShapeNet dataset and report higher precision and recall scores. Finally, we also demonstrate how our edge and corner detectors can be used as a novel approach towards automatic weld seam detection for robotic welding. We propose to generate weld seams directly from a point cloud as opposed to using 3D models for offline planning of welding paths. For this application, we show a comparison between Harris 3D and our proposed approach on a panel workpiece.
△ Less
Submitted 27 September, 2018;
originally announced September 2018.
-
Smooth and Efficient Policy Exploration for Robot Trajectory Learning
Authors:
Shidi Li,
Chee-Meng Chew,
Velusamy Subramaniam
Abstract:
Many policy search algorithms have been proposed for robot learning and proved to be practical in real robot applications. However, there are still hyperparameters in the algorithms, such as the exploration rate, which requires manual tuning. The existing methods to design the exploration rate manually or automatically may not be general enough or hard to apply in the real robot. In this paper, we…
▽ More
Many policy search algorithms have been proposed for robot learning and proved to be practical in real robot applications. However, there are still hyperparameters in the algorithms, such as the exploration rate, which requires manual tuning. The existing methods to design the exploration rate manually or automatically may not be general enough or hard to apply in the real robot. In this paper, we propose a learning model to update the exploration rate adaptively. The overall algorithm is a combination of methods proposed by other researchers. Smooth trajectories for the robot can be produced by the algorithm and the updated exploration rate maximizes the lower bound of the expected return. Our method is tested in the ball-in-cup problem. The results show that our method can receive the same learning outcome as the previous methods but with fewer iterations.
△ Less
Submitted 9 August, 2018; v1 submitted 13 April, 2018;
originally announced April 2018.
-
An Adaptive Sampling Approach to 3D Reconstruction of Weld Joint
Authors:
Soheil Keshmiri,
Syeda Mariam Ahmed,
Yue Wu,
Chee Meng Chew,
Chee Khiang Pang
Abstract:
We present an adaptive sampling approach to 3D reconstruction of the welding joint using the point cloud that is generated by a laser sensor. We start with a randomized strategy to approximate the surface of the volume of interest through selection of a number of pivotal candidates. Furthermore, we introduce three proposal distributions over the neighborhood of each of these pivots to adaptively s…
▽ More
We present an adaptive sampling approach to 3D reconstruction of the welding joint using the point cloud that is generated by a laser sensor. We start with a randomized strategy to approximate the surface of the volume of interest through selection of a number of pivotal candidates. Furthermore, we introduce three proposal distributions over the neighborhood of each of these pivots to adaptively sample from their neighbors to refine the original randomized approximation to incrementally reconstruct this welding space. We prevent our algorithm from being trapped in a neighborhood via permanently labeling the visited samples. In addition, we accumulate the accepted candidates along with their selected neighbors in a queue structure to allow every selected sample to contribute to the evolution of the reconstructed welding space as the algorithm progresses. We analyze the performance of our adaptive sampling algorithm in contrast to the random sampling, with and without replacement, to show a significant improvement in total number of samples that are drawn to identify the region of interest, thereby expanding upon neighboring samples to extract the entire region in a fewer iterations and a shorter computation time.
△ Less
Submitted 8 July, 2015; v1 submitted 14 February, 2015;
originally announced February 2015.
-
Application of Deep Neural Network in Estimation of the Weld Bead Parameters
Authors:
Soheil Keshmiri,
Xin Zheng,
Chee Meng Chew,
Chee Khiang Pang
Abstract:
We present a deep learning approach to estimation of the bead parameters in welding tasks. Our model is based on a four-hidden-layer neural network architecture. More specifically, the first three hidden layers of this architecture utilize Sigmoid function to produce their respective intermediate outputs. On the other hand, the last hidden layer uses a linear transformation to generate the final o…
▽ More
We present a deep learning approach to estimation of the bead parameters in welding tasks. Our model is based on a four-hidden-layer neural network architecture. More specifically, the first three hidden layers of this architecture utilize Sigmoid function to produce their respective intermediate outputs. On the other hand, the last hidden layer uses a linear transformation to generate the final output of this architecture. This transforms our deep network architecture from a classifier to a non-linear regression model. We compare the performance of our deep network with a selected number of results in the literature to show a considerable improvement in reducing the errors in estimation of these values. Furthermore, we show its scalability on estimating the weld bead parameters with same level of accuracy on combination of datasets that pertain to different welding techniques. This is a nontrivial result that is counter-intuitive to the general belief in this field of research.
△ Less
Submitted 8 July, 2015; v1 submitted 14 February, 2015;
originally announced February 2015.
-
Model-Free 3D Reconstruction of Weld Joint Using Laser Scanning
Authors:
Soheil Keshmiri,
Syeda Mariam Ahmed,
Yue Wu,
Chee Meng Chew,
Chee Khiang Pang
Abstract:
This article presents a novel utilization of the concept of entropy in information theory to model-free 3D reconstruction of weld joint in presence of noise. We show that our formulation attains its global minimum at the upper edge of this joint. This property significantly simplifies the extraction of this welding joint. Furthermore, we present an approach to compute the volume of this extracted…
▽ More
This article presents a novel utilization of the concept of entropy in information theory to model-free 3D reconstruction of weld joint in presence of noise. We show that our formulation attains its global minimum at the upper edge of this joint. This property significantly simplifies the extraction of this welding joint. Furthermore, we present an approach to compute the volume of this extracted space to facilitate the monitoring of the progress of the welding task. Moreover, we provide a preliminary analysis of the effect of variation of the noise on the extraction process of this space to realize the impact of this noise on the computation of its area and volume.
△ Less
Submitted 8 July, 2015; v1 submitted 15 October, 2014;
originally announced October 2014.