-
Radial Basis Function Neural Networks for Formation Control of Unmanned Aerial Vehicles
Authors:
Duy-Nam Bui,
Manh Duong Phung
Abstract:
This paper addresses the problem of controlling multiple unmanned aerial vehicles (UAVs) cooperating in a formation to carry out a complex task such as surface inspection. We first use the virtual leader-follower model to determine the topology and trajectory of the formation. A double-loop control system combining backstep** and sliding mode control techniques is then designed for the UAVs to t…
▽ More
This paper addresses the problem of controlling multiple unmanned aerial vehicles (UAVs) cooperating in a formation to carry out a complex task such as surface inspection. We first use the virtual leader-follower model to determine the topology and trajectory of the formation. A double-loop control system combining backstep** and sliding mode control techniques is then designed for the UAVs to track the trajectory. A radial basis function neural network (RBFNN) capable of estimating external disturbances is developed to enhance the robustness of the controller. The stability of the controller is proven by using the Lyapunov theorem. A number of comparisons and software-in-the-loop (SIL) tests have been conducted to evaluate the performance of the proposed controller. The results show that our controller not only outperforms other state-of-the-art controllers but is also sufficient for complex tasks of UAVs such as collecting surface data for inspection. The source code of our controller can be found at https://github.com/duynamrcv/rbf_bsmc
△ Less
Submitted 21 April, 2024;
originally announced April 2024.
-
Object Detection in Thermal Images Using Deep Learning for Unmanned Aerial Vehicles
Authors:
Minh Dang Tu,
Kieu Trang Le,
Manh Duong Phung
Abstract:
This work presents a neural network model capable of recognizing small and tiny objects in thermal images collected by unmanned aerial vehicles. Our model consists of three parts, the backbone, the neck, and the prediction head. The backbone is developed based on the structure of YOLOv5 combined with the use of a transformer encoder at the end. The neck includes a BI-FPN block combined with the us…
▽ More
This work presents a neural network model capable of recognizing small and tiny objects in thermal images collected by unmanned aerial vehicles. Our model consists of three parts, the backbone, the neck, and the prediction head. The backbone is developed based on the structure of YOLOv5 combined with the use of a transformer encoder at the end. The neck includes a BI-FPN block combined with the use of a sliding window and a transformer to increase the information fed into the prediction head. The prediction head carries out the detection by evaluating feature maps with the Sigmoid function. The use of transformers with attention and sliding windows increases recognition accuracy while kee** the model at a reasonable number of parameters and computation requirements for embedded systems. Experiments conducted on public dataset VEDAI and our collected datasets show that our model has a higher accuracy than state-of-the-art methods such as ResNet, Faster RCNN, ComNet, ViT, YOLOv5, SMPNet, and DPNetV3. Experiments on the embedded computer Jetson AGX show that our model achieves a real-time computation speed with a stability rate of over 90%.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Ant Colony Optimization for Cooperative Inspection Path Planning Using Multiple Unmanned Aerial Vehicles
Authors:
Duy Nam Bui,
Thuy Ngan Duong,
Manh Duong Phung
Abstract:
This paper presents a new swarm intelligence-based approach to deal with the cooperative path planning problem of unmanned aerial vehicles (UAVs), which is essential for the automatic inspection of infrastructure. The approach uses a 3D model of the structure to generate viewpoints for the UAVs. The calculation of the viewpoints considers the constraints related to the UAV formation model, camera…
▽ More
This paper presents a new swarm intelligence-based approach to deal with the cooperative path planning problem of unmanned aerial vehicles (UAVs), which is essential for the automatic inspection of infrastructure. The approach uses a 3D model of the structure to generate viewpoints for the UAVs. The calculation of the viewpoints considers the constraints related to the UAV formation model, camera parameters, and requirements for data post-processing. The viewpoints are then used as input to formulate the path planning as an extended traveling salesman problem and the definition of a new cost function. Ant colony optimization is finally used to solve the problem to yield optimal inspection paths. Experiments with 3D models of real structures have been conducted to evaluate the performance of the proposed approach. The results show that our system is not only capable of generating feasible inspection paths for UAVs but also reducing the path length by 29.47\% for complex structures when compared with another heuristic approach. The source code of the algorithm can be found at https://github.com/duynamrcv/aco_3d_ipp.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Self-Reconfigurable V-shape Formation of Multiple UAVs in Narrow Space Environments
Authors:
Duy Nam Bui,
Manh Duong Phung,
Hung Pham Duy
Abstract:
This paper presents the design and implementation of a self-reconfigurable V-shape formation controller for multiple unmanned aerial vehicles (UAVs) navigating through narrow spaces in a dense obstacle environment. The selection of the V-shape formation is motivated by its maneuverability and visibility advantages. The main objective is to develop an effective formation control strategy that allow…
▽ More
This paper presents the design and implementation of a self-reconfigurable V-shape formation controller for multiple unmanned aerial vehicles (UAVs) navigating through narrow spaces in a dense obstacle environment. The selection of the V-shape formation is motivated by its maneuverability and visibility advantages. The main objective is to develop an effective formation control strategy that allows UAVs to autonomously adjust their positions to form the desired formation while navigating through obstacles. To achieve this, we propose a distributed behavior-based control algorithm that combines the behaviors designed for individual UAVs so that they together navigate the UAVs to their desired positions. The reconfiguration process is automatic, utilizing individual UAV sensing within the formation, allowing for dynamic adaptations such as opening/closing wings or merging into a straight line. Simulation results show that the self-reconfigurable V-shape formation offers adaptability and effectiveness for UAV formations in complex operational scenarios.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Multisensor Data Fusion for Reliable Obstacle Avoidance
Authors:
Thanh Nguyen Canh,
Truong Son Nguyen,
Cong Hoang Quach,
Xiem HoangVan,
Manh Duong Phung
Abstract:
In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot and a 2D slide around it. To fuse the data from these sensors, we first use an external camera as a reference to combine data from two depth cameras. A projection…
▽ More
In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot and a 2D slide around it. To fuse the data from these sensors, we first use an external camera as a reference to combine data from two depth cameras. A projection technique is then introduced to convert the 3D point cloud data of the cameras to its 2D correspondence. An obstacle avoidance algorithm is then developed based on the dynamic window approach. A number of experiments have been conducted to evaluate our proposed approach. The results show that the robot can effectively avoid static and dynamic obstacles of different shapes and sizes in different environments.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Deployment of UAVs for Optimal Multihop Ad-hoc Networks Using Particle Swarm Optimization and Behavior-based Control
Authors:
Ngan Duong Thi Thuy,
Duy Nam Bui,
Manh Duong Phung,
Hung Pham Duy
Abstract:
This study proposes an approach for establishing an optimal multihop ad-hoc network using multiple unmanned aerial vehicles (UAVs) to provide emergency communication in disaster areas. The approach includes two stages, one uses particle swarm optimization (PSO) to find optimal positions to deploy UAVs, and the other uses a behavior-based controller to navigate the UAVs to their assigned positions…
▽ More
This study proposes an approach for establishing an optimal multihop ad-hoc network using multiple unmanned aerial vehicles (UAVs) to provide emergency communication in disaster areas. The approach includes two stages, one uses particle swarm optimization (PSO) to find optimal positions to deploy UAVs, and the other uses a behavior-based controller to navigate the UAVs to their assigned positions without colliding with obstacles in an unknown environment. Several constraints related to the UAVs' sensing and communication ranges have been imposed to ensure the applicability of the proposed approach in real-world scenarios. A number of simulation experiments with data loaded from real environments have been conducted. The results show that our proposed approach is not only successful in establishing multihop ad-hoc routes but also meets the requirements for real-time deployment of UAVs.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Lyapunov-based Nonlinear Model Predictive Control for Attitude Trajectory Tracking of Unmanned Aerial Vehicles
Authors:
Duy Nam Bui,
Thi Thanh Van Nguyen,
Manh Duong Phung
Abstract:
This paper presents a new Lyapunov-based nonlinear model predictive controller (LNMPC) for the attitude control problem of unmanned aerial vehicles (UAVs), which is essential for their functioning operation. The controller is designed based on a quadratic cost function integrating UAV dynamics and system constraints. An additional contraction constraint is then introduced to ensure closed-loop sys…
▽ More
This paper presents a new Lyapunov-based nonlinear model predictive controller (LNMPC) for the attitude control problem of unmanned aerial vehicles (UAVs), which is essential for their functioning operation. The controller is designed based on a quadratic cost function integrating UAV dynamics and system constraints. An additional contraction constraint is then introduced to ensure closed-loop system stability. That constraint is fulfilled via a Lyapunov function derived from a sliding mode controller (SMC). The feasibility and stability of the LNMPC are finally proved. Simulation and comparison results show that the proposed controller guarantees the system stability and outperforms other state-of-the-art nonlinear controllers such as the backstep** controller (BSC) and SMC. In addition, the proposed controller can be integrated into an existing UAV model in the Gazebo simulator to perform software-in-the-loop tests. The results show that the LNMPC is better than the built-in PID controller of the UAV, which confirms the validity and applicability of our proposed approach.
△ Less
Submitted 28 October, 2022;
originally announced October 2022.
-
Stag hunt game-based approach for cooperative UAVs
Authors:
L. V. Nguyen,
I. Torres Herrera,
T. H. Le,
M. D. Phung,
R. P. Aguilera,
Q. P. Ha
Abstract:
Unmanned aerial vehicles (UAVs) are being employed in many areas such as photography, emergency, entertainment, defence, agriculture, forestry, mining and construction. Over the last decade, UAV technology has found applications in numerous construction project phases, ranging from site map**, progress monitoring, building inspection, damage assessments, and material delivery. While extensive st…
▽ More
Unmanned aerial vehicles (UAVs) are being employed in many areas such as photography, emergency, entertainment, defence, agriculture, forestry, mining and construction. Over the last decade, UAV technology has found applications in numerous construction project phases, ranging from site map**, progress monitoring, building inspection, damage assessments, and material delivery. While extensive studies have been conducted on the advantages of UAVs for various construction-related processes, studies on UAV collaboration to improve the task capacity and efficiency are still scarce. This paper proposes a new cooperative path planning algorithm for multiple UAVs based on the stag hunt game and particle swarm optimization (PSO). First, a cost function for each UAV is defined, incorporating multiple objectives and constraints. The UAV game framework is then developed to formulate the multi-UAV path planning into the problem of finding payoff-dominant equilibrium. Next, a PSO-based algorithm is proposed to obtain optimal paths for the UAVs. Simulation results for a large construction site inspected by three UAVs indicate the effectiveness of the proposed algorithm in generating feasible and efficient flight paths for UAV formation during the inspection task.
△ Less
Submitted 28 August, 2022;
originally announced August 2022.
-
Classification of EEG Motor Imagery Using Deep Learning for Brain-Computer Interface Systems
Authors:
Alessandro Gallo,
Manh Duong Phung
Abstract:
A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of mot…
▽ More
A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data.
△ Less
Submitted 31 May, 2022;
originally announced June 2022.
-
Enhanced Teaching-Learning-based Optimization for 3D Path Planning of Multicopter UAVs
Authors:
Van Truong Hoang,
Manh Duong Phung
Abstract:
This paper introduces a new path planning algorithm for unmanned aerial vehicles (UAVs) based on the teaching-learning-based optimization (TLBO) technique. We first define an objective function that incorporates requirements on the path length and constraints on the movement and safe operation of UAVs to convert the path planning into an optimization problem. The optimization algorithm named Multi…
▽ More
This paper introduces a new path planning algorithm for unmanned aerial vehicles (UAVs) based on the teaching-learning-based optimization (TLBO) technique. We first define an objective function that incorporates requirements on the path length and constraints on the movement and safe operation of UAVs to convert the path planning into an optimization problem. The optimization algorithm named Multi-subject TLBO is then proposed to minimize the formulated objective function. The algorithm is developed based on TLBO but enhanced with new operations including mutation, elite selection and multi-subject training to improve the solution quality and speed up the convergence rate. Comparison with state-of-the-art algorithms and experiments with real UAVs have been conducted to evaluate the performance of the proposed algorithm. The results confirm its validity and effectiveness in generating optimal, collision-free and flyable paths for UAVs in complex operating environments.
△ Less
Submitted 31 May, 2022;
originally announced May 2022.
-
Mobile Robot Localization Using Fuzzy Neural Network Based Extended Kalman Filter
Authors:
Thi Thanh Van Nguyen,
Manh Duong Phung,
Thuan Hoang Tran,
Quang Vinh Tran
Abstract:
This paper proposes a novel approach to improve the performance of the extended Kalman filter (EKF) for the problem of mobile robot localization. A fuzzy logic system is employed to continuous-ly adjust the noise covariance matrices of the filter. A neural network is implemented to regulate the membership functions of the antecedent and consequent parts of the fuzzy rules. The aim is to gain the a…
▽ More
This paper proposes a novel approach to improve the performance of the extended Kalman filter (EKF) for the problem of mobile robot localization. A fuzzy logic system is employed to continuous-ly adjust the noise covariance matrices of the filter. A neural network is implemented to regulate the membership functions of the antecedent and consequent parts of the fuzzy rules. The aim is to gain the accuracy and avoid the divergence of the EKF when the noise covariance matrices are fixed or wrongly determined. Simulations and experiments have been conducted. The results show that the proposed filter is better than the EKF in localizing the mobile robot.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
Development of a Fast and Robust Gaze Tracking System for Game Applications
Authors:
Manh Duong Phung,
Cong Hoang Quach,
Quang Vinh Tran
Abstract:
In this study, a novel eye tracking system using a visual camera is developed to extract human's gaze, and it can be used in modern game machines to bring new and innovative interactive experience to players. Central to the components of the system, is a robust iris-center and eye-corner detection algorithm basing on it the gaze is continuously and adaptively extracted. Evaluation tests were appli…
▽ More
In this study, a novel eye tracking system using a visual camera is developed to extract human's gaze, and it can be used in modern game machines to bring new and innovative interactive experience to players. Central to the components of the system, is a robust iris-center and eye-corner detection algorithm basing on it the gaze is continuously and adaptively extracted. Evaluation tests were applied to nine people to evaluate the accuracy of the system and the results were 2.50 degrees (view angle) in horizontal direction and 3.07 degrees in vertical direction.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
Hierarchical Convolutional Neural Network with Feature Preservation and Autotuned Thresholding for Crack Detection
Authors:
Qiuchen Zhu,
Tran Hiep Dinh,
Manh Duong Phung,
Quang Phuc Ha
Abstract:
Drone imagery is increasingly used in automated inspection for infrastructure surface defects, especially in hazardous or unreachable environments. In machine vision, the key to crack detection rests with robust and accurate algorithms for image processing. To this end, this paper proposes a deep learning approach using hierarchical convolutional neural networks with feature preservation (HCNNFP)…
▽ More
Drone imagery is increasingly used in automated inspection for infrastructure surface defects, especially in hazardous or unreachable environments. In machine vision, the key to crack detection rests with robust and accurate algorithms for image processing. To this end, this paper proposes a deep learning approach using hierarchical convolutional neural networks with feature preservation (HCNNFP) and an intercontrast iterative thresholding algorithm for image binarization. First, a set of branch networks is proposed, wherein the output of previous convolutional blocks is half-sizedly concatenated to the current ones to reduce the obscuration in the down-sampling stage taking into account the overall information loss. Next, to extract the feature map generated from the enhanced HCNN, a binary contrast-based autotuned thresholding (CBAT) approach is developed at the post-processing step, where patterns of interest are clustered within the probability map of the identified features. The proposed technique is then applied to identify surface cracks on the surface of roads, bridges or pavements. An extensive comparison with existing techniques is conducted on various datasets and subject to a number of evaluation criteria including the average F-measure (AF\b{eta}) introduced here for dynamic quantification of the performance. Experiments on crack images, including those captured by unmanned aerial vehicles inspecting a monorail bridge. The proposed technique outperforms the existing methods on various tested datasets especially for GAPs dataset with an increase of about 1.4% in terms of AF\b{eta} while the mean percentage error drops by 2.2%. Such performance demonstrates the merits of the proposed HCNNFP architecture for surface defect inspection.
△ Less
Submitted 21 April, 2021;
originally announced April 2021.
-
Safety-enhanced UAV Path Planning with Spherical Vector-based Particle Swarm Optimization
Authors:
Manh Duong Phung,
Quang Phuc Ha
Abstract:
This paper presents a new algorithm named spherical vector-based particle swarm optimization (SPSO) to deal with the problem of path planning for unmanned aerial vehicles (UAVs) in complicated environments subjected to multiple threats. A cost function is first formulated to convert the path planning into an optimization problem that incorporates requirements and constraints for the feasible and s…
▽ More
This paper presents a new algorithm named spherical vector-based particle swarm optimization (SPSO) to deal with the problem of path planning for unmanned aerial vehicles (UAVs) in complicated environments subjected to multiple threats. A cost function is first formulated to convert the path planning into an optimization problem that incorporates requirements and constraints for the feasible and safe operation of the UAV. SPSO is then used to find the optimal path that minimizes the cost function by efficiently searching the configuration space of the UAV via the correspondence between the particle position and the speed, turn angle and climb/dive angle of the UAV. To evaluate the performance of SPSO, eight benchmarking scenarios have been generated from real digital elevation model maps. The results show that the proposed SPSO outperforms not only other particle swarm optimization (PSO) variants including the classic PSO, phase angle-encoded PSO and quantum-behave PSO but also other state-of-the-art metaheuristic optimization algorithms including the genetic algorithm (GA), artificial bee colony (ABC), and differential evolution (DE) in most scenarios. In addition, experiments have been conducted to demonstrate the validity of the generated paths for real UAV operations. Source code of the algorithm can be found at https://github.com/duongpm/SPSO.
△ Less
Submitted 13 April, 2021;
originally announced April 2021.
-
Motion-Encoded Particle Swarm Optimization for Moving Target Search Using UAVs
Authors:
Manh Duong Phung,
Quang Phuc Ha
Abstract:
This paper presents a novel algorithm named the motion-encoded particle swarm optimization (MPSO) for finding a moving target with unmanned aerial vehicles (UAVs). From the Bayesian theory, the search problem can be converted to the optimization of a cost function that represents the probability of detecting the target. Here, the proposed MPSO is developed to solve that problem by encoding the sea…
▽ More
This paper presents a novel algorithm named the motion-encoded particle swarm optimization (MPSO) for finding a moving target with unmanned aerial vehicles (UAVs). From the Bayesian theory, the search problem can be converted to the optimization of a cost function that represents the probability of detecting the target. Here, the proposed MPSO is developed to solve that problem by encoding the search trajectory as a series of UAV motion paths evolving over the generation of particles in a PSO algorithm. This motion-encoded approach allows for preserving important properties of the swarm including the cognitive and social coherence, and thus resulting in better solutions. Results from extensive simulations with existing methods show that the proposed MPSO improves the detection performance by 24\% and time performance by 4.71 times compared to the original PSO, and moreover, also outperforms other state-of-the-art metaheuristic optimization algorithms including the artificial bee colony (ABC), ant colony optimization (ACO), genetic algorithm (GA), differential evolution (DE), and tree-seed algorithm (TSA) in most search scenarios. Experiments have been conducted with real UAVs in searching for a dynamic target in different scenarios to demonstrate MPSO merits in a practical application.
△ Less
Submitted 5 October, 2020;
originally announced October 2020.
-
Development of a Fuzzy-based Patrol Robot Using in Building Automation System
Authors:
Thi Thanh Van Nguyen,
Manh Duong Phung,
Dinh Tuan Pham,
Quang Vinh Tran
Abstract:
A Building Automation System (BAS) has functions of monitoring and controlling the operation of all building sub-systems such as HVAC (Heating-Ventilation, Air-conditioning Control), electric consumption management, fire alarm control, security and access control, and appliance switching control. In the BAS, almost operations are automatically performed at the control centre, the building security…
▽ More
A Building Automation System (BAS) has functions of monitoring and controlling the operation of all building sub-systems such as HVAC (Heating-Ventilation, Air-conditioning Control), electric consumption management, fire alarm control, security and access control, and appliance switching control. In the BAS, almost operations are automatically performed at the control centre, the building security therefore must be strictly protected. In the traditional system, the security is usually ensured by a number of cameras installed at fixed positions and it may results in a limited vision. To overcome this disadvantage, our paper presents a novel security system in which a mobile robot is used as a patrol. The robot is equipped with fuzzy-based algorithms to allow it to avoid the obstacles in an unknown environment as well as other necessary mechanisms demanded for its patrol mission. The experiment results show that the system satisfies the requirements for the objective of monitoring and securing the building.
△ Less
Submitted 13 May, 2020;
originally announced June 2020.
-
Built Infrastructure Monitoring and Inspection Using UAVs and Vision-based Algorithms
Authors:
Khai Ky Ly,
Manh Duong Phung
Abstract:
This study presents an inspecting system using real-time control unmanned aerial vehicles (UAVs) to investigate structural surfaces. The system operates under favourable weather conditions to inspect a target structure, which is the Wentworth light rail base structure in this study. The system includes a drone, a GoPro HERO4 camera, a controller and a mobile phone. The drone takes off the ground m…
▽ More
This study presents an inspecting system using real-time control unmanned aerial vehicles (UAVs) to investigate structural surfaces. The system operates under favourable weather conditions to inspect a target structure, which is the Wentworth light rail base structure in this study. The system includes a drone, a GoPro HERO4 camera, a controller and a mobile phone. The drone takes off the ground manually in the testing field to collect the data requiring for later analysis. The images are taken through HERO 4 camera and then transferred in real time to the remote processing unit such as a ground control station by the wireless connection established by a Wi-Fi router. An image processing method has been proposed to detect defects or damages such as cracks. The method based on intensity histogram algorithms to exploit the pixel group related to the crack contained in the low intensity interval. Experiments, simulation and comparisons have been conducted to evaluate the performance and validity of the proposed system.
△ Less
Submitted 19 May, 2020;
originally announced May 2020.
-
Recognition of 26 Degrees of Freedom of Hands Using Model-based approach and Depth-Color Images
Authors:
Cong Hoang Quach,
Minh Trien Pham,
Anh Viet Dang,
Dinh Tuan Pham,
Thuan Hoang Tran,
Manh Duong Phung
Abstract:
In this study, we present an model-based approach to recognize full 26 degrees of freedom of a human hand. Input data include RGB-D images acquired from a Kinect camera and a 3D model of the hand constructed from its anatomy and graphical matrices. A cost function is then defined so that its minimum value is achieved when the model and observation images are matched. To solve the optimization prob…
▽ More
In this study, we present an model-based approach to recognize full 26 degrees of freedom of a human hand. Input data include RGB-D images acquired from a Kinect camera and a 3D model of the hand constructed from its anatomy and graphical matrices. A cost function is then defined so that its minimum value is achieved when the model and observation images are matched. To solve the optimization problem in 26 dimensional space, the particle swarm optimization algorimth with improvements are used. In addition, parallel computation in graphical processing units (GPU) is utilized to handle computationally expensive tasks. Simulation and experimental results show that the system can recognize 26 degrees of freedom of hands with the processing time of 0.8 seconds per frame. The algorithm is robust to noise and the hardware requirement is simple with a single camera.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Robust asymptotic stability of two-wheels differential drive mobile robot
Authors:
Thi Thanh Van Nguyen,
Manh Duong Phung,
Quang Vinh Tran
Abstract:
The paper proposes the stable motion control law design method for non-honomic differential-drive mobile robot with system and measurement noise in discrete time domain. This method is performed basing on dividing operating configuration of robot into two parts: glocal and local configuration then the control law is designed following Lyapunov stable theory for two configuration. The proposed stab…
▽ More
The paper proposes the stable motion control law design method for non-honomic differential-drive mobile robot with system and measurement noise in discrete time domain. This method is performed basing on dividing operating configuration of robot into two parts: glocal and local configuration then the control law is designed following Lyapunov stable theory for two configuration. The proposed stable control laws is able to reach asymptotically stably to target position and orientation from any initial conditions even existing noise in the system. Some simulation results have demonstrated the effect of proposed method.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Using multiple sensors for autonomous mobile robot navigation
Authors:
Thuan Hoang Tran,
Manh Duong Phung,
Anh Viet Dang,
Quang Vinh Tran
Abstract:
This paper presents the use of multi-sensor measurement system to guide autonomous mobile robot in the house. The system allows the 3D image acquisition to global map**, and algorithms to reduce the dimensionality of images to 2D global map navigation, trajectory design approach using the Lyapunov function method and avoid obstacles by the potential energy can also be presented. Also, sensor int…
▽ More
This paper presents the use of multi-sensor measurement system to guide autonomous mobile robot in the house. The system allows the 3D image acquisition to global map**, and algorithms to reduce the dimensionality of images to 2D global map navigation, trajectory design approach using the Lyapunov function method and avoid obstacles by the potential energy can also be presented. Also, sensor integrated method based on extended Kalman filter allows us to identify the exact location and orientation of the robot in the presence of interference from the environment.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Stabilization control of networked mobile robot using past observation-based preditive filter
Authors:
Manh Duong Phung,
Thi Thanh Van Nguyen,
Thuan Hoang Tran,
Quang Vinh Tran
Abstract:
This paper addresses the stabilization control problem for networked mobile robot subject to communication delay. A new state estimation filter namely past observation-based predictive filter is developed. This filter enables the prediction of system state from delayed measurement. The state estimator combined with developed control laws ensures the asymptotic stability of the networked system. Si…
▽ More
This paper addresses the stabilization control problem for networked mobile robot subject to communication delay. A new state estimation filter namely past observation-based predictive filter is developed. This filter enables the prediction of system state from delayed measurement. The state estimator combined with developed control laws ensures the asymptotic stability of the networked system. Simulations with parameters extracted from a real robot system were conducted and results confirmed the correctness as well as applicability of proposed approach.
△ Less
Submitted 13 May, 2020;
originally announced May 2020.
-
Sensing Data Fusion for Enhanced Indoor Air Quality Monitoring
Authors:
Q. P. Ha,
S. Metia,
M. D. Phung
Abstract:
Multisensor fusion of air pollutant data in smart buildings remains an important input to address the well-being and comfort perceived by their inhabitants. An integrated sensing system is part of a smart building where real-time indoor air quality data are monitored round the clock using sensors and operating in the Internet-of-Things (IoT) environment. In this work, we propose an air quality man…
▽ More
Multisensor fusion of air pollutant data in smart buildings remains an important input to address the well-being and comfort perceived by their inhabitants. An integrated sensing system is part of a smart building where real-time indoor air quality data are monitored round the clock using sensors and operating in the Internet-of-Things (IoT) environment. In this work, we propose an air quality management system merging indoor air quality index (IAQI) and humidex into an enhanced indoor air quality index (EIAQI) by using sensor data on a real-time basis. Here, indoor air pollutant levels are measured by a network of waspmote sensors while IAQI and humidex data are fused together using an extended fractional-order Kalman filter (EFKF). According to the obtained EIAQI, overall air quality alerts are provided in a timely fashion for accurate prediction with enhanced performance against measurement noise and nonlinearity. The estimation scheme is implemented by using the fractional-order modeling and control (FOMCON) toolbox. A case study is analysed to prove the effectiveness and validity of the proposed approach.
△ Less
Submitted 7 January, 2020;
originally announced January 2020.
-
Crack Detection Using Enhanced Hierarchical Convolutional Neural Networks
Authors:
Qiuchen Zhu,
Manh Duong Phung,
Quang Ha
Abstract:
Unmanned aerial vehicles (UAV) are expected to replace human in hazardous tasks of surface inspection due to their flexibility in operating space and capability of collecting high quality visual data. In this study, we propose enhanced hierarchical convolutional neural networks (HCNN) to detect cracks from image data collected by UAVs. Unlike traditional HCNN, here a set of branch networks is util…
▽ More
Unmanned aerial vehicles (UAV) are expected to replace human in hazardous tasks of surface inspection due to their flexibility in operating space and capability of collecting high quality visual data. In this study, we propose enhanced hierarchical convolutional neural networks (HCNN) to detect cracks from image data collected by UAVs. Unlike traditional HCNN, here a set of branch networks is utilised to reduce the obscuration in the down-sampling process. Moreover, the feature preserving blocks combine the current and previous terms from the convolutional blocks to provide input to the loss functions. As a result, the weights of resized images can be reduced to minimise the information loss. Experiments on images of different crack datasets have been carried out to demonstrate the effectiveness of proposed HCNN.
△ Less
Submitted 13 December, 2019;
originally announced December 2019.
-
Reconfigurable Multi-UAV Formation Using Angle-Encoded PSO
Authors:
V. T. Hoang,
M. D. Phung,
T. H. Dinh,
Q. Zhu,
Q. P. Ha
Abstract:
In this paper, we propose an algorithm for the formation of multiple UAVs used in vision-based inspection of infrastructure. A path planning algorithm is first developed by using a variant of the particle swarm optimisation, named theta-PSO, to generate a feasible path for the overall formation configuration taken into account the constraints for visual inspection. Here, we introduced a cost funct…
▽ More
In this paper, we propose an algorithm for the formation of multiple UAVs used in vision-based inspection of infrastructure. A path planning algorithm is first developed by using a variant of the particle swarm optimisation, named theta-PSO, to generate a feasible path for the overall formation configuration taken into account the constraints for visual inspection. Here, we introduced a cost function that includes various constraints on flight safety and visual inspection. A reconfigurable topology is then added based on the use of intermediate waypoints to allow the formation to avoid collision with obstacles during operation. The planned path and formation are then combined to derive the trajectory and velocity profiles for each UAV. Experiments have been conducted for the task of inspecting a light rail bridge. The results confirmed the validity and effectiveness of the proposed algorithm.
△ Less
Submitted 7 September, 2019;
originally announced September 2019.
-
System Architecture for Real-time Surface Inspection Using Multiple UAVs
Authors:
Van Truong Hoang,
Manh Duong Phung,
Tran Hiep Dinh,
Quang P. Ha
Abstract:
This paper presents a real-time control system for surface inspection using multiple unmanned aerial vehicles (UAVs). The UAVs are coordinated in a specific formation to collect data of the inspecting objects. The communication platform for data transmission is based on the Internet of Things (IoT). In the proposed architecture, the UAV formation is established via using the angle-encoded particle…
▽ More
This paper presents a real-time control system for surface inspection using multiple unmanned aerial vehicles (UAVs). The UAVs are coordinated in a specific formation to collect data of the inspecting objects. The communication platform for data transmission is based on the Internet of Things (IoT). In the proposed architecture, the UAV formation is established via using the angle-encoded particle swarm optimisation to generate an inspecting path and redistribute it to each UAV where communication links are embedded with an IoT board for network and data processing capabilities. Data collected are transmitted in real time through the network to remote computational units. To detect potential damage or defects, an online image processing technique is proposed and implemented based on histograms. Extensive simulation, experiments and comparisons have been conducted to verify the validity and performance of the proposed system.
△ Less
Submitted 7 July, 2019;
originally announced July 2019.
-
Modelling and Fast Terminal Sliding Mode Control for Mirror-based Pointing Systems
Authors:
Ansu Man Singh,
Manh Duong Phung,
Quang Ha
Abstract:
In this paper, we present a new discrete-time Fast Terminal Sliding Mode (FTSM) controller for mirror-based pointing systems. We first derive the decoupled model of those systems and then estimate the parameters using a nonlinear least-square identification method. Based on the derived model, we design a FTSM sliding manifold in the continuous domain. We then exploit the Euler discretization on th…
▽ More
In this paper, we present a new discrete-time Fast Terminal Sliding Mode (FTSM) controller for mirror-based pointing systems. We first derive the decoupled model of those systems and then estimate the parameters using a nonlinear least-square identification method. Based on the derived model, we design a FTSM sliding manifold in the continuous domain. We then exploit the Euler discretization on the designed FTSM sliding surfaces to synthesize a discrete-time controller. Furthermore, we improve the transient dynamics of the sliding surface by adding a linear term. Finally, we prove the stability of the proposed controller based on the Sarpturk reaching condition. Extensive simulations, followed by comparisons with the Terminal Sliding Mode (TSM) and Model Predictive Control (MPC) have been carried out to evaluate the effectiveness of the proposed approach. A comparative study with data obtained from a real-time experiment was also conducted. The results indicate the advantage of the proposed method over the other techniques.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
Angle-Encoded Swarm Optimization for UAV Formation Path Planning
Authors:
V. T. Hoang,
M. D. Phung,
T. H. Dinh,
Q. P. Ha
Abstract:
This paper presents a novel and feasible path planning technique for a group of unmanned aerial vehicles (UAVs) conducting surface inspection of infrastructure. The ultimate goal is to minimise the travel distance of UAVs while simultaneously avoid obstacles, and maintain altitude constraints as well as the shape of the UAV formation. A multiple-objective optimisation algorithm, called the Angle-e…
▽ More
This paper presents a novel and feasible path planning technique for a group of unmanned aerial vehicles (UAVs) conducting surface inspection of infrastructure. The ultimate goal is to minimise the travel distance of UAVs while simultaneously avoid obstacles, and maintain altitude constraints as well as the shape of the UAV formation. A multiple-objective optimisation algorithm, called the Angle-encoded Particle Swarm Optimization (theta-PSO) algorithm, is proposed to accelerate the swarm convergence with angular velocity and position being used for the location of particles. The whole formation is modelled as a virtual rigid body and controlled to maintain a desired geometric shape among the paths created while the centroid of the group follows a pre-determined trajectory. Based on the testbed of 3DR Solo drones equipped with a proprietary Mission Planner, and the Internet-of-Things (IoT) for multi-directional transmission and reception of data between the UAVs, extensive experiments have been conducted for triangular formation maintenance along a monorail bridge. The results obtained confirm the feasibility and effectiveness of the proposed approach.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
Crack Detection Using Enhanced Thresholding on UAV based Collected Images
Authors:
Q. Zhu,
T. H. Dinh,
V. T. Hoang,
M. D. Phung,
Q. P. Ha
Abstract:
This paper proposes a thresholding approach for crack detection in an unmanned aerial vehicle (UAV) based infrastructure inspection system. The proposed algorithm performs recursively on the intensity histogram of UAV-taken images to exploit their crack-pixels appearing at the low intensity interval. A quantified criterion of interclass contrast is proposed and employed as an object cost and stop…
▽ More
This paper proposes a thresholding approach for crack detection in an unmanned aerial vehicle (UAV) based infrastructure inspection system. The proposed algorithm performs recursively on the intensity histogram of UAV-taken images to exploit their crack-pixels appearing at the low intensity interval. A quantified criterion of interclass contrast is proposed and employed as an object cost and stop condition for the recursive process. Experiments on different datasets show that our algorithm outperforms different segmentation approaches to accurately extract crack features of some commercial buildings.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
-
Adaptive twisting sliding mode control for quadrotor unmanned aerial vehicles
Authors:
V. T. Hoang,
M. D. Phung,
Q. P. Ha
Abstract:
This work addresses the problem of robust attitude control of quadcopters. First, the mathematical model of the quadcopter is derived considering factors such as nonlinearity, external disturbances, uncertain dynamics and strong coupling. An adaptive twisting sliding mode control algorithm is then developed with the objective of controlling the quadcopter to track desired attitudes under various c…
▽ More
This work addresses the problem of robust attitude control of quadcopters. First, the mathematical model of the quadcopter is derived considering factors such as nonlinearity, external disturbances, uncertain dynamics and strong coupling. An adaptive twisting sliding mode control algorithm is then developed with the objective of controlling the quadcopter to track desired attitudes under various conditions. For this, the twisting sliding mode control law is modified with a proposed gain adaptation scheme to improve the control transient and tracking performance. Extensive simulation studies and comparisons with experimental data have been carried out for a Solo quadcopter. The results show that the proposed control scheme can achieve strong robustness against disturbances while is adaptable to parametric variations.
△ Less
Submitted 5 June, 2018;
originally announced June 2018.
-
Real-time Lane Marker Detection Using Template Matching with RGB-D Camera
Authors:
Cong Hoang Quach,
Van Lien Tran,
Duy Hung Nguyen,
Viet Thang Nguyen,
Minh Trien Pham,
Manh Duong Phung
Abstract:
This paper addresses the problem of lane detection which is fundamental for self-driving vehicles. Our approach exploits both colour and depth information recorded by a single RGB-D camera to better deal with negative factors such as lighting conditions and lane-like objects. In the approach, colour and depth images are first converted to a half-binary format and a 2D matrix of 3D points. They are…
▽ More
This paper addresses the problem of lane detection which is fundamental for self-driving vehicles. Our approach exploits both colour and depth information recorded by a single RGB-D camera to better deal with negative factors such as lighting conditions and lane-like objects. In the approach, colour and depth images are first converted to a half-binary format and a 2D matrix of 3D points. They are then used as the inputs of template matching and geometric feature extraction processes to form a response map so that its values represent the probability of pixels being lane markers. To further improve the results, the template and lane surfaces are finally refined by principal component analysis and lane model fitting techniques. A number of experiments have been conducted on both synthetic and real datasets. The result shows that the proposed approach can effectively eliminate unwanted noise to accurately detect lane markers in various scenarios. Moreover, the processing speed of 20 frames per second under hardware configuration of a popular laptop computer allows the proposed algorithm to be implemented for real-time autonomous driving applications.
△ Less
Submitted 5 June, 2018;
originally announced June 2018.
-
Management of solar energy in microgrids using IoT-based dependable control
Authors:
Manh Duong Phung,
Michel De La Villefromoy,
Quang Ha
Abstract:
Solar energy generation requires efficient monitoring and management in moving towards technologies for net-zero energy buildings. This paper presents a dependable control system based on the Internet of Things (IoT) to control and manage the energy flow of renewable energy collected by solar panels within a microgrid. Data for optimal control include not only measurements from local sensors but a…
▽ More
Solar energy generation requires efficient monitoring and management in moving towards technologies for net-zero energy buildings. This paper presents a dependable control system based on the Internet of Things (IoT) to control and manage the energy flow of renewable energy collected by solar panels within a microgrid. Data for optimal control include not only measurements from local sensors but also meteorological information retrieved in real-time from online sources. For system fault tolerance across the whole distributed control system featuring multiple controllers, dependable controllers are developed to control and optimise the tracking performance of photovoltaic arrays to maximally capture solar radiation and maintain system resilience and reliability in real time despite failures of one or more redundant controllers due to a problem with communication, hardware or cybersecurity. Experimental results have been obtained to evaluate the validity of the proposed approach.
△ Less
Submitted 10 October, 2017;
originally announced October 2017.
-
Adaptive Second-order Sliding Mode Control of UAVs for Civil Applications
Authors:
Van Truong Hoang,
Ansu Man Singh,
Manh Duong Phung,
Quang Ha
Abstract:
Quadcopters, as unmanned aerial vehicles (UAVs), have great potential in civil applications such as surveying, building monitoring, and infrastructure condition assessment. Quadcopters, however, are relatively sensitive to noises and disturbances so that their performance may be quickly downgraded in the case of inadequate control, system uncertainties and/or external disturbances. In this study,…
▽ More
Quadcopters, as unmanned aerial vehicles (UAVs), have great potential in civil applications such as surveying, building monitoring, and infrastructure condition assessment. Quadcopters, however, are relatively sensitive to noises and disturbances so that their performance may be quickly downgraded in the case of inadequate control, system uncertainties and/or external disturbances. In this study, we deal with the quadrotor low-level control by proposing a robust scheme named the adaptive second-order quasi-continuous sliding mode control (adaptive 2-QCSM). The ultimate objective is for robust attitude control of the UAV in monitoring and inspection of built infrastructure. First, the mathematical model of the quadcopter is derived considering nonlinearity, strong coupling, uncertain dynamics and external disturbances. The control design includes the selection of the sliding manifold and the development of quasi-continuous second-order sliding mode controller with an adaptive gain. Stability of the overall control system is analysed by using a global Lyapunov function for convergence of both the sliding dynamics and adaptation scheme. Extensive simulations have been carried out for evaluation. Results show that the proposed controller can achieve robustness against disturbances or parameter variations and has better tracking performance in comparison with experimental responses of a UAV in a real-time monitoring task.
△ Less
Submitted 31 July, 2017;
originally announced July 2017.
-
Automatic Crack Detection in Built Infrastructure Using Unmanned Aerial Vehicles
Authors:
Manh Duong Phung,
Van Truong Hoang,
Tran Hiep Dinh,
Quang Ha
Abstract:
This paper addresses the problem of crack detection which is essential for health monitoring of built infrastructure. Our approach includes two stages, data collection using unmanned aerial vehicles (UAVs) and crack detection using histogram analysis. For the data collection, a 3D model of the structure is first created by using laser scanners. Based on the model, geometric properties are extracte…
▽ More
This paper addresses the problem of crack detection which is essential for health monitoring of built infrastructure. Our approach includes two stages, data collection using unmanned aerial vehicles (UAVs) and crack detection using histogram analysis. For the data collection, a 3D model of the structure is first created by using laser scanners. Based on the model, geometric properties are extracted to generate way points necessary for navigating the UAV to take images of the structure. Then, our next step is to stick together those obtained images from the overlapped field of view. The resulting image is then clustered by histogram analysis and peak detection. Potential cracks are finally identified by using locally adaptive thresholds. The whole process is automatically carried out so that the inspection time is significantly improved while safety hazards can be minimised. A prototypical system has been developed for evaluation and experimental results are included.
△ Less
Submitted 31 July, 2017;
originally announced July 2017.
-
Enhanced discrete particle swarm optimization path planning for UAV vision-based surface inspection
Authors:
Manh Duong Phung,
Cong Hoang Quach,
Tran Hiep Dinh,
Quang Ha
Abstract:
In built infrastructure monitoring, an efficient path planning algorithm is essential for robotic inspection of large surfaces using computer vision. In this work, we first formulate the inspection path planning problem as an extended travelling salesman problem (TSP) in which both the coverage and obstacle avoidance were taken into account. An enhanced discrete particle swarm optimization (DPSO)…
▽ More
In built infrastructure monitoring, an efficient path planning algorithm is essential for robotic inspection of large surfaces using computer vision. In this work, we first formulate the inspection path planning problem as an extended travelling salesman problem (TSP) in which both the coverage and obstacle avoidance were taken into account. An enhanced discrete particle swarm optimization (DPSO) algorithm is then proposed to solve the TSP, with performance improvement by using deterministic initialization, random mutation, and edge exchange. Finally, we take advantage of parallel computing to implement the DPSO in a GPU-based framework so that the computation time can be significantly reduced while kee** the hardware requirement unchanged. To show the effectiveness of the proposed algorithm, experimental results are included for datasets obtained from UAV inspection of an office building and a bridge.
△ Less
Submitted 14 June, 2017;
originally announced June 2017.
-
Localization of Internet-based Mobile Robot
Authors:
Manh Duong Phung,
Thi Thanh Van Nguyen,
Thuan Hoang Tran,
Quang Vinh Tran
Abstract:
This paper presents a new optimal filter namely past observation-based extended Kalman filter for the problem of localization of Internet-based mobile robot in which the control input and the feedback measurement suffer from communication delay. The filter operates through two phases: the time update and the data correction. The time update predicts the robot position by reformulating the kinemati…
▽ More
This paper presents a new optimal filter namely past observation-based extended Kalman filter for the problem of localization of Internet-based mobile robot in which the control input and the feedback measurement suffer from communication delay. The filter operates through two phases: the time update and the data correction. The time update predicts the robot position by reformulating the kinematics model to be non-memoryless. The correction step corrects the prediction by extrapolating the delayed measurement to the present and then incorporating it to the being estimate as there is no delay. The optimality of the incorporation is ensured by the derivation of a multiplier that reflects the relevance of past observations to the present. Simulations in MATLAB and experiments in a real networked robot system confirm the validity of the proposed approach.
△ Less
Submitted 10 March, 2017;
originally announced March 2017.
-
Behavior-based Navigation of Mobile Robot in Unknown Environments Using Fuzzy Logic and Multi-Objective Optimization
Authors:
Thi Thanh Van Nguyen,
Manh Duong Phung,
Quang Vinh Tran
Abstract:
This study proposes behavior-based navigation architecture, named BBFM, to deal with the problem of navigating the mobile robot in unknown environments in the presence of obstacles and local minimum regions. In the architecture, the complex navigation task is split into principal sub-tasks or behaviors. Each behavior is implemented by a fuzzy controller and executed independently to deal with a sp…
▽ More
This study proposes behavior-based navigation architecture, named BBFM, to deal with the problem of navigating the mobile robot in unknown environments in the presence of obstacles and local minimum regions. In the architecture, the complex navigation task is split into principal sub-tasks or behaviors. Each behavior is implemented by a fuzzy controller and executed independently to deal with a specific problem of navigation. The fuzzy controller is modified to contain only the fuzzification and inference procedures so that its output is a membership function representing the behavior's objective. The membership functions of all controllers are then used as the objective functions for a multi-objective optimization process to coordinate all behaviors. The result of this process is an overall control signal, which is Pareto-optimal, used to control the robot. A number of simulations, comparisons, and experiments were conducted. The results show that the proposed architecture outperforms some popular behavior-based architectures in term of accuracy, smoothness, traveled distance, and time response.
△ Less
Submitted 9 March, 2017;
originally announced March 2017.
-
Automatic Interpretation of Unordered Point Cloud Data for UAV Navigation in Construction
Authors:
M. D. Phung,
C. H. Quach,
D. T. Chu,
N. Q. Nguyen,
T. H. Dinh,
Q. P. Ha
Abstract:
The objective of this work is to develop a data processing system that can automatically generate waypoints for navigation of an unmanned aerial vehicle (UAV) to inspect surfaces of structures like buildings and bridges. The input includes data recorded by two 2D laser scanners, orthogonally mounted on the UAV, and an inertial measurement unit (IMU). To achieve the goal, algorithms are developed t…
▽ More
The objective of this work is to develop a data processing system that can automatically generate waypoints for navigation of an unmanned aerial vehicle (UAV) to inspect surfaces of structures like buildings and bridges. The input includes data recorded by two 2D laser scanners, orthogonally mounted on the UAV, and an inertial measurement unit (IMU). To achieve the goal, algorithms are developed to process the data collected. They are separated into three major groups: (i) the data registration and filtering to generate a 3D model of the structure and control the density of point clouds for data completeness enhancement; (ii) the surface and obstacle detection to assist the UAV in monitoring tasks; and (iii) the waypoint generation to set the flight path. Experiments on different data sets show that the developed system is able to reconstruct a 3D point cloud of the structure, extract its surfaces and objects, and generate waypoints for the UAV to accomplish inspection tasks.
△ Less
Submitted 12 February, 2017; v1 submitted 22 December, 2016;
originally announced December 2016.
-
Localization of networked robot systems subject to random delay and packet loss
Authors:
Manh Duong Phung,
Thi Thanh Van Nguyen,
Thuan Hoang Tran,
Quang Vinh Tran
Abstract:
This paper deals with the localization problem of mobile robot subject to communication delay and packet loss. The delay and loss may appear in a random fashion in both control inputs and observation measurements. A unified state-space representation is constructed to describe these mixed uncertainties. Based on it, the optimal linear estimator is developed. The main idea is the derivation of a re…
▽ More
This paper deals with the localization problem of mobile robot subject to communication delay and packet loss. The delay and loss may appear in a random fashion in both control inputs and observation measurements. A unified state-space representation is constructed to describe these mixed uncertainties. Based on it, the optimal linear estimator is developed. The main idea is the derivation of a relevance factor to incorporate delayed measurements to the being estimate. The estimator is then extended for nonlinear systems. The performance of this method is tested within the simulations in MATLAB and the experiments in a real robot system. The good localization results prove the efficiency of the method for the purpose of localization of networked mobile robot.
△ Less
Submitted 3 December, 2016;
originally announced December 2016.
-
Localization of a unicycle-like mobile robot using LRF and omni-directional camera
Authors:
Tran Hiep Dinh,
Manh Duong Phung,
Thuan Hoang Tran,
Quang Vinh Tran
Abstract:
This paper addresses the localization problem. The extended Kalman filter (EKF) is employed to localize a unicycle-like mobile robot equipped with a laser range finder (LRF) sensor and an omni-directional camera. The LRF is used to scan the environment which is described with line segments. The segments are extracted by a modified least square quadratic method in which a dynamic threshold is injec…
▽ More
This paper addresses the localization problem. The extended Kalman filter (EKF) is employed to localize a unicycle-like mobile robot equipped with a laser range finder (LRF) sensor and an omni-directional camera. The LRF is used to scan the environment which is described with line segments. The segments are extracted by a modified least square quadratic method in which a dynamic threshold is injected. The camera is employed to determine the robot's orientation. The prediction step of the EKF is performed by extracting parameters from the kinematic model and input signal of the robot. The correction step is conducted with the implementation of a line matching algorithm and the comparison between line's parameters of the local and global maps. In the line matching algorithm, a conversion matrix is introduced to reduce the computation cost. Experiments have been carried out in a real mobile robot system and the results prove the applicability of the method for the purpose of localization.
△ Less
Submitted 28 November, 2016;
originally announced November 2016.
-
Easy-setup eye movement recording system for human-computer interaction
Authors:
Manh Duong Phung,
Quang Vinh Tran,
Kenji Hara,
Hirohito Inagaki,
Masanobu Abe
Abstract:
Tracking the movement of human eyes is expected to yield natural and convenient applications based on human-computer interaction (HCI). To implement an effective eye-tracking system, eye movements must be recorded without placing any restriction on the user's behavior or user discomfort. This paper describes an eye movement recording system that offers free-head, simple configuration. It does not…
▽ More
Tracking the movement of human eyes is expected to yield natural and convenient applications based on human-computer interaction (HCI). To implement an effective eye-tracking system, eye movements must be recorded without placing any restriction on the user's behavior or user discomfort. This paper describes an eye movement recording system that offers free-head, simple configuration. It does not require the user to wear anything on her head, and she can move her head freely. Instead of using a computer, the system uses a visual digital signal processor (DSP) camera to detect the position of eye corner, the center of pupil and then calculate the eye movement. Evaluation tests show that the sampling rate of the system can be 300 Hz and the accuracy is about 1.8 degree/s.
△ Less
Submitted 28 November, 2016;
originally announced November 2016.
-
Image segmentation based on histogram of depth and an application in driver distraction detection
Authors:
Tran Hiep Dinh,
Minh Trien Pham,
Manh Duong Phung,
Duc Manh Nguyen,
Van Manh Hoang,
Quang Vinh Tran
Abstract:
This study proposes an approach to segment human object from a depth image based on histogram of depth values. The region of interest is first extracted based on a predefined threshold for histogram regions. A region growing process is then employed to separate multiple human bodies with the same depth interval. Our contribution is the identification of an adaptive growth threshold based on the de…
▽ More
This study proposes an approach to segment human object from a depth image based on histogram of depth values. The region of interest is first extracted based on a predefined threshold for histogram regions. A region growing process is then employed to separate multiple human bodies with the same depth interval. Our contribution is the identification of an adaptive growth threshold based on the detected histogram region. To demonstrate the effectiveness of the proposed method, an application in driver distraction detection was introduced. After successfully extracting the driver's position inside the car, we came up with a simple solution to track the driver motion. With the analysis of the difference between initial and current frame, a change of cluster position or depth value in the interested region, which cross the preset threshold, is considered as a distracted activity. The experiment results demonstrated the success of the algorithm in detecting typical distracted driving activities such as using phone for calling or texting, adjusting internal devices and drinking in real time.
△ Less
Submitted 31 August, 2016;
originally announced September 2016.
