-
Robotic Exploration through Semantic Topometric Map**
Authors:
Scott Fredriksson,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
In this article, we introduce a novel strategy for robotic exploration in unknown environments using a semantic topometric map. As it will be presented, the semantic topometric map is generated by segmenting the grid map of the currently explored parts of the environment into regions, such as intersections, pathways, dead-ends, and unexplored frontiers, which constitute the structural semantics of…
▽ More
In this article, we introduce a novel strategy for robotic exploration in unknown environments using a semantic topometric map. As it will be presented, the semantic topometric map is generated by segmenting the grid map of the currently explored parts of the environment into regions, such as intersections, pathways, dead-ends, and unexplored frontiers, which constitute the structural semantics of an environment. The proposed exploration strategy leverages metric information of the frontier, such as distance and angle to the frontier, similar to existing frameworks, with the key difference being the additional utilization of structural semantic information, such as properties of the intersections leading to frontiers. The algorithm for generating semantic topometric map** utilized by the proposed method is lightweight, resulting in the method's online execution being both rapid and computationally efficient. Moreover, the proposed framework can be applied to both structured and unstructured indoor and outdoor environments, which enhances the versatility of the proposed exploration algorithm. We validate our exploration strategy and demonstrate the utility of structural semantics in exploration in two complex indoor environments by utilizing a Turtlebot3 as the robotic agent. Compared to traditional frontier-based methods, our findings indicate that the proposed approach leads to faster exploration and requires less computation time.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
GRID-FAST: A Grid-based Intersection Detection for Fast Semantic Topometric Map**
Authors:
Scott Fredriksson,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
This article introduces a novel approach to constructing a topometric map that allows for efficient navigation and decision-making in mobile robotics applications. The method generates the topometric map from a 2D grid-based map. The topometric map segments areas of the input map into different structural-semantic classes: intersections, pathways, dead ends, and pathways leading to unexplored area…
▽ More
This article introduces a novel approach to constructing a topometric map that allows for efficient navigation and decision-making in mobile robotics applications. The method generates the topometric map from a 2D grid-based map. The topometric map segments areas of the input map into different structural-semantic classes: intersections, pathways, dead ends, and pathways leading to unexplored areas. This method is grounded in a new technique for intersection detection that identifies the area and the openings of intersections in a semantically meaningful way. The framework introduces two levels of pre-filtering with minimal computational cost to eliminate small openings and objects from the map which are unimportant in the context of high-level map segmentation and decision making. The topological map generated by GRID-FAST enables fast navigation in large-scale environments, and the structural semantics can aid in mission planning, autonomous exploration, and human-to-robot cooperation. The efficacy of the proposed method is demonstrated through validation on real maps gathered from robotic experiments: 1) a structured indoor environment, 2) an unstructured cave-like subterranean environment, and 3) a large-scale outdoor environment, which comprises pathways, buildings, and scattered objects. Additionally, the proposed framework has been compared with state-of-the-art topological map** solutions and is able to produce a topometric and topological map with up to \blue92% fewer nodes than the next best solution.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
3D Voxel Maps to 2D Occupancy Maps for Efficient Path Planning for Aerial and Ground Robots
Authors:
Scott Fredriksson,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
This article introduces a novel method for converting 3D voxel maps, commonly utilized by robots for localization and navigation, into 2D occupancy maps that can be used for more computationally efficient large-scale navigation, both in the sense of computation time and memory usage. The main aim is to effectively integrate the distinct map** advantages of 2D and 3D maps to enable efficient path…
▽ More
This article introduces a novel method for converting 3D voxel maps, commonly utilized by robots for localization and navigation, into 2D occupancy maps that can be used for more computationally efficient large-scale navigation, both in the sense of computation time and memory usage. The main aim is to effectively integrate the distinct map** advantages of 2D and 3D maps to enable efficient path planning for both unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs). The proposed method uses the free space representation in the UFOMap map** solution to generate 2D occupancy maps with height and slope information. In the process of 3D to 2D map conversion, the proposed method conducts safety checks and eliminates free spaces in the map with dimensions (in the height axis) lower than the robot's safety margins. This allows an aerial or ground robot to navigate safely, relying primarily on the 2D map generated by the method. Additionally, the method extracts height and slope data from the 3D voxel map. The slope data identifies areas too steep for a ground robot to traverse, marking them as occupied, thus enabling a more accurate representation of the terrain for ground robots. The height data is utilized to convert paths generated using the 2D map into paths in 3D space for both UAVs and UGVs. The effectiveness of the proposed method is evaluated in two different environments.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
A CBF-Adaptive Control Architecture for Visual Navigation for UAV in the Presence of Uncertainties
Authors:
Viswa Narayanan Sankaranarayanan,
Akshit Saradagi,
Sumeet Satpute,
George Nikolakopoulos
Abstract:
In this article, we propose a control solution for the safe transfer of a quadrotor UAV between two surface robots positioning itself only using the visual features on the surface robots, which enforces safety constraints for precise landing and visual locking, in the presence of modeling uncertainties and external disturbances. The controller handles the ascending and descending phases of the nav…
▽ More
In this article, we propose a control solution for the safe transfer of a quadrotor UAV between two surface robots positioning itself only using the visual features on the surface robots, which enforces safety constraints for precise landing and visual locking, in the presence of modeling uncertainties and external disturbances. The controller handles the ascending and descending phases of the navigation using a visual locking control barrier function (VCBF) and a parametrizable switching descending CBF (DCBF) respectively, eliminating the need for an external planner. The control scheme has a backstep** approach for the position controller with the CBF filter acting on the position kinematics to produce a filtered virtual velocity control input, which is tracked by an adaptive controller to overcome modeling uncertainties and external disturbances. The experimental validation is carried out with a UAV that navigates from the base to the target using an RGB camera.
△ Less
Submitted 16 February, 2024;
originally announced February 2024.
-
Environmental Awareness Dynamic 5G QoS for Retaining Real Time Constraints in Robotic Applications
Authors:
Gerasimos Damigos,
Akshit Saradagi,
Sara Sandberg,
George Nikolakopoulos
Abstract:
The fifth generation (5G) cellular network technology is mature and increasingly utilized in many industrial and robotics applications, while an important functionality is the advanced Quality of Service (QoS) features. Despite the prevalence of 5G QoS discussions in the related literature, there is a notable absence of real-life implementations and studies concerning their application in time-cri…
▽ More
The fifth generation (5G) cellular network technology is mature and increasingly utilized in many industrial and robotics applications, while an important functionality is the advanced Quality of Service (QoS) features. Despite the prevalence of 5G QoS discussions in the related literature, there is a notable absence of real-life implementations and studies concerning their application in time-critical robotics scenarios. This article considers the operation of time-critical applications for 5G-enabled unmanned aerial vehicles (UAVs) and how their operation can be improved by the possibility to dynamically switch between QoS data flows with different priorities. As such, we introduce a robotics oriented analysis on the impact of the 5G QoS functionality on the performance of 5G-enabled UAVs. Furthermore, we introduce a novel framework for the dynamic selection of distinct 5G QoS data flows that is autonomously managed by the 5G-enabled UAV. This problem is addressed in a novel feedback loop fashion utilizing a probabilistic finite state machine (PFSM). Finally, the efficacy of the proposed scheme is experimentally validated with a 5G-enabled UAV in a real-world 5G stand-alone (SA) network.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectation
Authors:
Mario A. V. Saucedo,
Akash Patel,
Akshit Saradagi,
Christoforos Kanellakis,
George Nikolakopoulos
Abstract:
In this article, we propose the novel concept of Belief Scene Graphs, which are utility-driven extensions of partial 3D scene graphs, that enable efficient high-level task planning with partial information. We propose a graph-based learning methodology for the computation of belief (also referred to as expectation) on any given 3D scene graph, which is then used to strategically add new nodes (ref…
▽ More
In this article, we propose the novel concept of Belief Scene Graphs, which are utility-driven extensions of partial 3D scene graphs, that enable efficient high-level task planning with partial information. We propose a graph-based learning methodology for the computation of belief (also referred to as expectation) on any given 3D scene graph, which is then used to strategically add new nodes (referred to as blind nodes) that are relevant to a robotic mission. We propose the method of Computation of Expectation based on Correlation Information (CECI), to reasonably approximate real Belief/Expectation, by learning histograms from available training data. A novel Graph Convolutional Neural Network (GCN) model is developed, to learn CECI from a repository of 3D scene graphs. As no database of 3D scene graphs exists for the training of the novel CECI model, we present a novel methodology for generating a 3D scene graph dataset based on semantically annotated real-life 3D spaces. The generated dataset is then utilized to train the proposed CECI model and for extensive validation of the proposed method. We establish the novel concept of \textit{Belief Scene Graphs} (BSG), as a core component to integrate expectations into abstract representations. This new concept is an evolution of the classical 3D scene graph concept and aims to enable high-level reasoning for task planning and optimization of a variety of robotics missions. The efficacy of the overall framework has been evaluated in an object search scenario, and has also been tested in a real-life experiment to emulate human common sense of unseen-objects. For a video of the article, showcasing the experimental demonstration, please refer to the following link: https://youtu.be/hsGlSCa12iY
△ Less
Submitted 28 May, 2024; v1 submitted 6 February, 2024;
originally announced February 2024.
-
Model-Free Control Design for Feedback-Linearizable SISO Systems
Authors:
Karthik Shenoy,
Akshit Saradagi,
Ramkrishna Pasumarthy,
Vijaysekhar Chellaboina
Abstract:
Data-driven control has gained significant attention in recent years, particularly regarding feedback linearization of nonlinear systems. However, existing approaches face limitations when it comes to implementing them on hardware. The main challenges include the need for very small sampling times, which strain hardware capabilities, and the requirement of an initial open-loop data set, which can…
▽ More
Data-driven control has gained significant attention in recent years, particularly regarding feedback linearization of nonlinear systems. However, existing approaches face limitations when it comes to implementing them on hardware. The main challenges include the need for very small sampling times, which strain hardware capabilities, and the requirement of an initial open-loop data set, which can be impractical for stabilizing unstable equilibrium points. To address these issues, we propose a two-stage model-free approach that combines a high-gain observer and a dynamic controller. This eliminates the hardware implementation difficulties mentioned earlier. The high-gain observer acts as a robust state estimator, offering superior noise attenuation and lower computational costs, crucial factors for digital hardware implementation. Unlike data-driven methods, our design's stability and performance depend on a tunable software parameter, simplifying digital implementation without overburdening hardware resources. Experimental results on a Twin Rotor system demonstrate the effectiveness of our approach compared to the state-of-the-art data-driven method.
△ Less
Submitted 12 July, 2023;
originally announced July 2023.
-
Semantic and Topological Map** using Intersection Identification
Authors:
Scott Fredriksson,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
This article presents a novel approach to identifying and classifying intersections for semantic and topological map**. More specifically, the proposed novel approach has the merit of generating a semantically meaningful map containing intersections, pathways, dead ends, and pathways leading to unexplored frontiers. Furthermore, the resulting semantic map can be used to generate a sparse topolog…
▽ More
This article presents a novel approach to identifying and classifying intersections for semantic and topological map**. More specifically, the proposed novel approach has the merit of generating a semantically meaningful map containing intersections, pathways, dead ends, and pathways leading to unexplored frontiers. Furthermore, the resulting semantic map can be used to generate a sparse topological map representation, that can be utilized by robots for global navigation. The proposed solution also introduces a built-in filtering to handle noises in the environment, to remove openings in the map that the robot cannot pass, and to remove small objects to optimize and simplify the overall map** results. The efficacy of the proposed semantic and topological map** method is demonstrated over a map of an indoor structured environment that is built from experimental data. The proposed framework, when compared with similar state-of-the-art topological map** solutions, is able to produce a map with up to 89% fewer nodes than the next best solution.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Event Camera and LiDAR based Human Tracking for Adverse Lighting Conditions in Subterranean Environments
Authors:
Mario A. V. Saucedo,
Akash Patel,
Rucha Sawlekar,
Akshit Saradagi,
Christoforos Kanellakis,
Ali-Akbar Agha-Mohammadi,
George Nikolakopoulos
Abstract:
In this article, we propose a novel LiDAR and event camera fusion modality for subterranean (SubT) environments for fast and precise object and human detection in a wide variety of adverse lighting conditions, such as low or no light, high-contrast zones and in the presence of blinding light sources. In the proposed approach, information from the event camera and LiDAR are fused to localize a huma…
▽ More
In this article, we propose a novel LiDAR and event camera fusion modality for subterranean (SubT) environments for fast and precise object and human detection in a wide variety of adverse lighting conditions, such as low or no light, high-contrast zones and in the presence of blinding light sources. In the proposed approach, information from the event camera and LiDAR are fused to localize a human or an object-of-interest in a robot's local frame. The local detection is then transformed into the inertial frame and used to set references for a Nonlinear Model Predictive Controller (NMPC) for reactive tracking of humans or objects in SubT environments. The proposed novel fusion uses intensity filtering and K-means clustering on the LiDAR point cloud and frequency filtering and connectivity clustering on the events induced in an event camera by the returning LiDAR beams. The centroids of the clusters in the event camera and LiDAR streams are then paired to localize reflective markers present on safety vests and signs in SubT environments. The efficacy of the proposed scheme has been experimentally validated in a real SubT environment (a mine) with a Pioneer 3AT mobile robot. The experimental results show real-time performance for human detection and the NMPC-based controller allows for reactive tracking of a human or object of interest, even in complete darkness.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
Reactive Task Allocation for Balanced Servicing of Multiple Task Queues
Authors:
Niklas Dahlquist,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
In this article, we propose a reactive task allocation architecture for a multi-agent system for scenarios where the tasks arrive at random times and are grouped into multiple queues. Two stage tasks are considered where every task has a beginning, an intermediate and a final part, typical in pick-and-drop and inspect-and-report scenarios. A centralized auction-based task allocation system is prop…
▽ More
In this article, we propose a reactive task allocation architecture for a multi-agent system for scenarios where the tasks arrive at random times and are grouped into multiple queues. Two stage tasks are considered where every task has a beginning, an intermediate and a final part, typical in pick-and-drop and inspect-and-report scenarios. A centralized auction-based task allocation system is proposed, where an auction system takes into consideration bids submitted by the agents for individual tasks, current length of the queues and the waiting times of the tasks in the queues to decide on a task allocation strategy. The costs associated with these considerations, along with the constraints of having unique map**s between tasks and agents and constraints on the maximum number of agents that can be assigned to a queue, results in a Linear Integer Program (LIP) that is solved using the SCIP solver. For the scenario where the queue lengths are penalized but not the waiting times, we demonstrate that the auction system allocates tasks in a manner that all the queue lengths become constant, which is termed balancing. For the scenarios where both the costs are considered, we qualitatively analyse the effect of the choice of the relative weights on the resulting task allocation and provide guidelines for the choice of the weights. We present simulation results that illustrate the balanced allocation of tasks and validate the analysis for the trade-off between the costs related to queue lengths and task waiting times.
△ Less
Submitted 5 April, 2023;
originally announced April 2023.
-
Reactive Multi-agent Coordination using Auction-based Task Allocation and Behavior Trees
Authors:
Niklas Dahlquist,
Björn Lindqvist,
Akshit Saradagi,
George Nikolakopoulos
Abstract:
This article presents an architecture for multi-agent task allocation and task execution, through the unification of a market-inspired task-auctioning system with Behavior Trees for managing and executing lower level behaviors. We consider the scenario with multi-stage tasks, such as 'pick and place', whose arrival times are not known a priori. In such a scenario, a coordinating architecture is ex…
▽ More
This article presents an architecture for multi-agent task allocation and task execution, through the unification of a market-inspired task-auctioning system with Behavior Trees for managing and executing lower level behaviors. We consider the scenario with multi-stage tasks, such as 'pick and place', whose arrival times are not known a priori. In such a scenario, a coordinating architecture is expected to be reactive to newly arrived tasks and the resulting rerouting of agents should be dependent on the stage of completion of their current multi-stage tasks. In the novel architecture proposed in this article, a central auctioning system gathers bids (cost-estimates for completing currently available tasks) from all agents, and solves a combinatorial problem to optimally assign tasks to agents. For every agent, it's participation in the auctioning system and execution of an assigned multi-stage task is managed using behavior trees, which switch among several well-defined behaviors in response to changing scenarios. The auctioning system is run at a fixed rate, allowing for newly added tasks to be incorporated into the auctioning system, which makes the solution reactive and allows for the rerouting of some agents (subject to the states of the behavior trees). We demonstrate that the proposed architecture is especially well-suited for multi-stage tasks, where high costs are incurred when rerouting agents who have completed one or more stages of their current tasks. The scalability analysis of the proposed architecture reveals that it scales well with the number of agents and number of tasks. The proposed framework is experimentally validated in multiple scenarios in a lab environment. A video of a demonstration can be viewed at: https://youtu.be/ZdEkoOOlB2g}.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
Data-Driven Feedback Linearization of Nonlinear Systems with Periodic Orbits in the Zero-Dynamics
Authors:
Karthik Shenoy,
Akshit Saradagi,
Ramkrishna Pasumarthy,
Vijaysekhar Chellaboina
Abstract:
In this article, we present data-driven feedback linearization for nonlinear systems with periodic orbits in the zero-dynamics. This scenario is challenging for data-driven control design because the higher order terms of the internal dynamics in the discretization appear as disturbance inputs to the controllable subsystem of the normal form. Our design consists of two parts: a data-driven feedbac…
▽ More
In this article, we present data-driven feedback linearization for nonlinear systems with periodic orbits in the zero-dynamics. This scenario is challenging for data-driven control design because the higher order terms of the internal dynamics in the discretization appear as disturbance inputs to the controllable subsystem of the normal form. Our design consists of two parts: a data-driven feedback linearization based controller and a two-part estimator that can reconstruct the unknown nonlinear terms in the normal form of a nonlinear system. We investigate the effects of coupling between the subsystems in the normal form of the closed-loop nonlinear system and conclude that the presence of such coupling prevents asymptotic convergence of the controllable states. We also show that the estimation error in the controllable states scales linearly with the sampling time. Finally, we present a simulation based validation of the proposed data-driven feedback linearization.
△ Less
Submitted 21 November, 2022;
originally announced November 2022.
-
Safe Autonomous Docking Maneuvers for a Floating Platform based on Input Sharing Control Barrier Functions
Authors:
Akshit Saradagi,
Avijit Banerjee,
Sumeet Satpute,
George Nikolakopoulos
Abstract:
In this article, we present a control strategy for the problem of safe autonomous docking for a planar floating platform (Slider) that emulates the movement of a satellite. Employing the proposed strategy, Slider approaches a docking port with the right orientation, maintaining a safe distance, while always kee** a visual lock on the docking port throughout the docking maneuver. Control barrier…
▽ More
In this article, we present a control strategy for the problem of safe autonomous docking for a planar floating platform (Slider) that emulates the movement of a satellite. Employing the proposed strategy, Slider approaches a docking port with the right orientation, maintaining a safe distance, while always kee** a visual lock on the docking port throughout the docking maneuver. Control barrier functions are designed to impose the safety, direction of approach and visual locking constraints. Three control inputs of the Slider are shared among three barrier functions in enforcing the constraints. It is proved that the control inputs are shared in a conflict-free manner in rendering the sets defining safety and visual locking constraints forward invariant and in establishing finite-time convergence to the visual locking mode. The conflict-free input-sharing ensures the feasibility of a quadratic program that generates minimally-invasive corrections for a nominal controller, that is designed to track the docking port, so that the barrier constraints are respected throughout the docking maneuver. The efficacy of the proposed control design approach is validated through various simulations.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
Event-triggered Control for Nonlinear Systems with Center Manifolds
Authors:
Akshit Saradagi,
Vijay Muralidharan,
Arun D. Mahindrakar,
Pavankumar Tallapragada
Abstract:
In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a…
▽ More
In this work, we consider the problem of event-triggered implementation of control laws designed for the local stabilization of nonlinear systems with center manifolds. We propose event-triggering conditions which are derived from a local input-to-state stability characterization of such systems. The triggering conditions ensure local ultimate boundedness of the trajectories and the existence of a uniform positive lower bound for the inter-event times. The ultimate bound can be made arbitrarily small, but by allowing for smaller inter-event times. Under certain assumptions on the controller structure, local asymptotic stability of the origin is also guaranteed. Two sets of triggering conditions are proposed, that cater to the cases where the exact center manifold and only an approximation of the center manifold is computable. The closed-loop system exhibits some desirable properties when the exact knowledge of the center manifold is employed in checking the triggering conditions. Three illustrative examples that explore different scenarios are presented and the applicability of the proposed methods is demonstrated. The third example concerns the event-triggered implementation of a position stabilizing controller for the open-loop unstable Mobile Inverted Pendulum (MIP) robot.
△ Less
Submitted 20 October, 2021;
originally announced October 2021.
