-
Autonomous driving of trucks in off-road environment
Authors:
Kenny A. Q. Caldas,
Filipe M. Barbosa,
Junior A. R. Silva,
Tiago C. Santos,
Iago P. Gomes,
Luis A. Rosero,
Denis F. Wolf,
Valdir Grassi Jr
Abstract:
Off-road driving operations can be a challenging environment for human conductors as they are subject to accidents, repetitive and tedious tasks, strong vibrations, which may affect their health in the long term. Therefore, they can benefit from a successful implementation of autonomous vehicle technology, improving safety, reducing labor costs and fuel consumption, and increasing operational effi…
▽ More
Off-road driving operations can be a challenging environment for human conductors as they are subject to accidents, repetitive and tedious tasks, strong vibrations, which may affect their health in the long term. Therefore, they can benefit from a successful implementation of autonomous vehicle technology, improving safety, reducing labor costs and fuel consumption, and increasing operational efficiency. The main contribution of this paper is the experimental validation of a path tracking control strategy, composed of longitudinal and lateral controllers, on an off-road scenario with a fully-loaded heavy-duty truck. The longitudinal control strategy relies on a Non-Linear Model Predictive Controller (NMPC), which considers the path geometry and simplified vehicle dynamics to compute a smooth and comfortable input velocity, without violating the imposed constraints. The lateral controller is based on a Robust Linear Quadratic Regulator (RLQR), which considers a vehicle model subject to parametric uncertainties to minimize its lateral displacement and heading error, as well as ensure stability. Experiments were carried out using a fully-loaded vehicle on unpaved roads in an open-pit mine. The truck followed the reference path within the imposed constraints, showing robustness and driving smoothness.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
Semantic SuperPoint: A Deep Semantic Descriptor
Authors:
Gabriel S. Gama,
Nícolas S. Rosa,
Valdir Grassi Jr
Abstract:
Several SLAM methods benefit from the use of semantic information. Most integrate photometric methods with high-level semantics such as object detection and semantic segmentation. We propose that adding a semantic segmentation decoder in a shared encoder architecture would help the descriptor decoder learn semantic information, improving the feature extractor. This would be a more robust approach…
▽ More
Several SLAM methods benefit from the use of semantic information. Most integrate photometric methods with high-level semantics such as object detection and semantic segmentation. We propose that adding a semantic segmentation decoder in a shared encoder architecture would help the descriptor decoder learn semantic information, improving the feature extractor. This would be a more robust approach than only using high-level semantic information since it would be intrinsically learned in the descriptor and would not depend on the final quality of the semantic prediction. To add this information, we take advantage of multi-task learning methods to improve accuracy and balance the performance of each task. The proposed models are evaluated according to detection and matching metrics on the HPatches dataset. The results show that the Semantic SuperPoint model performs better than the baseline one.
△ Less
Submitted 2 November, 2022;
originally announced November 2022.
-
Leveraging convergence behavior to balance conflicting tasks in multi-task learning
Authors:
Angelica Tiemi Mizuno Nakamura,
Denis Fernando Wolf,
Valdir Grassi Jr
Abstract:
Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to share the same subset of parameters, creating an inductive bias between them during the training process. Due to its simplicity, potential to improve generalization…
▽ More
Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to share the same subset of parameters, creating an inductive bias between them during the training process. Due to its simplicity, potential to improve generalization, and reduce computational cost, it has gained the attention of the scientific and industrial communities. However, tasks often conflict with each other, which makes it challenging to define how the gradients of multiple tasks should be combined to allow simultaneous learning. To address this problem, we use the idea of multi-objective optimization to propose a method that takes into account temporal behaviour of the gradients to create a dynamic bias that adjust the importance of each task during the backpropagation. The result of this method is to give more attention to the tasks that are diverging or that are not being benefited during the last iterations, allowing to ensure that the simultaneous learning is heading to the performance maximization of all tasks. As a result, we empirically show that the proposed method outperforms the state-of-art approaches on learning conflicting tasks. Unlike the adopted baselines, our method ensures that all tasks reach good generalization performances.
△ Less
Submitted 13 April, 2022;
originally announced April 2022.
-
Robust path-following control design of heavy vehicles based on multiobjective evolutionary optimization
Authors:
Gustavo Alves Prudencio de Morais,
Lucas Barbosa Marcos,
Filipe Marques Barbosa,
Bruno Henrique Groenner Barbosa,
Marco Henrique Terra,
Valdir Grassi Jr
Abstract:
The ability to deal with systems parametric uncertainties is an essential issue for heavy self-driving vehicles in unconfined environments. In this sense, robust controllers prove to be efficient for autonomous navigation. However, uncertainty matrices for this class of systems are usually defined by algebraic methods which demand prior knowledge of the system dynamics. In this case, the control s…
▽ More
The ability to deal with systems parametric uncertainties is an essential issue for heavy self-driving vehicles in unconfined environments. In this sense, robust controllers prove to be efficient for autonomous navigation. However, uncertainty matrices for this class of systems are usually defined by algebraic methods which demand prior knowledge of the system dynamics. In this case, the control system designer depends on the quality of the uncertain model to obtain an optimal control performance. This work proposes a robust recursive controller designed via multiobjective optimization to overcome these shortcomings. Furthermore, a local search approach for multiobjective optimization problems is presented. The proposed method applies to any multiobjective evolutionary algorithm already established in the literature. The results presented show that this combination of model-based controller and machine learning improves the effectiveness of the system in terms of robustness, stability and smoothness.
△ Less
Submitted 12 January, 2022; v1 submitted 14 October, 2020;
originally announced October 2020.
-
On Deep Learning Techniques to Boost Monocular Depth Estimation for Autonomous Navigation
Authors:
Raul de Queiroz Mendes,
Eduardo Godinho Ribeiro,
Nicolas dos Santos Rosa,
Valdir Grassi Jr
Abstract:
Inferring the depth of images is a fundamental inverse problem within the field of Computer Vision since depth information is obtained through 2D images, which can be generated from infinite possibilities of observed real scenes. Benefiting from the progress of Convolutional Neural Networks (CNNs) to explore structural features and spatial image information, Single Image Depth Estimation (SIDE) is…
▽ More
Inferring the depth of images is a fundamental inverse problem within the field of Computer Vision since depth information is obtained through 2D images, which can be generated from infinite possibilities of observed real scenes. Benefiting from the progress of Convolutional Neural Networks (CNNs) to explore structural features and spatial image information, Single Image Depth Estimation (SIDE) is often highlighted in scopes of scientific and technological innovation, as this concept provides advantages related to its low implementation cost and robustness to environmental conditions. In the context of autonomous vehicles, state-of-the-art CNNs optimize the SIDE task by producing high-quality depth maps, which are essential during the autonomous navigation process in different locations. However, such networks are usually supervised by sparse and noisy depth data, from Light Detection and Ranging (LiDAR) laser scans, and are carried out at high computational cost, requiring high-performance Graphic Processing Units (GPUs). Therefore, we propose a new lightweight and fast supervised CNN architecture combined with novel feature extraction models which are designed for real-world autonomous navigation. We also introduce an efficient surface normals module, jointly with a simple geometric 2.5D loss function, to solve SIDE problems. We also innovate by incorporating multiple Deep Learning techniques, such as the use of densification algorithms and additional semantic, surface normals and depth information to train our framework. The method introduced in this work focuses on robotic applications in indoor and outdoor environments and its results are evaluated on the competitive and publicly available NYU Depth V2 and KITTI Depth datasets.
△ Less
Submitted 28 December, 2020; v1 submitted 13 October, 2020;
originally announced October 2020.
-
Real-Time Deep Learning Approach to Visual Servo Control and Grasp Detection for Autonomous Robotic Manipulation
Authors:
Eduardo Godinho Ribeiro,
Raul de Queiroz Mendes,
Valdir Grassi Jr
Abstract:
In order to explore robotic gras** in unstructured and dynamic environments, this work addresses the visual perception phase involved in the task. This phase involves the processing of visual data to obtain the location of the object to be grasped, its pose and the points at which the robot`s grippers must make contact to ensure a stable grasp. For this, the Cornell Gras** dataset is used to t…
▽ More
In order to explore robotic gras** in unstructured and dynamic environments, this work addresses the visual perception phase involved in the task. This phase involves the processing of visual data to obtain the location of the object to be grasped, its pose and the points at which the robot`s grippers must make contact to ensure a stable grasp. For this, the Cornell Gras** dataset is used to train a convolutional neural network that, having an image of the robot`s workspace, with a certain object, is able to predict a grasp rectangle that symbolizes the position, orientation and opening of the robot`s grippers before its closing. In addition to this network, which runs in real-time, another one is designed to deal with situations in which the object moves in the environment. Therefore, the second network is trained to perform a visual servo control, ensuring that the object remains in the robot`s field of view. This network predicts the proportional values of the linear and angular velocities that the camera must have so that the object is always in the image processed by the grasp network. The dataset used for training was automatically generated by a Kinova Gen3 manipulator. The robot is also used to evaluate the applicability in real-time and obtain practical results from the designed algorithms. Moreover, the offline results obtained through validation sets are also analyzed and discussed regarding their efficiency and processing speed. The developed controller was able to achieve a millimeter accuracy in the final position considering a target object seen for the first time. To the best of our knowledge, we have not found in the literature other works that achieve such precision with a controller learned from scratch. Thus, this work presents a new system for autonomous robotic manipulation with high processing speed and the ability to generalize to several different objects.
△ Less
Submitted 28 February, 2021; v1 submitted 13 October, 2020;
originally announced October 2020.
-
Perpetual Assurances for Self-Adaptive Systems
Authors:
Danny Weyns,
Nelly Bencomo,
Radu Calinescu,
Javier Cámara,
Carlo Ghezzi,
Vincenzo Grassi,
Lars Grunske,
Paola Inverardi,
Jean-Marc Jézéquel,
Sam Malek,
Raffaela Mirandola,
Marco Mori,
Giordano Tamburrelli
Abstract:
Providing assurances for self-adaptive systems is challenging. A primary underlying problem is uncertainty that may stem from a variety of different sources, ranging from incomplete knowledge to sensor noise and uncertain behavior of humans in the loop. Providing assurances that the self-adaptive system complies with its requirements calls for an enduring process spanning the whole lifetime of the…
▽ More
Providing assurances for self-adaptive systems is challenging. A primary underlying problem is uncertainty that may stem from a variety of different sources, ranging from incomplete knowledge to sensor noise and uncertain behavior of humans in the loop. Providing assurances that the self-adaptive system complies with its requirements calls for an enduring process spanning the whole lifetime of the system. In this process, humans and the system jointly derive and integrate new evidence and arguments, which we coined perpetual assurances for self-adaptive systems. In this paper, we provide a background framework and the foundation for perpetual assurances for self-adaptive systems. We elaborate on the concrete challenges of offering perpetual assurances, requirements for solutions, realization techniques and mechanisms to make solutions suitable. We also present benchmark criteria to compare solutions. We then present a concrete exemplar that researchers can use to assess and compare approaches for perpetual assurances for self-adaptation.
△ Less
Submitted 12 March, 2019;
originally announced March 2019.
-
Sparse-to-Continuous: Enhancing Monocular Depth Estimation using Occupancy Maps
Authors:
Nícolas Rosa,
Vitor Guizilini,
Valdir Grassi Jr
Abstract:
This paper addresses the problem of single image depth estimation (SIDE), focusing on improving the quality of deep neural network predictions. In a supervised learning scenario, the quality of predictions is intrinsically related to the training labels, which guide the optimization process. For indoor scenes, structured-light-based depth sensors (e.g. Kinect) are able to provide dense, albeit sho…
▽ More
This paper addresses the problem of single image depth estimation (SIDE), focusing on improving the quality of deep neural network predictions. In a supervised learning scenario, the quality of predictions is intrinsically related to the training labels, which guide the optimization process. For indoor scenes, structured-light-based depth sensors (e.g. Kinect) are able to provide dense, albeit short-range, depth maps. On the other hand, for outdoor scenes, LiDARs are considered the standard sensor, which comparatively provides much sparser measurements, especially in areas further away. Rather than modifying the neural network architecture to deal with sparse depth maps, this article introduces a novel densification method for depth maps, using the Hilbert Maps framework. A continuous occupancy map is produced based on 3D points from LiDAR scans, and the resulting reconstructed surface is projected into a 2D depth map with arbitrary resolution. Experiments conducted with various subsets of the KITTI dataset show a significant improvement produced by the proposed Sparse-to-Continuous technique, without the introduction of extra information into the training stage.
△ Less
Submitted 21 October, 2019; v1 submitted 24 September, 2018;
originally announced September 2018.
-
Robust path-following control for articulated heavy-duty vehicles
Authors:
Filipe Marques Barbosa,
Lucas Barbosa Marcos,
Maira Martins da Silva,
Marco Henrique Terra,
Valdir Grassi Jr
Abstract:
Path following and lateral stability are crucial issues for autonomous vehicles. Moreover, these problems increase in complexity when handling articulated heavy-duty vehicles due to their poor manoeuvrability, large sizes and mass variation. In addition, uncertainties on mass may have the potential to significantly decrease the performance of the system, even to the point of destabilising it. Thes…
▽ More
Path following and lateral stability are crucial issues for autonomous vehicles. Moreover, these problems increase in complexity when handling articulated heavy-duty vehicles due to their poor manoeuvrability, large sizes and mass variation. In addition, uncertainties on mass may have the potential to significantly decrease the performance of the system, even to the point of destabilising it. These parametric variations must be taken into account during the design of the controller. However, robust control techniques usually require offline adjustment of auxiliary tuning parameters, which is not practical, leading to sub-optimal operation. Hence, this paper presents an approach to path-following and lateral control for autonomous articulated heavy-duty vehicles subject to parametric uncertainties by using a robust recursive regulator. The main advantage of the proposed controller is that it does not depend on the offline adjustment of tuning parameters. Parametric uncertainties were assumed to be on the payload, and an $\mathcal{H}_{\infty}$ controller was used for performance comparison. The performance of both controllers is evaluated in a double lane-change manoeuvre. Simulation results showed that the proposed method had better performance in terms of robustness, lateral stability, driving smoothness and safety, which demonstrates that it is a very promising control technique for practical applications.
△ Less
Submitted 11 June, 2020; v1 submitted 6 August, 2018;
originally announced August 2018.
-
Learning to Race through Coordinate Descent Bayesian Optimisation
Authors:
Rafael Oliveira,
Fernando H. M. Rocha,
Lionel Ott,
Vitor Guizilini,
Fabio Ramos,
Valdir Grassi Jr
Abstract:
In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise control policies for individual stages of the process might not be applicable, and instead the whole policy might have to be optimised at once. On the other hand, th…
▽ More
In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise control policies for individual stages of the process might not be applicable, and instead the whole policy might have to be optimised at once. On the other hand, the cost to evaluate the policy's performance might also be high, being desirable that a solution can be found with as few interactions as possible with the real system. We consider the problem of optimising control policies to allow a robot to complete a given race track within a minimum amount of time. We assume that the robot has no prior information about the track or its own dynamical model, just an initial valid driving example. Localisation is only applied to monitor the robot and to provide an indication of its position along the track's centre axis. We propose a method for finding a policy that minimises the time per lap while kee** the vehicle on the track using a Bayesian optimisation (BO) approach over a reproducing kernel Hilbert space. We apply an algorithm to search more efficiently over high-dimensional policy-parameter spaces with BO, by iterating over each dimension individually, in a sequential coordinate descent-like scheme. Experiments demonstrate the performance of the algorithm against other methods in a simulated car racing environment.
△ Less
Submitted 16 February, 2018;
originally announced February 2018.
-
The Fluorescence Detector of the Pierre Auger Observatory
Authors:
The Pierre Auger Collaboration,
J. Abraham,
P. Abreu,
M. Aglietta,
C. Aguirre,
E. J. Ahn,
D. Allard,
I. Allekotte,
J. Allen,
P. Allison,
J. Alvarez-Muñiz,
M. Ambrosio,
L. Anchordoqui,
S. Andringa,
A. Anzalone,
C. Aramo,
E. Arganda,
S. Argirò,
K. Arisaka,
F. Arneodo,
F. Arqueros,
T. Asch,
H. Asorey,
P. Assis,
J. Aublin
, et al. (493 additional authors not shown)
Abstract:
The Pierre Auger Observatory is a hybrid detector for ultra-high energy cosmic rays. It combines a surface array to measure secondary particles at ground level together with a fluorescence detector to measure the development of air showers in the atmosphere above the array. The fluorescence detector comprises 24 large telescopes specialized for measuring the nitrogen fluorescence caused by charg…
▽ More
The Pierre Auger Observatory is a hybrid detector for ultra-high energy cosmic rays. It combines a surface array to measure secondary particles at ground level together with a fluorescence detector to measure the development of air showers in the atmosphere above the array. The fluorescence detector comprises 24 large telescopes specialized for measuring the nitrogen fluorescence caused by charged particles of cosmic ray air showers. In this paper we describe the components of the fluorescence detector including its optical system, the design of the camera, the electronics, and the systems for relative and absolute calibration. We also discuss the operation and the monitoring of the detector. Finally, we evaluate the detector performance and precision of shower reconstructions.
△ Less
Submitted 24 July, 2009;
originally announced July 2009.
-
Temperature behavior of vortices of a 3D thermoconducting viscous fluid
Authors:
V. Grassi,
R. A. Leo,
G. Soliani,
P. Tempesta
Abstract:
The Navier-Stokes-Fourier model for a 3D thermoconducting viscous fluid, where the evolution equation for the temperature T contains a term proportional to the rate of energy dissipation, is investigated analitically at the light of the rotational invariance property. Two cases are considered: the Couette flow and a flow with a radial velocity between two rotating impermeable and porous coaxial…
▽ More
The Navier-Stokes-Fourier model for a 3D thermoconducting viscous fluid, where the evolution equation for the temperature T contains a term proportional to the rate of energy dissipation, is investigated analitically at the light of the rotational invariance property. Two cases are considered: the Couette flow and a flow with a radial velocity between two rotating impermeable and porous coaxial cylinders, respectively. In both cases, we show the existence of a maximum value of T, T_max, when the difference of temperature Delta T=T_2-T_1 on the surfaces of the cylinders is assigned. The role of T_max is discussed in the context of different physical situations.
△ Less
Submitted 17 July, 2001;
originally announced July 2001.
-
Vortices and invariants surfaces generated by symmetries for the 3D Navier-Stokes equations
Authors:
V. Grassi,
R. A. Leo,
G. Soliani,
P. Tempesta
Abstract:
We show that certain infinitesimal operators of the Lie-point symmetries of the incompressible 3D Navier-Stokes equations give rise to vortex solutions with different characteristics. This approach allows an algebraic classification of vortices and throws light on the alignment mechanism between the vorticity and the vortex stretching vector. The symmetry algebra associated with the Navier-Stoke…
▽ More
We show that certain infinitesimal operators of the Lie-point symmetries of the incompressible 3D Navier-Stokes equations give rise to vortex solutions with different characteristics. This approach allows an algebraic classification of vortices and throws light on the alignment mechanism between the vorticity and the vortex stretching vector. The symmetry algebra associated with the Navier-Stokes equations turns out to be infinite- dimensional. New vortical structures, generalizing in some cases well-known configurations such as, for example, the Burgers and Lundgren solutions, are obtained and discussed in relation to the value of the dynamic angle. A systematic treatment of the boundary conditions invariant under the symmetry group of the equations under study is also performed, and the corresponding invariant surfaces are recognized.
△ Less
Submitted 10 December, 1999;
originally announced December 1999.
-
Continuous approximation of binomial lattices
Authors:
V. Grassi,
R. A. Leo,
G. Soliani,
L. Solombrino
Abstract:
A systematic analysis of a continuous version of a binomial lattice, containing a real parameter $γ$ and covering the Toda field equation as $γ\to\infty$, is carried out in the framework of group theory. The symmetry algebra of the equation is derived. Reductions by one-dimensional and two-dimensional subalgebras of the symmetry algebra and their corresponding subgroups, yield notable field equa…
▽ More
A systematic analysis of a continuous version of a binomial lattice, containing a real parameter $γ$ and covering the Toda field equation as $γ\to\infty$, is carried out in the framework of group theory. The symmetry algebra of the equation is derived. Reductions by one-dimensional and two-dimensional subalgebras of the symmetry algebra and their corresponding subgroups, yield notable field equations in lower dimensions whose solutions allow to find exact solutions to the original equation. Some reduced equations turn out to be related to potentials of physical interest, such as the Fermi-Pasta-Ulam and the Killingbeck potentials, and others. An instanton-like approximate solution is also obtained which reproduces the Eguchi-Hanson instanton configuration for $γ\to\infty$. Furthermore, the equation under consideration is extended to $(n+1)$--dimensions. A spherically symmetric form of this equation, studied by means of the symmetry approach, provides conformally invariant classes of field equations comprising remarkable special cases. One of these $(n=4)$ enables us to establish a connection with the Euclidean Yang-Mills equations, another appears in the context of Differential Geometry in relation to the socalled Yamabe problem. All the properties of the reduced equations are shared by the spherically symmetric generalized field equation.
△ Less
Submitted 4 February, 1998;
originally announced February 1998.
-
Equations of the reaction-diffusion type with a loop algebra structure
Authors:
E. Alfinito,
V. Grassi,
R. A. Leo,
G. Profilo,
G. Soliani
Abstract:
A system of equations of the reaction-diffusion type is studied in the framework of both the direct and the inverse prolongation structure. We find that this system allows an incomplete prolongation Lie algebra, which is used to find the spectral problem and a whole class of nonlinear field equations containing the original ones as a special case.
A system of equations of the reaction-diffusion type is studied in the framework of both the direct and the inverse prolongation structure. We find that this system allows an incomplete prolongation Lie algebra, which is used to find the spectral problem and a whole class of nonlinear field equations containing the original ones as a special case.
△ Less
Submitted 13 October, 1997;
originally announced October 1997.
