-
VBR: A Vision Benchmark in Rome
Authors:
Leonardo Brizi,
Emanuele Giacomini,
Luca Di Giammarino,
Simone Ferrari,
Omar Salem,
Lorenzo De Rebotti,
Giorgio Grisetti
Abstract:
This paper presents a vision and perception research dataset collected in Rome, featuring RGB data, 3D point clouds, IMU, and GPS data. We introduce a new benchmark targeting visual odometry and SLAM, to advance the research in autonomous robotics and computer vision. This work complements existing datasets by simultaneously addressing several issues, such as environment diversity, motion patterns…
▽ More
This paper presents a vision and perception research dataset collected in Rome, featuring RGB data, 3D point clouds, IMU, and GPS data. We introduce a new benchmark targeting visual odometry and SLAM, to advance the research in autonomous robotics and computer vision. This work complements existing datasets by simultaneously addressing several issues, such as environment diversity, motion patterns, and sensor frequency. It uses up-to-date devices and presents effective procedures to accurately calibrate the intrinsic and extrinsic of the sensors while addressing temporal synchronization. During recording, we cover multi-floor buildings, gardens, urban and highway scenarios. Combining handheld and car-based data collections, our setup can simulate any robot (quadrupeds, quadrotors, autonomous vehicles). The dataset includes an accurate 6-dof ground truth based on a novel methodology that refines the RTK-GPS estimate with LiDAR point clouds through Bundle Adjustment. All sequences divided in training and testing are accessible through our website.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Ca$^2$Lib: Simple and Accurate LiDAR-RGB Calibration using Small Common Markers
Authors:
Emanuele Giacomini,
Leonardo Brizi,
Luca Di Giammarino,
Omar Salem,
Patrizio Perugini,
Giorgio Grisetti
Abstract:
In many fields of robotics, knowing the relative position and orientation between two sensors is a mandatory precondition to operate with multiple sensing modalities. In this context, the pair LiDAR-RGB cameras offer complementary features: LiDARs yield sparse high quality range measurements, while RGB cameras provide a dense color measurement of the environment. Existing techniques often rely eit…
▽ More
In many fields of robotics, knowing the relative position and orientation between two sensors is a mandatory precondition to operate with multiple sensing modalities. In this context, the pair LiDAR-RGB cameras offer complementary features: LiDARs yield sparse high quality range measurements, while RGB cameras provide a dense color measurement of the environment. Existing techniques often rely either on complex calibration targets that are expensive to obtain, or extracted virtual correspondences that can hinder the estimate's accuracy. In this paper we address the problem of LiDAR-RGB calibration using typical calibration patterns (i.e. A3 chessboard) with minimal human intervention. Our approach exploits the planarity of the target to find correspondences between the sensors measurements, leading to features that are robust to LiDAR noise.
Moreover, we estimate a solution by solving a joint non-linear optimization problem. We validated our approach by carrying on quantitative and comparative experiments with other state-of-the-art approaches. Our results show that our simple schema performs on par or better than other approches using complex calibration targets. Finally, we release an open-source C++ implementation at \url{https://github.com/srrg-sapienza/ca2lib}
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
Photometric LiDAR and RGB-D Bundle Adjustment
Authors:
Luca Di Giammarino,
Emanuele Giacomini,
Leonardo Brizi,
Omar Salem,
Giorgio Grisetti
Abstract:
The joint optimization of the sensor trajectory and 3D map is a crucial characteristic of Simultaneous Localization and Map** (SLAM) systems. To achieve this, the gold standard is Bundle Adjustment (BA). Modern 3D LiDARs now retain higher resolutions that enable the creation of point cloud images resembling those taken by conventional cameras. Nevertheless, the typical effective global refinemen…
▽ More
The joint optimization of the sensor trajectory and 3D map is a crucial characteristic of Simultaneous Localization and Map** (SLAM) systems. To achieve this, the gold standard is Bundle Adjustment (BA). Modern 3D LiDARs now retain higher resolutions that enable the creation of point cloud images resembling those taken by conventional cameras. Nevertheless, the typical effective global refinement techniques employed for RGB-D sensors are not widely applied to LiDARs. This paper presents a novel BA photometric strategy that accounts for both RGB-D and LiDAR in the same way. Our work can be used on top of any SLAM/GNSS estimate to improve and refine the initial trajectory. We conducted different experiments using these two depth sensors on public benchmarks. Our results show that our system performs on par or better compared to other state-of-the-art ad-hoc SLAM/BA strategies, free from data association and without making assumptions about the environment. In addition, we present the benefit of jointly using RGB-D and LiDAR within our unified method. We finally release an open-source CUDA/C++ implementation.
△ Less
Submitted 29 March, 2023;
originally announced March 2023.
-
Enhancing LiDAR performance: Robust De-skewing Exclusively Relying on Range Measurements
Authors:
Omar Salem,
Emanuele Giacomini,
Leonardo Brizi,
Luca Di Giammarino,
Giorgio Grisetti
Abstract:
Most commercially available Light Detection and Ranging (LiDAR)s measure the distances along a 2D section of the environment by sequentially sampling the free range along directions centered at the sensor's origin. When the sensor moves during the acquisition, the measured ranges are affected by a phenomenon known as "skewing", which appears as a distortion in the acquired scan. Skewing potentiall…
▽ More
Most commercially available Light Detection and Ranging (LiDAR)s measure the distances along a 2D section of the environment by sequentially sampling the free range along directions centered at the sensor's origin. When the sensor moves during the acquisition, the measured ranges are affected by a phenomenon known as "skewing", which appears as a distortion in the acquired scan. Skewing potentially affects all systems that rely on LiDAR data, however, it could be compensated if the position of the sensor were known each time a single range is measured. Most methods to de-skew a LiDAR are based on external sensors such as IMU or wheel odometry, to estimate these intermediate LiDAR positions. In this paper, we present a method that relies exclusively on range measurements to effectively estimate the robot velocities which are then used for de-skewing. Our approach is suitable for low-frequency LiDAR where the skewing is more evident. It can be seamlessly integrated into existing pipelines, enhancing their performance at a negligible computational cost.
△ Less
Submitted 16 October, 2023; v1 submitted 13 March, 2023;
originally announced March 2023.
-
Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge
Authors:
Sharib Ali,
Noha Ghatwary,
Debesh Jha,
Ece Isik-Polat,
Gorkem Polat,
Chen Yang,
Wuyang Li,
Adrian Galdran,
Miguel-Ángel González Ballester,
Vajira Thambawita,
Steven Hicks,
Sahadev Poudel,
Sang-Woong Lee,
Ziyi **,
Tianyuan Gan,
ChengHui Yu,
JiangPeng Yan,
Doyeob Yeo,
Hyunseok Lee,
Nikhil Kumar Tomar,
Mahmood Haithmi,
Amr Ahmed,
Michael A. Riegler,
Christian Daul,
Pål Halvorsen
, et al. (7 additional authors not shown)
Abstract:
Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal of polyps (referred to as polypectomy ) are highly operator-dependent procedures. There exist a high missed detection rate and incomplete removal of colonic pol…
▽ More
Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal of polyps (referred to as polypectomy ) are highly operator-dependent procedures. There exist a high missed detection rate and incomplete removal of colonic polyps due to their variable nature, the difficulties to delineate the abnormality, the high recurrence rates, and the anatomical topography of the colon. There have been several developments in realising automated methods for both detection and segmentation of these polyps using machine learning. However, the major drawback in most of these methods is their ability to generalise to out-of-sample unseen datasets that come from different centres, modalities and acquisition systems. To test this hypothesis rigorously we curated a multi-centre and multi-population dataset acquired from multiple colonoscopy systems and challenged teams comprising machine learning experts to develop robust automated detection and segmentation methods as part of our crowd-sourcing Endoscopic computer vision challenge (EndoCV) 2021. In this paper, we analyse the detection results of the four top (among seven) teams and the segmentation results of the five top teams (among 16). Our analyses demonstrate that the top-ranking teams concentrated on accuracy (i.e., accuracy > 80% on overall Dice score on different validation sets) over real-time performance required for clinical applicability. We further dissect the methods and provide an experiment-based hypothesis that reveals the need for improved generalisability to tackle diversity present in multi-centre datasets.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
A multi-centre polyp detection and segmentation dataset for generalisability assessment
Authors:
Sharib Ali,
Debesh Jha,
Noha Ghatwary,
Stefano Realdon,
Renato Cannizzaro,
Osama E. Salem,
Dominique Lamarque,
Christian Daul,
Michael A. Riegler,
Kim V. Anonsen,
Andreas Petlund,
Pål Halvorsen,
Jens Rittscher,
Thomas de Lange,
James E. East
Abstract:
Polyps in the colon are widely known cancer precursors identified by colonoscopy. Whilst most polyps are benign, the polyp's number, size and surface structure are linked to the risk of colon cancer. Several methods have been developed to automate polyp detection and segmentation. However, the main issue is that they are not tested rigorously on a large multicentre purpose-built dataset, one reaso…
▽ More
Polyps in the colon are widely known cancer precursors identified by colonoscopy. Whilst most polyps are benign, the polyp's number, size and surface structure are linked to the risk of colon cancer. Several methods have been developed to automate polyp detection and segmentation. However, the main issue is that they are not tested rigorously on a large multicentre purpose-built dataset, one reason being the lack of a comprehensive public dataset. As a result, the developed methods may not generalise to different population datasets. To this extent, we have curated a dataset from six unique centres incorporating more than 300 patients. The dataset includes both single frame and sequence data with 3762 annotated polyp labels with precise delineation of polyp boundaries verified by six senior gastroenterologists. To our knowledge, this is the most comprehensive detection and pixel-level segmentation dataset (referred to as \textit{PolypGen}) curated by a team of computational scientists and expert gastroenterologists. The paper provides insight into data construction and annotation strategies, quality assurance, and technical validation. Our dataset can be downloaded from \url{ https://doi.org/10.7303/syn26376615}.
△ Less
Submitted 19 May, 2023; v1 submitted 8 June, 2021;
originally announced June 2021.
-
Performance Analysis of Dynamic Source Routing Protocol
Authors:
Amer O. Abu Salem,
Ghassan Samara,
Tareq Alhmiedat
Abstract:
Dynamic Source Routing (DSR) is an efficient on-demand routing protocol for mobile ad-hoc networks (MANET). It depends on two main procedures: Route Discovery and Route Maintenance. Route discovery is the procedure used at the source of the packets to discover a route to the destination. Route Maintenance is the procedure that discovers link failures and repairs them. Route caching is the sub proc…
▽ More
Dynamic Source Routing (DSR) is an efficient on-demand routing protocol for mobile ad-hoc networks (MANET). It depends on two main procedures: Route Discovery and Route Maintenance. Route discovery is the procedure used at the source of the packets to discover a route to the destination. Route Maintenance is the procedure that discovers link failures and repairs them. Route caching is the sub procedure serviceable to avoid the demand for discovering a route or to reduce route discovery delay before every data packet is sent. The goal of this paper is to evaluate the performance of DSR. Different performance expressions are investigated including, delivery ratio, end to-end delay, and throughput, depending on different cache sizes and different speeds. All of that as a study to develop a new caching strategy as a future work.
△ Less
Submitted 13 December, 2017;
originally announced December 2017.
-
A Mobile Device Prototype Application for the Detection and Prediction of Node Faults in Wireless Sensor Networks
Authors:
Anthony Marcus,
Ionut Cardei,
Borko Furht,
Osman Salem,
Ahmed Mehaoua
Abstract:
Various implementations of wireless sensor networks (i.e. personal area-, wireless body area- networks) are prone to node and network failures by such characteristics as limited node energy resources and hardware damage incurred from their surrounding environment (i.e. flooding, forest fires, a patient falling). This may jeopardize their reliability to act as early warning systems, monitoring syst…
▽ More
Various implementations of wireless sensor networks (i.e. personal area-, wireless body area- networks) are prone to node and network failures by such characteristics as limited node energy resources and hardware damage incurred from their surrounding environment (i.e. flooding, forest fires, a patient falling). This may jeopardize their reliability to act as early warning systems, monitoring systems for patients and athletes, and industrial and environmental observation networks. Following the current trend and widespread use of hand held, mobile communication devices, we outline an application architecture designed to detect and predict faulty nodes in wireless sensor networks. Furthermore, we implement our design as a proof of concept prototype for Android-based smartphones, which may be extended to develop other applications used for monitoring networked wireless personal area and body sensors used in other capacities. We have conducted several preliminary experiments to demonstrate the use of our design, which is capable of monitoring networks of wireless sensor devices and predicting node faults based on several localized metrics. As attributes of such networks may change over time, any models generated when the application is initialized must be updated periodically such that the applied machine learning algorithm maintains high levels of both accuracy and precision. The application is designed to discover node faults and, once identified, alert the user so that appropriate action may be taken.
△ Less
Submitted 21 January, 2014;
originally announced January 2014.
-
Dynamic Safety Message Power Control in VANET Using PSO
Authors:
Ghassan Samara,
Tareq Alhmiedat,
Amer O. Abu Salem
Abstract:
In the recent years Vehicular Ad hoc Networks (VANET) became one of the most challenging research area in the field of Mobile Ad hoc Networks (MANET). Vehicles in VANET send emergency and safety periodic messages through one control channel having a limited bandwidth, which causes a growing collision to the channel especially in dense traffic situations. In this paper a protocol Particle swarm opt…
▽ More
In the recent years Vehicular Ad hoc Networks (VANET) became one of the most challenging research area in the field of Mobile Ad hoc Networks (MANET). Vehicles in VANET send emergency and safety periodic messages through one control channel having a limited bandwidth, which causes a growing collision to the channel especially in dense traffic situations. In this paper a protocol Particle swarm optimization Beacon Power Control (PBPC) is proposed, which makes dynamic transmission power control to adjust the transmission power of the safety periodic messages that have been aggressively sent by all vehicles on the road 10 times per a second, the proposed protocol aims to decrease the packet collision resulted from periodic safety messages, which leads to control the load on the channel while ensuring a high probability of message reception within the safety distance of the sender vehicle.
△ Less
Submitted 21 January, 2014; v1 submitted 10 January, 2014;
originally announced January 2014.
-
Power Control Protocols in VANET
Authors:
Ghassan Samara,
Amer O Abu Salem,
Tareq Alhmiedat
Abstract:
Vehicular Ad hoc Networks (VANET) is one of the most challenging research area in the field of the Mobile Ad hoc Network (MANET), Power control is a critical issue in VANETwhere is should be managed carefully to help the channel to have high performance. In this paper a comparative study in the published protocols in the field of safety message dynamic power control will be presented and evaluated…
▽ More
Vehicular Ad hoc Networks (VANET) is one of the most challenging research area in the field of the Mobile Ad hoc Network (MANET), Power control is a critical issue in VANETwhere is should be managed carefully to help the channel to have high performance. In this paper a comparative study in the published protocols in the field of safety message dynamic power control will be presented and evaluated.
△ Less
Submitted 11 November, 2013;
originally announced November 2013.
-
Cache Discovery Policies of MANET
Authors:
Amer O. Abu Salem,
Tareq Alhmiedat,
Ghassan Samara
Abstract:
In situations where establishing a network infrastructure is impossible, Ad-hoc networks are considered particularly important. Most of the previous research in Ad-hoc networks concentrated on the development and enhancement of dynamic routing protocols, which could efficiently discover routes between two communicating nodes. Although routing strategies is an important topic in MANETs, other topic…
▽ More
In situations where establishing a network infrastructure is impossible, Ad-hoc networks are considered particularly important. Most of the previous research in Ad-hoc networks concentrated on the development and enhancement of dynamic routing protocols, which could efficiently discover routes between two communicating nodes. Although routing strategies is an important topic in MANETs, other topics such as data access are also crucial since the final goal of using Ad-hoc networks is to provide data access to mobile nodes. One of the most attractive techniques used to improve the data access performance in MANET environment is cooperative caching; which means multiple caching nodes share and cooperatively manage the cached contents. It is lead the research to important questions, what data should be cached, where, when, and how? A cooperative caching addressed into two basic issues: cache discovery and cache management, in other words, how to find requested data efficiently and how to manage an individual cache to improve the overall capacity of a cooperated cache. In this paper we have made a review of the existing cache discovery algorithms to address four stages after application request and before server response, using an historical file to record the previous data requests, and proposed cluster architecture with data cluster head election to store efficient information for future use and reducing the cost of flooding. In addition, this paper suggests some alternative techniques for cache discovery. Finally, the paper concludes with a discussion on future research directions.
△ Less
Submitted 6 October, 2013;
originally announced October 2013.
-
An Indoor Fingerprinting Localization Approach for ZigBee Wireless Sensor Networks
Authors:
Tareq Alhmiedat,
Ghassan Samara,
Amer O. Abu Salem
Abstract:
Location tracking systems are increasingly becoming the focus of research in the field of Wireless Sensor Network (WSN). Received Signal Strength (RSS)-based localization systems are at the forefront of tracking research applications. Radio location fingerprinting is one of the most promising indoor positioning approaches due to its powerful in terms of accuracy and cost. However, fingerprinting s…
▽ More
Location tracking systems are increasingly becoming the focus of research in the field of Wireless Sensor Network (WSN). Received Signal Strength (RSS)-based localization systems are at the forefront of tracking research applications. Radio location fingerprinting is one of the most promising indoor positioning approaches due to its powerful in terms of accuracy and cost. However, fingerprinting systems require the collection of a large number of reference points in the tracking area to achieve reasonable localization accuracy. In this paper, we propose a fingerprinting localization approach based on a RSS technique. The proposed system does not require gathering a large number of reference points and offers good localization accuracy indoors. The implemented approach is based on dividing the tracking area into subareas and assigning a unique feature to each subarea through ranging the RSS values from different reference points. In order to test the proposed system's efficiency, a number of real experiments have been conducted using Jennic sensor nodes.
△ Less
Submitted 8 August, 2013;
originally announced August 2013.
-
An imporved decentralized approach for tracking multiple mobile targets through ZigBee WSNs
Authors:
Tareq Alhmiedat,
Amer O. Abu Salem,
Anas Abu Taleb
Abstract:
Target localization and tracking problems in WSNs have received considerable attention recently, driven by the requirement to achieve high localization accuracy, with the minimum cost possible. In WSN based tracking applications, it is critical to know the current location of any sensor node with the minimum energy consumed. This paper focuses on the energy consumption issue in terms of communicat…
▽ More
Target localization and tracking problems in WSNs have received considerable attention recently, driven by the requirement to achieve high localization accuracy, with the minimum cost possible. In WSN based tracking applications, it is critical to know the current location of any sensor node with the minimum energy consumed. This paper focuses on the energy consumption issue in terms of communication between nodes whenever the localization information is transmitted to a sink node. Tracking through WSNs can be categorized into centralized and decentralized systems. Decentralized systems offer low power consumption when deployed to track a small number of mobile targets compared to the centralized tracking systems. However, in several applications, it is essential to position a large number of mobile targets. In such applications, decentralized systems offer high power consumption, since the location of each mobile target is required to be transmitted to a sink node, and this increases the power consumption for the whole WSN. In this paper, we propose a power efficient decentralized approach for tracking a large number of mobile targets while offering reasonable localization accuracy through ZigBee network.
△ Less
Submitted 11 July, 2013;
originally announced July 2013.
