-
Gated Fields: Learning Scene Reconstruction from Gated Videos
Authors:
Andrea Ramazzina,
Stefanie Walz,
Pragyan Dahal,
Mario Bijelic,
Felix Heide
Abstract:
Reconstructing outdoor 3D scenes from temporal observations is a challenge that recent work on neural fields has offered a new avenue for. However, existing methods that recover scene properties, such as geometry, appearance, or radiance, solely from RGB captures often fail when handling poorly-lit or texture-deficient regions. Similarly, recovering scenes with scanning LiDAR sensors is also diffi…
▽ More
Reconstructing outdoor 3D scenes from temporal observations is a challenge that recent work on neural fields has offered a new avenue for. However, existing methods that recover scene properties, such as geometry, appearance, or radiance, solely from RGB captures often fail when handling poorly-lit or texture-deficient regions. Similarly, recovering scenes with scanning LiDAR sensors is also difficult due to their low angular sampling rate which makes recovering expansive real-world scenes difficult. Tackling these gaps, we introduce Gated Fields - a neural scene reconstruction method that utilizes active gated video sequences. To this end, we propose a neural rendering approach that seamlessly incorporates time-gated capture and illumination. Our method exploits the intrinsic depth cues in the gated videos, achieving precise and dense geometry reconstruction irrespective of ambient illumination conditions. We validate the method across day and night scenarios and find that Gated Fields compares favorably to RGB and LiDAR reconstruction methods. Our code and datasets are available at https://light.princeton.edu/gatedfields/.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Vehicle State Estimation through Modular Factor Graph-based Fusion of Multiple Sensors
Authors:
Pragyan Dahal,
Jai Prakash,
Stefano Arrigoni,
Francesco Braghin
Abstract:
This study focuses on the critical aspect of robust state estimation for the safe navigation of an Autonomous Vehicle (AV). Existing literature primarily employs two prevalent techniques for state estimation, namely filtering-based and graph-based approaches. Factor Graph (FG) is a graph-based approach, constructed using Values and Factors for Maximum Aposteriori (MAP) estimation, that offers a mo…
▽ More
This study focuses on the critical aspect of robust state estimation for the safe navigation of an Autonomous Vehicle (AV). Existing literature primarily employs two prevalent techniques for state estimation, namely filtering-based and graph-based approaches. Factor Graph (FG) is a graph-based approach, constructed using Values and Factors for Maximum Aposteriori (MAP) estimation, that offers a modular architecture that facilitates the integration of inputs from diverse sensors. However, most FG-based architectures in current use require explicit knowledge of sensor parameters and are designed for single setups. To address these limitations, this research introduces a novel plug-and-play FG-based state estimator capable of operating without predefined sensor parameters. This estimator is suitable for deployment in multiple sensor setups, offering convenience and providing comprehensive state estimation at a high frequency, including mean and covariances. The proposed algorithm undergoes rigorous validation using various sensor setups on two different vehicles: a quadricycle and a shuttle bus. The algorithm provides accurate and robust state estimation across diverse scenarios, even when faced with degraded Global Navigation Satellite System (GNSS) measurements or complete outages. These findings highlight the efficacy and reliability of the algorithm in real-world AV applications.
△ Less
Submitted 2 October, 2023; v1 submitted 9 August, 2023;
originally announced August 2023.
-
Extended Object Tracking in Curvilinear Road Coordinates for Autonomous Driving
Authors:
Pragyan Dahal,
Simone Mentasti,
Stefano Arrigoni,
Francesco Braghin,
Matteo Matteucci,
Federico Cheli
Abstract:
In literature, Extended Object Tracking (EOT) algorithms developed for autonomous driving predominantly provide obstacles state estimation in cartesian coordinates in the Vehicle Reference Frame. However, in many scenarios, state representation in road-aligned curvilinear coordinates is preferred when implementing autonomous driving subsystems like cruise control, lane-kee** assist, platooning,…
▽ More
In literature, Extended Object Tracking (EOT) algorithms developed for autonomous driving predominantly provide obstacles state estimation in cartesian coordinates in the Vehicle Reference Frame. However, in many scenarios, state representation in road-aligned curvilinear coordinates is preferred when implementing autonomous driving subsystems like cruise control, lane-kee** assist, platooning, etc. This paper proposes a Gaussian Mixture Probability Hypothesis Density~(GM-PHD) filter with an Unscented Kalman Filter~(UKF) estimator that provides obstacle state estimates in curvilinear road coordinates. We employ a hybrid sensor fusion architecture between Lidar and Radar sensors to obtain rich measurement point representations for EOT. The measurement model for the UKF estimator is developed with the integration of coordinate conversion from curvilinear road coordinates to cartesian coordinates by using cubic hermit spline road model. The proposed algorithm is validated through Matlab Driving Scenario Designer simulation and experimental data collected at Monza Eni Circuit.
△ Less
Submitted 8 February, 2022;
originally announced February 2022.
-
Metrics for Computing Trust in a Multi-Agent Environment
Authors:
Sanat Kumar Bista,
Keshav P. Dahal,
Peter I. Cowling,
Bhadra Man Tuladhar
Abstract:
One of the risks involved in multi agent community is in the identification of trustworthy agent partners for transaction. In this paper we aim to describe a trust model for measuring trust in the interacting agents. The trust metric model works on the basis of the parameters that we have identified. The model primarily analyses trust value on the basis of the agents reputation, as provided by the…
▽ More
One of the risks involved in multi agent community is in the identification of trustworthy agent partners for transaction. In this paper we aim to describe a trust model for measuring trust in the interacting agents. The trust metric model works on the basis of the parameters that we have identified. The model primarily analyses trust value on the basis of the agents reputation, as provided by the agent itself, and the agents aggregate rating as provided by the witness agents. The final computation of the trust value is given by a weighted average of these two components. While computing the aggregate rating, a weight based method has been adopted to discount the contribution of possibly unfair ratings by the witness agents.
△ Less
Submitted 13 May, 2013;
originally announced May 2013.
-
Unraveling the Evolution of Defectors in Online Business Games
Authors:
Sanat Kumar Bista,
Keshav P. Dahal,
Peter I. Cowling,
Bhadra Man Tuladhar
Abstract:
Anonymous online business environments have a social dilemma situation in it. A dilemma on whether to cooperate or Defect. Defection by a buyer to seller and/or seller to buyer might give each a better profit at the cost of the loss of other. However, if these parties were to interact in future too, a bad past reference might prevent cooperative actions, thus depriving each other from a better gai…
▽ More
Anonymous online business environments have a social dilemma situation in it. A dilemma on whether to cooperate or Defect. Defection by a buyer to seller and/or seller to buyer might give each a better profit at the cost of the loss of other. However, if these parties were to interact in future too, a bad past reference might prevent cooperative actions, thus depriving each other from a better gain. The anonymity of the players and an absence of central governing body still make this environment tempting for the defectors. What might be the evolutionary behavior of defectors in such environment? How could their increasing population be controlled? It is these two questions basically that we attempt to address in this research work. A genetic algorithm based spatial iterated prisoners dilemma (SIPD) environment has been used to simulate the experiments. A case where compensation for the looser is provided by the system is modeled and analyzed through experiments. Our results show that compensation can be useful in decreasing defective population in the society, however, this might not be enough for the evolution of a cooperative and reliable society of trustworthy players.
△ Less
Submitted 13 May, 2013;
originally announced May 2013.
-
Evolution of Cooperation in an Incentive Based Business Game Environment
Authors:
Sanat Kumar Bista,
Keshav P Dahal,
Peter I Cowling
Abstract:
This paper discusses our investigation into the evolution of cooperative players in an online business environment. We explain our design of an incentive based system with its foundation over binary reputation system whose proportion of reward or punishment is a function of transaction value and the players past history of cooperation. We compare the evolution of cooperation in our setting with no…
▽ More
This paper discusses our investigation into the evolution of cooperative players in an online business environment. We explain our design of an incentive based system with its foundation over binary reputation system whose proportion of reward or punishment is a function of transaction value and the players past history of cooperation. We compare the evolution of cooperation in our setting with non-incentive based environment and our findings show that the incentive based method is more suitable for the evolution of trustworthy players.
△ Less
Submitted 13 May, 2013;
originally announced May 2013.
