-
SEVD: Synthetic Event-based Vision Dataset for Ego and Fixed Traffic Perception
Authors:
Manideep Reddy Aliminati,
Bharatesh Chakravarthi,
Aayush Atul Verma,
Arpitsinh Vaghela,
Hua Wei,
Xuesong Zhou,
Yezhou Yang
Abstract:
Recently, event-based vision sensors have gained attention for autonomous driving applications, as conventional RGB cameras face limitations in handling challenging dynamic conditions. However, the availability of real-world and synthetic event-based vision datasets remains limited. In response to this gap, we present SEVD, a first-of-its-kind multi-view ego, and fixed perception synthetic event-b…
▽ More
Recently, event-based vision sensors have gained attention for autonomous driving applications, as conventional RGB cameras face limitations in handling challenging dynamic conditions. However, the availability of real-world and synthetic event-based vision datasets remains limited. In response to this gap, we present SEVD, a first-of-its-kind multi-view ego, and fixed perception synthetic event-based dataset using multiple dynamic vision sensors within the CARLA simulator. Data sequences are recorded across diverse lighting (noon, nighttime, twilight) and weather conditions (clear, cloudy, wet, rainy, foggy) with domain shifts (discrete and continuous). SEVD spans urban, suburban, rural, and highway scenes featuring various classes of objects (car, truck, van, bicycle, motorcycle, and pedestrian). Alongside event data, SEVD includes RGB imagery, depth maps, optical flow, semantic, and instance segmentation, facilitating a comprehensive understanding of the scene. Furthermore, we evaluate the dataset using state-of-the-art event-based (RED, RVT) and frame-based (YOLOv8) methods for traffic participant detection tasks and provide baseline benchmarks for assessment. Additionally, we conduct experiments to assess the synthetic event-based dataset's generalization capabilities. The dataset is available at https://eventbasedvision.github.io/SEVD
△ Less
Submitted 19 April, 2024; v1 submitted 12 April, 2024;
originally announced April 2024.
-
eTraM: Event-based Traffic Monitoring Dataset
Authors:
Aayush Atul Verma,
Bharatesh Chakravarthi,
Arpitsinh Vaghela,
Hua Wei,
Yezhou Yang
Abstract:
Event cameras, with their high temporal and dynamic range and minimal memory usage, have found applications in various fields. However, their potential in static traffic monitoring remains largely unexplored. To facilitate this exploration, we present eTraM - a first-of-its-kind, fully event-based traffic monitoring dataset. eTraM offers 10 hr of data from different traffic scenarios in various li…
▽ More
Event cameras, with their high temporal and dynamic range and minimal memory usage, have found applications in various fields. However, their potential in static traffic monitoring remains largely unexplored. To facilitate this exploration, we present eTraM - a first-of-its-kind, fully event-based traffic monitoring dataset. eTraM offers 10 hr of data from different traffic scenarios in various lighting and weather conditions, providing a comprehensive overview of real-world situations. Providing 2M bounding box annotations, it covers eight distinct classes of traffic participants, ranging from vehicles to pedestrians and micro-mobility. eTraM's utility has been assessed using state-of-the-art methods for traffic participant detection, including RVT, RED, and YOLOv8. We quantitatively evaluate the ability of event-based models to generalize on nighttime and unseen scenes. Our findings substantiate the compelling potential of leveraging event cameras for traffic monitoring, opening new avenues for research and application. eTraM is available at https://eventbasedvision.github.io/eTraM
△ Less
Submitted 2 April, 2024; v1 submitted 29 March, 2024;
originally announced March 2024.
-
The LCO Outbursting Objects Key Project: Overview and Year 1 Status
Authors:
Tim Lister,
Michael S. P. Kelley,
Carrie E. Holt,
Henry H. Hsieh,
Michele T. Bannister,
Aayushi A. Verma,
Matthew M. Dobson,
Matthew M. Knight,
Youssef Moulane,
Megan E. Schwamb,
Dennis Bodewits,
James Bauer,
Joseph Chatelain,
Estela Fernández-Valenzuela,
Daniel Gardener,
Geza Gyuk,
Mark Hammergren,
Ky Huynh,
Emmanuel Jehin,
Rosita Kokotanekova,
Eva Lilly,
Man-To Hui,
Adam McKay,
Cyrielle Opitom,
Silvia Protopapa
, et al. (10 additional authors not shown)
Abstract:
The LCO Outbursting Objects Key (LOOK) Project uses the telescopes of the Las Cumbres Observatory (LCO) Network to: (1) to systematically monitor a sample of Dynamically New Comets over the whole sky, and (2) use alerts from existing sky surveys to rapidly respond to and characterize detected outburst activity in all small bodies. The data gathered on outbursts helps to characterize each outburst'…
▽ More
The LCO Outbursting Objects Key (LOOK) Project uses the telescopes of the Las Cumbres Observatory (LCO) Network to: (1) to systematically monitor a sample of Dynamically New Comets over the whole sky, and (2) use alerts from existing sky surveys to rapidly respond to and characterize detected outburst activity in all small bodies. The data gathered on outbursts helps to characterize each outburst's evolution with time, assess the frequency and magnitude distribution of outbursts in general, and contributes to the understanding of outburst processes and volatile distribution in the Solar System. The LOOK Project exploits the synergy between current and future wide-field surveys such as ZTF, PanSTARRS, and LSST as well as rapid-response telescope networks such as LCO, and serves as an excellent testbed for what will be needed the much larger number of objects coming from Rubin Observatory. We will describe the LOOK Project goals, the planning and target selection (including the use of NEOexchange as a Target and Observation Manager or "TOM"), and results from the first phase of observations, including the detection of activity and outbursts on the giant comet C/2014 UN271 (Bernardinelli-Bernstein) and the discovery and follow-up of outbursts on comets. Within these outburst discoveries, we present a high cadence of 7P/Pons-Winnecke with days, a large outburst on 57P/duToit-Neujmin-Delporte, and evidence that comet P/2020 X1 (ATLAS) was in outburst when discovered.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
-
Metallicity, ionization parameter, and pressure variations of HII regions in the TYPHOON spiral galaxies
Authors:
K. Grasha,
Q. H. Chen,
A. J. Battisti,
A. Acharyya,
S. Ridolfo,
E. Poehler,
S. Mably,
A. A. Verma,
K. L. Hayward,
A. Kharbanda,
H. Poetrodjojo,
M. Seibert,
J. A. Rich,
B. F. Madore,
L. J. Kewley
Abstract:
We present a spatially-resolved HII region study of the gas-phase metallicity, ionization parameter, and ISM pressure maps of 6 local star-forming and face-on spiral galaxies from the TYPHOON program. Self-consistent metallicity, ionization parameter, and pressure maps are calculated simultaneously through an iterative process to provide useful measures of the local chemical abundance and its rela…
▽ More
We present a spatially-resolved HII region study of the gas-phase metallicity, ionization parameter, and ISM pressure maps of 6 local star-forming and face-on spiral galaxies from the TYPHOON program. Self-consistent metallicity, ionization parameter, and pressure maps are calculated simultaneously through an iterative process to provide useful measures of the local chemical abundance and its relation to localized ISM properties. We constrain the presence of azimuthal variations in metallicity by measuring the residual metallicity offset $Δ$(O/H) after subtracting the linear fits to the radial metallicity profiles. We however find weak evidence of azimuthal variations in most of the galaxies, with small (mean 0.03 dex) scatter. The galaxies instead reveal that HII regions with enhanced and reduced abundances are found distributed throughout the disk. While the spiral pattern plays a role in organizing the ISM, it alone does not establish the relatively uniform azimuthal variations we observe. Differences in the metal abundances are more likely driven by the strong correlations with the local physical conditions. We find a strong and positive correlation between the ionization parameter and the local abundances as measured by the relative metallicity offset $Δ$(O/H), indicating a tight relationship between local physical conditions and their localized enrichment of the ISM. Additionally, we demonstrate the impact of unresolved observations on the measured ISM properties by rebinning the datacubes to simulate low-resolution (1 kpc) observations, typical of large IFU surveys. We find that the ionization parameter and ISM pressure diagnostics are impacted by the loss of resolution such that their measured values are larger relative to the measured values on sub-HII region scales.
△ Less
Submitted 4 March, 2022;
originally announced March 2022.
