Showing 1–2 of 2 results for author: Tilmon, B

SaccadeCam: Adaptive Visual Attention for Monocular Depth Sensing

Authors: Brevin Tilmon, Sanjeev J. Koppal

Abstract: Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the scene is imaged by the fovea, where resolution is highest. In this paper, we present the SaccadeCam framework for adaptively distributing resolution onto regions of interest in the sc… ▽ More Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the scene is imaged by the fovea, where resolution is highest. In this paper, we present the SaccadeCam framework for adaptively distributing resolution onto regions of interest in the scene. Our algorithm for adaptive resolution is a self-supervised network and we demonstrate results for end-to-end learning for monocular depth estimation. We also show preliminary results with a real SaccadeCam hardware prototype. △ Less

Submitted 16 August, 2021; v1 submitted 24 March, 2021; originally announced March 2021.

Comments: Accepted to IEEE/CVF International Conference on Computer Vision (ICCV)

Towards a MEMS-based Adaptive LIDAR

Authors: Francesco Pittaluga, Zaid Tasneem, Justin Folden, Brevin Tilmon, Ayan Chakrabarti, Sanjeev J. Koppal

Abstract: We present a proof-of-concept LIDAR design that allows adaptive real-time measurements according to dynamically specified measurement patterns. We describe our optical setup and calibration, which enables fast sparse depth measurements using a scanning MEMS (micro-electro-mechanical) mirror. We validate the efficacy of our prototype LIDAR design by testing on over 75 static and dynamic scenes span… ▽ More We present a proof-of-concept LIDAR design that allows adaptive real-time measurements according to dynamically specified measurement patterns. We describe our optical setup and calibration, which enables fast sparse depth measurements using a scanning MEMS (micro-electro-mechanical) mirror. We validate the efficacy of our prototype LIDAR design by testing on over 75 static and dynamic scenes spanning a range of environments. We show CNN-based depth-map completion experiments which demonstrate that our sensor can realize adaptive depth sensing for dynamic scenes. △ Less

Submitted 16 October, 2020; v1 submitted 20 March, 2020; originally announced March 2020.

Comments: 14 pages, 5 figures, project site: https://www.fpittaluga.com/adaptivelidar, to be published in International Conference on 3D Vision 2020