SpotNet: An Image Centric, Lidar Anchored Approach To Long Range Perception
Authors:
Louis Foucard,
Samar Khanna,
Yi Shi,
Chi-Kuei Liu,
Quinn Z Shen,
Thuyen Ngo,
Zi-Xiang Xia
Abstract:
In this paper, we propose SpotNet: a fast, single stage, image-centric but LiDAR anchored approach for long range 3D object detection. We demonstrate that our approach to LiDAR/image sensor fusion, combined with the joint learning of 2D and 3D detection tasks, can lead to accurate 3D object detection with very sparse LiDAR support. Unlike more recent bird's-eye-view (BEV) sensor-fusion methods whi…
▽ More
In this paper, we propose SpotNet: a fast, single stage, image-centric but LiDAR anchored approach for long range 3D object detection. We demonstrate that our approach to LiDAR/image sensor fusion, combined with the joint learning of 2D and 3D detection tasks, can lead to accurate 3D object detection with very sparse LiDAR support. Unlike more recent bird's-eye-view (BEV) sensor-fusion methods which scale with range $r$ as $O(r^2)$, SpotNet scales as $O(1)$ with range. We argue that such an architecture is ideally suited to leverage each sensor's strength, i.e. semantic understanding from images and accurate range finding from LiDAR data. Finally we show that anchoring detections on LiDAR points removes the need to regress distances, and so the architecture is able to transfer from 2MP to 8MP resolution images without re-training.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
Encoding Mechano-Memories in Actin Networks
Authors:
Sayantan Majumdar,
Louis C. Foucard,
Alex J. Levine,
Margaret L. Gardel
Abstract:
Understanding the response of complex materials to external force is central to fields ranging from materials science to biology. Here, we describe a novel type of mechanical adaptation in cross-linked networks of F-actin, a ubuiquitous protein found in eukaryotic cells. We show that shear stress changes its nonlinear mechanical response even long after that stress is removed. The duration, magnit…
▽ More
Understanding the response of complex materials to external force is central to fields ranging from materials science to biology. Here, we describe a novel type of mechanical adaptation in cross-linked networks of F-actin, a ubuiquitous protein found in eukaryotic cells. We show that shear stress changes its nonlinear mechanical response even long after that stress is removed. The duration, magnitude and direction of forcing history all impact changes in mechanical response. The `memory' of the forcing history is long-lived, but can be erased by force application in the opposite direction. We further show that the observed mechanical adaptation is consistent with stress-dependent changes in the nematic order of the constituent filaments. Thus, this mechano-memory is a type of nonlinear hysteretic response in which an applied, "training" strain modifies the nonlinear elasticity. This demonstrates that F-actin networks can encode analog read-write mechano-memories, which can be used for adaptation to mechanical stimuli.
△ Less
Submitted 16 June, 2017;
originally announced June 2017.
