DSCnet: Replicating Lidar Point Clouds with Deep Sensor Cloning
Authors:
Paden Tomasello,
Sammy Sidhu,
Anting Shen,
Matthew W. Moskewicz,
Nobie Redmon,
Gayatri Joshi,
Romi Phadte,
Paras Jain,
Forrest Iandola
Abstract:
Convolutional neural networks (CNNs) have become increasingly popular for solving a variety of computer vision tasks, ranging from image classification to image segmentation. Recently, autonomous vehicles have created a demand for depth information, which is often obtained using hardware sensors such as Light detection and ranging (LIDAR). Although it can provide precise distance measurements, mos…
▽ More
Convolutional neural networks (CNNs) have become increasingly popular for solving a variety of computer vision tasks, ranging from image classification to image segmentation. Recently, autonomous vehicles have created a demand for depth information, which is often obtained using hardware sensors such as Light detection and ranging (LIDAR). Although it can provide precise distance measurements, most LIDARs are still far too expensive to sell in mass-produced consumer vehicles, which has motivated methods to generate depth information from commodity automotive sensors like cameras.
In this paper, we propose an approach called Deep Sensor Cloning (DSC). The idea is to use Convolutional Neural Networks in conjunction with inexpensive sensors to replicate the 3D point-clouds that are created by expensive LIDARs. To accomplish this, we develop a new dataset (DSDepth) and a new family of CNN architectures (DSCnets). While previous tasks such as KITTI depth prediction use an interpolated RGB-D images as ground-truth for training, we instead use DSCnets to directly predict LIDAR point-clouds. When we compare the output of our models to a $75,000 LIDAR, we find that our most accurate DSCnet achieves a relative error of 5.77% using a single camera and 4.69% using stereo cameras.
△ Less
Submitted 26 November, 2018; v1 submitted 16 November, 2018;
originally announced November 2018.
On the Technology Prospects and Investment Opportunities for Scalable Neuroscience
Authors:
Thomas Dean,
Biafra Ahanonu,
Mainak Chowdhury,
Anjali Datta,
Andre Esteva,
Daniel Eth,
Nobie Redmon,
Oleg Rumyantsev,
Ysis Tarter
Abstract:
Two major initiatives to accelerate research in the brain sciences have focused attention on develo** a new generation of scientific instruments for neuroscience. These instruments will be used to record static (structural) and dynamic (behavioral) information at unprecedented spatial and temporal resolution and report out that information in a form suitable for computational analysis. We distin…
▽ More
Two major initiatives to accelerate research in the brain sciences have focused attention on develo** a new generation of scientific instruments for neuroscience. These instruments will be used to record static (structural) and dynamic (behavioral) information at unprecedented spatial and temporal resolution and report out that information in a form suitable for computational analysis. We distinguish between recording - taking measurements of individual cells and the extracellular matrix - and reporting - transcoding, packaging and transmitting the resulting information for subsequent analysis - as these represent very different challenges as we scale the relevant technologies to support simultaneously tracking the many neurons that comprise neural circuits of interest. We investigate a diverse set of technologies with the purpose of anticipating their development over the span of the next 10 years and categorizing their impact in terms of short-term [1-2 years], medium-term [2-5 years] and longer-term [5-10 years] deliverables.
△ Less
Submitted 27 July, 2013;
originally announced July 2013.
