-
Microtearding mode study in NSTX using machine learning enhanced reduced model
Authors:
Max T. Curie,
Joel Larakers,
Jason Parisi,
Gary Staebler,
Stefano Munaretto,
Walter Guttenfelder,
Emily Belli,
David R. Hatch,
Mate Lampert,
Galina Avdeeva,
Tom Neiser,
Sterling Smith,
Ahmed Diallo,
Oak Nelson,
Stanley Kaye,
Eric Fredrickson,
Joshua M Manela,
Shelly Lei,
Michael Halfmoon,
Matthew M Tennery,
Ehab Hassan
Abstract:
This article presents a survey of NSTX cases to study the microtearing mode (MTM) stabilities using the newly developed global reduced model for Slab-Like Microtearing modes (SLiM). A trained neutral network version of SLiM enables rapid assessment (0.05s/mode) of MTM with $98\%$ accuracy providing an opportunity for systemic equilibrium reconstructions based on the matching of experimentally obse…
▽ More
This article presents a survey of NSTX cases to study the microtearing mode (MTM) stabilities using the newly developed global reduced model for Slab-Like Microtearing modes (SLiM). A trained neutral network version of SLiM enables rapid assessment (0.05s/mode) of MTM with $98\%$ accuracy providing an opportunity for systemic equilibrium reconstructions based on the matching of experimentally observed frequency bands and SLiM prediction across a wide range of parameters. Such a method finds some success in the NSTX discharges, the frequency observed in the experiment matches with what SLiM predicted. Based on the experience with SLiM analysis, a workflow to estimate the potential MTM frequency for a quick assessment based on experimental observation has been established.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detection
Authors:
Jyh-**g Hwang,
Henrik Kretzschmar,
Joshua Manela,
Sean Rafferty,
Nicholas Armstrong-Crews,
Tiffany Chen,
Dragomir Anguelov
Abstract:
Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is challenging, however, as each of the sensors lacks information along a perpendicular axis, that is, depth is unknown to camera and elevation is unknown to radar.…
▽ More
Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is challenging, however, as each of the sensors lacks information along a perpendicular axis, that is, depth is unknown to camera and elevation is unknown to radar. We propose the camera-radar matching network CramNet, an efficient approach to fuse the sensor readings from camera and radar in a joint 3D space. To leverage radar range measurements for better camera depth predictions, we propose a novel ray-constrained cross-attention mechanism that resolves the ambiguity in the geometric correspondences between camera features and radar features. Our method supports training with sensor modality dropout, which leads to robust 3D object detection, even when a camera or radar sensor suddenly malfunctions on a vehicle. We demonstrate the effectiveness of our fusion approach through extensive experiments on the RADIATE dataset, one of the few large-scale datasets that provide radar radio frequency imagery. A camera-only variant of our method achieves competitive performance in monocular 3D object detection on the Waymo Open Dataset.
△ Less
Submitted 17 October, 2022; v1 submitted 17 October, 2022;
originally announced October 2022.
-
Hierarchical Deep Stereo Matching on High-resolution Images
Authors:
Gengshan Yang,
Joshua Manela,
Michael Happold,
Deva Ramanan
Abstract:
We explore the problem of real-time stereo matching on high-res imagery. Many state-of-the-art (SOTA) methods struggle to process high-res imagery because of memory constraints or speed limitations. To address this issue, we propose an end-to-end framework that searches for correspondences incrementally over a coarse-to-fine hierarchy. Because high-res stereo datasets are relatively rare, we intro…
▽ More
We explore the problem of real-time stereo matching on high-res imagery. Many state-of-the-art (SOTA) methods struggle to process high-res imagery because of memory constraints or speed limitations. To address this issue, we propose an end-to-end framework that searches for correspondences incrementally over a coarse-to-fine hierarchy. Because high-res stereo datasets are relatively rare, we introduce a dataset with high-res stereo pairs for both training and evaluation. Our approach achieved SOTA performance on Middlebury-v3 and KITTI-15 while running significantly faster than its competitors. The hierarchical design also naturally allows for anytime on-demand reports of disparity by cap** intermediate coarse results, allowing us to accurately predict disparity for near-range structures with low latency (30ms). We demonstrate that the performance-vs-speed trade-off afforded by on-demand hierarchies may address sensing needs for time-critical applications such as autonomous driving.
△ Less
Submitted 13 December, 2019;
originally announced December 2019.