-
End-to-End Driving via Self-Supervised Imitation Learning Using Camera and LiDAR Data
Authors:
** Bok Park,
**kyu Lee,
Muhyun Back,
Hyunmin Han,
David T. Ma,
Sang Min Won,
Sung Soo Hwang,
Il Yong Chun
Abstract:
In autonomous driving, the end-to-end (E2E) driving approach that predicts vehicle control signals directly from sensor data is rapidly gaining attention. To learn a safe E2E driving system, one needs an extensive amount of driving data and human intervention. Vehicle control data is constructed by many hours of human driving, and it is challenging to construct large vehicle control datasets. Ofte…
▽ More
In autonomous driving, the end-to-end (E2E) driving approach that predicts vehicle control signals directly from sensor data is rapidly gaining attention. To learn a safe E2E driving system, one needs an extensive amount of driving data and human intervention. Vehicle control data is constructed by many hours of human driving, and it is challenging to construct large vehicle control datasets. Often, publicly available driving datasets are collected with limited driving scenes, and collecting vehicle control data is only available by vehicle manufacturers. To address these challenges, this paper proposes the first self-supervised learning framework, self-supervised imitation learning (SSIL), that can learn E2E driving networks without using driving command data. To construct pseudo steering angle data, proposed SSIL predicts a pseudo target from the vehicle's poses at the current and previous time points that are estimated with light detection and ranging sensors. Our numerical experiments demonstrate that the proposed SSIL framework achieves comparable E2E driving accuracy with the supervised learning counterpart. In addition, our qualitative analyses using a conventional visual explanation tool show that trained NNs by proposed SSIL and the supervision counterpart attend similar objects in making predictions.
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses
Authors:
Jeongmin Brian Park,
Vikram Sharma Mailthody,
Zaid Qureshi,
Wen-mei Hwu
Abstract:
Graph Neural Networks (GNNs) are emerging as a powerful tool for learning from graph-structured data and performing sophisticated inference tasks in various application domains. Although GNNs have been shown to be effective on modest-sized graphs, training them on large-scale graphs remains a significant challenge due to lack of efficient data access and data movement methods. Existing frameworks…
▽ More
Graph Neural Networks (GNNs) are emerging as a powerful tool for learning from graph-structured data and performing sophisticated inference tasks in various application domains. Although GNNs have been shown to be effective on modest-sized graphs, training them on large-scale graphs remains a significant challenge due to lack of efficient data access and data movement methods. Existing frameworks for training GNNs use CPUs for graph sampling and feature aggregation, while the training and updating of model weights are executed on GPUs. However, our in-depth profiling shows the CPUs cannot achieve the throughput required to saturate GNN model training throughput, causing gross under-utilization of expensive GPU resources. Furthermore, when the graph and its embeddings do not fit in the CPU memory, the overhead introduced by the operating system, say for handling page-faults, comes in the critical path of execution.
To address these issues, we propose the GPU Initiated Direct Storage Access (GIDS) dataloader, to enable GPU-oriented GNN training for large-scale graphs while efficiently utilizing all hardware resources, such as CPU memory, storage, and GPU memory with a hybrid data placement strategy. By enabling GPU threads to fetch feature vectors directly from storage, GIDS dataloader solves the memory capacity problem for GPU-oriented GNN training. Moreover, GIDS dataloader leverages GPU parallelism to tolerate storage latency and eliminates expensive page-fault overhead. Doing so enables us to design novel optimizations for exploiting locality and increasing effective bandwidth for GNN training. Our evaluation using a single GPU on terabyte-scale GNN datasets shows that GIDS dataloader accelerates the overall DGL GNN training pipeline by up to 392X when compared to the current, state-of-the-art DGL dataloader.
△ Less
Submitted 6 March, 2024; v1 submitted 28 June, 2023;
originally announced June 2023.
-
Unitarity and Dilaton effective theory
Authors:
Deog Ki Hong,
Gyurin Kim,
Jun Beom Park
Abstract:
From the low-energy effective theory of dilatons, consistent with the scale anomaly, we calculate the $2\to2$ scattering amplitudes of dilatons. We find that the one-loop amplitude violates the unitarity bound as the scattering energy approaches the cutoff of the effective theory, $\sqrt{s}=\sqrt{4π} f_D$. We then show that the inclusion of the next-to-lightest state, namely the spin-2 state, of m…
▽ More
From the low-energy effective theory of dilatons, consistent with the scale anomaly, we calculate the $2\to2$ scattering amplitudes of dilatons. We find that the one-loop amplitude violates the unitarity bound as the scattering energy approaches the cutoff of the effective theory, $\sqrt{s}=\sqrt{4π} f_D$. We then show that the inclusion of the next-to-lightest state, namely the spin-2 state, of mass around the cutoff improves the unitarity. The unitarity argument suggests that the mass ratio of the dilaton and the spin-2 state is proportional to the square of the Miransky-BKT scaling of the near conformal dynamics.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
Multimodal Sensor-Based Semantic 3D Map** for a Large-Scale Environment
Authors:
Jongmin Jeong,
Tae Sung Yoon,
** Bae Park
Abstract:
Semantic 3D map** is one of the most important fields in robotics, and has been used in many applications, such as robot navigation, surveillance, and virtual reality. In general, semantic 3D map** is mainly composed of 3D reconstruction and semantic segmentation. As these technologies evolve, there has been great progress in semantic 3D map** in recent years. Furthermore, the number of robo…
▽ More
Semantic 3D map** is one of the most important fields in robotics, and has been used in many applications, such as robot navigation, surveillance, and virtual reality. In general, semantic 3D map** is mainly composed of 3D reconstruction and semantic segmentation. As these technologies evolve, there has been great progress in semantic 3D map** in recent years. Furthermore, the number of robotic applications requiring semantic information in 3D map** to perform high-level tasks has increased, and many studies on semantic 3D map** have been published. Existing methods use a camera for both 3D reconstruction and semantic segmentation. However, this is not suitable for large-scale environments and has the disadvantage of high computational complexity. To address this problem, we propose a multimodal sensor-based semantic 3D map** system using a 3D Lidar combined with a camera. In this study, we build a 3D map by estimating odometry based on a global positioning system (GPS) and an inertial measurement unit (IMU), and use the latest 2D convolutional neural network (CNN) for semantic segmentation. To build a semantic 3D map, we integrate the 3D map with semantic information by using coordinate transformation and Bayes' update scheme. In order to improve the semantic 3D map, we propose a 3D refinement process to correct wrongly segmented voxels and remove traces of moving vehicles in the 3D map. Through experiments on challenging sequences, we demonstrate that our method outperforms state-of-the-art methods in terms of accuracy and intersection over union (IoU). Thus, our method can be used for various applications that require semantic information in 3D map.
△ Less
Submitted 28 February, 2018;
originally announced February 2018.
-
$φ$ photoproduction on the proton at $E_γ$ = 1.5 - 2.9 GeV
Authors:
K. Mizutani,
M. Niiyama,
T. Nakano,
M. Yosoi,
Y. Nozawa,
D. S. Ahn,
J. K. Ahn,
W. C. Chang,
J. Y. Chen,
S. Daté,
W. Gohn,
H. Hamano,
T. Hashimoto,
K. Hicks,
T. Hiraiwa,
T. Hotta,
S. H. Hwang,
T. Ishikawa,
K. Joo,
W. S. Jung,
Y. Kato,
H. Katsuragawa,
M. H. Kim,
S. H. Kim,
H. Kohri
, et al. (31 additional authors not shown)
Abstract:
Differential cross sections at $t=t_{\text{min}}$ and decay asymmetries for the $γp\rightarrowφp$ reaction have been measured using linearly polarized photons in the range 1.5 to 2.9 GeV. These cross sections were used to determine the Pomeron strength factor. The cross sections and decay asymmetries are consistently described by the $t$-channel Pomeron and pseudoscalar exchange model in the…
▽ More
Differential cross sections at $t=t_{\text{min}}$ and decay asymmetries for the $γp\rightarrowφp$ reaction have been measured using linearly polarized photons in the range 1.5 to 2.9 GeV. These cross sections were used to determine the Pomeron strength factor. The cross sections and decay asymmetries are consistently described by the $t$-channel Pomeron and pseudoscalar exchange model in the $E_γ$ region above 2.37 GeV. In the lower energy region, an excess over the model prediction is observed in the energy dependence of the differential cross sections at $t=t_{\text{min}}$. This observation suggests that additional processes or interference effects between Pomeron exchange and other processes appear near the threshold region.
△ Less
Submitted 30 September, 2017;
originally announced October 2017.
-
Non-destructive electron microscopy imaging and analysis of biological samples with graphene coating
Authors:
Jong Bo Park,
Yong-** Kim,
Je Min Yoo,
Youngsoo Kim,
Seong-Min Kim,
Sang ** Kim,
Roman Gorbachev,
I. I. Barbolina,
Myung-Han Yoon,
Byung Hee Hong,
Konstantin S. Novoselov
Abstract:
In electron microscopy, charging of non-conductive biological samples by focused electron beams hinders their high-resolution imaging. Gold or platinum coatings have been commonly used to prevent such sample charging, but it disables further quantitative and qualitative chemical analyses by energy dispersive spectroscopy (EDS). Here we report that graphene-coating on biological samples enables non…
▽ More
In electron microscopy, charging of non-conductive biological samples by focused electron beams hinders their high-resolution imaging. Gold or platinum coatings have been commonly used to prevent such sample charging, but it disables further quantitative and qualitative chemical analyses by energy dispersive spectroscopy (EDS). Here we report that graphene-coating on biological samples enables non-destructive high-resolution imaging by scanning electron microscopy (SEM) as well as chemical analysis by EDS, utilizing graphene's transparency to electron beams, high conductivity, outstanding mechanical strength, and flexibility. We believe that the graphene-coated imaging and analysis would provide us a new opportunity to explore various biological phenomena unseen before due to the limitation in sample preparation and image resolution, which will broaden our understanding on the life mechanism of various living organisms.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
-
Growth Dynamics and Gas Transport Mechanism of Nanobubbles in Graphene Liquid Cells
Authors:
Dongha Shin,
Jong Bo Park,
Yong-** Kim,
Sang ** Kim,
** Hyoun Kang,
Bora Lee,
Sung-Pyo Cho,
Byung Hee Hong,
Konstantin S. Novoselov
Abstract:
Formation, evolution, and vanishing of bubbles are common phenomena in our nature, which can be easily observed in boiling or falling waters, carbonated drinks, gas-forming electrochemical reactions, etc. However, the morphology and the growth dynamics of the bubbles at nanoscale have not been fully investigated owing to the lack of proper imaging tools that can visualize nanoscale objects in liqu…
▽ More
Formation, evolution, and vanishing of bubbles are common phenomena in our nature, which can be easily observed in boiling or falling waters, carbonated drinks, gas-forming electrochemical reactions, etc. However, the morphology and the growth dynamics of the bubbles at nanoscale have not been fully investigated owing to the lack of proper imaging tools that can visualize nanoscale objects in liquid phase. Here we demonstrate, for the first time, that the nanobubbles in water encapsulated by graphene membrane can be visualized by in situ ultrahigh vacuum transmission electron microscopy (UHV-TEM), showing the critical radius of nanobubbles determining its unusual long-term stability as well as two distinct growth mechanisms of merging nanobubbles (Ostwald ripening and coalescing) depending on their relative sizes. Interestingly, the gas transport through ultrathin water membranes at nanobubble interface is free from dissolution, which is clearly different from conventional gas transport that includes condensation, transmission and evaporation. Our finding is expected to provide a deeper insight to understand unusual chemical, biological and environmental phenomena where nanoscale gas-state is involved.
△ Less
Submitted 7 June, 2014;
originally announced June 2014.
-
Invariantly Admissible Policy Iteration for a Class of Nonlinear Optimal Control Problems
Authors:
Jae Youg Lee,
** Bae Park,
Yoon Ho Choi
Abstract:
In this paper, we propose a generalized successive approximation method (SAM), called invariantly admissible policy iteration (PI), for finding the solution to a class of input-affine nonlinear optimal control problems by iterations. Unlike the existing SAM, the proposed method updates the domain of the next policy and value function for admissibility (and invariance). In the existing SAM, the adm…
▽ More
In this paper, we propose a generalized successive approximation method (SAM), called invariantly admissible policy iteration (PI), for finding the solution to a class of input-affine nonlinear optimal control problems by iterations. Unlike the existing SAM, the proposed method updates the domain of the next policy and value function for admissibility (and invariance). In the existing SAM, the admissibility of the generated policies are guaranteed under the two implicit assumptions regarding Lyapunov's theorem and invariance, both of which are presented and discussed in this paper and are generally not true. On the contrary, the proposed invariantly admissible PI guarantees the admissibility in a more refined manner, without such assumptions. The admissibility and invariance of the updated region, with respect to the corresponding policies, are mathematically prove under the specific invariant admissible update rule. We also provide monotonic decreasing and uniform convergence properties of the sequence of value functions under certain conditions. Finally, numerical simulations are presented to illustrate the proposed PI method and its effectiveness.
△ Less
Submitted 26 May, 2014; v1 submitted 17 February, 2014;
originally announced February 2014.
-
Complexity analysis of the stock market
Authors:
Joongwoo Brian Park,
Jeong Won Lee,
Jae-Suk Yang,
Hang-Hyun Jo,
Hie-Tae Moon
Abstract:
We study the complexity of the stock market by constructing $ε$-machines of Standard and Poor's 500 index from February 1983 to April 2006 and by measuring the statistical complexities. It is found that both the statistical complexity and the number of causal states of constructed $ε$-machines have decreased for last twenty years and that the average memory length needed to predict the future op…
▽ More
We study the complexity of the stock market by constructing $ε$-machines of Standard and Poor's 500 index from February 1983 to April 2006 and by measuring the statistical complexities. It is found that both the statistical complexity and the number of causal states of constructed $ε$-machines have decreased for last twenty years and that the average memory length needed to predict the future optimally has become shorter. These results support that the information is delivered to the economic agents and applied to the market prices more rapidly in year 2006 than in year 1983.
△ Less
Submitted 11 December, 2006; v1 submitted 30 July, 2006;
originally announced July 2006.
-
Minimum Entropy Density Method for the Time Series Analysis
Authors:
Jeong Won Lee,
Joongwoo Brian Park,
Hang-Hyun Jo,
Jae-Suk Yang,
Hie-Tae Moon
Abstract:
The entropy density is an intuitive and powerful concept to study the complicated nonlinear processes derived from physical systems. We develop the minimum entropy density method (MEDM) to detect the structure scale of a given time series, which is defined as the scale in which the uncertainty is minimized, hence the pattern is revealed most. The MEDM is applied to the financial time series of S…
▽ More
The entropy density is an intuitive and powerful concept to study the complicated nonlinear processes derived from physical systems. We develop the minimum entropy density method (MEDM) to detect the structure scale of a given time series, which is defined as the scale in which the uncertainty is minimized, hence the pattern is revealed most. The MEDM is applied to the financial time series of Standard and Poor's 500 index from February 1983 to April 2006. Then the temporal behavior of structure scale is obtained and analyzed in relation to the information delivery time and efficient market hypothesis.
△ Less
Submitted 14 November, 2006; v1 submitted 30 July, 2006;
originally announced July 2006.
