-
Personalized Video Relighting With an At-Home Light Stage
Authors:
Jun Myeong Choi,
Max Christman,
Roni Sengupta
Abstract:
In this paper, we develop a personalized video relighting algorithm that produces high-quality and temporally consistent relit videos under any pose, expression, and lighting condition in real-time. Existing relighting algorithms typically rely either on publicly available synthetic data, which yields poor relighting results, or instead on light stage data which is difficult to obtain. We show tha…
▽ More
In this paper, we develop a personalized video relighting algorithm that produces high-quality and temporally consistent relit videos under any pose, expression, and lighting condition in real-time. Existing relighting algorithms typically rely either on publicly available synthetic data, which yields poor relighting results, or instead on light stage data which is difficult to obtain. We show that by just capturing video of a user watching YouTube videos on a monitor we can train a personalized algorithm capable of performing high-quality relighting under any condition. Our key contribution is a novel neural relighting architecture that effectively separates the intrinsic appearance features - the geometry and reflectance of the face - from the source lighting and then combines them with the target lighting to generate a relit image. This neural network architecture enables smoothing of intrinsic appearance features leading to temporally stable video relighting. Both qualitative and quantitative evaluations show that our architecture improves portrait image relighting quality and temporal consistency over state-of-the-art approaches on both casually captured `Light Stage at Your Desk' (LSYD) and light-stage-captured `One Light At a Time' (OLAT) datasets.
△ Less
Submitted 4 December, 2023; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Search for the Pair Production of Dark Particles $X$ with $K_L^0 \to XX$, $X \to γγ$
Authors:
C. Lin,
J. K. Ahn,
J. M. Choi,
M. S. Farrington,
M. Gonzalez,
N. Grethen,
Y. B. Hsiung,
T. Inagaki,
I. Kamiji,
E. J. Kim,
J. L. Kim,
H. M. Kim,
K. Kawata,
A. Kitagawa,
T. K. Komatsubara,
K. Kotera,
S. K. Lee,
J. W. Lee,
G. Y. Lim,
Y. Luo,
T. Matsumura,
K. Nakagiri,
H. Nanjo,
T. Nomura,
K. Ono
, et al. (17 additional authors not shown)
Abstract:
We present the first search for the pair production of dark particles $X$ via $K_L^0\to XX$ with $X$ decaying into two photons using the data collected by the KOTO experiment. No signal was observed in the mass range of 40 - 110 MeV/c$^2$ and 210 - 240 MeV/c$^2$. This sets upper limits on the branching fractions as $\mathcal{B}(K_L^0 \to XX)$ $<$ (1-4) $\times$ 10$^{-7}$ and…
▽ More
We present the first search for the pair production of dark particles $X$ via $K_L^0\to XX$ with $X$ decaying into two photons using the data collected by the KOTO experiment. No signal was observed in the mass range of 40 - 110 MeV/c$^2$ and 210 - 240 MeV/c$^2$. This sets upper limits on the branching fractions as $\mathcal{B}(K_L^0 \to XX)$ $<$ (1-4) $\times$ 10$^{-7}$ and $\mathcal{B}(K_L^0 \to XX)$ $<$ (1-2) $\times$ 10$^{-6}$ at the 90% confidence level for the two mass regions, respectively.
△ Less
Submitted 6 February, 2023; v1 submitted 22 September, 2022;
originally announced September 2022.
-
Training machine-learning potentials for crystal structure prediction using disordered structures
Authors:
Changho Hong,
Jeong Min Choi,
Wonseok Jeong,
Sungwoo Kang,
Suyeon Ju,
Kyeongpung Lee,
Jisu Jung,
Yong Youn,
Seungwu Han
Abstract:
Prediction of the stable crystal structure for multinary (ternary or higher) compounds with unexplored compositions demands fast and accurate evaluation of free energies in exploring the vast configurational space. The machine-learning potential such as the neural network potential (NNP) is poised to meet this requirement but a dearth of information on the crystal structure poses a challenge in ch…
▽ More
Prediction of the stable crystal structure for multinary (ternary or higher) compounds with unexplored compositions demands fast and accurate evaluation of free energies in exploring the vast configurational space. The machine-learning potential such as the neural network potential (NNP) is poised to meet this requirement but a dearth of information on the crystal structure poses a challenge in choosing training sets. Herein we propose constructing the training set from densityfunctional-theory (DFT) based dynamical trajectories of liquid and quenched amorphous phases, which does not require any preceding information on material structures except for the chemical composition. To demonstrate suitability of the trained NNP in the crystal structure prediction, we compare NNP and DFT energies for Ba2AgSi3, Mg2SiO4, LiAlCl4, and InTe2O5F over experimental phases as well as low-energy crystal structures that are generated theoretically. For every material, we find strong correlations between DFT and NNP energies, ensuring that the NNPs can properly rank energies among low-energy crystalline structures. We also find that the evolutionary search using the NNPs can identify low-energy metastable phases more efficiently than the DFTbased approach. By proposing a way to develo** reliable machine-learning potentials for the crystal structure prediction, this work will pave the way to identifying unexplored multinary phases efficiently.
△ Less
Submitted 2 December, 2020; v1 submitted 18 August, 2020;
originally announced August 2020.
-
First Search for the $K_L \to π^0 γ$ Decay
Authors:
J. K. Ahn,
B. Beckford,
M. Campbell,
S. H. Chen,
J. M. Choi,
J. Comfort,
K. Dona,
M. S. Farrington,
N. Hara,
H. Haraguchi,
Y. B. Hsiung,
M. Hutcheson,
T. Inagaki,
M. Isoe,
I. Kamiji,
E. J. Kim,
J. L. Kim,
H. M. Kim,
T. K. Komatsubara,
K. Kotera,
J. W. Lee,
G. Y. Lim,
C. Lin,
Q. S. Lin,
Y. Luo
, et al. (37 additional authors not shown)
Abstract:
We report the first search for the $K_L \to π^0 γ$ decay, which is forbidden by Lorentz invariance, using the data from 2016 to 2018 at the J-PARC KOTO experiment. With a single event sensitivity of $(7.1\pm 0.3_{\rm stat.} \pm 1.6_{\rm syst.})\times 10^{-8}$, no candidate event was observed in the signal region. The upper limit on the branching fraction was set to be $1.7\times 10^{-7}$ at the 90…
▽ More
We report the first search for the $K_L \to π^0 γ$ decay, which is forbidden by Lorentz invariance, using the data from 2016 to 2018 at the J-PARC KOTO experiment. With a single event sensitivity of $(7.1\pm 0.3_{\rm stat.} \pm 1.6_{\rm syst.})\times 10^{-8}$, no candidate event was observed in the signal region. The upper limit on the branching fraction was set to be $1.7\times 10^{-7}$ at the 90\% confidence level.
△ Less
Submitted 24 March, 2021; v1 submitted 26 June, 2020;
originally announced June 2020.
-
Automatic detection and segmentation of lumbar vertebra from X-ray images for compression fracture evaluation
Authors:
Kang Cheol Kim,
Hyun Cheol Cho,
Tae Jun Jang,
Jong Mun Choi,
** Keun Seo
Abstract:
For compression fracture detection and evaluation, an automatic X-ray image segmentation technique that combines deep-learning and level-set methods is proposed. Automatic segmentation is much more difficult for X-ray images than for CT or MRI images because they contain overlap** shadows of thoracoabdominal structures including lungs, bowel gases, and other bony structures such as ribs. Additio…
▽ More
For compression fracture detection and evaluation, an automatic X-ray image segmentation technique that combines deep-learning and level-set methods is proposed. Automatic segmentation is much more difficult for X-ray images than for CT or MRI images because they contain overlap** shadows of thoracoabdominal structures including lungs, bowel gases, and other bony structures such as ribs. Additional difficulties include unclear object boundaries, the complex shape of the vertebra, inter-patient variability, and variations in image contrast. Accordingly, a structured hierarchical segmentation method is presented that combines the advantages of two deep-learning methods. Pose-driven learning is used to selectively identify the five lumbar vertebra in an accurate and robust manner. With knowledge of the vertebral positions, M-net is employed to segment the individual vertebra. Finally, fine-tuning segmentation is applied by combining the level-set method with the previously obtained segmentation results. The performance of the proposed method was validated using clinical data, resulting in center position detection error of $25.35\pm10.86$ and a mean Dice similarity metric of $91.60\pm2.22\%$.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
Nearest-Neighbor Detection of Atoms in a 1D Optical Lattice by Fluorescence Imaging
Authors:
M. Karski,
L. Förster,
J. M. Choi,
W. Alt,
A. Widera,
D. Meschede
Abstract:
We overcome the diffraction limit in fluorescence imaging of neutral atoms in a sparsely filled one-dimensional optical lattice. At a periodicity of 433 nm, we reliably infer the separation of two atoms down to nearest neighbors. We observe light induced losses of atoms occupying the same lattice site, while for atoms in adjacent lattice sites, no losses due to light induced interactions occur.…
▽ More
We overcome the diffraction limit in fluorescence imaging of neutral atoms in a sparsely filled one-dimensional optical lattice. At a periodicity of 433 nm, we reliably infer the separation of two atoms down to nearest neighbors. We observe light induced losses of atoms occupying the same lattice site, while for atoms in adjacent lattice sites, no losses due to light induced interactions occur. Our method points towards characterization of correlated quantum states in optical lattice systems with filling factors of up to one atom per lattice site.
△ Less
Submitted 6 February, 2009; v1 submitted 24 July, 2008;
originally announced July 2008.
