Showing 1–50 of 173 results for author: Shin, C

Disentangled Motion Modeling for Video Frame Interpolation

Authors: Jaihyun Lew, Jooyoung Choi, Chaehun Shin, Dahuin Jung, Sungroh Yoon

Abstract: Video frame interpolation (VFI) aims to synthesize intermediate frames in between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works employ the high quality generative models for perceptual quality. However, they require complex training and large computational cost for modeling on the pixel space. In this paper,… ▽ More Video frame interpolation (VFI) aims to synthesize intermediate frames in between existing frames to enhance visual smoothness and quality. Beyond the conventional methods based on the reconstruction loss, recent works employ the high quality generative models for perceptual quality. However, they require complex training and large computational cost for modeling on the pixel space. In this paper, we introduce disentangled Motion Modeling (MoMo), a diffusion-based approach for VFI that enhances visual quality by focusing on intermediate motion modeling. We propose disentangled two-stage training process, initially training a frame synthesis model to generate frames from input pairs and their optical flows. Subsequently, we propose a motion diffusion model, equipped with our novel diffusion U-Net architecture designed for optical flow, to produce bi-directional flows between frames. This method, by leveraging the simpler low-frequency representation of motions, achieves superior perceptual quality with reduced computational demands compared to generative modeling methods on the pixel space. Our method surpasses state-of-the-art methods in perceptual metrics across various benchmarks, demonstrating its efficacy and efficiency in VFI. Our code is available at: https://github.com/JHLew/MoMo △ Less

Submitted 24 June, 2024; originally announced June 2024.

Is Free Self-Alignment Possible?

Authors: Dyah Adila, Changho Shin, Yi**g Zhang, Frederic Sala

Abstract: Aligning pretrained language models (LMs) is a complex and resource-intensive process, often requiring access to large amounts of ground-truth preference data and substantial compute. Are these costs necessary? That is, it is possible to align using only inherent model knowledge and without additional training? We tackle this challenge with AlignEZ, a novel approach that uses (1) self-generated pr… ▽ More Aligning pretrained language models (LMs) is a complex and resource-intensive process, often requiring access to large amounts of ground-truth preference data and substantial compute. Are these costs necessary? That is, it is possible to align using only inherent model knowledge and without additional training? We tackle this challenge with AlignEZ, a novel approach that uses (1) self-generated preference data and (2) representation editing to provide nearly cost-free alignment. During inference, AlignEZ modifies LM representations to reduce undesirable and boost desirable components using subspaces identified via self-generated preference pairs. Our experiments reveal that this nearly cost-free procedure significantly narrows the gap between base pretrained and tuned models by an average of 31.6%, observed across six datasets and three model architectures. Additionally, we explore the potential of using AlignEZ as a means of expediting more expensive alignment procedures. Our experiments show that AlignEZ improves DPO models tuned only using a small subset of ground-truth preference data. Lastly, we study the conditions under which improvement using AlignEZ is feasible, providing valuable insights into its effectiveness. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Revisiting Reactor Anti-Neutrino 5 MeV Bump with $^{13}$C Neutral-Current Interaction

Authors: Pouya Bakhti, Min-Gwa Park, Meshkat Rajaee, Chang Sub Shin, Seodong Shin

Abstract: For the first time, we systematically investigate the potential of neutrino-nucleus neutral current interactions with $^{13}$C to identify the origin of the 5 MeV bump observed in reactor anti-neutrino spectra in the inverse beta decay process. The distinctive signal is obtained from the de-excitation of $^{13}$C$^*$ into the ground state emitting a 3.685 MeV photon in various liquid scintillator… ▽ More For the first time, we systematically investigate the potential of neutrino-nucleus neutral current interactions with $^{13}$C to identify the origin of the 5 MeV bump observed in reactor anti-neutrino spectra in the inverse beta decay process. The distinctive signal is obtained from the de-excitation of $^{13}$C$^*$ into the ground state emitting a 3.685 MeV photon in various liquid scintillator detectors. Such an interaction predominantly occurs for the reactor anti-neutrinos within the energy range coinciding with the 5 MeV bump. For a detector that has a capability of 95\% level photon and electron separation and small thorium contamination below $5 \times 10^{-17}$ gr/gr located in a site with an overburden of about a few hundred m.w.e, such as the location of near detectors of RENO and Daya Bay will have a great sensitivity to resolve the 5 MeV bump. In addition, we propose a novel approach to track the time evolution of reactor isotopes by analyzing our $^{13}$C signal shedding light on the contributions from $^{235}$U or $^{239}$Pu to the observed bump. This provides an extra powerful tool in both discriminating the flux models and testing any new physics possibilities for the 5 MeV bump at 3$σ$ to 5$σ$ level with much less systematic uncertainties and assuming 10 kt.year of data collection. Our detector requirements are realistic, aligning well with recent studies conducted for existing or forthcoming experiments. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Comments: 6 pages, 3 figures

OTTER: Improving Zero-Shot Classification via Optimal Transport

Authors: Changho Shin, Jitian Zhao, Sonia Cromp, Harit Vishwakarma, Frederic Sala

Abstract: Popular zero-shot models suffer due to artifacts inherited from pretraining. A particularly detrimental artifact, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the label distribution are not suitable in zero-shot settings, as they have incompatible requirements such as access to labeled downstream task data or knowledge o… ▽ More Popular zero-shot models suffer due to artifacts inherited from pretraining. A particularly detrimental artifact, caused by unbalanced web-scale pretraining data, is mismatched label distribution. Existing approaches that seek to repair the label distribution are not suitable in zero-shot settings, as they have incompatible requirements such as access to labeled downstream task data or knowledge of the true label balance in the pretraining distribution. We sidestep these challenges and introduce a simple and lightweight approach to adjust pretrained model predictions via optimal transport. Our technique requires only an estimate of the label distribution of a downstream task. Theoretically, we characterize the improvement produced by our procedure under certain mild conditions and provide bounds on the error caused by misspecification. Empirically, we validate our method in a wide array of zero-shot image and text classification tasks, improving accuracy by 4.8% and 15.9% on average, and beating baselines like Prior Matching -- often by significant margins -- in 17 out of 21 datasets. △ Less

Submitted 12 April, 2024; originally announced April 2024.

Comments: 29 pages

Pulse Shape Discrimination in JSNS$^2$

Authors: T. Dodo, M. K. Cheoun, J. H. Choi, J. Y. Choi, J. Goh, K. Haga, M. Harada, S. Hasegawa, W. Hwang, T. Iida, H. I. Jang, J. S. Jang, K. K. Joo, D. E. Jung, S. K. Kang, Y. Kasugai, T. Kawasaki, E. J. Kim, J. Y. Kim, S. B. Kim, W. Kim, H. Kinoshita, T. Konno, D. H. Lee, I. T. Lim , et al. (29 additional authors not shown)

Abstract: JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment that is searching for sterile neutrinos via the observation of $\barν_μ \rightarrow \barν_e$ appearance oscillations using neutrinos with muon decay-at-rest. For this search, rejecting cosmic-ray-induced neutron events by Pulse Shape Discrimination (PSD) is essential because the JSNS$^2$ detector is loca… ▽ More JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment that is searching for sterile neutrinos via the observation of $\barν_μ \rightarrow \barν_e$ appearance oscillations using neutrinos with muon decay-at-rest. For this search, rejecting cosmic-ray-induced neutron events by Pulse Shape Discrimination (PSD) is essential because the JSNS$^2$ detector is located above ground, on the third floor of the building. We have achieved 95$\%$ rejection of neutron events while kee** 90$\%$ of signal, electron-like events using a data driven likelihood method. △ Less

Submitted 28 March, 2024; originally announced April 2024.

Comments: arXiv admin note: text overlap with arXiv:2111.07482, arXiv:2308.02722

Improving Diffusion-Based Generative Models via Approximated Optimal Transport

Authors: Daegyu Kim, Jooyoung Choi, Chaehun Shin, Uiwon Hwang, Sungroh Yoon

Abstract: We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, significantly enhancing the ability of diffusion models to estimate the denoiser outputs accurately. This improvement leads to ODE trajectories of diffusion models with lower curva… ▽ More We introduce the Approximated Optimal Transport (AOT) technique, a novel training scheme for diffusion-based generative models. Our approach aims to approximate and integrate optimal transport into the training process, significantly enhancing the ability of diffusion models to estimate the denoiser outputs accurately. This improvement leads to ODE trajectories of diffusion models with lower curvature and reduced truncation errors during sampling. We achieve superior image quality and reduced sampling steps by employing AOT in training. Specifically, we achieve FID scores of 1.88 with just 27 NFEs and 1.73 with 29 NFEs in unconditional and conditional generations, respectively. Furthermore, when applying AOT to train the discriminator for guidance, we establish new state-of-the-art FID scores of 1.68 and 1.58 for unconditional and conditional generations, respectively, each with 29 NFEs. This outcome demonstrates the effectiveness of AOT in enhancing the performance of diffusion models. △ Less

Submitted 8 March, 2024; originally announced March 2024.

Extensive search for axion dark matter over 1\,GHz with CAPP's Main Axion eXperiment

Authors: Saebyeok Ahn, **Myeong Kim, Boris I. Ivanov, Ohjoon Kwon, HeeSu Byun, Arjan F. van Loo, SeongTae Par, Junu Jeong, Soohyung Lee, **su Kim, Çağlar Kutlu, Andrew K. Yi, Yasunobu Nakamura, Seonjeong Oh, Danho Ahn, SungJae Bae, Hyoungsoon Choi, Jihoon Choi, Yonuk Chong, Woohyun Chung, Violeta Gkika, Jihn E. Kim, Younggeun Kim, Byeong Rok Ko, Lino Miceli , et al. (11 additional authors not shown)

Abstract: We report an extensive high-sensitivity search for axion dark matter above 1\,GHz at the Center for Axion and Precision Physics Research (CAPP). The cavity resonant search, exploiting the coupling between axions and photons, explored the frequency (mass) range of 1.025\,GHz (4.24\,$μ$eV) to 1.185\,GHz (4.91\,$μ$eV). We have introduced a number of innovations in this field, demonstrating the practi… ▽ More We report an extensive high-sensitivity search for axion dark matter above 1\,GHz at the Center for Axion and Precision Physics Research (CAPP). The cavity resonant search, exploiting the coupling between axions and photons, explored the frequency (mass) range of 1.025\,GHz (4.24\,$μ$eV) to 1.185\,GHz (4.91\,$μ$eV). We have introduced a number of innovations in this field, demonstrating the practical approach of optimizing all the relevant parameters of axion haloscopes, extending presently available technology. The CAPP 12\,T magnet with an aperture of 320\,mm made of Nb$_3$Sn and NbTi superconductors surrounding a 37-liter ultralight-weight copper cavity is expected to convert DFSZ axions into approximately $10^2$ microwave photons per second. A powerful dilution refrigerator, capable of kee** the core system below 40\,mK, combined with quantum-noise limited readout electronics, achieved a total system noise of about 200\,mK or below, which corresponds to a background of roughly $4\times 10^3$ photons per second within the axion bandwidth. The combination of all those improvements provides unprecedented search performance, imposing the most stringent exclusion limits on axion--photon coupling in this frequency range to date. These results also suggest an experimental capability suitable for highly-sensitive searches for axion dark matter above 1\,GHz. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: A detailed axion dark matter article with 27 pages, 22 figures

Dynamical Generation of the Baryon Asymmetry from a Scale Hierarchy

Authors: Jae Hyeok Chang, Kwang Sik Jeong, Chang Hyeon Lee, Chang Sub Shin

Abstract: We propose a novel baryogenesis scenario where the baryon asymmetry originates directly from a hierarchy between two fundamental mass scales: the electroweak scale and the Planck scale. Our model is based on the neutrino-portal Affleck-Dine (AD) mechanism, which generates the asymmetry of the AD sector during the radiation-dominated era and subsequently transfers it to the baryon number before the… ▽ More We propose a novel baryogenesis scenario where the baryon asymmetry originates directly from a hierarchy between two fundamental mass scales: the electroweak scale and the Planck scale. Our model is based on the neutrino-portal Affleck-Dine (AD) mechanism, which generates the asymmetry of the AD sector during the radiation-dominated era and subsequently transfers it to the baryon number before the electroweak phase transition. The observed baryon asymmetry is then a natural outcome of this scenario. The model is testable as it predicts the existence of a Majoron with a keV mass and an electroweak scale decay constant. The impact of the relic Majoron on $ΔN_{\rm eff}$ can be measured through near-future CMB observations. △ Less

Submitted 5 February, 2024; v1 submitted 24 January, 2024; originally announced January 2024.

Comments: 5+5 pages, 2+1 figures. v2:references added, discussion extended

Report number: FERMILAB-PUB-24-0012-T-V

Multimodal Data Curation via Object Detection and Filter Ensembles

Authors: Tzu-Heng Huang, Changho Shin, Sui Jiet Tay, Dyah Adila, Frederic Sala

Abstract: We propose an approach for curating multimodal data that we used for our entry in the 2023 DataComp competition filtering track. Our technique combines object detection and weak supervision-based ensembling. In the first of two steps in our approach, we employ an out-of-the-box zero-shot object detection model to extract granular information and produce a variety of filter designs. In the second s… ▽ More We propose an approach for curating multimodal data that we used for our entry in the 2023 DataComp competition filtering track. Our technique combines object detection and weak supervision-based ensembling. In the first of two steps in our approach, we employ an out-of-the-box zero-shot object detection model to extract granular information and produce a variety of filter designs. In the second step, we employ weak supervision to ensemble filtering rules. This approach results in a 4% performance improvement when compared to the best-performing baseline, producing the top-ranking position in the small scale track at the time of writing. Furthermore, in the medium scale track, we achieve a noteworthy 4.2% improvement over the baseline by simply ensembling existing baselines with weak supervision. △ Less

Submitted 5 January, 2024; originally announced January 2024.

Comments: Appeared in the Workshop of Towards the Next Generation of Computer Vision Datasets (TNGCV) on ICCV 2023

Constraining MeV to 10 GeV majoron by Big Bang Nucleosynthesis

Authors: Sanghyeon Chang, Sougata Ganguly, Tae Hyun Jung, Tae-Sun Park, Chang Sub Shin

Abstract: We estimate the Big Bang nucleosynthesis (BBN) constraint on the majoron in the mass range between $1\,{\rm MeV}$ to $10\,{\rm GeV}$ which dominantly decays into the standard model neutrinos. When the majoron lifetime is shorter than $1\,{\rm sec}$, the injected neutrinos mainly heat up background plasma, which alters the relation between photon temperature and background neutrino temperature. For… ▽ More We estimate the Big Bang nucleosynthesis (BBN) constraint on the majoron in the mass range between $1\,{\rm MeV}$ to $10\,{\rm GeV}$ which dominantly decays into the standard model neutrinos. When the majoron lifetime is shorter than $1\,{\rm sec}$, the injected neutrinos mainly heat up background plasma, which alters the relation between photon temperature and background neutrino temperature. For a lifetime longer than $1\,{\rm sec}$, most of the injected neutrinos directly contribute to the protons-to-neutrons conversion. In both cases, deuterium and helium abundances are enhanced, while the constraint from the deuterium is stronger than that from the helium. $^7{\rm Li}$ abundance gets decreased as a consequence of additional neutrons, but the parameter range that fits the observed $^7{\rm Li}$ abundance is excluded by the deuterium constraint. We also estimate other cosmological constraints and compare them with the BBN bound. △ Less

Submitted 1 July, 2024; v1 submitted 1 January, 2024; originally announced January 2024.

Comments: 12 pages, 3 figures, v2: major revision made by including correct n/p conversion induced by modified thermal neutrinos, slight changes in the result, references added, version accepted in PRD

Report number: CTPU-PTC-23-56

ControlDreamer: Stylized 3D Generation with Multi-View ControlNet

Authors: Yeongtak Oh, Jooyoung Choi, Yongsung Kim, Minjun Park, Chaehun Shin, Sungroh Yoon

Abstract: Recent advancements in text-to-3D generation have significantly contributed to the automation and democratization of 3D content creation. Building upon these developments, we aim to address the limitations of current methods in generating 3D models with creative geometry and styles. We introduce multi-view ControlNet, a novel depth-aware multi-view diffusion model trained on generated datasets fro… ▽ More Recent advancements in text-to-3D generation have significantly contributed to the automation and democratization of 3D content creation. Building upon these developments, we aim to address the limitations of current methods in generating 3D models with creative geometry and styles. We introduce multi-view ControlNet, a novel depth-aware multi-view diffusion model trained on generated datasets from a carefully curated text corpus. Our multi-view ControlNet is then integrated into our two-stage pipeline, ControlDreamer, enabling text-guided generation of stylized 3D models. Additionally, we present a comprehensive benchmark for 3D style editing, encompassing a broad range of subjects, including objects, animals, and characters, to further facilitate research on diverse 3D generation. Our comparative analysis reveals that this new pipeline outperforms existing text-to-3D methods as evidenced by human evaluations and CLIP score metrics. △ Less

Submitted 5 January, 2024; v1 submitted 2 December, 2023; originally announced December 2023.

Comments: Project page: https://controldreamer.github.io/

Effective Theory Approach for Axion Wormholes

Authors: Dhong Yeon Cheong, Seong Chan Park, Chang Sub Shin

Abstract: We employ the effective field theory approach to analyze the characteristics of Euclidean wormholes within axion theories. Using this approach, we obtain non-perturbative instantons in various complex scalar models with and without a non-minimal coupling to gravity, as well as models featuring the $R^2$ term for a range of coupling values. This yields a series of analytical expressions for the axi… ▽ More We employ the effective field theory approach to analyze the characteristics of Euclidean wormholes within axion theories. Using this approach, we obtain non-perturbative instantons in various complex scalar models with and without a non-minimal coupling to gravity, as well as models featuring the $R^2$ term for a range of coupling values. This yields a series of analytical expressions for the axion wormhole action, shedding light on the model parameters and field dependencies of contributions in both the ultraviolet and infrared domains. Consequently, model-dependent local operators that disrupt axion shift symmetries are generated at lower energy levels. This, in turn, provides crucial insights into the gravitational influences on the axion quality problem. △ Less

Submitted 19 June, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

Comments: 25 pages, 6 figures, v2: To appear in JHEP, added discussions on the cutoff scale and an appendix on the potential contribution

Report number: CERN-TH-2023-184

Zero-Shot Robustification of Zero-Shot Models

Authors: Dyah Adila, Changho Shin, Linrong Cai, Frederic Sala

Abstract: Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can impact their performance. The traditional solution is fine-tuning, but this undermines the key advantage of pretrained models, which is their ability to be used out-of-the-box. We p… ▽ More Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can impact their performance. The traditional solution is fine-tuning, but this undermines the key advantage of pretrained models, which is their ability to be used out-of-the-box. We propose RoboShot, a method that improves the robustness of pretrained model embeddings in a fully zero-shot fashion. First, we use language models (LMs) to obtain useful insights from task descriptions. These insights are embedded and used to remove harmful and boost useful components in embeddings -- without any supervision. Theoretically, we provide a simple and tractable model for biases in zero-shot embeddings and give a result characterizing under what conditions our approach can boost performance. Empirically, we evaluate RoboShot on nine image and NLP classification tasks and show an average improvement of 15.98% on worst group accuracy, with trivial decrease in overall accuracy over several zero-shot baselines. Additionally, we demonstrate that RoboShot is compatible with a variety of pretrained and language models and propose a way to further boost performance with a zero-shot adaptation variant. △ Less

Submitted 12 February, 2024; v1 submitted 8 September, 2023; originally announced September 2023.

Comments: International Conference on Learning Representations (ICLR), 2024

The acrylic vessel for JSNS$^{2}$-II neutrino target

Authors: C. D. Shin, S. Ajimura, M. K. Cheoun, J. H. Choi, J. Y. Choi, T. Dodo, J. Goh, K. Haga, M. Harada, S. Hasegawa, T. Hiraiwa, W. Hwang, T. Iida, H. I. Jang, J. S. Jang, H. Jeon, S. Jeon, K. K. Joo, D. E. Jung, S. K. Kang, Y. Kasugai, T. Kawasaki, E. J. Kim, J. Y. Kim, S. B. Kim , et al. (35 additional authors not shown)

Abstract: The JSNS$^{2}$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment designed for the search for sterile neutrinos. The experiment is currently at the stage of the second phase named JSNS$^{2}$-II with two detectors at near and far locations from the neutrino source. One of the key components of the experiment is an acrylic vessel, that is used for the target volume… ▽ More The JSNS$^{2}$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment designed for the search for sterile neutrinos. The experiment is currently at the stage of the second phase named JSNS$^{2}$-II with two detectors at near and far locations from the neutrino source. One of the key components of the experiment is an acrylic vessel, that is used for the target volume for the detection of the anti-neutrinos. The specifications, design, and measured properties of the acrylic vessel are described. △ Less

Submitted 11 December, 2023; v1 submitted 4 September, 2023; originally announced September 2023.

Journal ref: 2023 JINST 18 T12001

Study on the accidental background of the JSNS$^2$ experiment

Authors: D. H. Lee, S. Ajimura, M. K. Cheoun, J. H. Choi, J. Y. Choi, T. Dodo, J. Goh, K. Haga, M. Harada, S. Hasegawa, T. Hiraiwa, W. Hwang, H. I. Jang, J. S. Jang, H. Jeon, S. Jeon, K. K. Joo, D. E. Jung, S. K. Kang, Y. Kasugai, T. Kawasaki, E. J. Kim, J. Y. Kim, S. B. Kim, W. Kim , et al. (33 additional authors not shown)

Abstract: JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment which searches for sterile neutrinos via the observation of $\barν_μ \to \barν_{e}$ appearance oscillations using muon decay-at-rest neutrinos. The data taking of JSNS$^2$ have been performed from 2021. In this manuscript, a study of the accidental background is presented. The rate of the accidental back… ▽ More JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment which searches for sterile neutrinos via the observation of $\barν_μ \to \barν_{e}$ appearance oscillations using muon decay-at-rest neutrinos. The data taking of JSNS$^2$ have been performed from 2021. In this manuscript, a study of the accidental background is presented. The rate of the accidental background is (9.29$\pm 0.39) \times 10^{-8}$ / spill with 0.75 MW beam power and comparable to the number of searching signals. △ Less

Submitted 22 April, 2024; v1 submitted 4 August, 2023; originally announced August 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2111.07482

Journal ref: Eur. Phys. J. C 84, 409 (2024)

Diffusion-Stego: Training-free Diffusion Generative Steganography via Message Projection

Authors: Daegyu Kim, Chaehun Shin, Jooyoung Choi, Dahuin Jung, Sungroh Yoon

Abstract: Generative steganography is the process of hiding secret messages in generated images instead of cover images. Existing studies on generative steganography use GAN or Flow models to obtain high hiding message capacity and anti-detection ability over cover images. However, they create relatively unrealistic stego images because of the inherent limitations of generative models. We propose Diffusion-… ▽ More Generative steganography is the process of hiding secret messages in generated images instead of cover images. Existing studies on generative steganography use GAN or Flow models to obtain high hiding message capacity and anti-detection ability over cover images. However, they create relatively unrealistic stego images because of the inherent limitations of generative models. We propose Diffusion-Stego, a generative steganography approach based on diffusion models which outperform other generative models in image generation. Diffusion-Stego projects secret messages into latent noise of diffusion models and generates stego images with an iterative denoising process. Since the naive hiding of secret messages into noise boosts visual degradation and decreases extracted message accuracy, we introduce message projection, which hides messages into noise space while addressing these issues. We suggest three options for message projection to adjust the trade-off between extracted message accuracy, anti-detection ability, and image quality. Diffusion-Stego is a training-free approach, so we can apply it to pre-trained diffusion models which generate high-quality images, or even large-scale text-to-image models, such as Stable diffusion. Diffusion-Stego achieved a high capacity of messages (3.0 bpp of binary messages with 98% accuracy, and 6.0 bpp with 90% accuracy) as well as high quality (with a FID score of 2.77 for 1.0 bpp on the FFHQ 64$\times$64 dataset) that makes it challenging to distinguish from real images in the PNG format. △ Less

Submitted 30 May, 2023; originally announced May 2023.

What can a GNOME do? Search targets for the Global Network of Optical Magnetometers for Exotic physics searches

Authors: S. Afach, D. Aybas Tumturk, H. Bekker, B. C. Buchler, D. Budker, K. Cervantes, A. Derevianko, J. Eby, N. L. Figueroa, R. Folman, D. Gavil'an Martin, M. Givon, Z. D. Grujic, H. Guo, P. Hamilton, M. P. Hedges, D. F. Jackson Kimball, S. Khamis, D. Kim, E. Klinger, A. Kryemadhi, X. Liu, G. Lukasiewicz, H. Masia-Roig, M. Padniuk , et al. (28 additional authors not shown)

Abstract: Numerous observations suggest that there exist undiscovered beyond-the-Standard-Model particles and fields. Because of their unknown nature, these exotic particles and fields could interact with Standard Model particles in many different ways and assume a variety of possible configurations. Here we present an overview of the Global Network of Optical Magnetometers for Exotic physics searches (GNOM… ▽ More Numerous observations suggest that there exist undiscovered beyond-the-Standard-Model particles and fields. Because of their unknown nature, these exotic particles and fields could interact with Standard Model particles in many different ways and assume a variety of possible configurations. Here we present an overview of the Global Network of Optical Magnetometers for Exotic physics searches (GNOME), our ongoing experimental program designed to test a wide range of exotic physics scenarios. The GNOME experiment utilizes a worldwide network of shielded atomic magnetometers (and, more recently, comagnetometers) to search for spatially and temporally correlated signals due to torques on atomic spins from exotic fields of astrophysical origin. We survey the temporal characteristics of a variety of possible signals currently under investigation such as those from topological defect dark matter (axion-like particle domain walls), axion-like particle stars, solitons of complex-valued scalar fields (Q-balls), stochastic fluctuations of bosonic dark matter fields, a solar axion-like particle halo, and bursts of ultralight bosonic fields produced by cataclysmic astrophysical events such as binary black hole mergers. △ Less

Submitted 4 May, 2023; v1 submitted 2 May, 2023; originally announced May 2023.

Comments: 22 pages, 12 figures, submitted to Annalen der Physik

Journal ref: Annalen der Physik 2023, 2300083 (2023)

EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimation

Authors: Ilwi Yun, Chanyong Shin, Hyunku Lee, Hyuk-Jae Lee, Chae Eun Rhee

Abstract: Estimating the depths of equirectangular (i.e., 360) images (EIs) is challenging given the distorted 180 x 360 field-of-view, which is hard to be addressed via convolutional neural network (CNN). Although a transformer with global attention achieves significant improvements over CNN for EI depth estimation task, it is computationally inefficient, which raises the need for transformer with local at… ▽ More Estimating the depths of equirectangular (i.e., 360) images (EIs) is challenging given the distorted 180 x 360 field-of-view, which is hard to be addressed via convolutional neural network (CNN). Although a transformer with global attention achieves significant improvements over CNN for EI depth estimation task, it is computationally inefficient, which raises the need for transformer with local attention. However, to apply local attention successfully for EIs, a specific strategy, which addresses distorted equirectangular geometry and limited receptive field simultaneously, is required. Prior works have only cared either of them, resulting in unsatisfactory depths occasionally. In this paper, we propose an equirectangular geometry-biased transformer termed EGformer. While limiting the computational cost and the number of network parameters, EGformer enables the extraction of the equirectangular geometry-aware local attention with a large receptive field. To achieve this, we actively utilize the equirectangular geometry as the bias for the local attention instead of struggling to reduce the distortion of EIs. As compared to the most recent EI depth estimation studies, the proposed approach yields the best depth outcomes overall with the lowest computational cost and the fewest parameters, demonstrating the effectiveness of the proposed methods. △ Less

Submitted 7 September, 2023; v1 submitted 16 April, 2023; originally announced April 2023.

Comments: 12 pages, Accepted to ICCV23, Camera ready version

Mitigating Source Bias for Fairer Weak Supervision

Authors: Changho Shin, Sonia Cromp, Dyah Adila, Frederic Sala

Abstract: Weak supervision enables efficient development of training sets by reducing the need for ground truth labels. However, the techniques that make weak supervision attractive -- such as integrating any source of signal to estimate unknown labels -- also entail the danger that the produced pseudolabels are highly biased. Surprisingly, given everyday use and the potential for increased bias, weak super… ▽ More Weak supervision enables efficient development of training sets by reducing the need for ground truth labels. However, the techniques that make weak supervision attractive -- such as integrating any source of signal to estimate unknown labels -- also entail the danger that the produced pseudolabels are highly biased. Surprisingly, given everyday use and the potential for increased bias, weak supervision has not been studied from the point of view of fairness. We begin such a study, starting with the observation that even when a fair model can be built from a dataset with access to ground-truth labels, the corresponding dataset labeled via weak supervision can be arbitrarily unfair. To address this, we propose and empirically validate a model for source unfairness in weak supervision, then introduce a simple counterfactual fairness-based technique that can mitigate these biases. Theoretically, we show that it is possible for our approach to simultaneously improve both accuracy and fairness -- in contrast to standard fairness approaches that suffer from tradeoffs. Empirically, we show that our technique improves accuracy on weak supervision baselines by as much as 32\% while reducing demographic parity gap by 82.5\%. A simple extension of our method aimed at maximizing performance produces state-of-the-art performance in five out of ten datasets in the WRENCH benchmark. △ Less

Submitted 29 November, 2023; v1 submitted 30 March, 2023; originally announced March 2023.

Comments: NeurIPS 2023

Edit-A-Video: Single Video Editing with Object-Aware Consistency

Authors: Chaehun Shin, Heeseung Kim, Che Hyun Lee, Sang-gil Lee, Sungroh Yoon

Abstract: Despite the fact that text-to-video (TTV) model has recently achieved remarkable success, there have been few approaches on TTV for its extension to video editing. Motivated by approaches on TTV models adapting from diffusion-based text-to-image (TTI) models, we suggest the video editing framework given only a pretrained TTI model and a single <text, video> pair, which we term Edit-A-Video. The fr… ▽ More Despite the fact that text-to-video (TTV) model has recently achieved remarkable success, there have been few approaches on TTV for its extension to video editing. Motivated by approaches on TTV models adapting from diffusion-based text-to-image (TTI) models, we suggest the video editing framework given only a pretrained TTI model and a single <text, video> pair, which we term Edit-A-Video. The framework consists of two stages: (1) inflating the 2D model into the 3D model by appending temporal modules and tuning on the source video (2) inverting the source video into the noise and editing with target text prompt and attention map injection. Each stage enables the temporal modeling and preservation of semantic attributes of the source video. One of the key challenges for video editing include a background inconsistency problem, where the regions not included for the edit suffer from undesirable and inconsistent temporal alterations. To mitigate this issue, we also introduce a novel mask blending method, termed as sparse-causal blending (SC Blending). We improve previous mask blending methods to reflect the temporal consistency so that the area where the editing is applied exhibits smooth transition while also achieving spatio-temporal consistency of the unedited regions. We present extensive experimental results over various types of text and videos, and demonstrate the superiority of the proposed method compared to baselines in terms of background consistency, text alignment, and video editing quality. △ Less

Submitted 17 November, 2023; v1 submitted 14 March, 2023; originally announced March 2023.

Comments: ACML 2023 Best Paper Award

Search for the Sagittarius Tidal Stream of Axion Dark Matter around 4.55 $μ$eV

Authors: Andrew K. Yi, Saebyeok Ahn, Çağlar Kutlu, **Myeong Kim, Byeong Rok Ko, Boris I. Ivanov, HeeSu Byun, Arjan F. van Loo, SeongTae Park, Junu Jeong, Ohjoon Kwon, Yasunobu Nakamura, Sergey V. Uchaikin, Jihoon Choi, Soohyung Lee, MyeongJae Lee, Yun Chang Shin, **su Kim, Doyu Lee, Danho Ahn, SungJae Bae, Jiwon Lee, Younggeun Kim, Violeta Gkika, Ki Woong Lee , et al. (7 additional authors not shown)

Abstract: We report the first search for the Sagittarius tidal stream of axion dark matter around 4.55 $μ$eV using CAPP-12TB haloscope data acquired in March of 2022. Our result excluded the Sagittarius tidal stream of Dine-Fischler-Srednicki-Zhitnitskii and Kim-Shifman-Vainshtein-Zakharov axion dark matter densities of $ρ_a\gtrsim0.184$ and $\gtrsim0.025$ GeV/cm$^{3}$, respectively, over a mass range from… ▽ More We report the first search for the Sagittarius tidal stream of axion dark matter around 4.55 $μ$eV using CAPP-12TB haloscope data acquired in March of 2022. Our result excluded the Sagittarius tidal stream of Dine-Fischler-Srednicki-Zhitnitskii and Kim-Shifman-Vainshtein-Zakharov axion dark matter densities of $ρ_a\gtrsim0.184$ and $\gtrsim0.025$ GeV/cm$^{3}$, respectively, over a mass range from 4.51 to 4.59 $μ$eV at a 90% confidence level. △ Less

Submitted 13 July, 2023; v1 submitted 2 February, 2023; originally announced February 2023.

Comments: 6 pages, 7 Figures, PRD Letter accepted

Journal ref: Physical Review D 108, L021304 (2023)

Dark gauge boson emission from supernova pions

Authors: Chang Sub Shin, Seokhoon Yun

Abstract: The hot, neutron-rich, and dense circumstance in core-collapse supernovae provides a source of negatively charged pions that may make up a significant portion of the matter. These abundant thermal pions can play a role to populate light and hidden hypothetical particles. We discuss the dark gauge boson production via reactions involving supernova pions, the rate of which is determined by the isove… ▽ More The hot, neutron-rich, and dense circumstance in core-collapse supernovae provides a source of negatively charged pions that may make up a significant portion of the matter. These abundant thermal pions can play a role to populate light and hidden hypothetical particles. We discuss the dark gauge boson production via reactions involving supernova pions, the rate of which is determined by the isovector nucleon coupling. We take into account the two toy models, the dark photon and the gauged $B-L$ models, that carry the typical distinct isovector nucleon coupling structure in the medium. Pion-induced dark gauge bosons leave an imprint on several observational consequences associated with supernova. Their sizable emissivity and characteristic hard spectral distribution result in the stringent constraints on the dark gauge boson models, in particular at masses above the two electron mass. △ Less

Submitted 7 September, 2023; v1 submitted 28 November, 2022; originally announced November 2022.

Comments: 12 pages, 4 figures; version published in PHYSICAL REVIEW D, figures updated

DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priors

Authors: Dogyoon Lee, Minhyeok Lee, Cha** Shin, Sangyoun Lee

Abstract: Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been demonstrated under strictly controlled settings, with little attention paid to less ideal scenarios, including with the presence of noise such as exposure, ill… ▽ More Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been demonstrated under strictly controlled settings, with little attention paid to less ideal scenarios, including with the presence of noise such as exposure, illumination changes, and blur. In particular, though blur frequently occurs in real situations, NeRF that can handle blurred images has received little attention. The few studies that have investigated NeRF for blurred images have not considered geometric and appearance consistency in 3D space, which is one of the most important factors in 3D reconstruction. This leads to inconsistency and the degradation of the perceptual quality of the constructed scene. Hence, this paper proposes a DP-NeRF, a novel clean NeRF framework for blurred images, which is constrained with two physical priors. These priors are derived from the actual blurring process during image acquisition by the camera. DP-NeRF proposes rigid blurring kernel to impose 3D consistency utilizing the physical priors and adaptive weight proposal to refine the color composition error in consideration of the relationship between depth and blur. We present extensive experimental results for synthetic and real scenes with two types of blur: camera motion blur and defocus blur. The results demonstrate that DP-NeRF successfully improves the perceptual quality of the constructed NeRF ensuring 3D geometric and appearance consistency. We further demonstrate the effectiveness of our model with comprehensive ablation analysis. △ Less

Submitted 8 March, 2023; v1 submitted 22 November, 2022; originally announced November 2022.

Comments: Accepted at CVPR 2023, Code: https://github.com/dogyoonlee/DP-NeRF, Project page: https://dogyoonlee.github.io/dpnerf/

LittleBird: Efficient Faster & Longer Transformer for Question Answering

Authors: Minchul Lee, Kijong Han, Myeong Cheol Shin

Abstract: BERT has shown a lot of sucess in a wide variety of NLP tasks. But it has a limitation dealing with long inputs due to its attention mechanism. Longformer, ETC and BigBird addressed this issue and effectively solved the quadratic dependency problem. However we find that these models are not sufficient, and propose LittleBird, a novel model based on BigBird with improved speed and memory footprint… ▽ More BERT has shown a lot of sucess in a wide variety of NLP tasks. But it has a limitation dealing with long inputs due to its attention mechanism. Longformer, ETC and BigBird addressed this issue and effectively solved the quadratic dependency problem. However we find that these models are not sufficient, and propose LittleBird, a novel model based on BigBird with improved speed and memory footprint while maintaining accuracy. In particular, we devise a more flexible and efficient position representation method based on Attention with Linear Biases (ALiBi). We also show that replacing the method of global information represented in the BigBird with pack and unpack attention is more effective. The proposed model can work on long inputs even after being pre-trained on short inputs, and can be trained efficiently reusing existing pre-trained language model for short inputs. This is a significant benefit for low-resource languages where large amounts of long text data are difficult to obtain. As a result, our experiments show that LittleBird works very well in a variety of languages, achieving high performance in question answering tasks, particularly in KorQuAD2.0, Korean Question Answering Dataset for long paragraphs. △ Less

Submitted 12 April, 2023; v1 submitted 21 October, 2022; originally announced October 2022.

Comments: Accepted to EMNLP 2022. see https://aclanthology.org/2022.emnlp-main.352/

Axion Dark Matter Search around 4.55 $μ$eV with Dine-Fischler-Srednicki-Zhitnitskii Sensitivity

Authors: Andrew K. Yi, Saebyeok Ahn, Çağlar Kutlu, **Myeong Kim, Byeong Rok Ko, Boris I. Ivanov, HeeSu Byun, Arjan F. van Loo, SeongTae Park, Junu Jeong, Ohjoon Kwon, Yasunobu Nakamura, Sergey V. Uchaikin, Jihoon Choi, Soohyung Lee, MyeongJae Lee, Yun Chang Shin, **su Kim, Doyu Lee, Danho Ahn, SungJae Bae, Jiwon Lee, Younggeun Kim, Violeta Gkika, Ki Woong Lee , et al. (7 additional authors not shown)

Abstract: We report an axion dark matter search at Dine-Fischler-Srednicki-Zhitnitskii sensitivity with the CAPP-12TB haloscope, assuming axions contribute 100\% of the local dark matter density. The search excluded the axion--photon coupling $g_{aγγ}$ down to about $6.2\times10^{-16}$ GeV$^{-1}$ over the axion mass range between 4.51 and 4.59 $μ$eV at a 90\% confidence level. The achieved experimental… ▽ More We report an axion dark matter search at Dine-Fischler-Srednicki-Zhitnitskii sensitivity with the CAPP-12TB haloscope, assuming axions contribute 100\% of the local dark matter density. The search excluded the axion--photon coupling $g_{aγγ}$ down to about $6.2\times10^{-16}$ GeV$^{-1}$ over the axion mass range between 4.51 and 4.59 $μ$eV at a 90\% confidence level. The achieved experimental sensitivity can also exclude Kim-Shifman-Vainshtein-Zakharov axion dark matter that makes up just 13\% of the local dark matter density. The CAPP-12TB haloscope will continue the search over a wide range of axion masses. △ Less

Submitted 16 February, 2023; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: 7 pages, 6 figures

Journal ref: Physical Review Letters 130, 071002 (2023)

Expanded Adaptive Scaling Normalization for End to End Image Compression

Authors: Cha** Shin, Hyeongmin Lee, Hanbin Son, Sang** Lee, Dogyoon Lee, Sangyoun Lee

Abstract: Recently, learning-based image compression methods that utilize convolutional neural layers have been developed rapidly. Rescaling modules such as batch normalization which are often used in convolutional neural networks do not operate adaptively for the various inputs. Therefore, Generalized Divisible Normalization(GDN) has been widely used in image compression to rescale the input features adapt… ▽ More Recently, learning-based image compression methods that utilize convolutional neural layers have been developed rapidly. Rescaling modules such as batch normalization which are often used in convolutional neural networks do not operate adaptively for the various inputs. Therefore, Generalized Divisible Normalization(GDN) has been widely used in image compression to rescale the input features adaptively across both spatial and channel axes. However, the representation power or degree of freedom of GDN is severely limited. Additionally, GDN cannot consider the spatial correlation of an image. To handle the limitations of GDN, we construct an expanded form of the adaptive scaling module, named Expanded Adaptive Scaling Normalization(EASN). First, we exploit the swish function to increase the representation ability. Then, we increase the receptive field to make the adaptive rescaling module consider the spatial correlation. Furthermore, we introduce an input map** function to give the module a higher degree of freedom. We demonstrate how our EASN works in an image compression network using the visualization results of the feature map, and we conduct extensive experiments to show that our EASN increases the rate-distortion performance remarkably, and even outperforms the VVC intra at a high bit rate. △ Less

Submitted 5 August, 2022; originally announced August 2022.

Comments: ECCV2022 Accepted

Cooperative Infrastructure Perception

Authors: Fawad Ahmad, Christina Suyong Shin, Weiwu Pang, Branden Leong, Pradipta Ghosh, Ramesh Govindan

Abstract: Recent works have considered two qualitatively different approaches to overcome line-of-sight limitations of 3D sensors used for perception: cooperative perception and infrastructure-augmented perception. In this paper, motivated by increasing deployments of infrastructure LiDARs, we explore a third approach, cooperative infrastructure perception. This approach generates perception outputs by fusi… ▽ More Recent works have considered two qualitatively different approaches to overcome line-of-sight limitations of 3D sensors used for perception: cooperative perception and infrastructure-augmented perception. In this paper, motivated by increasing deployments of infrastructure LiDARs, we explore a third approach, cooperative infrastructure perception. This approach generates perception outputs by fusing outputs of multiple infrastructure sensors, but, to be useful, must do so quickly and accurately. We describe the design, implementation and evaluation of Cooperative Infrastructure Perception (CIP), which uses a combination of novel algorithms and systems optimizations. It produces perception outputs within 100 ms using modest computing resources and with accuracy comparable to the state-of-the-art. CIP, when used to augment vehicle perception, can improve safety. When used in conjunction with offloaded planning, CIP can increase traffic throughput at intersections. △ Less

Submitted 26 June, 2024; v1 submitted 18 July, 2022; originally announced July 2022.

Out of Sight, Out of Mind: A Source-View-Wise Feature Aggregation for Multi-View Image-Based Rendering

Authors: Geonho Cha, Chaehun Shin, Sungroh Yoon, Dongyoon Wee

Abstract: To estimate the volume density and color of a 3D point in the multi-view image-based rendering, a common approach is to inspect the consensus existence among the given source image features, which is one of the informative cues for the estimation procedure. To this end, most of the previous methods utilize equally-weighted aggregation features. However, this could make it hard to check the consens… ▽ More To estimate the volume density and color of a 3D point in the multi-view image-based rendering, a common approach is to inspect the consensus existence among the given source image features, which is one of the informative cues for the estimation procedure. To this end, most of the previous methods utilize equally-weighted aggregation features. However, this could make it hard to check the consensus existence when some outliers, which frequently occur by occlusions, are included in the source image feature set. In this paper, we propose a novel source-view-wise feature aggregation method, which facilitates us to find out the consensus in a robust way by leveraging local structures in the feature set. We first calculate the source-view-wise distance distribution for each source feature for the proposed aggregation. After that, the distance distribution is converted to several similarity distributions with the proposed learnable similarity map** functions. Finally, for each element in the feature set, the aggregation features are extracted by calculating the weighted means and variances, where the weights are derived from the similarity distributions. In experiments, we validate the proposed method on various benchmark datasets, including synthetic and real image scenes. The experimental results demonstrate that incorporating the proposed features improves the performance by a large margin, resulting in the state-of-the-art performance. △ Less

Submitted 10 June, 2022; originally announced June 2022.

Measurement of cosmogenic $^9$Li and $^8$He production rates at RENO

Authors: H. G. Lee, J. H. Choi, H. I. Jang, J. S. Jang, S. H. Jeon, K. K. Joo, D. E. Jung, J. G. Kim, J. H. Kim, J. Y. Kim, S. B. Kim, S. Y. Kim, W. Kim, E. Kwon, D. H. Lee, W. J. Lee, I. T. Lim, D. H. Moon, M. Y. Pac, J. S. Park, R. G. Park, H. Seo, J. W. Seo, C. D. Shin, B. S. Yang , et al. (4 additional authors not shown)

Abstract: We report the measured production rates of unstable isotopes $^9$Li and $^8$He produced by cosmic muon spallation on $^{12}$C using two identical detectors of the RENO experiment. Their beta-decays accompanied by a neutron make a significant contribution to backgrounds of reactor antineutrino events in precise determination of the smallest neutrino mixing angle. The mean muon energy of its near (f… ▽ More We report the measured production rates of unstable isotopes $^9$Li and $^8$He produced by cosmic muon spallation on $^{12}$C using two identical detectors of the RENO experiment. Their beta-decays accompanied by a neutron make a significant contribution to backgrounds of reactor antineutrino events in precise determination of the smallest neutrino mixing angle. The mean muon energy of its near (far) detector with an overburden of 120 (450) m.w.e. is estimated as 33.1 +- 2.3 (73.6 +- 4.4) GeV. Based on roughly 3100 days of data, the cosmogenic production rate of $^9$Li ($^8$He) isotope is measured to be 44.2 +- 3.1 (10.6 +- 7.4) per day at near detector and 10.0 +- 1.1 (2.1 +- 1.5) per day at far detector. This corresponds to yields of $^9$Li ($^8$He), 4.80 +- 0.36 (1.15 +- 0.81) and 9.9 +- 1.1 (2.1 +- 1.5) at near and far detectors, respectively, in a unit of 10$^{-8}$ $μ^{-1}$ g${^-1}$ cm${^2}$. Combining the measured $^9$Li yields with other available underground measurements, an excellent power-law relationship of the yield with respect to the mean muon energy is found to have an exponent of $α$ = 0.75 +- 0.05. △ Less

Submitted 2 July, 2022; v1 submitted 20 April, 2022; originally announced April 2022.

Comments: 11 pages, 14 figures

Perception Prioritized Training of Diffusion Models

Authors: Jooyoung Choi, Jungbeom Lee, Chaehun Shin, Sungwon Kim, Hyunwoo Kim, Sungroh Yoon

Abstract: Diffusion models learn to restore noisy data, which is corrupted with different levels of noise, by optimizing the weighted sum of the corresponding loss terms, i.e., denoising score matching loss. In this paper, we show that restoring data corrupted with certain noise levels offers a proper pretext task for the model to learn rich visual concepts. We propose to prioritize such noise levels over o… ▽ More Diffusion models learn to restore noisy data, which is corrupted with different levels of noise, by optimizing the weighted sum of the corresponding loss terms, i.e., denoising score matching loss. In this paper, we show that restoring data corrupted with certain noise levels offers a proper pretext task for the model to learn rich visual concepts. We propose to prioritize such noise levels over other levels during training, by redesigning the weighting scheme of the objective function. We show that our simple redesign of the weighting scheme significantly improves the performance of diffusion models regardless of the datasets, architectures, and sampling strategies. △ Less

Submitted 1 April, 2022; originally announced April 2022.

Comments: CVPR 2022 Code: https://github.com/jychoi118/P2-weighting

GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records

Authors: Xi Yang, Aokun Chen, Nima PourNejatian, Hoo Chang Shin, Kaleb E Smith, Christopher Parisien, Colin Compas, Cheryl Martin, Mona G Flores, Ying Zhang, Tanja Magoc, Christopher A Harle, Gloria Lipori, Duane A Mitchell, William R Hogan, Elizabeth A Shenkman, Jiang Bian, Yonghui Wu

Abstract: There is an increasing interest in develo** artificial intelligence (AI) systems to process and interpret electronic health records (EHRs). Natural language processing (NLP) powered by pretrained language models is the key technology for medical AI systems utilizing clinical narratives. However, there are few clinical language models, the largest of which trained in the clinical domain is compar… ▽ More There is an increasing interest in develo** artificial intelligence (AI) systems to process and interpret electronic health records (EHRs). Natural language processing (NLP) powered by pretrained language models is the key technology for medical AI systems utilizing clinical narratives. However, there are few clinical language models, the largest of which trained in the clinical domain is comparatively small at 110 million parameters (compared with billions of parameters in the general domain). It is not clear how large clinical language models with billions of parameters can help medical AI systems utilize unstructured EHRs. In this study, we develop from scratch a large clinical language model - GatorTron - using >90 billion words of text (including >82 billion words of de-identified clinical text) and systematically evaluate it on 5 clinical NLP tasks including clinical concept extraction, medical relation extraction, semantic textual similarity, natural language inference (NLI), and medical question answering (MQA). We examine how (1) scaling up the number of parameters and (2) scaling up the size of the training data could benefit these NLP tasks. GatorTron models scale up the clinical language model from 110 million to 8.9 billion parameters and improve 5 clinical NLP tasks (e.g., 9.6% and 9.5% improvement in accuracy for NLI and MQA), which can be applied to medical AI systems to improve healthcare delivery. The GatorTron models are publicly available at: https://catalog.ngc.nvidia.com/orgs/nvidia/teams/clara/models/gatortron_og. △ Less

Submitted 16 December, 2022; v1 submitted 2 February, 2022; originally announced March 2022.

Comments: 24 pages, 2 figures, 3 tables

Reachability of turn sequences

Authors: William S. Evans, Noushin Saeedi, Chan-Su Shin, Hyun Tark

Abstract: A turn sequence of left and right turns is realized as a simple rectilinear chain of integral segments whose turns at its bends are the same as the turn sequence. The chain starts from the origin and ends at some point which we call a reachable point of the turn sequence. We investigate the combinatorial and geometric properties of the set of reachable points of a given turn sequence such as the s… ▽ More A turn sequence of left and right turns is realized as a simple rectilinear chain of integral segments whose turns at its bends are the same as the turn sequence. The chain starts from the origin and ends at some point which we call a reachable point of the turn sequence. We investigate the combinatorial and geometric properties of the set of reachable points of a given turn sequence such as the shape, connectedness, and sufficient and necessary conditions on the reachability to the four signed axes. We also prove the upper and lower bounds on the maximum distance from the origin to the closest reachable point on signed axes for a turn sequence. The bounds are expressed in terms of the difference between the number of left and right turns in the sequence as well as, in certain cases, the length of the maximal monotone prefix or suffix of the turn sequence. The bounds are exactly matched or tight within additive constants for some signed axes. △ Less

Submitted 21 March, 2022; v1 submitted 1 March, 2022; originally announced March 2022.

Comments: 27 pages, 15 figures

MSC Class: 52C02 ACM Class: F.2.2; G.2.2

Exploring Discontinuity for Video Frame Interpolation

Authors: Sang** Lee, Hyeongmin Lee, Cha** Shin, Hanbin Son, Sangyoun Lee

Abstract: Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame war** operations and refinement modules for the warped frames. These studies have been conducted on natural videos containing only continuous motions. However, many practical videos contain various unnatural objects with… ▽ More Video frame interpolation (VFI) is the task that synthesizes the intermediate frame given two consecutive frames. Most of the previous studies have focused on appropriate frame war** operations and refinement modules for the warped frames. These studies have been conducted on natural videos containing only continuous motions. However, many practical videos contain various unnatural objects with discontinuous motions such as logos, user interfaces and subtitles. We propose three techniques to make the existing deep learning-based VFI architectures robust to these elements. First is a novel data augmentation strategy called figure-text mixing (FTM) which can make the models learn discontinuous motions during training stage without any extra dataset. Second, we propose a simple but effective module that predicts a map called discontinuity map (D-map), which densely distinguishes between areas of continuous and discontinuous motions. Lastly, we propose loss functions to give supervisions of the discontinuous motion areas which can be applied along with FTM and D-map. We additionally collect a special test benchmark called Graphical Discontinuous Motion (GDM) dataset consisting of some mobile games and chatting videos. Applied to the various state-of-the-art VFI networks, our method significantly improves the interpolation qualities on the videos from not only GDM dataset, but also the existing benchmarks containing only continuous motions such as Vimeo90K, UCF101, and DAVIS. △ Less

Submitted 23 March, 2023; v1 submitted 15 February, 2022; originally announced February 2022.

Comments: highlight at CVPR 2023 (10% of accepted papers)

Enhanced Frame and Event-Based Simulator and Event-Based Video Interpolation Network

Authors: Adam Radomski, Andreas Georgiou, Thomas Debrunner, Chenghan Li, Luca Longinotti, Minwon Seo, Moosung Kwak, Chang-Woo Shin, Paul K. J. Park, Hyunsurk Eric Ryu, Kynan Eng

Abstract: Fast neuromorphic event-based vision sensors (Dynamic Vision Sensor, DVS) can be combined with slower conventional frame-based sensors to enable higher-quality inter-frame interpolation than traditional methods relying on fixed motion approximations using e.g. optical flow. In this work we present a new, advanced event simulator that can produce realistic scenes recorded by a camera rig with an ar… ▽ More Fast neuromorphic event-based vision sensors (Dynamic Vision Sensor, DVS) can be combined with slower conventional frame-based sensors to enable higher-quality inter-frame interpolation than traditional methods relying on fixed motion approximations using e.g. optical flow. In this work we present a new, advanced event simulator that can produce realistic scenes recorded by a camera rig with an arbitrary number of sensors located at fixed offsets. It includes a new configurable frame-based image sensor model with realistic image quality reduction effects, and an extended DVS model with more accurate characteristics. We use our simulator to train a novel reconstruction model designed for end-to-end reconstruction of high-fps video. Unlike previously published methods, our method does not require the frame and DVS cameras to have the same optics, positions, or camera resolutions. It is also not limited to objects a fixed distance from the sensor. We show that data generated by our simulator can be used to train our new model, leading to reconstructed images on public datasets of equivalent or better quality than the state of the art. We also show our sensor generalizing to data recorded by real sensors. △ Less

Submitted 17 December, 2021; originally announced December 2021.

Comments: 10 pages, 19 figures

Universalizing Weak Supervision

Authors: Changho Shin, Winfred Li, Harit Vishwakarma, Nicholas Roberts, Frederic Sala

Abstract: Weak supervision (WS) frameworks are a popular way to bypass hand-labeling large datasets for training data-hungry models. These approaches synthesize multiple noisy but cheaply-acquired estimates of labels into a set of high-quality pseudolabels for downstream training. However, the synthesis technique is specific to a particular kind of label, such as binary labels or sequences, and each new lab… ▽ More Weak supervision (WS) frameworks are a popular way to bypass hand-labeling large datasets for training data-hungry models. These approaches synthesize multiple noisy but cheaply-acquired estimates of labels into a set of high-quality pseudolabels for downstream training. However, the synthesis technique is specific to a particular kind of label, such as binary labels or sequences, and each new label type requires manually designing a new synthesis algorithm. Instead, we propose a universal technique that enables weak supervision over any label type while still offering desirable properties, including practical flexibility, computational efficiency, and theoretical guarantees. We apply this technique to important problems previously not tackled by WS frameworks including learning to rank, regression, and learning in hyperbolic space. Theoretically, our synthesis approach produces a consistent estimators for learning some challenging but important generalizations of the exponential family model. Experimentally, we validate our framework and show improvement over baselines in diverse settings including real-world learning-to-rank and regression problems along with learning on hyperbolic manifolds. △ Less

Submitted 29 November, 2023; v1 submitted 7 December, 2021; originally announced December 2021.

Comments: ICLR 2022

A photonic platform hosting telecom photon emitters in silicon

Authors: Michael Hollenbach, Nagesh S. Jagtap, Ciarán Fowley, Juan Baratech, Verónica Guardia-Arce, Ulrich Kentsch, Anna Eichler-Volf, Nikolay V. Abrosimov, Artur Erbe, ChaeHo Shin, Hakseong Kim, Manfred Helm, Woo Lee, Georgy V. Astakhov, Yonder Berencén

Abstract: Silicon, a ubiquitous material in modern computing, is an emerging platform for realizing a source of indistinguishable single-photons on demand. The integration of recently discovered single-photon emitters in silicon into photonic structures, is advantageous to exploit their full potential for integrated photonic quantum technologies. Here, we show the integration of telecom photon emitters in a… ▽ More Silicon, a ubiquitous material in modern computing, is an emerging platform for realizing a source of indistinguishable single-photons on demand. The integration of recently discovered single-photon emitters in silicon into photonic structures, is advantageous to exploit their full potential for integrated photonic quantum technologies. Here, we show the integration of telecom photon emitters in a photonic platform consisting of silicon nanopillars. We developed a CMOS-compatible nanofabrication method, enabling the production of thousands of individual nanopillars per square millimeter with state-of-the-art photonic-circuit pitch, all the while being free of fabrication-related radiation damage defects. We found a waveguiding effect of the 1278 nm-G center emission along individual pillars accompanied by improved brightness, photoluminescence signal-to-noise ratio and photon extraction efficiency compared to that of bulk silicon. These results unlock clear pathways to monolithically integrating single-photon emitters into a photonic platform at a scale that matches the required pitch of quantum photonic circuits. △ Less

Submitted 5 December, 2021; originally announced December 2021.

Comments: 6 pages, 4 figures

Characterization of the correlated background for a sterile neutrino search using the first dataset of the JSNS$^2$ experiment

Authors: Y. Hino, S. Ajimura, M. K. Cheoun, J. H. Choi, T. Dodo, H. Furuta, J. Goh, K. Haga, M. Harada, S. Hasegawa, T. Hiraiwa, W. Hwang, H. I. Jang, J. S. Jang, H. Jeon, S. Jeon, K. K. Joo, J. R. Jordan, D. E. Jung, S. K. Kang, Y. Kasugai, T. Kawasaki, E. J. Kim, J. Y. Kim, S. B. Kim , et al. (40 additional authors not shown)

Abstract: JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment that is searching for sterile neutrinos via the observation of $\barν_μ \to \barν_{e}$ appearance oscillations using muon decay-at-rest neutrinos. Before dedicated data taking in the first-half of 2021, we performed a commissioning run for 10 days in June 2020. Using the data obtained in this commissioni… ▽ More JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment that is searching for sterile neutrinos via the observation of $\barν_μ \to \barν_{e}$ appearance oscillations using muon decay-at-rest neutrinos. Before dedicated data taking in the first-half of 2021, we performed a commissioning run for 10 days in June 2020. Using the data obtained in this commissioning run, in this paper, we present an estimate of the correlated background which imitates the $\barν_{e}$ signal in a sterile neutrino search. In addition, in order to demonstrate future prospects of the JSNS$^2$ experiment, possible pulse shape discrimination improvements towards reducing cosmic ray induced fast neutron background are described. △ Less

Submitted 11 March, 2022; v1 submitted 14 November, 2021; originally announced November 2021.

Comments: 7 pages, 3 figures

Dark gauge boson production from neutron stars via nucleon-nucleon bremsstrahlung

Authors: Chang Sub Shin, Seokhoon Yun

Abstract: We discuss the dark gauge boson emission from neutron stars via nucleon-nucleon bremsstrahlung. Through the rigorous treatment of the effective field theory prescription and the thermal effect, we derive the relevant couplings of dark gauge bosons to hadrons in medium. As a specific example, the $U(1)_{\rm B-L}$ gauge boson scenario is chosen to investigate dark gauge boson emissivities during sup… ▽ More We discuss the dark gauge boson emission from neutron stars via nucleon-nucleon bremsstrahlung. Through the rigorous treatment of the effective field theory prescription and the thermal effect, we derive the relevant couplings of dark gauge bosons to hadrons in medium. As a specific example, the $U(1)_{\rm B-L}$ gauge boson scenario is chosen to investigate dark gauge boson emissivities during supernovae and cooling of young neutron stars. From the stellar cooling argument, we obtain the constraints on the $\rm B-L$ gauge coupling for given gauge boson masses in two observations: the duration of the supernova neutrino signal of SN1987A, and the inferred x-ray luminosity of the compact object in the remnant of SN1987A (NS1987A). In particular, the constraint from SN1987A on the $U(1)_{\rm B-L}$ gauge boson scenario is revisited. The excluded gauge coupling due to the emission of transverse polarizations is an order of magnitude enhanced compared to the previous derivation. There is also a newly excluded parameter space due to the emission of longitudinal polarizations. △ Less

Submitted 16 February, 2022; v1 submitted 7 October, 2021; originally announced October 2021.

Comments: 29 pages, 5 figures; v2: version published in JHEP, figures updated

Axion emission from supernova with axion-pion-nucleon contact interaction

Authors: Kiwoon Choi, Hee Jung Kim, Hyeonseok Seong, Chang Sub Shin

Abstract: We examine the axion emission from supernovae with a complete set of relevant axion couplings including the axion-pion-nucleon contact interaction which was ignored in the previous studies. Two processes are affected by the axion-pion-nucleon contact interaction, $π^-+p \rightarrow n + a$ and $n+p\rightarrow n+p+a$, and these processes can be the dominant source of axions for some region in the ax… ▽ More We examine the axion emission from supernovae with a complete set of relevant axion couplings including the axion-pion-nucleon contact interaction which was ignored in the previous studies. Two processes are affected by the axion-pion-nucleon contact interaction, $π^-+p \rightarrow n + a$ and $n+p\rightarrow n+p+a$, and these processes can be the dominant source of axions for some region in the axion parameter space or in astrophysical conditions encountered inside supernovae. We find that the contact interaction can enhance the axion emissivity of $π^-+p \rightarrow n + a$ by a factor of $2-4$, while the effect on $n+p\rightarrow n+p+a$ is not significant. We also discuss the relative importance of other pion-induced processes such as $π^0+n\rightarrow n+a$ and $π^-+π^0\rightarrow π^-+a$. △ Less

Submitted 21 February, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

Comments: 20 pages, 6 figures, v2: minor changes, references updated, appendix added, matches the published version

Report number: CTPU-PTC-21-35

Journal ref: JHEP 02 (2022) 143

A machine learning algorithm for direct detection of axion-like particle domain walls

Authors: Dongok Kim, Derek F. Jackson Kimball, Hector Masia-Roig, Joseph A. Smiga, Arne Wickenbrock, Dmitry Budker, Younggeun Kim, Yun Chang Shin, Yannis K. Semertzidis

Abstract: The Global Network of Optical Magnetometers for Exotic physics searches (GNOME) conducts an experimental search for certain forms of dark matter based on their spatiotemporal signatures imprinted on a global array of synchronized atomic magnetometers. The experiment described here looks for a gradient coupling of axion-like particles (ALPs) with proton spins as a signature of locally dense dark ma… ▽ More The Global Network of Optical Magnetometers for Exotic physics searches (GNOME) conducts an experimental search for certain forms of dark matter based on their spatiotemporal signatures imprinted on a global array of synchronized atomic magnetometers. The experiment described here looks for a gradient coupling of axion-like particles (ALPs) with proton spins as a signature of locally dense dark matter objects such as domain walls. In this work, stochastic optimization with machine learning is proposed for use in a search for ALP domain walls based on GNOME data. The validity and reliability of this method were verified using binary classification. The projected sensitivity of this new analysis method for ALP domain-wall crossing events is presented. △ Less

Submitted 30 September, 2021; originally announced October 2021.

Widely tunable and narrow linewidth chip-scale lasers from deep visible to near-IR

Authors: Mateus Corato-Zanarella, Andres Gil-Molina, Xingchen Ji, Min Chul Shin, Aseema Mohanty, Michal Lipson

Abstract: Widely-tunable and narrow-linewidth integrated lasers across all visible wavelengths are necessary to enable on-chip technologies such as quantum photonics, optical trap**, and biophotonics. However, such lasers have not been realized due to the strong wavelength sensitivity and high loss of integrated optical devices at short wavelengths. Here we overcome these challenges and demonstrate a chip… ▽ More Widely-tunable and narrow-linewidth integrated lasers across all visible wavelengths are necessary to enable on-chip technologies such as quantum photonics, optical trap**, and biophotonics. However, such lasers have not been realized due to the strong wavelength sensitivity and high loss of integrated optical devices at short wavelengths. Here we overcome these challenges and demonstrate a chip-scale visible lasers platform by using tightly-confined, micrometer-scale silicon nitride resonators and commercial Fabry-Perot laser diodes. We achieve tunable and narrow-linewidth lasing in the deep blue (450 nm), blue (488 nm), green (520 nm), red (660 nm) and near-IR (785 nm) with coarse tuning up to 12 nm, fine tuning up to 33.9 GHz, linewidth down to sub-kHz, side-mode suppression ratio > 35 dB, and fiber-coupled power up to 10 mW. These specifications of our chip-scale lasers are comparable to those of state-of-the-art commercial laser systems, making them stand out as powerful tools for the next generation of visible-light technologies. △ Less

Submitted 16 September, 2021; originally announced September 2021.

Engineering thermal transport across layered graphene-MoS2 superlattices

Authors: Aditya Sood, Charles Sievers, Yong Cheol Shin, Victoria Chen, Shunda Chen, Kirby K. H. Smithe, Sukti Chatterjee, Davide Donadio, Kenneth E. Goodson, Eric Pop

Abstract: Layering two-dimensional van der Waals materials provides unprecedented control over atomic placement, which could enable tailoring of vibrational spectra and heat flow at the sub-nanometer scale. Here, using spatially-resolved ultrafast thermoreflectance and spectroscopy, we uncover the design rules governing cross-plane heat transport in superlattices assembled from monolayers of graphene (G) an… ▽ More Layering two-dimensional van der Waals materials provides unprecedented control over atomic placement, which could enable tailoring of vibrational spectra and heat flow at the sub-nanometer scale. Here, using spatially-resolved ultrafast thermoreflectance and spectroscopy, we uncover the design rules governing cross-plane heat transport in superlattices assembled from monolayers of graphene (G) and MoS2 (M). Using a combinatorial experimental approach, we probe nine different stacking sequences: G, GG, MG, GGG, GMG, GGMG, GMGG, GMMG, GMGMG and identify the effects of vibrational mismatch, interlayer adhesion, and junction asymmetry on thermal transport. Pure G sequences display signatures of quasi-ballistic transport, whereas adding even a single M layer strongly disrupts heat conduction. The experimental data are described well by molecular dynamics simulations which include thermal expansion, accounting for the effect of finite temperature on the interlayer spacing. The simulations show that a change of only 1.5% in the layer separation can lead to a nearly 100% increase of the thermal resistance. Using these design rules, we experimentally demonstrate a 5-layer GMGMG superlattice with an ultralow effective cross-plane thermal conductivity comparable to air, paving the way for a new class of thermal metamaterials with extreme properties. △ Less

Submitted 22 July, 2021; originally announced July 2021.

Journal ref: ACS Nano (2021)

Aligned Natural Inflation in the Large Volume Scenario

Authors: Stephen Angus, Kang-Sin Choi, Chang Sub Shin

Abstract: We embed natural inflation in an explict string theory model and derive observables in cosmology. We achieve this by compactifying the type IIB string on a Calabi-Yau orientifold, stabilizing moduli via the Large Volume Scenario, and configuring axions using D7-brane stacks. In order to obtain a large effective decay constant, we employ the Kim-Nilles-Peloso alignment mechanism, with the required… ▽ More We embed natural inflation in an explict string theory model and derive observables in cosmology. We achieve this by compactifying the type IIB string on a Calabi-Yau orientifold, stabilizing moduli via the Large Volume Scenario, and configuring axions using D7-brane stacks. In order to obtain a large effective decay constant, we employ the Kim-Nilles-Peloso alignment mechanism, with the required multiple axions arising naturally from anisotropic bulk geometries. The bulk volumes, and hence the axion decay constants, are stabilized by generalized one-loop corrections and subject to various conditions: the Kähler cone condition on the string geometry; the convex hull condition of the weak gravity conjecture; and the constraint from the power spectrum of scalar perturbations. We find that all constraints can be satisfied in a geometry with relatively small volume and thus heavy bulk axion mass. We also covariantize the convex hull condition for the axion-dilaton-instanton system and verify the normalization of the extremal bound. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Comments: 54 pages, 8 figures

Report number: APCTP Pre2021-012, CTPU-PTC-21-27

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Authors: Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu

Abstract: Denoising diffusion probabilistic models have been recently proposed to generate high-quality samples by estimating the gradient of the data density. The framework defines the prior noise as a standard Gaussian distribution, whereas the corresponding data distribution may be more complicated than the standard Gaussian distribution, which potentially introduces inefficiency in denoising the prior n… ▽ More Denoising diffusion probabilistic models have been recently proposed to generate high-quality samples by estimating the gradient of the data density. The framework defines the prior noise as a standard Gaussian distribution, whereas the corresponding data distribution may be more complicated than the standard Gaussian distribution, which potentially introduces inefficiency in denoising the prior noise into the data sample because of the discrepancy between the data and the prior. In this paper, we propose PriorGrad to improve the efficiency of the conditional diffusion model for speech synthesis (for example, a vocoder using a mel-spectrogram as the condition) by applying an adaptive prior derived from the data statistics based on the conditional information. We formulate the training and sampling procedures of PriorGrad and demonstrate the advantages of an adaptive prior through a theoretical analysis. Focusing on the speech synthesis domain, we consider the recently proposed diffusion-based speech generative models based on both the spectral and time domains and show that PriorGrad achieves faster convergence and inference with superior performance, leading to an improved perceptual quality and robustness to a smaller network capacity, and thereby demonstrating the efficiency of a data-dependent adaptive prior. △ Less

Submitted 20 February, 2022; v1 submitted 11 June, 2021; originally announced June 2021.

Comments: ICLR 2022. 19 pages, 7 figures, 8 tables. Audio samples: https://speechresearch.github.io/priorgrad/

Massless Preheating and Electroweak Vacuum Metastability

Authors: Jeff Kost, Chang Sub Shin, Takahiro Terada

Abstract: Current measurements of Standard Model parameters suggest that the electroweak vacuum is metastable. This metastability has important cosmological implications, because large fluctuations in the Higgs field could trigger vacuum decay in the early universe. For the false vacuum to survive, interactions which stabilize the Higgs during inflation -- e.g., inflaton-Higgs interactions or non-minimal co… ▽ More Current measurements of Standard Model parameters suggest that the electroweak vacuum is metastable. This metastability has important cosmological implications, because large fluctuations in the Higgs field could trigger vacuum decay in the early universe. For the false vacuum to survive, interactions which stabilize the Higgs during inflation -- e.g., inflaton-Higgs interactions or non-minimal couplings to gravity -- are typically necessary. However, the post-inflationary preheating dynamics of these same interactions could also trigger vacuum decay, thereby recreating the problem we sought to avoid. This dynamics is often assumed catastrophic for models exhibiting scale invariance since these generically allow for unimpeded growth of fluctuations. In this paper, we examine the dynamics of such "massless preheating" scenarios and show that the competing threats to metastability can nonetheless be balanced to ensure viability. We find that fully accounting for both the backreaction from particle production and the effects of perturbative decays reveals a large number of disjoint "islands of (meta)stability" over the parameter space of couplings. Ultimately, the interplay among Higgs-stabilizing interactions plays a significant role, leading to a sequence of dynamical phases that effectively extend the metastable regions to large Higgs-curvature couplings. △ Less

Submitted 14 February, 2022; v1 submitted 14 May, 2021; originally announced May 2021.

Comments: 27 pages, LaTeX, 13 figures

Report number: CTPU-PTC-21-20

Journal ref: Phys. Rev. D 105, 043508 (2022)

OutFlip: Generating Out-of-Domain Samples for Unknown Intent Detection with Natural Language Attack

Authors: DongHyun Choi, Myeong Cheol Shin, EungGyun Kim, Dong Ryeol Shin

Abstract: Out-of-domain (OOD) input detection is vital in a task-oriented dialogue system since the acceptance of unsupported inputs could lead to an incorrect response of the system. This paper proposes OutFlip, a method to generate out-of-domain samples using only in-domain training dataset automatically. A white-box natural language attack method HotFlip is revised to generate out-of-domain samples inste… ▽ More Out-of-domain (OOD) input detection is vital in a task-oriented dialogue system since the acceptance of unsupported inputs could lead to an incorrect response of the system. This paper proposes OutFlip, a method to generate out-of-domain samples using only in-domain training dataset automatically. A white-box natural language attack method HotFlip is revised to generate out-of-domain samples instead of adversarial examples. Our evaluation results showed that integrating OutFlip-generated out-of-domain samples into the training dataset could significantly improve an intent classification model's out-of-domain detection performance. △ Less

Submitted 12 May, 2021; originally announced May 2021.

Comments: 9 pages, 3 figures; to be appear in ACL Findings of ACL-IJCNLP 2021

Cosmic Axion Force

Authors: Dongok Kim, Younggeun Kim, Yannis K. Semertzidis, Yun Chang Shin, Wen Yin

Abstract: Nambu-Goldstone bosons, or axions, may be ubiquitous. Some of the axions may have small masses and thus serve as mediators of long-range forces. In this paper, we study the force mediated by an extremely light axion, $φ$, between the visible sector and the dark sector, where dark matter lives. Since nature does not preserve the CP symmetry, the coupling between dark matter and $φ$ is generically C… ▽ More Nambu-Goldstone bosons, or axions, may be ubiquitous. Some of the axions may have small masses and thus serve as mediators of long-range forces. In this paper, we study the force mediated by an extremely light axion, $φ$, between the visible sector and the dark sector, where dark matter lives. Since nature does not preserve the CP symmetry, the coupling between dark matter and $φ$ is generically CP-violating. In this case, the induced force is extremely long-range and behaves as an effective magnetic field. If the force acts on electrons or nucleons, the spins of them on Earth precess around a fixed direction towards the galactic center. This provides an experimental opportunity for $φ$ with mass, $m_φ$, and decay constant, $f_φ$, satisfying $m_φ\lesssim 10^{-25}\,$ eV, $f_φ\lesssim 10^{14}\,$GeV if the daily modulation of the effective magnetic field signals in magnetometers is measured by using the coherent averaging method. The effective magnetic field induced by an axionic compact object, such as an axion domain wall, is also discussed. △ Less

Submitted 7 May, 2021; originally announced May 2021.

Comments: 30pages, 8figures

Report number: TU-1023

The JSNS^2 Detector

Authors: S. Ajimura, M. Botran, J. H. Choi, J. W. Choi, M. K. Cheoun, T. Dodo, H. Furuta, J. Goh, K. Haga, M. Harada, S. Hasegawa, Y. Hino, T. Hiraiwa, H. I. Jang, J. S. Jang, M. C. Jang, H. Jeon, S. Jeon, K. K. Joo, J. R. Jordan, D. E. Jung, S. K. Kang, Y. Kasugai, T. Kawasaki, E. J. Kim , et al. (41 additional authors not shown)

Abstract: The JSNS^2 (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) experiment aims to search for oscillations involving a sterile neutrino in the eV^2 mass-splitting range. The experiment will search for the appearance of electron antineutrinos oscillated from muon antineutrinos. The electron antineutrinos are detected via the inverse beta decay process using a liquid scintillator det… ▽ More The JSNS^2 (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) experiment aims to search for oscillations involving a sterile neutrino in the eV^2 mass-splitting range. The experiment will search for the appearance of electron antineutrinos oscillated from muon antineutrinos. The electron antineutrinos are detected via the inverse beta decay process using a liquid scintillator detector. A 1MW beam of 3 GeV protons incident on a spallation neutron target produces an intense and pulsed neutrino source from pion, muon, and kaon decay at rest. The JSNS^2 detector is located 24 m away from the neutrino source and began operation from June 2020. The detector contains 17 tonnes of gadolinium (Gd) loaded liquid scintillator (LS) in an acrylic vessel, as a neutrino target. It is surrounded by 31 tonnes of unloaded LS in a stainless steel tank. Optical photons produced in LS are viewed by 120 R7081 Hamamatsu 10-inch Photomultiplier Tubes (PMTs). In this paper, we describe the JSNS^2 detector design, construction, and operation. △ Less

Submitted 24 August, 2021; v1 submitted 27 April, 2021; originally announced April 2021.

Comments: 41 pages, 29 figures

AeroTraj: Trajectory Planning for Fast, and Accurate 3D Reconstruction Using a Drone-based LiDAR

Authors: Fawad Ahmad, Christina Shin, Rajrup Ghosh, John D'Ambrosio, Eugene Chai, Karthik Sundaresan, Ramesh Govindan

Abstract: This paper presents AeroTraj, a system that enables fast, accurate, and automated reconstruction of 3D models of large buildings using a drone-mounted LiDAR. LiDAR point clouds can be used directly to assemble 3D models if their positions are accurately determined. AeroTraj uses SLAM for this, but must ensure complete and accurate reconstruction while minimizing drone battery usage. Doing this req… ▽ More This paper presents AeroTraj, a system that enables fast, accurate, and automated reconstruction of 3D models of large buildings using a drone-mounted LiDAR. LiDAR point clouds can be used directly to assemble 3D models if their positions are accurately determined. AeroTraj uses SLAM for this, but must ensure complete and accurate reconstruction while minimizing drone battery usage. Doing this requires balancing competing constraints: drone speed, height, and orientation. AeroTraj exploits building geometry in designing an optimal trajectory that incorporates these constraints. Even with an optimal trajectory, SLAM's position error can drift over time, so AeroTraj tracks drift in-flight by offloading computations to the cloud and invokes a re-calibration procedure to minimize error. AeroTraj can reconstruct large structures with centimeter-level accuracy and with an average end-to-end latency below 250 ms, significantly outperforming the state of the art. △ Less

Submitted 26 June, 2024; v1 submitted 17 April, 2021; originally announced April 2021.

Stability of a numerical scheme for methane transport in hydrate zone under equilibrium and non-equilibrium conditions

Authors: Malgorzata Peszynska, Choah Shin

Abstract: In this paper we carry out numerical analysis for a family of simplified gas transport models with hydrate formation and dissociation in subsurface, in equilibrium and non-equilibrium conditions. These models are adequate for simulation of hydrate phase change at basin and at shorter time scales, but the analysis does not account directly for the related effects of evolving hydraulic properties.… ▽ More In this paper we carry out numerical analysis for a family of simplified gas transport models with hydrate formation and dissociation in subsurface, in equilibrium and non-equilibrium conditions. These models are adequate for simulation of hydrate phase change at basin and at shorter time scales, but the analysis does not account directly for the related effects of evolving hydraulic properties. To our knowledge this is the first analysis of such a model. It is carried out for the transport steps while kee** the pressure solution fixed. We frame the transport model as conservation law with a non-smooth space-dependent flux function; the kinetic model approximates this equilibrium. We prove weak stability of the upwind scheme applied to the regularized conservation law. We illustrate the model, confirm convergence with numerical simulations, and illustrate its use for some relevant equilibrium and non-equilibrium scenarios. △ Less

Submitted 17 March, 2021; originally announced March 2021.

Comments: 44 pages, 13 figures