Showing 1–50 of 183 results for author: Yoon, W

Speed-up of Data Analysis with Kernel Trick in Encrypted Domain

Authors: Joon Soo Yoo, Baek Kyung Song, Tae Min Ahn, Ji Won Heo, Ji Won Yoon

Abstract: Homomorphic encryption (HE) is pivotal for secure computation on encrypted data, crucial in privacy-preserving data analysis. However, efficiently processing high-dimensional data in HE, especially for machine learning and statistical (ML/STAT) algorithms, poses a challenge. In this paper, we present an effective acceleration method using the kernel method for HE schemes, enhancing time performanc… ▽ More Homomorphic encryption (HE) is pivotal for secure computation on encrypted data, crucial in privacy-preserving data analysis. However, efficiently processing high-dimensional data in HE, especially for machine learning and statistical (ML/STAT) algorithms, poses a challenge. In this paper, we present an effective acceleration method using the kernel method for HE schemes, enhancing time performance in ML/STAT algorithms within encrypted domains. This technique, independent of underlying HE mechanisms and complementing existing optimizations, notably reduces costly HE multiplications, offering near constant time complexity relative to data dimension. Aimed at accessibility, this method is tailored for data scientists and developers with limited cryptography background, facilitating advanced data analysis in secure environments. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: Submitted as a preprint

Constraining Inflation with the BICEP/Keck CMB Polarization Experiments

Authors: The BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, D. Beck, J. J. Bock, H. Boenish, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, B. Elwood, S. Fatigoni, J. P. Filippini, M. Gao , et al. (63 additional authors not shown)

Abstract: The BICEP/$\textit{Keck}$ (BK) series of cosmic microwave background (CMB) polarization experiments has, over the past decade and a half, produced a series of field-leading constraints on cosmic inflation via measurements of the "B-mode" polarization of the CMB. Primordial B modes are directly tied to the amplitude of primordial gravitational waves (PGW), their strength parameterized by the tensor… ▽ More The BICEP/$\textit{Keck}$ (BK) series of cosmic microwave background (CMB) polarization experiments has, over the past decade and a half, produced a series of field-leading constraints on cosmic inflation via measurements of the "B-mode" polarization of the CMB. Primordial B modes are directly tied to the amplitude of primordial gravitational waves (PGW), their strength parameterized by the tensor-to-scalar ratio, $r$, and thus the energy scale of inflation. Having set the most sensitive constraints to-date on $r$, $σ(r)=0.009$ ($r_{0.05}<0.036, 95\%$ C.L.) using data through the 2018 observing season (``BK18''), the BICEP/$\textit{Keck}$ program has continued to improve its dataset in the years since. We give a brief overview of the BK program and the "BK18" result before discussing the program's ongoing efforts, including the deployment and performance of the $\textit{Keck Array}$'s successor instrument, BICEP Array, improvements to data processing and internal consistency testing, new techniques such as delensing, and how those will ultimately serve to allow BK reach $σ(r) \lesssim 0.003$ using data through the 2027 observing season. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: 9 pages, 5 figures. Contribution to the 2024 Cosmology session of the 58th Rencontres de Moriond

Quantum plasmonic sensing by Hong-Ou-Mandel interferometry

Authors: Seung** Yoon, Yu Sung Choi, Mark Tame, Jae Woong Yoon, Sergey V. Polyakov, Changhyoup Lee

Abstract: We propose a quantum plasmonic sensor using Hong-Ou-Mandel (HOM) interferometry that measures the refractive index of an analyte, embedded in a plasmonic beam splitter composed of a dual-Kretschmann configuration, which serves as a frustrated total internal reflection beamsplitter. The sensing performance of the HOM interferometry, combined with single-photon detectors, is evaluated through Fisher… ▽ More We propose a quantum plasmonic sensor using Hong-Ou-Mandel (HOM) interferometry that measures the refractive index of an analyte, embedded in a plasmonic beam splitter composed of a dual-Kretschmann configuration, which serves as a frustrated total internal reflection beamsplitter. The sensing performance of the HOM interferometry, combined with single-photon detectors, is evaluated through Fisher information for estimation of the refractive index of the analyte. This is subsequently compared with the classical benchmark that considers the injection of a coherent state of light into the plasmonic beamsplitter. By varying the wavelength of the single photons and the refractive index of the analyte, we identify a wide range where a 50 % quantum enhancement is achieved and discuss the observed behaviors in comparison with the classical benchmark. We expect this study to provide a useful insight into the advancement of quantum-enhanced sensing technologies, with direct implications for a wide range of nanophotonic beamsplitter structures. △ Less

Submitted 23 April, 2024; v1 submitted 16 April, 2024; originally announced April 2024.

XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coverage

Authors: Jae-Jun Lee, Sung Whan Yoon

Abstract: Meta-learning, which pursues an effective initialization model, has emerged as a promising approach to handling unseen tasks. However, a limitation remains to be evident when a meta-learner tries to encompass a wide range of task distribution, e.g., learning across distinctive datasets or domains. Recently, a group of works has attempted to employ multiple model initializations to cover widely-ran… ▽ More Meta-learning, which pursues an effective initialization model, has emerged as a promising approach to handling unseen tasks. However, a limitation remains to be evident when a meta-learner tries to encompass a wide range of task distribution, e.g., learning across distinctive datasets or domains. Recently, a group of works has attempted to employ multiple model initializations to cover widely-ranging tasks, but they are limited in adaptively expanding initializations. We introduce XB-MAML, which learns expandable basis parameters, where they are linearly combined to form an effective initialization to a given task. XB-MAML observes the discrepancy between the vector space spanned by the basis and fine-tuned parameters to decide whether to expand the basis. Our method surpasses the existing works in the multi-domain meta-learning benchmarks and opens up new chances of meta-learning for obtaining the diverse inductive bias that can be combined to stretch toward the effective initialization for diverse unseen tasks. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: In Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS) 2024, Valencia, Spain

SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting

Authors: Hoon Kim, Minje Jang, Wonjun Yoon, Jisoo Lee, Donghyun Na, Sanghyun Woo

Abstract: We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pre-training framework. Drawing on the Cook-Torrance reflectance model, we have meticulously configured the architecture design to precisely simulate light-surface interactions. Furthermore, to overcome the limitation of scarce high-quality lightstage data, we have developed a self-… ▽ More We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pre-training framework. Drawing on the Cook-Torrance reflectance model, we have meticulously configured the architecture design to precisely simulate light-surface interactions. Furthermore, to overcome the limitation of scarce high-quality lightstage data, we have developed a self-supervised pre-training strategy. This novel combination of accurate physical modeling and expanded training dataset establishes a new benchmark in relighting realism. △ Less

Submitted 28 February, 2024; originally announced February 2024.

Comments: CVPR2024. Live demos available at https://www.beeble.ai/

Self-evolving Autoencoder Embedded Q-Network

Authors: J. Senthilnath, Bangjian Zhou, Zhen Wei Ng, Deeksha Aggarwal, Rajdeep Dutta, Ji Wei Yoon, Aye Phyu Phyu Aung, Keyu Wu, Min Wu, Xiaoli Li

Abstract: In the realm of sequential decision-making tasks, the exploration capability of a reinforcement learning (RL) agent is paramount for achieving high rewards through interactions with the environment. To enhance this crucial ability, we propose SAQN, a novel approach wherein a self-evolving autoencoder (SA) is embedded with a Q-Network (QN). In SAQN, the self-evolving autoencoder architecture adapts… ▽ More In the realm of sequential decision-making tasks, the exploration capability of a reinforcement learning (RL) agent is paramount for achieving high rewards through interactions with the environment. To enhance this crucial ability, we propose SAQN, a novel approach wherein a self-evolving autoencoder (SA) is embedded with a Q-Network (QN). In SAQN, the self-evolving autoencoder architecture adapts and evolves as the agent explores the environment. This evolution enables the autoencoder to capture a diverse range of raw observations and represent them effectively in its latent space. By leveraging the disentangled states extracted from the encoder generated latent space, the QN is trained to determine optimal actions that improve rewards. During the evolution of the autoencoder architecture, a bias-variance regulatory strategy is employed to elicit the optimal response from the RL agent. This strategy involves two key components: (i) fostering the growth of nodes to retain previously acquired knowledge, ensuring a rich representation of the environment, and (ii) pruning the least contributing nodes to maintain a more manageable and tractable latent space. Extensive experimental evaluations conducted on three distinct benchmark environments and a real-world molecular environment demonstrate that the proposed SAQN significantly outperforms state-of-the-art counterparts. The results highlight the effectiveness of the self-evolving autoencoder and its collaboration with the Q-Network in tackling sequential decision-making tasks. △ Less

Submitted 18 February, 2024; originally announced February 2024.

Comments: 11 pages, 9 figures, 3 tables

Dirac Bilayer Metasurfaces as an Inverse Gires-Tournois Etalon

Authors: Ki Young Lee, Kwang Wook Yoo, Francesco Monticone, Jae Woong Yoon

Abstract: Efficient transmissive pure-phase resonances are highly desirable for optical modulation and wavefront engineering. Here, we propose a novel principle to realize a pure-phase resonance in an extremely broad transmission band, as opposed to previous approaches restricted to operating in reflection mode or over a narrow spectral band. We show that a glide-symmetric bilayer metasurface mathematically… ▽ More Efficient transmissive pure-phase resonances are highly desirable for optical modulation and wavefront engineering. Here, we propose a novel principle to realize a pure-phase resonance in an extremely broad transmission band, as opposed to previous approaches restricted to operating in reflection mode or over a narrow spectral band. We show that a glide-symmetric bilayer metasurface mathematically mimicking a two-dimensional Dirac semimetal induces unidirectional guided-mode excitation and perfect leakage-radiation blazing at the transmission channel. These effects create a peculiar resonant-scattering configuration, similar to the classical reflective Gires-Tournois etalon, but in transmission, providing full 2pi phase modulation with constant transmittance near 100%. Most importantly, this effect persists over an extremely wide band, associated with topological effects. Hence, our proposed approach produces a spectrally and parametrically robust pure-phase resonance effect in transmission, which is highly beneficial for practical applications. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 11 pages, 5 figures

Generating Nanoporous Graphene from Point and Stone-Wales Defects: A Study with Dimensionally Restricted Molecular Dynamics (DR-MD)

Authors: Ji Wei Yoon

Abstract: Defects in graphene are both a boon and a bane for applications - they can induce uncontrollable effects but can also provide novel ways to manipulate the properties of pristine graphene. Nanoporous Graphene, which contains nanoscopic holes, has found impactful applications in sustainability domains, e.g. gas separation, water filtration membranes and battery technologies. For this report, we inve… ▽ More Defects in graphene are both a boon and a bane for applications - they can induce uncontrollable effects but can also provide novel ways to manipulate the properties of pristine graphene. Nanoporous Graphene, which contains nanoscopic holes, has found impactful applications in sustainability domains, e.g. gas separation, water filtration membranes and battery technologies. For this report, we investigate pore formation in graphene with no defect, one and two mono-vacancies, and two di-vacancies using bespoke Dimensionally Restricted Molecular Dynamics (DR-MD) designed for the purpose. We show DR-MD to be superior to free-standing or substrate suspended configurations for simulating stable defected structures. Applying DR-MD, stable pore configurations are identified, and their formation mechanisms elucidated. We also investigated formation mechanisms due to two Stone-Wales 55-77 defects, and the formation energies of their linearly extended structures, along the zigzag and armchair directions, and when they are placed in different relative orientations. This study offers a way to identify stable porous defect structures in graphene and insights into atomistic pore formation mechanisms for an environmentally important material. △ Less

Submitted 6 October, 2023; v1 submitted 26 August, 2023; originally announced August 2023.

Comments: 20 pages, 10 figures

MSC Class: -

A Measurement of Gravitational Lensing of the Cosmic Microwave Background Using SPT-3G 2018 Data

Authors: Z. Pan, F. Bianchini, W. L. K. Wu, P. A. R. Ade, Z. Ahmed, E. Anderes, A. J. Anderson, B. Ansarinejad, M. Archipley, K. Aylor, L. Balkenhol, P. S. Barry, R. Basu Thakur, K. Benabed, A. N. Bender, B. A. Benson, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, E. Camphuis, J. E. Carlstrom, F. W. Carter, T. W. Cecil, C. L. Chang , et al. (111 additional authors not shown)

Abstract: We present a measurement of gravitational lensing over 1500 deg$^2$ of the Southern sky using SPT-3G temperature data at 95 and 150 GHz taken in 2018. The lensing amplitude relative to a fiducial Planck 2018 $Λ$CDM cosmology is found to be $1.020\pm0.060$, excluding instrumental and astrophysical systematic uncertainties. We conduct extensive systematic and null tests to check the robustness of th… ▽ More We present a measurement of gravitational lensing over 1500 deg$^2$ of the Southern sky using SPT-3G temperature data at 95 and 150 GHz taken in 2018. The lensing amplitude relative to a fiducial Planck 2018 $Λ$CDM cosmology is found to be $1.020\pm0.060$, excluding instrumental and astrophysical systematic uncertainties. We conduct extensive systematic and null tests to check the robustness of the lensing measurements, and report a minimum-variance combined lensing power spectrum over angular multipoles of $50<L<2000$, which we use to constrain cosmological models. When analyzed alone and jointly with primary cosmic microwave background (CMB) spectra within the $Λ$CDM model, our lensing amplitude measurements are consistent with measurements from SPT-SZ, SPTpol, ACT, and Planck. Incorporating loose priors on the baryon density and other parameters including uncertainties on a foreground bias template, we obtain a $1σ$ constraint on $σ_8 Ω_{\rm m}^{0.25}=0.595 \pm 0.026$ using the SPT-3G 2018 lensing data alone, where $σ_8$ is a common measure of the amplitude of structure today and $Ω_{\rm m}$ is the matter density parameter. Combining SPT-3G 2018 lensing measurements with baryon acoustic oscillation (BAO) data, we derive parameter constraints of $σ_8 = 0.810 \pm 0.033$, $S_8 \equiv σ_8(Ω_{\rm m}/0.3)^{0.5}= 0.836 \pm 0.039$, and Hubble constant $H_0 =68.8^{+1.3}_{-1.6}$ km s$^{-1}$ Mpc$^{-1}$. Using CMB anisotropy and lensing measurements from SPT-3G only, we provide independent constraints on the spatial curvature of $Ω_{K} = 0.014^{+0.023}_{-0.026}$ (95% C.L.) and the dark energy density of $Ω_Λ= 0.722^{+0.031}_{-0.026}$ (68% C.L.). When combining SPT-3G lensing data with SPT-3G CMB anisotropy and BAO data, we find an upper limit on the sum of the neutrino masses of $\sum m_ν< 0.30$ eV (95% C.L.). △ Less

Submitted 29 January, 2024; v1 submitted 22 August, 2023; originally announced August 2023.

Comments: Bandpower and likelihood data available at https://pole.uchicago.edu/public/data/spt3g_2018_lensing/

Journal ref: Physical Review D 108.12 (2023): 122005

Explainable machine learning to enable high-throughput electrical conductivity optimization and discovery of doped conjugated polymers

Authors: Ji Wei Yoon, Adithya Kumar, Pawan Kumar, Kedar Hippalgaonkar, J Senthilnath, Vijila Chellappan

Abstract: The combination of high-throughput experimentation techniques and machine learning (ML) has recently ushered in a new era of accelerated material discovery, enabling the identification of materials with cutting-edge properties. However, the measurement of certain physical quantities remains challenging to automate. Specifically, meticulous process control, experimentation and laborious measurement… ▽ More The combination of high-throughput experimentation techniques and machine learning (ML) has recently ushered in a new era of accelerated material discovery, enabling the identification of materials with cutting-edge properties. However, the measurement of certain physical quantities remains challenging to automate. Specifically, meticulous process control, experimentation and laborious measurements are required to achieve optimal electrical conductivity in doped polymer materials. We propose a ML approach, which relies on readily measured absorbance spectra, to accelerate the workflow associated with measuring electrical conductivity. The classification model accurately classifies samples with a conductivity > 25 to 100 S/cm, achieving a maximum of 100 % accuracy rate. For the subset of highly conductive samples, we employed a regression model to predict their conductivities, yielding an impressive test R2 value of 0.984. We tested the models with samples of the two highest conductivities (498 and 506 S/cm) and showed that they were able to correctly classify and predict the two extrapolative conductivities at satisfactory levels of errors. The proposed ML-assisted workflow results in an improvement in the efficiency of the conductivity measurements by 89 % of the maximum achievable using our experimental techniques. Furthermore, our approach addressed the common challenge of the lack of explainability in ML models by exploiting bespoke mathematical properties of the descriptors and ML model, allowing us to gain corroborated insights into the spectral influences on conductivity. Through this study, we offer an accelerated pathway for optimizing the properties of doped polymer materials while showcasing the valuable insights that can be derived from purposeful utilization of ML in experimental science. △ Less

Submitted 27 April, 2024; v1 submitted 8 August, 2023; originally announced August 2023.

Comments: 33 Pages, 17 figures

Journal ref: Knowledge-Based Systems 295C (2024) 111812

EM-Network: Oracle Guided Self-distillation for Sequence Learning

Authors: Ji Won Yoon, Sunghwan Ahn, Hyeonseung Lee, Minchan Kim, Seok Min Kim, Nam Soo Kim

Abstract: We introduce EM-Network, a novel self-distillation approach that effectively leverages target information for supervised sequence-to-sequence (seq2seq) learning. In contrast to conventional methods, it is trained with oracle guidance, which is derived from the target sequence. Since the oracle guidance compactly represents the target-side context that can assist the sequence model in solving the t… ▽ More We introduce EM-Network, a novel self-distillation approach that effectively leverages target information for supervised sequence-to-sequence (seq2seq) learning. In contrast to conventional methods, it is trained with oracle guidance, which is derived from the target sequence. Since the oracle guidance compactly represents the target-side context that can assist the sequence model in solving the task, the EM-Network achieves a better prediction compared to using only the source input. To allow the sequence model to inherit the promising capability of the EM-Network, we propose a new self-distillation strategy, where the original sequence model can benefit from the knowledge of the EM-Network in a one-stage manner. We conduct comprehensive experiments on two types of seq2seq models: connectionist temporal classification (CTC) for speech recognition and attention-based encoder-decoder (AED) for machine translation. Experimental results demonstrate that the EM-Network significantly advances the current state-of-the-art approaches, improving over the best prior work on speech recognition and establishing state-of-the-art performance on WMT'14 and IWSLT'14. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Comments: ICML 2023

MCR-Data2vec 2.0: Improving Self-supervised Speech Pre-training via Model-level Consistency Regularization

Authors: Ji Won Yoon, Seok Min Kim, Nam Soo Kim

Abstract: Self-supervised learning (SSL) has shown significant progress in speech processing tasks. However, despite the intrinsic randomness in the Transformer structure, such as dropout variants and layer-drop, improving the model-level consistency remains under-explored in the speech SSL literature. To address this, we propose a new pre-training method that uses consistency regularization to improve Data… ▽ More Self-supervised learning (SSL) has shown significant progress in speech processing tasks. However, despite the intrinsic randomness in the Transformer structure, such as dropout variants and layer-drop, improving the model-level consistency remains under-explored in the speech SSL literature. To address this, we propose a new pre-training method that uses consistency regularization to improve Data2vec 2.0, the recent state-of-the-art (SOTA) SSL model. Specifically, the proposed method involves sampling two different student sub-models within the Data2vec 2.0 framework, enabling two output variants derived from a single input without additional parameters. Subsequently, we regularize the outputs from the student sub-models to be consistent and require them to predict the representation of the teacher model. Our experimental results demonstrate that the proposed approach improves the SSL model's robustness and generalization ability, resulting in SOTA results on the SUPERB benchmark. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Comments: INTERSPEECH 2023

Timelike General Rotational Surfaces in Minkowski 4-Space with Density

Authors: Ahmet Kazan, Mustafa Altın, Dae Won Yoon

Abstract: In this study, we give weighted mean and weighted Gaussian curvatures of two types of timelike general rotational surfaces with non-null plane meridian curves in four-dimensional Minkowski space E^4_1 with density e^(λ_1x^2+λ_2^y2+λ_3z^2+λ_4t^2), where λ_i (i = 1,2,3,4) are not all zero and we give some results about weighted minimal and weighted flat timelike general rotational surfaces in E^4_1… ▽ More In this study, we give weighted mean and weighted Gaussian curvatures of two types of timelike general rotational surfaces with non-null plane meridian curves in four-dimensional Minkowski space E^4_1 with density e^(λ_1x^2+λ_2^y2+λ_3z^2+λ_4t^2), where λ_i (i = 1,2,3,4) are not all zero and we give some results about weighted minimal and weighted flat timelike general rotational surfaces in E^4_1 with density. Also, we construct some examples for these surfaces. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Comments: 16 pages, 3 figures

MSC Class: 53A10; 53A35; 53B30

POEM: Polarization of Embeddings for Domain-Invariant Representations

Authors: Sang-Yeong Jo, Sung Whan Yoon

Abstract: Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capability on novel domains. Most existing DG approaches share the same philosophy to minimize the discrepancy between domains by finding the domain-invariant representations. On the con… ▽ More Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capability on novel domains. Most existing DG approaches share the same philosophy to minimize the discrepancy between domains by finding the domain-invariant representations. On the contrary, our proposed method called POEM acquires a strong DG capability by learning domain-invariant and domain-specific representations and polarizing them. Specifically, POEM cotrains category-classifying and domain-classifying embeddings while regularizing them to be orthogonal via minimizing the cosine-similarity between their features, i.e., the polarization of embeddings. The clear separation of embeddings suppresses domain-specific features in the domain-invariant embeddings. The concept of POEM shows a unique direction to enhance the domain robustness of representations that brings considerable and consistent performance gains when combined with existing DG methods. Extensive simulation results in popular DG benchmarks with the PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet datasets show that POEM indeed facilitates the category-classifying embedding to be more domain-invariant. △ Less

Submitted 22 May, 2023; originally announced May 2023.

Comments: In Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI) 2023, Washington D.C. USA

Development of deep biological ages aware of morbidity and mortality based on unsupervised and semi-supervised deep learning approaches

Authors: Seong-Eun Moon, Ji Won Yoon, Shinyoung Joo, Yoohyung Kim, Jae Hyun Bae, Seokho Yoon, Haanju Yoo, Young Min Cho

Abstract: Background: While deep learning technology, which has the capability of obtaining latent representations based on large-scale data, can be a potential solution for the discovery of a novel aging biomarker, existing deep learning methods for biological age estimation usually depend on chronological ages and lack of consideration of mortality and morbidity that are the most significant outcomes of a… ▽ More Background: While deep learning technology, which has the capability of obtaining latent representations based on large-scale data, can be a potential solution for the discovery of a novel aging biomarker, existing deep learning methods for biological age estimation usually depend on chronological ages and lack of consideration of mortality and morbidity that are the most significant outcomes of aging. Methods: This paper proposes a novel deep learning model to learn latent representations of biological aging in regard to subjects' morbidity and mortality. The model utilizes health check-up data in addition to morbidity and mortality information to learn the complex relationships between aging and measured clinical attributes. Findings: The proposed model is evaluated on a large dataset of general populations compared with KDM and other learning-based models. Results demonstrate that biological ages obtained by the proposed model have superior discriminability of subjects' morbidity and mortality. △ Less

Submitted 1 February, 2023; originally announced February 2023.

Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework

Authors: Won** Yoon, Richard Jackson, Elliot Ford, Vladimir Poroshin, Jaewoo Kang

Abstract: In order to assist the drug discovery/development process, pharmaceutical companies often apply biomedical NER and linking techniques over internal and public corpora. Decades of study of the field of BioNLP has produced a plethora of algorithms, systems and datasets. However, our experience has been that no single open source system meets all the requirements of a modern pharmaceutical company. I… ▽ More In order to assist the drug discovery/development process, pharmaceutical companies often apply biomedical NER and linking techniques over internal and public corpora. Decades of study of the field of BioNLP has produced a plethora of algorithms, systems and datasets. However, our experience has been that no single open source system meets all the requirements of a modern pharmaceutical company. In this work, we describe these requirements according to our experience of the industry, and present Kazu, a highly extensible, scalable open source framework designed to support BioNLP for the pharmaceutical sector. Kazu is a built around a computationally efficient version of the BERN2 NER model (TinyBERN2), and subsequently wraps several other BioNLP technologies into one coherent system. KAZU framework is open-sourced: https://github.com/AstraZeneca/KAZU △ Less

Submitted 30 November, 2022; originally announced December 2022.

Comments: EMNLP 2022 - Industry track

Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition

Authors: Ji Won Yoon, Beom Jun Woo, Sunghwan Ahn, Hyeonseung Lee, Nam Soo Kim

Abstract: Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist temporal classification (CTC)-based model has attracted research interest due to its non-autoregressive nature. However, such CTC models require a heavy comput… ▽ More Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist temporal classification (CTC)-based model has attracted research interest due to its non-autoregressive nature. However, such CTC models require a heavy computational cost to achieve outstanding performance. To mitigate the computational burden, we propose a simple yet effective knowledge distillation (KD) for the CTC framework, namely Inter-KD, that additionally transfers the teacher's knowledge to the intermediate CTC layers of the student network. From the experimental results on the LibriSpeech, we verify that the Inter-KD shows better achievements compared to the conventional KD methods. Without using any language model (LM) and data augmentation, Inter-KD improves the word error rate (WER) performance from 8.85 % to 6.30 % on the test-clean. △ Less

Submitted 28 November, 2022; originally announced November 2022.

Comments: Accepted by 2022 SLT Workshop

RiSi: Spectro-temporal RAN-agnostic Modulation Identification for OFDMA Signals

Authors: Daulet Kurmantayev, Dohyun Kwun, Hyoil Kim, Sung Whan Yoon

Abstract: RAN-agnostic communications can identify intrinsic features of the unknown signal without any prior knowledge, with which incompatible RANs in the same unlicensed band could achieve better coexistence performance than today's LBT-based coexistence. Blind modulation identification is its key building block, which blindly identifies the modulation type of an incompatible signal without any prior kno… ▽ More RAN-agnostic communications can identify intrinsic features of the unknown signal without any prior knowledge, with which incompatible RANs in the same unlicensed band could achieve better coexistence performance than today's LBT-based coexistence. Blind modulation identification is its key building block, which blindly identifies the modulation type of an incompatible signal without any prior knowledge. Recent blind modulation identification schemes are built upon deep neural networks, which are limited to single-carrier signal recognition thus not pragmatic for identifying spectro-temporal OFDMA signals whose modulation varies with time and frequency. Therefore, this paper proposes RiSi, a semantic segmentation neural network designed to work on OFDMA's spectrograms, that employs flattened convolutions to better identify the grid-like pattern of OFDMA's resource blocks. We trained RiSi with a realistic OFDMA dataset including various channel impairments, and achieved the modulation identification accuracy of 86% on average over four modulation types of BPSK, QPSK, 16-QAM, 64-QAM. Then, we enhanced the generalization performance of RiSi by applying domain generalization methods while treating varying FFT size or varying CP length as different domains, showing that thus-generalized RiSi can perform reasonably well with unseen data. △ Less

Submitted 27 June, 2024; v1 submitted 22 November, 2022; originally announced November 2022.

Comments: 8 pages, 5 figures, in Proceedings of IEEE WoWMoM 2024

High-energy betatron source driven by a 4-PW laser with applications to non-destructive imaging

Authors: Calin Ioan Hojbota, Mohammad Mirzaie, Do Yeon Kim, Tae Gyu Pak, Mohammad Rezaei-Pandari, Vishwa Bandhu Pathak, Jong Ho Jeon, ** Woo Yoon, Jae Hae Sung, Seong Ku Lee, Chul Min Kim, Ki Yong Kim, Chang Hee Nam

Abstract: Petawatt-class lasers can produce multi-GeV electron beams through laser wakefield electron acceleration. As a by-product, the accelerated electron beams can generate broad synchrotron-like radiation known as betatron radiation. In the present work, we measure the properties of the radiation produced from 2 GeV, 215 pC electron beams, which shows a broad radiation spectrum with a critical energy o… ▽ More Petawatt-class lasers can produce multi-GeV electron beams through laser wakefield electron acceleration. As a by-product, the accelerated electron beams can generate broad synchrotron-like radiation known as betatron radiation. In the present work, we measure the properties of the radiation produced from 2 GeV, 215 pC electron beams, which shows a broad radiation spectrum with a critical energy of 515 keV, extending up to MeV photon energies and 10 mrad divergence. Due to its high energy and flux, such radiation is an ideal candidate for gamma-ray radiography of dense objects. We employed a compact betatron radiation setup operated at relatively high-repetition rates (0.1 Hz) and used it to scan cm-sized objects: a DRAM circuit, BNC and SMA connectors, a padlock and a gas jet nozzle. GEANT4 simulations were carried out to reproduce the radiograph of the gas jet. The setup and the radiation source can reveal the interior structure of the objects at the sub-mm level, proving that it can further be applied to diagnose cracks or holes in various components. The radiation source presented here is a valuable tool for non-destructive inspection and for applications in high-energy-density physics such as nuclear fusion. △ Less

Submitted 15 November, 2022; originally announced November 2022.

Comments: 15 pages, 6 figures

BICEP / Keck XVII: Line of Sight Distortion Analysis: Estimates of Gravitational Lensing, Anisotropic Cosmic Birefringence, Patchy Reionization, and Systematic Errors

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. A. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (70 additional authors not shown)

Abstract: We present estimates of line-of-sight distortion fields derived from the 95 GHz and 150 GHz data taken by BICEP2, BICEP3, and Keck Array up to the 2018 observing season, leading to cosmological constraints and a study of instrumental and astrophysical systematics. Cosmological constraints are derived from three of the distortion fields concerning gravitational lensing from large-scale structure, p… ▽ More We present estimates of line-of-sight distortion fields derived from the 95 GHz and 150 GHz data taken by BICEP2, BICEP3, and Keck Array up to the 2018 observing season, leading to cosmological constraints and a study of instrumental and astrophysical systematics. Cosmological constraints are derived from three of the distortion fields concerning gravitational lensing from large-scale structure, polarization rotation from magnetic fields or an axion-like field, and the screening effect of patchy reionization. We measure an amplitude of the lensing power spectrum $A_L^{φφ}=0.95 \pm 0.20$. We constrain polarization rotation, expressed as the coupling constant of a Chern-Simons electromagnetic term $g_{aγ} \leq 2.6 \times 10^{-2}/H_I$, where $H_I$ is the inflationary Hubble parameter, and an amplitude of primordial magnetic fields smoothed over 1 Mpc $B_{1\text{Mpc}} \leq 6.6 \;\text{nG}$ at 95 GHz. We constrain the root mean square of optical-depth fluctuations in a simple "crinkly surface" model of patchy reionization, finding $A^τ<0.19$ ($2σ$) for the coherence scale of $L_c=100$. We show that all of the distortion fields of the 95 GHz and 150 GHz polarization maps are consistent with simulations including lensed-$Λ$CDM, dust, and noise, with no evidence for instrumental systematics. In some cases, the EB and TB quadratic estimators presented here are more sensitive than our previous map-based null tests at identifying and rejecting spurious B-modes that might arise from instrumental effects. Finally, we verify that the standard deprojection filtering in the BICEP/Keck data processing is effective at removing temperature to polarization leakage. △ Less

Submitted 5 June, 2023; v1 submitted 14 October, 2022; originally announced October 2022.

Comments: 34 pages, 19 figures, accepted for publication in The Astrophysical Journal

Journal ref: ApJ (2023) 949 43

BICEP / Keck XVI: Characterizing Dust Polarization through Correlations with Neutral Hydrogen

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. A. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, S. E. Clark, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini , et al. (71 additional authors not shown)

Abstract: We characterize Galactic dust filaments by correlating BICEP/Keck and Planck data with polarization templates based on neutral hydrogen (H I) observations. Dust polarization is important for both our understanding of astrophysical processes in the interstellar medium (ISM) and the search for primordial gravitational waves in the cosmic microwave background (CMB). In the diffuse ISM, H I is strongl… ▽ More We characterize Galactic dust filaments by correlating BICEP/Keck and Planck data with polarization templates based on neutral hydrogen (H I) observations. Dust polarization is important for both our understanding of astrophysical processes in the interstellar medium (ISM) and the search for primordial gravitational waves in the cosmic microwave background (CMB). In the diffuse ISM, H I is strongly correlated with the dust and partly organized into filaments that are aligned with the local magnetic field. We analyze the deep BICEP/Keck data at 95, 150, and 220 GHz, over the low-column-density region of sky where BICEP/Keck has set the best limits on primordial gravitational waves. We separate the H I emission into distinct velocity components and detect dust polarization correlated with the local Galactic H I but not with the H I associated with Magellanic Stream I. We present a robust, multifrequency detection of polarized dust emission correlated with the filamentary H I morphology template down to 95 GHz. For assessing its utility for foreground cleaning, we report that the H I morphology template correlates in B modes at a $\sim$10-65$\%$ level over the multipole range $20 < \ell < 200$ with the BICEP/Keck maps, which contain contributions from dust, CMB, and noise components. We measure the spectral index of the filamentary dust component spectral energy distribution to be $β= 1.54 \pm 0.13$. We find no evidence for decorrelation in this region between the filaments and the rest of the dust field or from the inclusion of dust associated with the intermediate velocity H I. Finally, we explore the morphological parameter space in the H I-based filamentary model. △ Less

Submitted 13 March, 2023; v1 submitted 11 October, 2022; originally announced October 2022.

Comments: 27 pages, 12 figures

Journal ref: ApJ 945 72 (2023)

Canal Hypersurfaces Generated by Pseudo Null, Partially Null and Null Curves in Lorentz-Minkowski 4-Space

Authors: Mustafa Altin, Ahmet Kazan, Dae Won Yoon

Abstract: In this paper, we obtain the parametric expressions of the canal hypersurfaces that are formed as the envelope of a family of pseudo hyperspheres or pseudo hyperbolic hyperspheres whose centers lie on a pseudo null, partially null or null curves in $E^4_1$ and give their some geometric invariants such as unit normal vector fields, Gaussian curvatures and mean curvatures. Also, we construct some ex… ▽ More In this paper, we obtain the parametric expressions of the canal hypersurfaces that are formed as the envelope of a family of pseudo hyperspheres or pseudo hyperbolic hyperspheres whose centers lie on a pseudo null, partially null or null curves in $E^4_1$ and give their some geometric invariants such as unit normal vector fields, Gaussian curvatures and mean curvatures. Also, we construct some examples for these canal hypersurfaces and finally, we give some characterizations for tubular hypersurfaces in $E^4_1$. △ Less

Submitted 29 September, 2022; originally announced September 2022.

Comments: 22 pages, 1 figure. arXiv admin note: text overlap with arXiv:2206.12572

The evolution of the electric field along optical fiber for the type-2 and 3 PAFs in Minkowski 3-space

Authors: Nevin Ertug Gurbuz, Dae Won Yoon

Abstract: In this paper, we introduce the type-2 and the type-3 Positional Adapted Frame(PAF) of spacelike curve and timelike curve in Minkowski 3-space. From these PAFs, we study the evolutions of the electric field vectors of the type-2 and type-3 PAFs. As a result, we also investigate the Fermi-Walker parallel and the Lorentz force equation of the electric field vectors for the type-2 and type-3 PAFs in… ▽ More In this paper, we introduce the type-2 and the type-3 Positional Adapted Frame(PAF) of spacelike curve and timelike curve in Minkowski 3-space. From these PAFs, we study the evolutions of the electric field vectors of the type-2 and type-3 PAFs. As a result, we also investigate the Fermi-Walker parallel and the Lorentz force equation of the electric field vectors for the type-2 and type-3 PAFs in Minkowski 3-space. △ Less

Submitted 15 September, 2022; originally announced September 2022.

Thermal Testing for Cryogenic CMB Instrument Optical Design

Authors: D. C. Goldfinger, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. A. Bischoff, J. J. Bock, V. Buza, J. Cheshire, J. Connors, J. Cornelison, M. Crumrine, A. J. Cukierman, E. V. Denison, M. I. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, C. Giannakopoulos, N. Goeckner-Wald, J. Grayson, P. K. Grimes , et al. (61 additional authors not shown)

Abstract: Observations of the Cosmic Microwave Background rely on cryogenic instrumentation with cold detectors, readout, and optics providing the low noise performance and instrumental stability required to make more sensitive measurements. It is therefore critical to optimize all aspects of the cryogenic design to achieve the necessary performance, with low temperature components and acceptable system coo… ▽ More Observations of the Cosmic Microwave Background rely on cryogenic instrumentation with cold detectors, readout, and optics providing the low noise performance and instrumental stability required to make more sensitive measurements. It is therefore critical to optimize all aspects of the cryogenic design to achieve the necessary performance, with low temperature components and acceptable system cooling requirements. In particular, we will focus on our use of thermal filters and cold optics, which reduce the thermal load passed along to the cryogenic stages. To test their performance, we have made a series of in situ measurements while integrating the third receiver for the BICEP Array telescope. In addition to characterizing the behavior of this receiver, these measurements continue to refine the models that are being used to inform design choices being made for future instruments. △ Less

Submitted 4 August, 2022; originally announced August 2022.

Comments: 9 pages, 8 figures, Proceedings of SPIE 2022

2022 Upgrade and Improved Low Frequency Camera Sensitivity for CMB Observation at the South Pole

Authors: A. Soliman, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, D. Beck, J. J. Bock, V. Buza, J. Cheshire, J. Connors, J. Cornelison, M. Crumrine, A. J. Cukierman, E. V. Denison, M. I. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, C. Giannakopoulos, N. Goeckner-Wald, D. C. Goldfinger, J. Grayson , et al. (61 additional authors not shown)

Abstract: Constraining the Galactic foregrounds with multi-frequency Cosmic Microwave Background (CMB) observations is an essential step towards ultimately reaching the sensitivity to measure primordial gravitational waves (PGWs), the sign of inflation after the Big-Bang that would be imprinted on the CMB. The BICEP Array telescope is a set of multi-frequency cameras designed to constrain the energy scale o… ▽ More Constraining the Galactic foregrounds with multi-frequency Cosmic Microwave Background (CMB) observations is an essential step towards ultimately reaching the sensitivity to measure primordial gravitational waves (PGWs), the sign of inflation after the Big-Bang that would be imprinted on the CMB. The BICEP Array telescope is a set of multi-frequency cameras designed to constrain the energy scale of inflation through CMB B-mode searches while also controlling the polarized galactic foregrounds. The lowest frequency BICEP Array receiver (BA1) has been observing from the South Pole since 2020 and provides 30 GHz and 40 GHz data to characterize the Galactic synchrotron in our CMB maps. In this paper, we present the design of the BA1 detectors and the full optical characterization of the camera including the on-sky performance at the South Pole. The paper also introduces the design challenges during the first observing season including the effect of out-of-band photons on detectors performance. It also describes the tests done to diagnose that effect and the new upgrade to minimize these photons, as well as installing more dichroic detectors during the 2022 deployment season to improve the BA1 sensitivity. We finally report background noise measurements of the detectors with the goal of having photon noise dominated detectors in both optical channels. BA1 achieves an improvement in map** speed compared to the previous deployment season. △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: Proceedings of SPIE Astronomical Telescopes + Instrumentation 2022 (AS22)

Improved Polarization Calibration of the BICEP3 CMB Polarimeter at the South Pole

Authors: J. Cornelison, C. Vergès, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. A. Bischoff, J. J. Bock, V. Buza, J. R. Cheshire IV, J. Connors, M. Crumrine, A. J. Cukierman, E. V. Denison, M. I. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, C. Giannakopoulos, N. Goeckner-Wald, D. C. Goldfinger, J. Grayson , et al. (61 additional authors not shown)

Abstract: The BICEP3 Polarimeter is a small aperture, refracting telescope, dedicated to the observation of the Cosmic Microwave Background (CMB) at 95GHz. It is designed to target degree angular scale polarization patterns, in particular the very-much-sought-after primordial B-mode signal, which is a unique signature of cosmic inflation. The polarized signal from the sky is reconstructed by differencing co… ▽ More The BICEP3 Polarimeter is a small aperture, refracting telescope, dedicated to the observation of the Cosmic Microwave Background (CMB) at 95GHz. It is designed to target degree angular scale polarization patterns, in particular the very-much-sought-after primordial B-mode signal, which is a unique signature of cosmic inflation. The polarized signal from the sky is reconstructed by differencing co-localized, orthogonally polarized superconducting Transition Edge Sensor (TES) bolometers. In this work, we present absolute measurements of the polarization response of the detectors for more than $\sim 800$ functioning detector pairs of the BICEP3 experiment, out of a total of $\sim 1000$. We use a specifically designed Rotating Polarized Source (RPS) to measure the polarization response at multiple source and telescope boresight rotation angles, to fully map the response over 360 degrees. We present here polarization properties extracted from on-site calibration data taken in January 2022. A similar calibration campaign was performed in 2018, but we found that our constraint was dominated by systematics on the level of $\sim0.5^\circ$. After a number of improvements to the calibration set-up, we are now able to report a significantly lower level of systematic contamination. In the future, such precise measurements will be used to constrain physics beyond the standard cosmological model, namely cosmic birefringence. △ Less

Submitted 25 August, 2022; v1 submitted 29 July, 2022; originally announced July 2022.

Comments: Submitted to: SPIE Astronomical Telescopes + Instrumentation (AS22)

Canal Hypersurfaces Generated by Non-Null Curves in Lorentz-Minkowski 4-Space

Authors: Ahmet Kazan, Mustafa Altin, Dae Won Yoon

Abstract: In the present paper, firstly we obtain the general expression of the canal hypersurfaces which are formed as the envelope of a family of pseudo hyperspheres, pseudo hyperbolic hyperspheres and null hypercones in $E_{1}^{4}$ and give their some geometric invariants such as unit normal vector fields, Gaussian curvatures, mean curvatures and principal curvatures. Also we give some results about thei… ▽ More In the present paper, firstly we obtain the general expression of the canal hypersurfaces which are formed as the envelope of a family of pseudo hyperspheres, pseudo hyperbolic hyperspheres and null hypercones in $E_{1}^{4}$ and give their some geometric invariants such as unit normal vector fields, Gaussian curvatures, mean curvatures and principal curvatures. Also we give some results about their flatness and minimality conditions and Weingarten canal hypersurfaces. Also, we obtain these characterizations for tubular hypersurfaces in $E_{1}^{4}$ by taking constant radius function and finally we construct some examples and visualize them with the aid of Mathematica. △ Less

Submitted 25 June, 2022; originally announced June 2022.

Linearity Characterization and Uncertainty Quantification of Spectroradiometers via Maximum Likelihood and the Non-parametric Bootstrap

Authors: Adam L. Pintar, Zachary H. Levine, Howard W. Yoon, Stephen E. Maxwell

Abstract: A technique for characterizing and correcting the linearity of radiometric instruments is known by the names the "flux-addition method" and the "combinatorial technique". In this paper, we develop a rigorous uncertainty quantification method for use with this technique and illustrate its use with both synthetic data and experimental data from a "beam conjoiner" instrument. We present a probabilist… ▽ More A technique for characterizing and correcting the linearity of radiometric instruments is known by the names the "flux-addition method" and the "combinatorial technique". In this paper, we develop a rigorous uncertainty quantification method for use with this technique and illustrate its use with both synthetic data and experimental data from a "beam conjoiner" instrument. We present a probabilistic model that relates the instrument readout to a set of unknown fluxes via a set of polynomial coefficients. Maximum likelihood estimates (MLEs) of the unknown fluxes and polynomial coefficients are recommended, while a non-parametric bootstrap algorithm enables uncertainty quantification (e.g., it can return standard errors). The synthetic data represent plausible outputs of a radiometric instrument and enable testing and validation of the method. The MLEs for these data are found to be approximately unbiased, and confidence intervals derived from the bootstrap replicates are found to be consistent with their target coverage of 95 %. For the polynomial coefficients, the relative bias was less than 1 % and the observed coverages range from 90 % to 97 %. The experimental data set is used to illustrate how a complete calibration with uncertainties can be achieved using the method plus one well-known flux level. The uncertainty contribution attributable to estimation of the instrument's nonlinear response is less than 0.02 % over most of its range. △ Less

Submitted 29 September, 2022; v1 submitted 28 April, 2022; originally announced April 2022.

HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition

Authors: Ji Won Yoon, Beom Jun Woo, Nam Soo Kim

Abstract: Pre-training with self-supervised models, such as Hidden-unit BERT (HuBERT) and wav2vec 2.0, has brought significant improvements in automatic speech recognition (ASR). However, these models usually require an expensive computational cost to achieve outstanding performance, slowing down the inference speed. To improve the model efficiency, we introduce an early exit scheme for ASR, namely HuBERT-E… ▽ More Pre-training with self-supervised models, such as Hidden-unit BERT (HuBERT) and wav2vec 2.0, has brought significant improvements in automatic speech recognition (ASR). However, these models usually require an expensive computational cost to achieve outstanding performance, slowing down the inference speed. To improve the model efficiency, we introduce an early exit scheme for ASR, namely HuBERT-EE, that allows the model to stop the inference dynamically. In HuBERT-EE, multiple early exit branches are added at the intermediate layers. When the intermediate prediction of the early exit branch is confident, the model stops the inference, and the corresponding result can be returned early. We investigate the proper early exiting criterion and fine-tuning strategy to effectively perform early exiting. Experimental results on the LibriSpeech show that HuBERT-EE can accelerate the inference of the HuBERT while simultaneously balancing the trade-off between the performance and the latency. △ Less

Submitted 19 June, 2024; v1 submitted 13 April, 2022; originally announced April 2022.

Comments: Accepted by INTERSPEECH 2024

The Latest Constraints on Inflationary B-modes from the BICEP/Keck Telescopes

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (71 additional authors not shown)

Abstract: For the past decade, the BICEP/Keck collaboration has been operating a series of telescopes at the Amundsen-Scott South Pole Station measuring degree-scale $B$-mode polarization imprinted in the Cosmic Microwave Background (CMB) by primordial gravitational waves (PGWs). These telescopes are compact refracting polarimeters map** about 2% of the sky, observing at a broad range of frequencies to ac… ▽ More For the past decade, the BICEP/Keck collaboration has been operating a series of telescopes at the Amundsen-Scott South Pole Station measuring degree-scale $B$-mode polarization imprinted in the Cosmic Microwave Background (CMB) by primordial gravitational waves (PGWs). These telescopes are compact refracting polarimeters map** about 2% of the sky, observing at a broad range of frequencies to account for the polarized foreground from Galactic synchrotron and thermal dust emission. Our latest publication "BK18" utilizes the data collected up to the 2018 observing season, in conjunction with the publicly available WMAP and Planck data, to constrain the tensor-to-scalar ratio $r$. It particularly includes (1) the 3-year BICEP3 data which is the current deepest CMB polarization map at the foreground-minimum 95 GHz; and (2) the Keck 220 GHz map with a higher signal-to-noise ratio on the dust foreground than the Planck 353 GHz map. We fit the auto- and cross-spectra of these maps to a multicomponent likelihood model ($Λ$CDM+dust+synchrotron+noise+$r$) and find it to be an adequate description of the data at the current noise level. The likelihood analysis yields $σ(r)=0.009$. The inference of $r$ from our baseline model is tightened to $r_{0.05}=0.014^{+0.010}_{-0.011}$ and $r_{0.05}<0.036$ at 95% confidence, meaning that the BICEP/Keck $B$-mode data is the most powerful existing dataset for the constraint of PGWs. The up-coming BICEP Array telescope is projected to reach $σ(r) \lesssim 0.003$ using data up to 2027. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: 8 pages, 6 figures, contribution to the 2022 Cosmology session of the 56th Rencontres de Moriond

Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot Segmentation

Authors: Jun Seo, Young-Hyun Park, Sung Whan Yoon, Jaekyun Moon

Abstract: Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a learnable module that can be placed on top of existing segmentation networks for performing few-shot segmentation. This module, called the task-adaptive feature tran… ▽ More Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a learnable module that can be placed on top of existing segmentation networks for performing few-shot segmentation. This module, called the task-adaptive feature transformer (TAFT), linearly transforms task-specific high-level features to a set of task agnostic features well-suited to conducting few-shot segmentation. The task-conditioned feature transformation allows an effective utilization of the semantic information in novel classes to generate tight segmentation masks. We also propose a semantic enrichment (SE) module that utilizes a pixel-wise attention module for high-level feature and an auxiliary loss from an auxiliary segmentation network conducting the semantic segmentation for all training classes. Experiments on PASCAL-$5^i$ and COCO-$20^i$ datasets confirm that the added modules successfully extend the capability of existing segmentators to yield highly competitive few-shot segmentation performances. △ Less

Submitted 14 February, 2022; originally announced February 2022.

Comments: 8 pages, 7 figures. arXiv admin note: text overlap with arXiv:2010.11437

Asteroid Measurements at Millimeter Wavelengths with the South Pole Telescope

Authors: P. M. Chichura, A. Foster, C. Patel, N. Ossa-Jaen, P. A. R. Ade, Z. Ahmed, A. J. Anderson, M. Archipley, J. E. Austermann, J. S. Avva, L. Balkenhol, P. S. Barry, R. Basu Thakur, J. A. Beall, K. Benabed, A. N. Bender, B. A. Benson, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, J. E. Carlstrom, F. W. Carter, T. W. Cecil , et al. (119 additional authors not shown)

Abstract: We present the first measurements of asteroids in millimeter wavelength (mm) data from the South Pole Telescope (SPT), which is used primarily to study the cosmic microwave background (CMB). We analyze maps of two $\sim270$ deg$^2$ sky regions near the ecliptic plane, each observed with the SPTpol camera $\sim100$ times over one month. We subtract the mean of all maps of a given field, removing st… ▽ More We present the first measurements of asteroids in millimeter wavelength (mm) data from the South Pole Telescope (SPT), which is used primarily to study the cosmic microwave background (CMB). We analyze maps of two $\sim270$ deg$^2$ sky regions near the ecliptic plane, each observed with the SPTpol camera $\sim100$ times over one month. We subtract the mean of all maps of a given field, removing static sky signal, and then average the mean-subtracted maps at known asteroid locations. We detect three asteroids$\text{ -- }$(324) Bamberga, (13) Egeria, and (22) Kalliope$\text{ -- }$with signal-to-noise ratios (S/N) of 11.2, 10.4, and 6.1, respectively, at 2.0 mm (150 GHz); we also detect (324) Bamberga with S/N of 4.1 at 3.2 mm (95 GHz). We place constraints on these asteroids' effective emissivities, brightness temperatures, and light curve modulation amplitude. Our flux density measurements of (324) Bamberga and (13) Egeria roughly agree with predictions, while our measurements of (22) Kalliope suggest lower flux, corresponding to effective emissivities of $0.66 \pm 0.11$ at 2.0 mm and $<0.47$ at 3.2mm. We predict the asteroids detectable in other SPT datasets and find good agreement with detections of (772) Tanete and (1093) Freda in recent data from the SPT-3G camera, which has $\sim10 \times$ the map** speed of SPTpol. This work is the first focused analysis of asteroids in data from CMB surveys, and it demonstrates we can repurpose historic and future datasets for asteroid studies. Future SPT measurements can help constrain the distribution of surface properties over a larger asteroid population. △ Less

Submitted 21 April, 2023; v1 submitted 2 February, 2022; originally announced February 2022.

Comments: 21 pages, 9 figures

Journal ref: 2022 ApJ 936 173

BICEP Array: 150 GHz detector module development

Authors: A. Schillaci, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, D. Beck, J. J. Bock, V. Buza, J. Cheshire, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, C. Giannakopoulos, N. Goeckner-Wald, D. Goldfinger, J. A. Grayson , et al. (59 additional authors not shown)

Abstract: The BICEP/Keck Collaboration is currently leading the quest to the highest sensitivity measurements of the polarized CMB anisotropies on degree scale with a series of cryogenic telescopes, of which BICEP Array is the latest Stage-3 upgrade with a total of $\sim32,000$ detectors. The instrument comprises 4 receivers spanning 30 to 270 GHz, with the low-frequency 30/40 GHz deployed to the South Pole… ▽ More The BICEP/Keck Collaboration is currently leading the quest to the highest sensitivity measurements of the polarized CMB anisotropies on degree scale with a series of cryogenic telescopes, of which BICEP Array is the latest Stage-3 upgrade with a total of $\sim32,000$ detectors. The instrument comprises 4 receivers spanning 30 to 270 GHz, with the low-frequency 30/40 GHz deployed to the South Pole Station in late 2019. The full complement of receivers is forecast to set the most stringent constraints on the tensor to scalar ratio $r$. Building on these advances, the overarching small-aperture telescope concept is already being used as the reference for further Stage-4 experiment design. In this paper I will present the development of the BICEP Array 150 GHz detector module and its fabrication requirements, with highlights on the high-density time division multiplexing (TDM) design of the cryogenic circuit boards. The low-impedance wiring required between the detectors and the first-stage SQUID amplifiers is crucial to maintain a stiff voltage bias on the detectors. A novel multi-layer FR4 Printed Circuit Board (PCB) with superconducting traces, capable of reading out up to 648 detectors, is presented along with its validation tests. I will also describe an ultra-high density TDM detector module we developed for a CMB-S4-like experiment that allows up to 1,920 detectors to be read out. TDM has been chosen as the detector readout technology for the Cosmic Microwave Background Stage-4 (CMB-S4) experiment based on its proven low-noise performance, predictable costs and overall maturity of the architecture. The heritage for TDM is rooted in mm- and submm-wave experiments dating back 20 years and has since evolved to support a multiplexing factor of 64x in Stage-3 experiments. △ Less

Submitted 29 November, 2021; originally announced November 2021.

Comments: 9 pages, 5 figure, Proceeding of LTD19 submitted to Journal of Low Temperature Physics

Plastic Laminate Antireflective Coatings for Millimeter-wave Optics in BICEP Array

Authors: Marion Dierickx, P. A. R. Ade, Zeeshan Ahmed, Mandana Amiri, Denis Barkats, Ritoban Basu Thakur, Colin A. Bischoff, Dominic Beck, James J. Bock, Victor Buza, James R. Cheshire IV, Jake Connors, James Cornelison, Michael Crumrine, Ari Jozef Cukierman, Edward Denison, Lionel Duband, Miranda Eiben, Sofia Fatigoni, Jeff P. Filippini, Christos Giannakopoulos, Neil Goeckner-Wald, David Goldfinger, James A. Grayson, Paul Grimes , et al. (60 additional authors not shown)

Abstract: The BICEP/Keck series of experiments target the Cosmic Microwave Background at degree-scale resolution from the South Pole. Over the next few years, the "Stage-3" BICEP Array (BA) telescope will improve the program's frequency coverage and sensitivity to primordial B-mode polarization by an order of magnitude. The first receiver in the array, BA1, began observing at 30/40 GHz in early 2020. The ne… ▽ More The BICEP/Keck series of experiments target the Cosmic Microwave Background at degree-scale resolution from the South Pole. Over the next few years, the "Stage-3" BICEP Array (BA) telescope will improve the program's frequency coverage and sensitivity to primordial B-mode polarization by an order of magnitude. The first receiver in the array, BA1, began observing at 30/40 GHz in early 2020. The next two receivers, BA2 and BA3, are currently being assembled and will map the southern sky at frequencies ranging from 95 GHz to 150 GHz. Common to all BA receivers is a refractive, on-axis, cryogenic optical design that focuses microwave radiation onto a focal plane populated with antenna-coupled bolometers. High-performance antireflective coatings up to 760 mm in aperture are needed for each element in the optical chain, and must withstand repeated thermal cycles down to 4 K. Here we present the design and fabrication of the 30/40 GHz anti-reflection coatings for the recently deployed BA1 receiver, then discuss laboratory measurements of their reflectance. We review the lamination method for these single- and dual-layer plastic coatings with indices matched to various polyethylene, nylon and alumina optics. We also describe ongoing efforts to optimize coatings for the next BA cryostats, which may inform technological choices for future Small-Aperture Telescopes of the CMB "Stage 4" experiment. △ Less

Submitted 29 November, 2021; originally announced November 2021.

Comments: 8 pages, 4 figures. Submitted to Journal of Low Temperature Physics

Improving Tagging Consistency and Entity Coverage for Chemical Identification in Full-text Articles

Authors: Hyunjae Kim, Mujeen Sung, Won** Yoon, Sungjoon Park, Jaewoo Kang

Abstract: This paper is a technical report on our system submitted to the chemical identification task of the BioCreative VII Track 2 challenge. The main feature of this challenge is that the data consists of full-text articles, while current datasets usually consist of only titles and abstracts. To effectively address the problem, we aim to improve tagging consistency and entity coverage using various meth… ▽ More This paper is a technical report on our system submitted to the chemical identification task of the BioCreative VII Track 2 challenge. The main feature of this challenge is that the data consists of full-text articles, while current datasets usually consist of only titles and abstracts. To effectively address the problem, we aim to improve tagging consistency and entity coverage using various methods such as majority voting within the same articles for named entity recognition (NER) and a hybrid approach that combines a dictionary and a neural model for normalization. In the experiments on the NLM-Chem dataset, we show that our methods improve models' performance, particularly in terms of recall. Finally, in the official evaluation of the challenge, our system was ranked 1st in NER by significantly outperforming the baseline model and more than 80 submissions from 16 teams. △ Less

Submitted 20 November, 2021; originally announced November 2021.

Comments: BioCreative VII Challenge Evaluation Workshop

Geometric Characterizations of Canal Hypersurfaces in Euclidean Spaces

Authors: Ahmet Kazan, Mustafa Altın, Dae Won Yoon

Abstract: In the present paper, firstly we obtain the general expression of canal hypersurfaces in Euclidean n-space and deal with canal hypersurfaces in Euclidean 4-space E4. We compute Gauss map, Gaussian curvature and mean curvature of canal hypersurfaces in E4 and obtain an important relation between the mean and Gaussian curvatures as 3Hrho = Krho^3-2. We prove that, the flat canal hypersurfaces in Euc… ▽ More In the present paper, firstly we obtain the general expression of canal hypersurfaces in Euclidean n-space and deal with canal hypersurfaces in Euclidean 4-space E4. We compute Gauss map, Gaussian curvature and mean curvature of canal hypersurfaces in E4 and obtain an important relation between the mean and Gaussian curvatures as 3Hrho = Krho^3-2. We prove that, the flat canal hypersurfaces in Euclidean 4-space are only circular hypercylinders or circular hypercones and minimal canal hypersurfaces are only generalized catenoids. Also, we state the expression of tubular hypersurfaces in Euclidean spaces and give some results about Weingarten tubular hypersurfaces in E4. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: 12 pages

MSC Class: 14J70; 53A07; 53A10

Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models

Authors: Ji Won Yoon, Hyung Yong Kim, Hyeonseung Lee, Sunghwan Ahn, Nam Soo Kim

Abstract: Knowledge distillation (KD), best known as an effective method for model compression, aims at transferring the knowledge of a bigger network (teacher) to a much smaller network (student). Conventional KD methods usually employ the teacher model trained in a supervised manner, where output labels are treated only as targets. Extending this supervised scheme further, we introduce a new type of teach… ▽ More Knowledge distillation (KD), best known as an effective method for model compression, aims at transferring the knowledge of a bigger network (teacher) to a much smaller network (student). Conventional KD methods usually employ the teacher model trained in a supervised manner, where output labels are treated only as targets. Extending this supervised scheme further, we introduce a new type of teacher model for connectionist temporal classification (CTC)-based sequence models, namely Oracle Teacher, that leverages both the source inputs and the output labels as the teacher model's input. Since the Oracle Teacher learns a more accurate CTC alignment by referring to the target information, it can provide the student with more optimal guidance. One potential risk for the proposed approach is a trivial solution that the model's output directly copies the target input. Based on a many-to-one map** property of the CTC algorithm, we present a training strategy that can effectively prevent the trivial solution and thus enables utilizing both source and target inputs for model training. Extensive experiments are conducted on two sequence learning tasks: speech recognition and scene text recognition. From the experimental results, we empirically show that the proposed model improves the students across these tasks while achieving a considerable speed-up in the teacher model's training time. △ Less

Submitted 11 August, 2023; v1 submitted 5 November, 2021; originally announced November 2021.

Comments: Accepted by IEEE/ACM Transactions on Audio, Speech and Language Processing

BICEP / Keck XIII: Improved Constraints on Primordial Gravitational Waves using Planck, WMAP, and BICEP/Keck Observations through the 2018 Observing Season

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (68 additional authors not shown)

Abstract: We present results from an analysis of all data taken by the BICEP2, Keck Array and BICEP3 CMB polarization experiments up to and including the 2018 observing season. We add additional Keck Array observations at 220 GHz and BICEP3 observations at 95 GHz to the previous 95/150/220 GHz data set. The $Q/U$ maps now reach depths of 2.8, 2.8 and 8.8 $μ{\mathrm K}_{cmb}$ arcmin at 95, 150 and 220 GHz re… ▽ More We present results from an analysis of all data taken by the BICEP2, Keck Array and BICEP3 CMB polarization experiments up to and including the 2018 observing season. We add additional Keck Array observations at 220 GHz and BICEP3 observations at 95 GHz to the previous 95/150/220 GHz data set. The $Q/U$ maps now reach depths of 2.8, 2.8 and 8.8 $μ{\mathrm K}_{cmb}$ arcmin at 95, 150 and 220 GHz respectively over an effective area of $\approx 600$ square degrees at 95 GHz and $\approx 400$ square degrees at 150 & 220 GHz. The 220 GHz maps now achieve a signal-to-noise on polarized dust emission exceeding that of Planck at 353 GHz. We take auto- and cross-spectra between these maps and publicly available WMAP and Planck maps at frequencies from 23 to 353 GHz and evaluate the joint likelihood of the spectra versus a multicomponent model of lensed-$Λ$CDM+$r$+dust+synchrotron+noise. The foreground model has seven parameters, and no longer requires a prior on the frequency spectral index of the dust emission taken from measurements on other regions of the sky. This model is an adequate description of the data at the current noise levels. The likelihood analysis yields the constraint $r_{0.05}<0.036$ at 95% confidence. Running maximum likelihood search on simulations we obtain unbiased results and find that $σ(r)=0.009$. These are the strongest constraints to date on primordial gravitational waves. △ Less

Submitted 1 October, 2021; originally announced October 2021.

Comments: 22 pages, 24 figures, as published in PRL, data and figures available for download at http://bicepkeck.org

Journal ref: Phys. Rev. Lett. 127, 151301 (2021)

BICEP / Keck XV: The BICEP3 CMB Polarimeter and the First Three Year Data Set

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, D. Beck, C. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (68 additional authors not shown)

Abstract: We report on the design and performance of the BICEP3 instrument and its first three-year data set collected from 2016 to 2018. BICEP3 is a 52cm aperture, refracting telescope designed to observe the polarization of the cosmic microwave background (CMB) on degree angular scales at 95GHz. It started science observation at the South Pole in 2016 with 2400 antenna-coupled transition-edge sensor (TES)… ▽ More We report on the design and performance of the BICEP3 instrument and its first three-year data set collected from 2016 to 2018. BICEP3 is a 52cm aperture, refracting telescope designed to observe the polarization of the cosmic microwave background (CMB) on degree angular scales at 95GHz. It started science observation at the South Pole in 2016 with 2400 antenna-coupled transition-edge sensor (TES) bolometers. The receiver first demonstrated new technologies such as large-diameter alumina optics, Zotefoam infrared filters, and flux-activated SQUIDs, allowing $\sim 10\times$ higher optical throughput compared to the Keck design. BICEP3 achieved instrument noise-equivalent temperatures of 9.2, 6.8 and 7.1$μ\text{K}_{\text{CMB}}\sqrt{\text{s}}$ and reached Stokes $Q$ and $U$ map depths of 5.9, 4.4 and 4.4$μ$K-arcmin in 2016, 2017 and 2018, respectively. The combined three-year data set achieved a polarization map depth of 2.8$μ$K-arcmin over an effective area of 585 square degrees, which is the deepest CMB polarization map made to date at 95GHz. △ Less

Submitted 1 October, 2021; originally announced October 2021.

Comments: 35 pages, 35 figures, as submitted to ApJ, data and figures available for download at http://bicepkeck.org

Journal ref: The Astrophysical Journal 927, 77 (2022)

BICEP / Keck XIV: Improved constraints on axion-like polarization oscillations in the cosmic microwave background

Authors: BICEP/Keck Collaboration, :, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, D. Beck, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire IV, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. V. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (68 additional authors not shown)

Abstract: We present an improved search for axion-like polarization oscillations in the cosmic microwave background (CMB) with observations from the Keck Array. An all-sky, temporally sinusoidal rotation of CMB polarization, equivalent to a time-variable cosmic birefringence, is an observable manifestation of a local axion field and potentially allows a CMB polarimeter to detect axion-like dark matter direc… ▽ More We present an improved search for axion-like polarization oscillations in the cosmic microwave background (CMB) with observations from the Keck Array. An all-sky, temporally sinusoidal rotation of CMB polarization, equivalent to a time-variable cosmic birefringence, is an observable manifestation of a local axion field and potentially allows a CMB polarimeter to detect axion-like dark matter directly. We describe improvements to the method presented in previous work, and we demonstrate the updated method with an expanded dataset consisting of the 2012-2015 observing seasons. We set limits on the axion-photon coupling constant for mass $m$ in the range $10^{-23}$-$10^{-18}~\mathrm{eV}$, which corresponds to oscillation periods on the order of hours to years. Our results are consistent with the background model. For periods between $1$ and $30~\mathrm{d}$ ($1.6 \times 10^{-21} \leq m \leq 4.8 \times 10^{-20}~\mathrm{eV}$), the $95\%$-confidence upper limits on rotation amplitude are approximately constant with a median of $0.27^\circ$, which constrains the axion-photon coupling constant to $g_{φγ} < (4.5 \times 10^{-12}~\mathrm{GeV}^{-1}) m/(10^{-21}~\mathrm{eV}$), if axion-like particles constitute all of the dark matter. More than half of the collected BICEP dataset has yet to be analyzed, and several current and future CMB polarimetry experiments can apply the methods presented here to achieve comparable or superior constraints. In the coming years, oscillation measurements can achieve the sensitivity to rule out unexplored regions of the axion parameter space. △ Less

Submitted 14 March, 2022; v1 submitted 6 August, 2021; originally announced August 2021.

Comments: 14 pages, 3 figures

Journal ref: Phys. Rev. D 105, 022006 (2022)

The Design and Integrated Performance of SPT-3G

Authors: J. A. Sobrin, A. J. Anderson, A. N. Bender, B. A. Benson, D. Dutcher, A. Foster, N. Goeckner-Wald, J. Montgomery, A. Nadolski, A. Rahlin, P. A. R. Ade, Z. Ahmed, E. Anderes, M. Archipley, J. E. Austermann, J. S. Avva, K. Aylor, L. Balkenhol, P. S. Barry, R. Basu Thakur, K. Benabed, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant , et al. (98 additional authors not shown)

Abstract: SPT-3G is the third survey receiver operating on the South Pole Telescope dedicated to high-resolution observations of the cosmic microwave background (CMB). Sensitive measurements of the temperature and polarization anisotropies of the CMB provide a powerful dataset for constraining cosmology. Additionally, CMB surveys with arcminute-scale resolution are capable of detecting galaxy clusters, mill… ▽ More SPT-3G is the third survey receiver operating on the South Pole Telescope dedicated to high-resolution observations of the cosmic microwave background (CMB). Sensitive measurements of the temperature and polarization anisotropies of the CMB provide a powerful dataset for constraining cosmology. Additionally, CMB surveys with arcminute-scale resolution are capable of detecting galaxy clusters, millimeter-wave bright galaxies, and a variety of transient phenomena. The SPT-3G instrument provides a significant improvement in map** speed over its predecessors, SPT-SZ and SPTpol. The broadband optics design of the instrument achieves a 430 mm diameter image plane across observing bands of 95 GHz, 150 GHz, and 220 GHz, with 1.2 arcmin FWHM beam response at 150 GHz. In the receiver, this image plane is populated with 2690 dual-polarization, tri-chroic pixels (~16000 detectors) read out using a 68X digital frequency-domain multiplexing readout system. In 2018, SPT-3G began a multiyear survey of 1500 deg$^{2}$ of the southern sky. We summarize the unique optical, cryogenic, detector, and readout technologies employed in SPT-3G, and we report on the integrated performance of the instrument. △ Less

Submitted 25 February, 2022; v1 submitted 21 June, 2021; originally announced June 2021.

Comments: 25 pages, 11 figures. Accepted for publication in ApJS

Report number: FERMILAB-PUB-21-291-AE

Journal ref: ApJS 258 42 (2022)

Sequence tagging for biomedical extractive question answering

Authors: Won** Yoon, Richard Jackson, Aron Lagerberg, Jaewoo Kang

Abstract: Current studies in extractive question answering (EQA) have modeled the single-span extraction setting, where a single answer span is a label to predict for a given question-passage pair. This setting is natural for general domain EQA as the majority of the questions in the general domain can be answered with a single span. Following general domain EQA models, current biomedical EQA (BioEQA) model… ▽ More Current studies in extractive question answering (EQA) have modeled the single-span extraction setting, where a single answer span is a label to predict for a given question-passage pair. This setting is natural for general domain EQA as the majority of the questions in the general domain can be answered with a single span. Following general domain EQA models, current biomedical EQA (BioEQA) models utilize the single-span extraction setting with post-processing steps. In this article, we investigate the question distribution across the general and biomedical domains and discover biomedical questions are more likely to require list-type answers (multiple answers) than factoid-type answers (single answer). This necessitates the models capable of producing multiple answers for a question. Based on this preliminary study, we propose a sequence tagging approach for BioEQA, which is a multi-span extraction setting. Our approach directly tackles questions with a variable number of phrases as their answer and can learn to decide the number of answers for a question from training data. Our experimental results on the BioASQ 7b and 8b list-type questions outperformed the best-performing existing models without requiring post-processing steps. Source codes and resources are freely available for download at https://github.com/dmis-lab/SeqTagQA △ Less

Submitted 7 July, 2022; v1 submitted 15 April, 2021; originally announced April 2021.

Comments: Published as "advanced access". Bioinformatics (2022). Supplementary data are available at Bioinformatics online

Journal ref: Bioinformatics, 2022, 1-8

Performance and characterization of the SPT-3G digital frequency-domain multiplexed readout system using an improved noise and crosstalk model

Authors: J. Montgomery, P. A. R. Ade, Z. Ahmed, E. Anderes, A. J. Anderson, M. Archipley, J. S. Avva, K. Aylor, L. Balkenhol, P. S. Barry, R. Basu Thakur, K. Benabed, A. N. Bender, B. A. Benson, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, J. E. Carlstrom, F. W. Carter, T. W. Cecil, C. L. Chang, P. Chaubal, G. Chen , et al. (96 additional authors not shown)

Abstract: The third generation South Pole Telescope camera (SPT-3G) improves upon its predecessor (SPTpol) by an order of magnitude increase in detectors on the focal plane. The technology used to read out and control these detectors, digital frequency-domain multiplexing (DfMUX), is conceptually the same as used for SPTpol, but extended to accommodate more detectors. A nearly 5x expansion in the readout op… ▽ More The third generation South Pole Telescope camera (SPT-3G) improves upon its predecessor (SPTpol) by an order of magnitude increase in detectors on the focal plane. The technology used to read out and control these detectors, digital frequency-domain multiplexing (DfMUX), is conceptually the same as used for SPTpol, but extended to accommodate more detectors. A nearly 5x expansion in the readout operating bandwidth has enabled the use of this large focal plane, and SPT-3G performance meets the forecasting targets relevant to its science objectives. However, the electrical dynamics of the higher-bandwidth readout differ from predictions based on models of the SPTpol system due to the higher frequencies used, and parasitic impedances associated with new cryogenic electronic architecture. To address this, we present an updated derivation for electrical crosstalk in higher-bandwidth DfMUX systems, and identify two previously uncharacterized contributions to readout noise, which become dominant at high bias frequency. The updated crosstalk and noise models successfully describe the measured crosstalk and readout noise performance of SPT-3G. These results also suggest specific changes to warm electronics component values, wire-harness properties, and SQUID parameters, to improve the readout system for future experiments using DfMUX, such as the LiteBIRD space telescope. △ Less

Submitted 21 February, 2022; v1 submitted 29 March, 2021; originally announced March 2021.

Comments: Accepted to the Journal of Astronomical Telescopes, Instruments, and Systems

Journal ref: J. Astron. Telesc. Instrum. Syst. 8(1) 014001 (8 January 2022)

Constraints on $Λ$CDM Extensions from the SPT-3G 2018 $EE$ and $TE$ Power Spectra

Authors: L. Balkenhol, D. Dutcher, P. A. R. Ade, Z. Ahmed, E. Anderes, A. J. Anderson, M. Archipley, J. S. Avva, K. Aylor, P. S. Barry, R. Basu Thakur, K. Benabed, A. N. Bender, B. A. Benson, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, J. E. Carlstrom, F. W. Carter, T. W. Cecil, C. L. Chang, P. Chaubal, G. Chen , et al. (95 additional authors not shown)

Abstract: We present constraints on extensions to the $Λ$CDM cosmological model from measurements of the $E$-mode polarization auto-power spectrum and the temperature-$E$-mode cross-power spectrum of the cosmic microwave background (CMB) made using 2018 SPT-3G data. The extensions considered vary the primordial helium abundance, the effective number of relativistic degrees of freedom, the sum of neutrino ma… ▽ More We present constraints on extensions to the $Λ$CDM cosmological model from measurements of the $E$-mode polarization auto-power spectrum and the temperature-$E$-mode cross-power spectrum of the cosmic microwave background (CMB) made using 2018 SPT-3G data. The extensions considered vary the primordial helium abundance, the effective number of relativistic degrees of freedom, the sum of neutrino masses, the relativistic energy density and mass of a sterile neutrino, and the mean spatial curvature. We do not find clear evidence for any of these extensions, from either the SPT-3G 2018 dataset alone or in combination with baryon acoustic oscillation and \textit{Planck} data. None of these model extensions significantly relax the tension between Hubble-constant, $H_0$, constraints from the CMB and from distance-ladder measurements using Cepheids and supernovae. The addition of the SPT-3G 2018 data to \textit{Planck} reduces the square-root of the determinants of the parameter covariance matrices by factors of $1.3 - 2.0$ across these models, signaling a substantial reduction in the allowed parameter volume. We also explore CMB-based constraints on $H_0$ from combined SPT, \textit{Planck}, and ACT DR4 datasets. While individual experiments see some indications of different $H_0$ values between the $TT$, $TE$, and $EE$ spectra, the combined $H_0$ constraints are consistent between the three spectra. For the full combined datasets, we report $H_0 = 67.49 \pm 0.53\,\mathrm{km\,s^{-1}\,Mpc^{-1}}$, which is the tightest constraint on $H_0$ from CMB power spectra to date and in $4.1\,σ$ tension with the most precise distance-ladder-based measurement of $H_0$. The SPT-3G survey is planned to continue through at least 2023, with existing maps of combined 2019 and 2020 data already having $\sim3.5\times$ lower noise than the maps used in this analysis. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Comments: Submitted to PRD; 19 pages, 7 figures

Journal ref: Phys. Rev. D 104, 083509 (2021)

Detection of Galactic and Extragalactic Millimeter-Wavelength Transient Sources with SPT-3G

Authors: S. Guns, A. Foster, C. Daley, A. Rahlin, N. Whitehorn, P. A. R. Ade, Z. Ahmed, E. Anderes, A. J. Anderson, M. Archipley, J. S. Avva, K. Aylor, L. Balkenhol, P. S. Barry, R. Basu Thakur, K. Benabed, A. N. Bender, B. A. Benson, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, J. E. Carlstrom, F. W. Carter , et al. (97 additional authors not shown)

Abstract: High-angular-resolution cosmic microwave background experiments provide a unique opportunity to conduct a survey of time-variable sources at millimeter wavelengths, a population which has primarily been understood through follow-up measurements of detections in other bands. Here we report the first results of an astronomical transient survey with the South Pole Telescope (SPT) using the SPT-3G cam… ▽ More High-angular-resolution cosmic microwave background experiments provide a unique opportunity to conduct a survey of time-variable sources at millimeter wavelengths, a population which has primarily been understood through follow-up measurements of detections in other bands. Here we report the first results of an astronomical transient survey with the South Pole Telescope (SPT) using the SPT-3G camera to observe 1500 square degrees of the southern sky. The observations took place from March to November 2020 in three bands centered at 95, 150, and 220 GHz. This survey yielded the detection of fifteen transient events from sources not previously detected by the SPT. The majority are associated with variable stars of different types, expanding the number of such detected flares by more than a factor of two. The stellar flares are unpolarized and bright, in some cases exceeding 1 Jy, and have durations from a few minutes to several hours. Another population of detected events last for 2--3 weeks and appear to be extragalactic in origin. Though data availability at other wavelengths is limited, we find evidence for concurrent optical activity for two of the stellar flares. Future data from SPT-3G and forthcoming instruments will provide real-time detection of millimeter-wave transients on timescales of minutes to months. △ Less

Submitted 8 June, 2021; v1 submitted 10 March, 2021; originally announced March 2021.

Comments: 14 pages, 9 figures; accepted to ApJ 5/27

Journal ref: ApJ 916 98 (2021)

Analysis of Temperature-to-Polarization Leakage in BICEP3 and Keck CMB Data from 2016 to 2018

Authors: The BICEP/Keck Collaboration, :, T. St. Germaine, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher , et al. (64 additional authors not shown)

Abstract: The BICEP/Keck Array experiment is a series of small-aperture refracting telescopes observing degree-scale Cosmic Microwave Background polarization from the South Pole in search of a primordial $B$-mode signature. As a pair differencing experiment, an important systematic that must be controlled is the differential beam response between the co-located, orthogonally polarized detectors. We use high… ▽ More The BICEP/Keck Array experiment is a series of small-aperture refracting telescopes observing degree-scale Cosmic Microwave Background polarization from the South Pole in search of a primordial $B$-mode signature. As a pair differencing experiment, an important systematic that must be controlled is the differential beam response between the co-located, orthogonally polarized detectors. We use high-fidelity, in-situ measurements of the beam response to estimate the temperature-to-polarization (T $\rightarrow$ P) leakage in our latest data including observations from 2016 through 2018. This includes three years of BICEP3 observing at 95 GHz, and multifrequency data from Keck Array. Here we present band-averaged far-field beam maps, differential beam mismatch, and residual beam power (after filtering out the leading difference modes via deprojection) for these receivers. We show preliminary results of "beam map simulations," which use these beam maps to observe a simulated temperature (no $Q/U$) sky to estimate T $\rightarrow$ P leakage in our real data. △ Less

Submitted 3 February, 2021; originally announced February 2021.

Comments: 9 pages, 4 figures

Journal ref: Proc. SPIE 11453, Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for Astronomy X, 114532E (15 December 2020)

The design of the Ali CMB Polarization Telescope receiver

Authors: Maria Salatino, Jason E. Austermann, Keith L. Thompson, Peter A. R. Ade, Xiran Bai, James A. Beall, Dan T. Becker, Yifu Cai, Zhi Chang, Ding Chen, Pisin Chen, Jake Connors, Jacques Delabrouille, Bradley Dober, Shannon M. Duff, Guanhua Gao, Shamik Ghosh, Richard C. Givhan, Gene C. Hilton, Bin Hu, Johannes Hubmayr, Ethan D. Karpel, Chao-Lin Kuo, Hong Li, Mingzhe Li , et al. (50 additional authors not shown)

Abstract: Ali CMB Polarization Telescope (AliCPT-1) is the first CMB degree-scale polarimeter to be deployed on the Tibetan plateau at 5,250m above sea level. AliCPT-1 is a 90/150 GHz 72 cm aperture, two-lens refracting telescope cooled down to 4 K. Alumina lenses, 800mm in diameter, image the CMB in a 33.4° field of view on a 636mm wide focal plane. The modularized focal plane consists of dichroic polariza… ▽ More Ali CMB Polarization Telescope (AliCPT-1) is the first CMB degree-scale polarimeter to be deployed on the Tibetan plateau at 5,250m above sea level. AliCPT-1 is a 90/150 GHz 72 cm aperture, two-lens refracting telescope cooled down to 4 K. Alumina lenses, 800mm in diameter, image the CMB in a 33.4° field of view on a 636mm wide focal plane. The modularized focal plane consists of dichroic polarization-sensitive Transition-Edge Sensors (TESes). Each module includes 1,704 optically active TESes fabricated on a 150mm diameter silicon wafer. Each TES array is read out with a microwave multiplexing readout system capable of a multiplexing factor up to 2,048. Such a large multiplexing factor has allowed the practical deployment of tens of thousands of detectors, enabling the design of a receiver that can operate up to 19 TES arrays for a total of 32,376 TESes. AliCPT-1 leverages the technological advancements in the detector design from multiple generations of previously successful feedhorn-coupled polarimeters, and in the instrument design from BICEP-3, but applied on a larger scale. The cryostat receiver is currently under integration and testing. During the first deployment year, the focal plane will be populated with up to 4 TES arrays. Further TES arrays will be deployed in the following years, fully populating the focal plane with 19 arrays on the fourth deployment year. Here we present the AliCPT-1 receiver design, and how the design has been optimized to meet the experimental requirements. △ Less

Submitted 23 January, 2021; originally announced January 2021.

Comments: Proc. SPIE, 11453, 114532A (2020)

Journal ref: Proceedings of SPIE, 'Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for Astronomy X', Volume 11453, 114532A (2020)

Measurements of the E-Mode Polarization and Temperature-E-Mode Correlation of the CMB from SPT-3G 2018 Data

Authors: D. Dutcher, L. Balkenhol, P. A. R. Ade, Z. Ahmed, E. Anderes, A. J. Anderson, M. Archipley, J. S. Avva, K. Aylor, P. S. Barry, R. Basu Thakur, K. Benabed, A. N. Bender, B. A. Benson, F. Bianchini, L. E. Bleem, F. R. Bouchet, L. Bryant, K. Byrum, J. E. Carlstrom, F. W. Carter, T. W. Cecil, C. L. Chang, P. Chaubal, G. Chen , et al. (96 additional authors not shown)

Abstract: We present measurements of the $E$-mode ($EE$) polarization power spectrum and temperature-$E$-mode ($TE$) cross-power spectrum of the cosmic microwave background using data collected by SPT-3G, the latest instrument installed on the South Pole Telescope. This analysis uses observations of a 1500 deg$^2$ region at 95, 150, and 220 GHz taken over a four month period in 2018. We report binned values… ▽ More We present measurements of the $E$-mode ($EE$) polarization power spectrum and temperature-$E$-mode ($TE$) cross-power spectrum of the cosmic microwave background using data collected by SPT-3G, the latest instrument installed on the South Pole Telescope. This analysis uses observations of a 1500 deg$^2$ region at 95, 150, and 220 GHz taken over a four month period in 2018. We report binned values of the $EE$ and $TE$ power spectra over the angular multipole range $300 \le \ell < 3000$, using the multifrequency data to construct six semi-independent estimates of each power spectrum and their minimum-variance combination. These measurements improve upon the previous results of SPTpol across the multipole ranges $300 \le \ell \le 1400$ for $EE$ and $300 \le \ell \le 1700$ for $TE$, resulting in constraints on cosmological parameters comparable to those from other current leading ground-based experiments. We find that the SPT-3G dataset is well-fit by a $Λ$CDM cosmological model with parameter constraints consistent with those from Planck and SPTpol data. From SPT-3G data alone, we find $H_0 = 68.8 \pm 1.5 \mathrm{km\,s^{-1}\,Mpc^{-1}}$ and $σ_8 = 0.789 \pm 0.016$, with a gravitational lensing amplitude consistent with the $Λ$CDM prediction ($A_L = 0.98 \pm 0.12$). We combine the SPT-3G and the Planck datasets and obtain joint constraints on the $Λ$CDM model. The volume of the 68% confidence region in six-dimensional $Λ$CDM parameter space is reduced by a factor of 1.5 compared to Planck-only constraints, with only slight shifts in central values. We note that the results presented here are obtained from data collected during just half of a typical observing season with only part of the focal plane operable, and that the active detector count has since nearly doubled for observations made with SPT-3G after 2018. △ Less

Submitted 5 January, 2021; originally announced January 2021.

Journal ref: Phys. Rev. D 104, 022003 (2021)

Observing low elevation sky and the CMB Cold Spot with BICEP3 at the South Pole

Authors: J. Kang, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire, J. Connors, J. Cornelison, M. Crumrine, A. Cukierman, E. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher, N. Goeckner-Wald, D. C. Goldfinger , et al. (62 additional authors not shown)

Abstract: BICEP3 is a 520 mm aperture on-axis refracting telescope at the South Pole, which observes the polarization of the cosmic microwave background (CMB) at 95 GHz to search for the B-mode signal from inflationary gravitational waves. In addition to this main target, we have developed a low-elevation observation strategy to extend coverage of the Southern sky at the South Pole, where BICEP3 can quickly… ▽ More BICEP3 is a 520 mm aperture on-axis refracting telescope at the South Pole, which observes the polarization of the cosmic microwave background (CMB) at 95 GHz to search for the B-mode signal from inflationary gravitational waves. In addition to this main target, we have developed a low-elevation observation strategy to extend coverage of the Southern sky at the South Pole, where BICEP3 can quickly achieve degree-scale E-mode measurements over a large area. An interesting E-mode measurement is probing a potential polarization anomaly around the CMB Cold Spot. During the austral summer seasons of 2018-19 and 2019-20, BICEP3 observed the sky with a flat mirror to redirect the beams to various low elevation ranges. The preliminary data analysis shows degree-scale E-modes measured with high signal-to-noise ratio. △ Less

Submitted 17 December, 2020; v1 submitted 16 December, 2020; originally announced December 2020.

Comments: 12 pages, 10 figures; Figure 7 shows the correct file

Journal ref: Proc. SPIE 11453, Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for Astronomy X, 114532D (13 December 2020)

Polarization Calibration of the BICEP3 CMB polarimeter at the South Pole

Authors: J. Cornelison, P. A. R. Ade, Z. Ahmed, M. Amiri, D. Barkats, R. Basu Thakur, C. A. Bischoff, J. J. Bock, H. Boenish, E. Bullock, V. Buza, J. R. Cheshire, J. Connors, M. Crumrine, A. Cukierman, E. Denison, M. Dierickx, L. Duband, M. Eiben, S. Fatigoni, J. P. Filippini, S. Fliescher, N. Goeckner-Wald, D. C. Goldfinger, J. A. Grayson , et al. (62 additional authors not shown)

Abstract: The BICEP3 CMB Polarimeter is a small-aperture refracting telescope located at the South Pole and is specifically designed to search for the possible signature of inflationary gravitational waves in the Cosmic Microwave Background (CMB). The experiment measures polarization on the sky by differencing the signal of co-located, orthogonally polarized antennas coupled to Transition Edge Sensor (TES)… ▽ More The BICEP3 CMB Polarimeter is a small-aperture refracting telescope located at the South Pole and is specifically designed to search for the possible signature of inflationary gravitational waves in the Cosmic Microwave Background (CMB). The experiment measures polarization on the sky by differencing the signal of co-located, orthogonally polarized antennas coupled to Transition Edge Sensor (TES) detectors. We present precise measurements of the absolute polarization response angles and polarization efficiencies for nearly all of BICEP3s $\sim800$ functioning polarization-sensitive detector pairs from calibration data taken in January 2018. Using a Rotating Polarized Source (RPS), we mapped polarization response for each detector over a full 360 degrees of source rotation and at multiple telescope boresight rotations from which per-pair polarization properties were estimated. In future work, these results will be used to constrain signals predicted by exotic physical models such as Cosmic Birefringence. △ Less

Submitted 10 December, 2020; originally announced December 2020.

Comments: Proceedings submitted to SPIE 2020 (AS111). 12 pages, 5 figures, 2 tables