-
LenSiam: Self-Supervised Learning on Strong Gravitational Lens Images
Authors:
Po-Wen Chang,
Kuan-Wei Huang,
Joshua Fagin,
James Hung-Hsu Chan,
Joshua Yao-Yu Lin
Abstract:
Self-supervised learning has been known for learning good representations from data without the need for annotated labels. We explore the simple siamese (SimSiam) architecture for representation learning on strong gravitational lens images. Commonly used image augmentations tend to change lens properties; for example, zoom-in would affect the Einstein radius. To create image pairs representing the…
▽ More
Self-supervised learning has been known for learning good representations from data without the need for annotated labels. We explore the simple siamese (SimSiam) architecture for representation learning on strong gravitational lens images. Commonly used image augmentations tend to change lens properties; for example, zoom-in would affect the Einstein radius. To create image pairs representing the same underlying lens model, we introduce a lens augmentation method to preserve lens properties by fixing the lens model while varying the source galaxies. Our research demonstrates this lens augmentation works well with SimSiam for learning the lens image representation without labels, so we name it LenSiam. We also show that a pre-trained LenSiam model can benefit downstream tasks. We open-source our code and datasets at https://github.com/kuanweih/LenSiam .
△ Less
Submitted 8 November, 2023;
originally announced November 2023.
-
Strong Gravitational Lensing Parameter Estimation with Vision Transformer
Authors:
Kuan-Wei Huang,
Geoff Chih-Fan Chen,
Po-Wen Chang,
Sheng-Chieh Lin,
Chia-Jung Hsu,
Vishal Thengane,
Joshua Yao-Yu Lin
Abstract:
Quantifying the parameters and corresponding uncertainties of hundreds of strongly lensed quasar systems holds the key to resolving one of the most important scientific questions: the Hubble constant ($H_{0}$) tension. The commonly used Markov chain Monte Carlo (MCMC) method has been too time-consuming to achieve this goal, yet recent work has shown that convolution neural networks (CNNs) can be a…
▽ More
Quantifying the parameters and corresponding uncertainties of hundreds of strongly lensed quasar systems holds the key to resolving one of the most important scientific questions: the Hubble constant ($H_{0}$) tension. The commonly used Markov chain Monte Carlo (MCMC) method has been too time-consuming to achieve this goal, yet recent work has shown that convolution neural networks (CNNs) can be an alternative with seven orders of magnitude improvement in speed. With 31,200 simulated strongly lensed quasar images, we explore the usage of Vision Transformer (ViT) for simulated strong gravitational lensing for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at some lensing parameters, including the most important mass-related parameters such as the center of lens $θ_{1}$ and $θ_{2}$, the ellipticities $e_1$ and $e_2$, and the radial power-law slope $γ'$. With this promising preliminary result, we believe the ViT (or attention-based) network architecture can be an important tool for strong lensing science for the next generation of surveys. The open source of our code and data is in \url{https://github.com/kuanweih/strong_lensing_vit_resnet}.
△ Less
Submitted 8 October, 2022;
originally announced October 2022.
-
VLBInet: Radio Interferometry Data Classification for EHT with Neural Networks
Authors:
Joshua Yao-Yu Lin,
Dominic W. Pesce,
George N. Wong,
Ajay Uppili Arasanipalai,
Ben S. Prather,
Charles F. Gammie
Abstract:
The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for the EHT is how well key parameters, such as trapped magnetic flux and the associated disk models, can be…
▽ More
The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for the EHT is how well key parameters, such as trapped magnetic flux and the associated disk models, can be extracted from present and future EHT VLBI data products. The process of modeling visibilities and analyzing them is complicated by the fact that the data are sparsely sampled in the Fourier domain while most of the theory/simulation is constructed in the image domain. Here we propose a data-driven approach to analyze complex visibilities and closure quantities for radio interferometric data with neural networks. Using mock interferometric data, we show that our neural networks are able to infer the accretion state as either high magnetic flux (MAD) or low magnetic flux (SANE), suggesting that it is possible to perform parameter extraction directly in the visibility domain without image reconstruction. We have applied VLBInet to real M87 EHT data taken on four different days in 2017 (April 5, 6, 10, 11), and our neural networks give a score prediction 0.52, 0.4, 0.43, 0.76 for each day, with an average score 0.53, which shows no significant indication for the data to lean toward either the MAD or SANE state.
△ Less
Submitted 14 October, 2021;
originally announced October 2021.
-
Galaxy Morphological Classification with Efficient Vision Transformer
Authors:
Joshua Yao-Yu Lin,
Song-Mao Liao,
Hung-** Huang,
Wei-Ting Kuo,
Olivia Hsuan-Min Ou
Abstract:
Quantifying the morphology of galaxies has been an important task in astrophysics to understand the formation and evolution of galaxies. In recent years, the data size has been dramatically increasing due to several on-going and upcoming surveys. Labeling and identifying interesting objects for further investigations has been explored by citizen science through the Galaxy Zoo Project and by machin…
▽ More
Quantifying the morphology of galaxies has been an important task in astrophysics to understand the formation and evolution of galaxies. In recent years, the data size has been dramatically increasing due to several on-going and upcoming surveys. Labeling and identifying interesting objects for further investigations has been explored by citizen science through the Galaxy Zoo Project and by machine learning in particular with the convolutional neural networks (CNNs). In this work, we explore the usage of Vision Transformer (ViT) for galaxy morphology classification for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at classifying smaller-sized and fainter galaxies. With this promising preliminary result, we believe the ViT network architecture can be an important tool for galaxy morphological classification for the next generation surveys. Our open source, is publicly available at
\url{https://github.com/sliao-mi-luku/Galaxy-Zoo-Classification}
△ Less
Submitted 3 February, 2022; v1 submitted 3 October, 2021;
originally announced October 2021.
-
AGNet: Weighing Black Holes with Deep Learning
Authors:
Joshua Yao-Yu Lin,
Sneh Pandya,
Devanshi Pratap,
Xin Liu,
Matias Carrasco Kind,
Volodymyr Kindratenko
Abstract:
Supermassive black holes (SMBHs) are ubiquitously found at the centers of most massive galaxies. Measuring SMBH mass is important for understanding the origin and evolution of SMBHs. However, traditional methods require spectroscopic data which is expensive to gather. We present an algorithm that weighs SMBHs using quasar light time series, circumventing the need for expensive spectra. We train, v…
▽ More
Supermassive black holes (SMBHs) are ubiquitously found at the centers of most massive galaxies. Measuring SMBH mass is important for understanding the origin and evolution of SMBHs. However, traditional methods require spectroscopic data which is expensive to gather. We present an algorithm that weighs SMBHs using quasar light time series, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 light curves for a sample of $38,939$ spectroscopically confirmed quasars to map out the nonlinear encoding between SMBH mass and multi-color optical light curves. We find a 1$σ$ scatter of 0.37 dex between the predicted SMBH mass and the fiducial virial mass estimate based on SDSS single-epoch spectra, which is comparable to the systematic uncertainty in the virial mass estimate. Our results have direct implications for more efficient applications with future observations from the Vera C. Rubin Observatory. Our code, \textsf{AGNet}, is publicly available at \url{https://github.com/snehjp2/AGNet}.
△ Less
Submitted 21 November, 2022; v1 submitted 17 August, 2021;
originally announced August 2021.
-
Inferring Black Hole Properties from Astronomical Multivariate Time Series with Bayesian Attentive Neural Processes
Authors:
Ji Won Park,
Ashley Villar,
Yin Li,
Yan-Fei Jiang,
Shirley Ho,
Joshua Yao-Yu Lin,
Philip J. Marshall,
Aaron Roodman
Abstract:
Among the most extreme objects in the Universe, active galactic nuclei (AGN) are luminous centers of galaxies where a black hole feeds on surrounding matter. The variability patterns of the light emitted by an AGN contain information about the physical properties of the underlying black hole. Upcoming telescopes will observe over 100 million AGN in multiple broadband wavelengths, yielding a large…
▽ More
Among the most extreme objects in the Universe, active galactic nuclei (AGN) are luminous centers of galaxies where a black hole feeds on surrounding matter. The variability patterns of the light emitted by an AGN contain information about the physical properties of the underlying black hole. Upcoming telescopes will observe over 100 million AGN in multiple broadband wavelengths, yielding a large sample of multivariate time series with long gaps and irregular sampling. We present a method that reconstructs the AGN time series and simultaneously infers the posterior probability density distribution (PDF) over the physical quantities of the black hole, including its mass and luminosity. We apply this method to a simulated dataset of 11,000 AGN and report precision and accuracy of 0.4 dex and 0.3 dex in the inferred black hole mass. This work is the first to address probabilistic time series reconstruction and parameter inference for AGN in an end-to-end fashion.
△ Less
Submitted 18 June, 2021; v1 submitted 2 June, 2021;
originally announced June 2021.
-
A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
Authors:
V. Ashley Villar,
Miles Cranmer,
Edo Berger,
Gabriella Contardo,
Shirley Ho,
Griffin Hosseinzadeh,
Joshua Yao-Yu Lin
Abstract:
There is a shortage of multi-wavelength and spectroscopic followup capabilities given the number of transient and variable astrophysical events discovered through wide-field, optical surveys such as the upcoming Vera C. Rubin Observatory. From the haystack of potential science targets, astronomers must allocate scarce resources to study a selection of needles in real time. Here we present a variat…
▽ More
There is a shortage of multi-wavelength and spectroscopic followup capabilities given the number of transient and variable astrophysical events discovered through wide-field, optical surveys such as the upcoming Vera C. Rubin Observatory. From the haystack of potential science targets, astronomers must allocate scarce resources to study a selection of needles in real time. Here we present a variational recurrent autoencoder neural network to encode simulated Rubin Observatory extragalactic transient events using 1% of the PLAsTiCC dataset to train the autoencoder. Our unsupervised method uniquely works with unlabeled, real time, multivariate and aperiodic data. We rank 1,129,184 events based on an anomaly score estimated using an isolation forest. We find that our pipeline successfully ranks rarer classes of transients as more anomalous. Using simple cuts in anomaly score and uncertainty, we identify a pure (~95% pure) sample of rare transients (i.e., transients other than Type Ia, Type II and Type Ibc supernovae) including superluminous and pair-instability supernovae. Finally, our algorithm is able to identify these transients as anomalous well before peak, enabling real-time follow up studies in the era of the Rubin Observatory.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
deeplenstronomy: A dataset simulation package for strong gravitational lensing
Authors:
Robert Morgan,
Brian Nord,
Simon Birrer,
Joshua Yao-Yu Lin,
Jason Poh
Abstract:
Automated searches for strong gravitational lensing in optical imaging survey datasets often employ machine learning and deep learning approaches. These techniques require more example systems to train the algorithms than have presently been discovered, which creates a need for simulated images as training dataset supplements. This work introduces and summarizes deeplenstronomy, an open-source Pyt…
▽ More
Automated searches for strong gravitational lensing in optical imaging survey datasets often employ machine learning and deep learning approaches. These techniques require more example systems to train the algorithms than have presently been discovered, which creates a need for simulated images as training dataset supplements. This work introduces and summarizes deeplenstronomy, an open-source Python package that enables efficient, large-scale, and reproducible simulation of images of astronomical systems. A full suite of unit tests, documentation, and example notebooks are available at https://deepskies.github.io/deeplenstronomy/ .
△ Less
Submitted 4 February, 2021;
originally announced February 2021.
-
Large-Scale Gravitational Lens Modeling with Bayesian Neural Networks for Accurate and Precise Inference of the Hubble Constant
Authors:
Ji Won Park,
Sebastian Wagner-Carena,
Simon Birrer,
Philip J. Marshall,
Joshua Yao-Yu Lin,
Aaron Roodman
Abstract:
We investigate the use of approximate Bayesian neural networks (BNNs) in modeling hundreds of time-delay gravitational lenses for Hubble constant ($H_0$) determination. Our BNN was trained on synthetic HST-quality images of strongly lensed active galactic nuclei (AGN) with lens galaxy light included. The BNN can accurately characterize the posterior PDFs of model parameters governing the elliptica…
▽ More
We investigate the use of approximate Bayesian neural networks (BNNs) in modeling hundreds of time-delay gravitational lenses for Hubble constant ($H_0$) determination. Our BNN was trained on synthetic HST-quality images of strongly lensed active galactic nuclei (AGN) with lens galaxy light included. The BNN can accurately characterize the posterior PDFs of model parameters governing the elliptical power-law mass profile in an external shear field. We then propagate the BNN-inferred posterior PDFs into ensemble $H_0$ inference, using simulated time delay measurements from a plausible dedicated monitoring campaign. Assuming well-measured time delays and a reasonable set of priors on the environment of the lens, we achieve a median precision of $9.3$\% per lens in the inferred $H_0$. A simple combination of 200 test-set lenses results in a precision of 0.5 $\textrm{km s}^{-1} \textrm{ Mpc}^{-1}$ ($0.7\%$), with no detectable bias in this $H_0$ recovery test. The computation time for the entire pipeline -- including the training set generation, BNN training, and $H_0$ inference -- translates to 9 minutes per lens on average for 200 lenses and converges to 6 minutes per lens as the sample size is increased. Being fully automated and efficient, our pipeline is a promising tool for exploring ensemble-level systematics in lens modeling for $H_0$ inference.
△ Less
Submitted 11 April, 2021; v1 submitted 30 November, 2020;
originally announced December 2020.
-
AGNet: Weighing Black Holes with Machine Learning
Authors:
Joshua Yao-Yu Lin,
Sneh Pandya,
Devanshi Pratap,
Xin Liu,
Matias Carrasco Kind
Abstract:
Supermassive black holes (SMBHs) are ubiquitously found at the centers of most galaxies. Measuring SMBH mass is important for understanding the origin and evolution of SMBHs. However, traditional methods require spectral data which is expensive to gather. To solve this problem, we present an algorithm that weighs SMBHs using quasar light time series, circumventing the need for expensive spectra. W…
▽ More
Supermassive black holes (SMBHs) are ubiquitously found at the centers of most galaxies. Measuring SMBH mass is important for understanding the origin and evolution of SMBHs. However, traditional methods require spectral data which is expensive to gather. To solve this problem, we present an algorithm that weighs SMBHs using quasar light time series, circumventing the need for expensive spectra. We train, validate, and test neural networks that directly learn from the Sloan Digital Sky Survey (SDSS) Stripe 82 data for a sample of $9,038$ spectroscopically confirmed quasars to map out the nonlinear encoding between black hole mass and multi-color optical light curves. We find a 1$σ$ scatter of 0.35 dex between the predicted mass and the fiducial virial mass based on SDSS single-epoch spectra. Our results have direct implications for efficient applications with future observations from the Vera Rubin Observatory.
△ Less
Submitted 1 December, 2020; v1 submitted 30 November, 2020;
originally announced November 2020.
-
Hunting for Dark Matter Subhalos in Strong Gravitational Lensing with Neural Networks
Authors:
Joshua Yao-Yu Lin,
Hang Yu,
Warren Morningstar,
Jian Peng,
Gilbert Holder
Abstract:
Dark matter substructures are interesting since they can reveal the properties of dark matter. Collisionless N-body simulations of cold dark matter show more substructures compared with the population of dwarf galaxy satellites observed in our local group. Therefore, understanding the population and property of subhalos at cosmological scale would be an interesting test for cold dark matter. In re…
▽ More
Dark matter substructures are interesting since they can reveal the properties of dark matter. Collisionless N-body simulations of cold dark matter show more substructures compared with the population of dwarf galaxy satellites observed in our local group. Therefore, understanding the population and property of subhalos at cosmological scale would be an interesting test for cold dark matter. In recent years, it has become possible to detect individual dark matter subhalos near images of strongly lensed extended background galaxies. In this work, we discuss the possibility of using deep neural networks to detect dark matter subhalos, and showing some preliminary results with simulated data. We found that neural networks not only show promising results on detecting multiple dark matter subhalos, but also learn to reject the subhalos on the lensing arc of a smooth lens where there is no subhalo.
△ Less
Submitted 26 October, 2020; v1 submitted 24 October, 2020;
originally announced October 2020.
-
Anomaly Detection for Multivariate Time Series of Exotic Supernovae
Authors:
V. Ashley Villar,
Miles Cranmer,
Gabriella Contardo,
Shirley Ho,
Joshua Yao-Yu Lin
Abstract:
Supernovae mark the explosive deaths of stars and enrich the cosmos with heavy elements. Future telescopes will discover thousands of new supernovae nightly, creating a need to flag astrophysically interesting events rapidly for followup study. Ideally, such an anomaly detection pipeline would be independent of our current knowledge and be sensitive to unexpected phenomena. Here we present an unsu…
▽ More
Supernovae mark the explosive deaths of stars and enrich the cosmos with heavy elements. Future telescopes will discover thousands of new supernovae nightly, creating a need to flag astrophysically interesting events rapidly for followup study. Ideally, such an anomaly detection pipeline would be independent of our current knowledge and be sensitive to unexpected phenomena. Here we present an unsupervised method to search for anomalous time series in real time for transient, multivariate, and aperiodic signals. We use a RNN-based variational autoencoder to encode supernova time series and an isolation forest to search for anomalous events in the learned encoded space. We apply this method to a simulated dataset of 12,159 supernovae, successfully discovering anomalous supernovae and objects with catastrophically incorrect redshift measurements. This work is the first anomaly detection pipeline for supernovae which works with online datastreams.
△ Less
Submitted 21 October, 2020;
originally announced October 2020.
-
Feature Extraction on Synthetic Black Hole Images
Authors:
Joshua Yao-Yu Lin,
George N. Wong,
Ben S. Prather,
Charles F. Gammie
Abstract:
The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for EHT is how well key parameters such as spin and trapped magnetic flux can be extracted from present and…
▽ More
The Event Horizon Telescope (EHT) recently released the first horizon-scale images of the black hole in M87. Combined with other astronomical data, these images constrain the mass and spin of the hole as well as the accretion rate and magnetic flux trapped on the hole. An important question for EHT is how well key parameters such as spin and trapped magnetic flux can be extracted from present and future EHT data alone. Here we explore parameter extraction using a neural network trained on high resolution synthetic images drawn from state-of-the-art simulations. We find that the neural network is able to recover spin and flux with high accuracy. We are particularly interested in interpreting the neural network output and understanding which features are used to identify, e.g., black hole spin. Using feature maps, we find that the network keys on low surface brightness features in particular.
△ Less
Submitted 1 July, 2020;
originally announced July 2020.
-
Gravitational Lensing of the Cosmic Neutrino Background
Authors:
Joshua Yao-Yu Lin,
Gilbert Holder
Abstract:
We study gravitational lensing of the cosmic neutrino background. This signal is undetectable for the foreseeable future, but there is a rich trove of information available. At least some of the neutrinos from the early universe will be non-relativistic today, with a closer surface of last scattering (compared to the cosmic microwave background) and with larger angles of deflection. Lensing of mas…
▽ More
We study gravitational lensing of the cosmic neutrino background. This signal is undetectable for the foreseeable future, but there is a rich trove of information available. At least some of the neutrinos from the early universe will be non-relativistic today, with a closer surface of last scattering (compared to the cosmic microwave background) and with larger angles of deflection. Lensing of massive neutrinos is strongly chromatic: both the amplitude of lensing and the cosmic time at which the potential is traversed depend on neutrino momentum, in principle giving access to our entire causal volume, not restricted to the light cone. As a concrete example, we focus on the case where the cosmic neutrino background would be strongly lensed when passing through halos of galaxy clusters and galaxies. We calculate the Einstein radius for cosmic neutrinos and investigate the impact of neutrino mass.
△ Less
Submitted 8 May, 2020; v1 submitted 8 October, 2019;
originally announced October 2019.
-
Deblending and Classifying Astronomical Sources with Mask R-CNN Deep Learning
Authors:
Colin J. Burke,
Patrick D. Aleo,
Yu-Ching Chen,
Xin Liu,
John R. Peterson,
Glenn H. Sembroski,
Joshua Yao-Yu Lin
Abstract:
We apply a new deep learning technique to detect, classify, and deblend sources in multi-band astronomical images. We train and evaluate the performance of an artificial neural network built on the Mask R-CNN image processing framework, a general code for efficient object detection, classification, and instance segmentation. After evaluating the performance of our network against simulated ground…
▽ More
We apply a new deep learning technique to detect, classify, and deblend sources in multi-band astronomical images. We train and evaluate the performance of an artificial neural network built on the Mask R-CNN image processing framework, a general code for efficient object detection, classification, and instance segmentation. After evaluating the performance of our network against simulated ground truth images for star and galaxy classes, we find a precision of 92% at 80% recall for stars and a precision of 98% at 80% recall for galaxies in a typical field with $\sim30$ galaxies/arcmin$^2$. We investigate the deblending capability of our code, and find that clean deblends are handled robustly during object masking, even for significantly blended sources. This technique, or extensions using similar network architectures, may be applied to current and future deep imaging surveys such as LSST and WFIRST. Our code, Astro R-CNN, is publicly available at https://github.com/burke86/astro_rcnn.
△ Less
Submitted 8 October, 2019; v1 submitted 7 August, 2019;
originally announced August 2019.
