-
Bump Morphology of the CMAGIC Diagram
Authors:
L. Aldoroty,
L. Wang,
P. Hoeflich,
J. Yang,
N. Suntzeff,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
K. Boone,
C. Buton,
Y. Copin,
S. Dixon,
D. Fouchez,
E. Gangler,
R. Gupta,
B. Hayden,
Mitchell Karmen,
A. G. Kim,
M. Kowalski,
D. Küsters,
P. -F. Léget,
F. Mondon
, et al. (16 additional authors not shown)
Abstract:
We apply the color-magnitude intercept calibration method (CMAGIC) to the Nearby Supernova Factory SNe Ia spectrophotometric dataset. The currently existing CMAGIC parameters are the slope and intercept of a straight line fit to the first linear region in the color-magnitude diagram, which occurs over a span of approximately 30 days after maximum brightness. We define a new parameter, $ω_{XY}$, th…
▽ More
We apply the color-magnitude intercept calibration method (CMAGIC) to the Nearby Supernova Factory SNe Ia spectrophotometric dataset. The currently existing CMAGIC parameters are the slope and intercept of a straight line fit to the first linear region in the color-magnitude diagram, which occurs over a span of approximately 30 days after maximum brightness. We define a new parameter, $ω_{XY}$, the size of the ``bump'' feature near maximum brightness for arbitrary filters $X$ and $Y$. We find a significant correlation between the slope of the first linear region, $β_{XY, 1}$, in the CMAGIC diagram and $ω_{XY}$. These results may be used to our advantage, as they are less affected by extinction than parameters defined as a function of time. Additionally, $ω_{XY}$ is computed independently of templates. We find that current empirical templates are successful at reproducing the features described in this work, particularly SALT3, which correctly exhibits the negative correlation between slope and bump size seen in our data. In 1-D simulations, we show that the correlation between the size of the bump feature and $β_{XY, 1}$ can be understood as a result of chemical mixing due to large-scale Rayleigh-Taylor instabilities.
△ Less
Submitted 22 June, 2023; v1 submitted 13 October, 2022;
originally announced October 2022.
-
A Probabilistic Autoencoder for Type Ia Supernovae Spectral Time Series
Authors:
George Stein,
Uros Seljak,
Vanessa Bohm,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
K. Boone,
C. Buton,
Y. Copin,
S. Dixon,
D. Fouchez,
E. Gangler,
R. Gupta,
B. Hayden,
W. Hillebrandt,
M. Karmen,
A. G. Kim,
M. Kowalski,
D. Kusters,
P. F. Leget,
F. Mondon,
J. Nordin
, et al. (15 additional authors not shown)
Abstract:
We construct a physically-parameterized probabilistic autoencoder (PAE) to learn the intrinsic diversity of type Ia supernovae (SNe Ia) from a sparse set of spectral time series. The PAE is a two-stage generative model, composed of an Auto-Encoder (AE) which is interpreted probabilistically after training using a Normalizing Flow (NF). We demonstrate that the PAE learns a low-dimensional latent sp…
▽ More
We construct a physically-parameterized probabilistic autoencoder (PAE) to learn the intrinsic diversity of type Ia supernovae (SNe Ia) from a sparse set of spectral time series. The PAE is a two-stage generative model, composed of an Auto-Encoder (AE) which is interpreted probabilistically after training using a Normalizing Flow (NF). We demonstrate that the PAE learns a low-dimensional latent space that captures the nonlinear range of features that exists within the population, and can accurately model the spectral evolution of SNe Ia across the full range of wavelength and observation times directly from the data. By introducing a correlation penalty term and multi-stage training setup alongside our physically-parameterized network we show that intrinsic and extrinsic modes of variability can be separated during training, removing the need for the additional models to perform magnitude standardization. We then use our PAE in a number of downstream tasks on SNe Ia for increasingly precise cosmological analyses, including automatic detection of SN outliers, the generation of samples consistent with the data distribution, and solving the inverse problem in the presence of noisy and incomplete data to constrain cosmological distance measurements. We find that the optimal number of intrinsic model parameters appears to be three, in line with previous studies, and show that we can standardize our test sample of SNe Ia with an RMS of $0.091 \pm 0.010$ mag, which corresponds to $0.074 \pm 0.010$ mag if peculiar velocity contributions are removed. Trained models and codes are released at \href{https://github.com/georgestein/suPAErnova}{github.com/georgestein/suPAErnova}
△ Less
Submitted 15 July, 2022;
originally announced July 2022.
-
Uniform Recalibration of Common Spectrophotometry Standard Stars onto the CALSPEC System using the SuperNova Integral Field Spectrograph
Authors:
David Rubin,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
K. Boone,
C. Buton,
Y. Copin,
S. Dixon,
D. Fouchez,
E. Gangler,
R. Gupta,
B. Hayden,
W. Hillebrandt,
A. G. Kim,
M. Kowalski,
D. Kuesters,
P. -F. Leget,
F. Mondon,
J. Nordin,
R. Pain,
E. Pecontal,
R. Pereira
, et al. (13 additional authors not shown)
Abstract:
We calibrate spectrophotometric optical spectra of 32 stars commonly used as standard stars, referenced to 14 stars already on the HST-based CALSPEC flux system. Observations of CALSPEC and non-CALSPEC stars were obtained with the SuperNova Integral Field Spectrograph over the wavelength range 3300 A to 9400 A as calibration for the Nearby Supernova Factory cosmology experiment. In total, this ana…
▽ More
We calibrate spectrophotometric optical spectra of 32 stars commonly used as standard stars, referenced to 14 stars already on the HST-based CALSPEC flux system. Observations of CALSPEC and non-CALSPEC stars were obtained with the SuperNova Integral Field Spectrograph over the wavelength range 3300 A to 9400 A as calibration for the Nearby Supernova Factory cosmology experiment. In total, this analysis used 4289 standard-star spectra taken on photometric nights. As a modern cosmology analysis, all pre-submission methodological decisions were made with the flux scale and external comparison results blinded. The large number of spectra per star allows us to treat the wavelength-by-wavelength calibration for all nights simultaneously with a Bayesian hierarchical model, thereby enabling a consistent treatment of the Type Ia supernova cosmology analysis and the calibration on which it critically relies. We determine the typical per-observation repeatability (median 14 mmag for exposures >~ 5 s), the Maunakea atmospheric transmission distribution (median dispersion of 7 mmag with uncertainty 1 mmag), and the scatter internal to our CALSPEC reference stars (median of 8 mmag). We also check our standards against literature filter photometry, finding generally good agreement over the full 12-magnitude range. Overall, the mean of our system is calibrated to the mean of CALSPEC at the level of ~ 3 mmag. With our large number of observations, careful crosschecks, and 14 reference stars, our results are the best calibration yet achieved with an integral-field spectrograph, and among the best calibrated surveys.
△ Less
Submitted 21 June, 2022; v1 submitted 2 May, 2022;
originally announced May 2022.
-
The Twins Embedding of Type Ia Supernovae I: The Diversity of Spectra at Maximum Light
Authors:
K. Boone,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
C. Buton,
Y. Copin,
S. Dixon,
D. Fouchez,
E. Gangler,
R. Gupta,
B. Hayden,
W. Hillebrandt,
A. G. Kim,
M. Kowalski,
D. Küsters,
P. -F. Léget,
F. Mondon,
J. Nordin,
R. Pain,
E. Pecontal,
R. Pereira,
S. Perlmutter
, et al. (12 additional authors not shown)
Abstract:
We study the spectral diversity of Type Ia supernovae (SNe Ia) at maximum light using high signal-to-noise spectrophotometry of 173 SNe Ia from the Nearby Supernova Factory. We decompose the diversity of these spectra into different extrinsic and intrinsic components, and we construct a nonlinear parameterization of the intrinsic diversity of SNe Ia that preserves pairings of "twin" SNe Ia. We cal…
▽ More
We study the spectral diversity of Type Ia supernovae (SNe Ia) at maximum light using high signal-to-noise spectrophotometry of 173 SNe Ia from the Nearby Supernova Factory. We decompose the diversity of these spectra into different extrinsic and intrinsic components, and we construct a nonlinear parameterization of the intrinsic diversity of SNe Ia that preserves pairings of "twin" SNe Ia. We call this parameterization the "Twins Embedding". Our methodology naturally handles highly nonlinear variability in spectra, such as changes in the photosphere expansion velocity, and uses the full spectrum rather than being limited to specific spectral line strengths, ratios or velocities. We find that the time evolution of SNe Ia near maximum light is remarkably similar, with 84.6% of the variance in common to all SNe Ia. After correcting for brightness and color, the intrinsic variability of SNe Ia is mostly restricted to specific spectral lines, and we find intrinsic dispersions as low as ~0.02 mag between 6600 and 7200 A. With a nonlinear three-dimensional model plus one dimension for color, we can explain 89.2% of the intrinsic diversity in our sample of SNe Ia, which includes several different kinds of "peculiar" SNe Ia. A linear model requires seven dimensions to explain a comparable fraction of the intrinsic diversity. We show how a wide range of previously-established indicators of diversity in SNe Ia can be recovered from the Twins Embedding. In a companion article, we discuss how these results an be applied to standardization of SNe Ia for cosmology.
△ Less
Submitted 5 May, 2021;
originally announced May 2021.
-
The Twins Embedding of Type Ia Supernovae II: Improving Cosmological Distance Estimates
Authors:
K. Boone,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
C. Buton,
Y. Copin,
S. Dixon,
D. Fouchez,
E. Gangler,
R. Gupta,
B. Hayden,
W. Hillebrandt,
A. G. Kim,
M. Kowalski,
D. Küsters,
P. -F. Léget,
F. Mondon,
J. Nordin,
R. Pain,
E. Pecontal,
R. Pereira,
S. Perlmutter
, et al. (12 additional authors not shown)
Abstract:
We show how spectra of Type Ia supernovae (SNe Ia) at maximum light can be used to improve cosmological distance estimates. In a companion article, we used manifold learning to build a three-dimensional parameterization of the intrinsic diversity of SNe Ia at maximum light that we call the "Twins Embedding". In this article, we discuss how the Twins Embedding can be used to improve the standardiza…
▽ More
We show how spectra of Type Ia supernovae (SNe Ia) at maximum light can be used to improve cosmological distance estimates. In a companion article, we used manifold learning to build a three-dimensional parameterization of the intrinsic diversity of SNe Ia at maximum light that we call the "Twins Embedding". In this article, we discuss how the Twins Embedding can be used to improve the standardization of SNe Ia. With a single spectrophotometrically-calibrated spectrum near maximum light, we can standardize our sample of SNe Ia with an RMS of $0.101 \pm 0.007$ mag, which corresponds to $0.084 \pm 0.009$ mag if peculiar velocity contributions are removed and $0.073 \pm 0.008$ mag if a larger reference sample were obtained. Our techniques can standardize the full range of SNe Ia, including those typically labeled as peculiar and often rejected from other analyses. We find that traditional light curve width + color standardization such as SALT2 is not sufficient. The Twins Embedding identifies a subset of SNe Ia including but not limited to 91T-like SNe Ia whose SALT2 distance estimates are biased by $0.229 \pm 0.045$ mag. Standardization using the Twins Embedding also significantly decreases host-galaxy correlations. We recover a host mass step of $0.040 \pm 0.020$ mag compared to $0.092 \pm 0.024$ mag for SALT2 standardization on the same sample of SNe Ia. These biases in traditional standardization methods could significantly impact future cosmology analyses if not properly taken into account.
△ Less
Submitted 5 May, 2021;
originally announced May 2021.
-
Anomaly detection in the Zwicky Transient Facility DR3
Authors:
K. L. Malanchev,
M. V. Pruzhinskaya,
V. S. Korolev,
P. D. Aleo,
M. V. Kornilov,
E. E. O. Ishida,
V. V. Krushinsky,
F. Mondon,
S. Sreejith,
A. A. Volnova,
A. A. Belinski,
A. V. Dodin,
A. M. Tatarnikov,
S. G. Zheltoukhov
Abstract:
We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of 3 stages: feature extraction, search of outliers with machine learning algorithms and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million obje…
▽ More
We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of 3 stages: feature extraction, search of outliers with machine learning algorithms and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million objects. A set of 4 automatic learning algorithms was used to identify 277 outliers, which were subsequently scrutinised by an expert. From these, 188 (68%) were found to be bogus light curves -- including effects from the image subtraction pipeline as well as overlap** between a star and a known asteroid, 66 (24%) were previously reported sources whereas 23 (8%) correspond to non-catalogued objects, with the two latter cases of potential scientific interest (e. g. 1 spectroscopically confirmed RS Canum Venaticorum star, 4 supernovae candidates, 1 red dwarf flare). Moreover, using results from the expert analysis, we were able to identify a simple bi-dimensional relation which can be used to aid filtering potentially bogus light curves in future studies. We provide a complete list of objects with potential scientific application so they can be further scrutinised by the community. These results confirm the importance of combining automatic machine learning algorithms with domain knowledge in the construction of recommendation systems for astronomy. Our code is publicly available at https://github.com/snad-space/zwad
△ Less
Submitted 2 February, 2021; v1 submitted 2 December, 2020;
originally announced December 2020.
-
The SNEMO and SUGAR Companion Datasets
Authors:
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
S. Bongard,
K. Boone,
C. Buton,
N. Chotard,
Y. Copin,
S. Dixon,
H. K. Fakhouri,
U. Feindt,
D. Fouchez,
E. Gangler,
B. Hayden,
W. Hillebrandt,
A. G. Kim,
M. Kowalski,
D. Kusters,
P. -F. Leget,
Q. Lin,
S. Lombardo,
F. Mondon,
J. Nordin
, et al. (19 additional authors not shown)
Abstract:
The Nearby Supernova Factory has made spectrophotometric observations of Type Ia supernovae since $2004$. This work presents an interim version of the data produced, including $210$ supernovae observed between $2004$ and $2013$.
The Nearby Supernova Factory has made spectrophotometric observations of Type Ia supernovae since $2004$. This work presents an interim version of the data produced, including $210$ supernovae observed between $2004$ and $2013$.
△ Less
Submitted 17 April, 2020;
originally announced May 2020.
-
Active Anomaly Detection for time-domain discoveries
Authors:
Emille E. O. Ishida,
Matwey V. Kornilov,
Konstantin L. Malanchev,
Maria V. Pruzhinskaya,
Alina A. Volnova,
Vladimir S. Korolev,
Florian Mondon,
Sreevarsha Sreejith,
Anastasia Malancheva,
Shubhomoy Das
Abstract:
We present the first evidence that adaptive learning techniques can boost the discovery of unusual objects within astronomical light curve data sets. Our method follows an active learning strategy where the learning algorithm chooses objects which can potentially improve the learner if additional information about them is provided. This new information is subsequently used to update the machine le…
▽ More
We present the first evidence that adaptive learning techniques can boost the discovery of unusual objects within astronomical light curve data sets. Our method follows an active learning strategy where the learning algorithm chooses objects which can potentially improve the learner if additional information about them is provided. This new information is subsequently used to update the machine learning model, allowing its accuracy to evolve with each new information. For the case of anomaly detection, the algorithm aims to maximize the number of scientifically interesting anomalies presented to the expert by slightly modifying the weights of a traditional Isolation Forest (IF) at each iteration. In order to demonstrate the potential of such techniques, we apply the Active Anomaly Discovery (AAD) algorithm to 2 data sets: simulated light curves from the PLAsTiCC challenge and real light curves from the Open Supernova Catalog. We compare the AAD results to those of a static IF. For both methods, we performed a detailed analysis for all objects with the ~2% highest anomaly scores. We show that, in the real data scenario, AAD was able to identify ~80\% more true anomalies than the IF. This result is the first evidence that AAD algorithms can play a central role in the search for new physics in the era of large scale sky surveys.
△ Less
Submitted 14 July, 2020; v1 submitted 29 September, 2019;
originally announced September 2019.
-
SUGAR: An improved empirical model of Type Ia Supernovae based on spectral features
Authors:
P. -F. Léget,
E. Gangler,
F. Mondon,
G. Aldering,
P. Antilogus,
C. Aragon,
S. Bailey,
C. Baltay,
K. Barbary,
S. Bongard,
K. Boone,
C. Buton,
N. Chotard,
Y. Copin,
S. Dixon,
P. Fagrelius,
U. Feindt,
D. Fouchez,
B. Hayden,
W. Hillebrandt,
A. Kim,
M. Kowalski,
D. Kuesters,
S. Lombardo,
Q. Lin
, et al. (18 additional authors not shown)
Abstract:
Type Ia Supernovae (SNe Ia) are widely used to measure the expansion of the Universe. Improving distance measurements of SNe Ia is one technique to better constrain the acceleration of expansion and determine its physical nature. This document develops a new SNe Ia spectral energy distribution (SED) model, called the SUpernova Generator And Reconstructor (SUGAR), which improves the spectral descri…
▽ More
Type Ia Supernovae (SNe Ia) are widely used to measure the expansion of the Universe. Improving distance measurements of SNe Ia is one technique to better constrain the acceleration of expansion and determine its physical nature. This document develops a new SNe Ia spectral energy distribution (SED) model, called the SUpernova Generator And Reconstructor (SUGAR), which improves the spectral description of SNe Ia, and consequently could improve the distance measurements. This model is constructed from SNe Ia spectral properties and spectrophotometric data from The Nearby Supernova Factory collaboration. In a first step, a PCA-like method is used on spectral features measured at maximum light, which allows us to extract the intrinsic properties of SNe Ia. Next, the intrinsic properties are used to extract the average extinction curve. Third, an interpolation using Gaussian Processes facilitates using data taken at different epochs during the lifetime of a SN Ia and then projecting the data on a fixed time grid. Finally, the three steps are combined to build the SED model as a function of time and wavelength. This is the SUGAR model. The main advancement in SUGAR is the addition of two additional parameters to characterize SNe Ia variability. The first is tied to the properties of SNe Ia ejecta velocity, the second is correlated with their calcium lines. The addition of these parameters, as well as the high quality the Nearby Supernova Factory data, makes SUGAR an accurate and efficient model for describing the spectra of normal SNe Ia as they brighten and fade. The performance of this model makes it an excellent SED model for experiments like ZTF, LSST or WFIRST.
△ Less
Submitted 24 September, 2019;
originally announced September 2019.
-
Anomaly Detection in the Open Supernova Catalog
Authors:
Maria V. Pruzhinskaya,
Konstantin L. Malanchev,
Matwey V. Kornilov,
Emille E. O. Ishida,
Florian Mondon,
Alina A. Volnova,
Vladimir S. Korolev
Abstract:
In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events…
▽ More
In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events of unknown physical nature. The task of finding them can be framed as an anomaly detection problem. In this work, we perform for the first time an automated anomaly detection analysis in the photometric data of the Open Supernova Catalog (OSC), which serves as a proof of concept for the applicability of these methods to future large scale surveys. The analysis consists of the following steps: 1) data selection from the OSC and approximation of the pre-processed data with Gaussian processes, 2) dimensionality reduction, 3) searching for outliers with the use of the isolation forest algorithm, 4) expert analysis of the identified outliers. The pipeline returned 81 candidate anomalies, 27 (33%) of which were confirmed to be from astrophysically peculiar objects. Found anomalies correspond to a selected sample of 1.4% of the initial automatically identified data sample of ~2000 objects. Among the identified outliers we recognised superluminous supernovae, non-classical Type Ia supernovae, unusual Type II supernovae, one active galactic nucleus and one binary microlensing event. We also found that 16 anomalies classified as supernovae in the literature are likely to be quasars or stars. Our proposed pipeline represents an effective strategy to guarantee we shall not overlook exciting new science hidden in the data we fought so hard to acquire. All code and products of this investigation are made publicly available.
△ Less
Submitted 22 August, 2019; v1 submitted 27 May, 2019;
originally announced May 2019.
