-
Validating Synthetic Galaxy Catalogs for Dark Energy Science in the LSST Era
Authors:
Eve Kovacs,
Yao-Yuan Mao,
Michel Aguena,
Anita Bahmanyar,
Adam Broussard,
James Butler,
Duncan Campbell,
Chihway Chang,
Shenming Fu,
Katrin Heitmann,
Danila Korytov,
François Lanusse,
Patricia Larsen,
Rachel Mandelbaum,
Christopher B. Morrison,
Constantin Payerne,
Marina Ricci,
Eli Rykoff,
F. Javier Sánchez,
Ignacio Sevilla-Noarbe,
Melanie Simet,
Chun-Hao To,
Vinu Vikraman,
Rongpu Zhou,
Camille Avestruz
, et al. (14 additional authors not shown)
Abstract:
Large simulation efforts are required to provide synthetic galaxy catalogs for ongoing and upcoming cosmology surveys. These extragalactic catalogs are being used for many diverse purposes covering a wide range of scientific topics. In order to be useful, they must offer realistically complex information about the galaxies they contain. Hence, it is critical to implement a rigorous validation proc…
▽ More
Large simulation efforts are required to provide synthetic galaxy catalogs for ongoing and upcoming cosmology surveys. These extragalactic catalogs are being used for many diverse purposes covering a wide range of scientific topics. In order to be useful, they must offer realistically complex information about the galaxies they contain. Hence, it is critical to implement a rigorous validation procedure that ensures that the simulated galaxy properties faithfully capture observations and delivers an assessment of the level of realism attained by the catalog. We present here a suite of validation tests that have been developed by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). We discuss how the inclusion of each test is driven by the scientific targets for static ground-based dark energy science and by the availability of suitable validation data. The validation criteria that are used to assess the performance of a catalog are flexible and depend on the science goals. We illustrate the utility of this suite by showing examples for the validation of cosmoDC2, the extragalactic catalog recently released for the LSST DESC second Data Challenge.
△ Less
Submitted 13 January, 2022; v1 submitted 7 October, 2021;
originally announced October 2021.
-
Results of the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC)
Authors:
R. Hložek,
K. A. Ponder,
A. I. Malz,
M. Dai,
G. Narayan,
E. E. O. Ishida,
T. Allam Jr,
A. Bahmanyar,
R. Biswas,
L. Galbany,
S. W. Jha,
D. O. Jones,
R. Kessler,
M. Lochner,
A. A. Mahabal,
K. S. Mandel,
J. R. Martínez-Galarza,
J. D. McEwen,
D. Muthukrishna,
H. V. Peiris,
C. M. Peters,
C. N. Setzer
Abstract:
Next-generation surveys like the Legacy Survey of Space and Time (LSST) on the Vera C. Rubin Observatory will generate orders of magnitude more discoveries of transients and variable stars than previous surveys. To prepare for this data deluge, we developed the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC), a competition which aimed to catalyze the development of ro…
▽ More
Next-generation surveys like the Legacy Survey of Space and Time (LSST) on the Vera C. Rubin Observatory will generate orders of magnitude more discoveries of transients and variable stars than previous surveys. To prepare for this data deluge, we developed the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC), a competition which aimed to catalyze the development of robust classifiers under LSST-like conditions of a non-representative training set for a large photometric test set of imbalanced classes. Over 1,000 teams participated in PLAsTiCC, which was hosted in the Kaggle data science competition platform between Sep 28, 2018 and Dec 17, 2018, ultimately identifying three winners in February 2019. Participants produced classifiers employing a diverse set of machine learning techniques including hybrid combinations and ensemble averages of a range of approaches, among them boosted decision trees, neural networks, and multi-layer perceptrons. The strong performance of the top three classifiers on Type Ia supernovae and kilonovae represent a major improvement over the current state-of-the-art within astronomy. This paper summarizes the most promising methods and evaluates their results in detail, highlighting future directions both for classifier development and simulation needs for a next generation PLAsTiCC data set.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
CosmoDC2: A Synthetic Sky Catalog for Dark Energy Science with LSST
Authors:
Danila Korytov,
Andrew Hearin,
Eve Kovacs,
Patricia Larsen,
Esteban Rangel,
Joseph Hollowed,
Andrew J. Benson,
Katrin Heitmann,
Yao-Yuan Mao,
Anita Bahmanyar,
Chihway Chang,
Duncan Campbell,
Joseph Derose,
Hal Finkel,
Nicholas Frontiere,
Eric Gawiser,
Salman Habib,
Benjamin Joachimi,
François Lanusse,
Nan Li,
Rachel Mandelbaum,
Christopher Morrison,
Jeffrey A. Newman,
Adrian Pope,
Eli Rykoff
, et al. (5 additional authors not shown)
Abstract:
This paper introduces cosmoDC2, a large synthetic galaxy catalog designed to support precision dark energy science with the Large Synoptic Survey Telescope (LSST). CosmoDC2 is the starting point for the second data challenge (DC2) carried out by the LSST Dark Energy Science Collaboration (LSST DESC). The catalog is based on a trillion-particle, 4.225 Gpc^3 box cosmological N-body simulation, the `…
▽ More
This paper introduces cosmoDC2, a large synthetic galaxy catalog designed to support precision dark energy science with the Large Synoptic Survey Telescope (LSST). CosmoDC2 is the starting point for the second data challenge (DC2) carried out by the LSST Dark Energy Science Collaboration (LSST DESC). The catalog is based on a trillion-particle, 4.225 Gpc^3 box cosmological N-body simulation, the `Outer Rim' run. It covers 440 deg^2 of sky area to a redshift of z=3 and is complete to a magnitude depth of 28 in the r-band. Each galaxy is characterized by a multitude of properties including stellar mass, morphology, spectral energy distributions, broadband filter magnitudes, host halo information and weak lensing shear. The size and complexity of cosmoDC2 requires an efficient catalog generation methodology; our approach is based on a new hybrid technique that combines data-driven empirical approaches with semi-analytic galaxy modeling. A wide range of observation-based validation tests has been implemented to ensure that cosmoDC2 enables the science goals of the planned LSST DESC DC2 analyses. This paper also represents the official release of the cosmoDC2 data set, including an efficient reader that facilitates interaction with the data.
△ Less
Submitted 27 July, 2019; v1 submitted 15 July, 2019;
originally announced July 2019.
-
Testing Gravity Using Type Ia Supernovae Discovered by Next-Generation Wide-Field Imaging Surveys
Authors:
A. G. Kim,
G. Aldering,
P. Antilogus,
A. Bahmanyar,
S. BenZvi,
H. Courtois,
T. Davis,
H. Feldman,
S. Ferraro,
S. Gontcho A Gontcho,
O. Graur,
R. Graziani,
J. Guy,
C. Harper,
R. Hložek,
C. Howlett,
D. Huterer,
C. Ju,
P. -F. Leget,
E. V. Linder,
P. McDonald,
J. Nordin,
P. Nugent,
S. Perlmutter,
N. Regnault
, et al. (7 additional authors not shown)
Abstract:
In the upcoming decade cadenced wide-field imaging surveys will increase the number of identified $z<0.3$ Type~Ia supernovae (SNe~Ia) from the hundreds to the hundreds of thousands. The increase in the number density and solid-angle coverage of SNe~Ia, in parallel with improvements in the standardization of their absolute magnitudes, now make them competitive probes of the growth of structure and…
▽ More
In the upcoming decade cadenced wide-field imaging surveys will increase the number of identified $z<0.3$ Type~Ia supernovae (SNe~Ia) from the hundreds to the hundreds of thousands. The increase in the number density and solid-angle coverage of SNe~Ia, in parallel with improvements in the standardization of their absolute magnitudes, now make them competitive probes of the growth of structure and hence of gravity. The peculiar velocity power spectrum is sensitive to the growth index $γ$, which captures the effect of gravity on the linear growth of structure through the relation $f=Ω_M^γ$. We present the first projections for the precision in $γ$ for a range of realistic SN peculiar-velocity survey scenarios. In the next decade the peculiar velocities of SNe~Ia in the local $z<0.3$ Universe will provide a measure of $γ$ to $\pm 0.01$ precision that can definitively distinguish between General Relativity and leading models of alternative gravity.
△ Less
Submitted 18 March, 2019;
originally announced March 2019.
-
The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Data set
Authors:
The PLAsTiCC team,
Tarek Allam Jr.,
Anita Bahmanyar,
Rahul Biswas,
Mi Dai,
Lluís Galbany,
Renée Hložek,
Emille E. O. Ishida,
Saurabh W. Jha,
David O. Jones,
Richard Kessler,
Michelle Lochner,
Ashish A. Mahabal,
Alex I. Malz,
Kaisey S. Mandel,
Juan Rafael Martínez-Galarza,
Jason D. McEwen,
Daniel Muthukrishna,
Gautham Narayan,
Hiranya Peiris,
Christina M. Peters,
Kara Ponder,
Christian N. Setzer,
The LSST Dark Energy Science Collaboration,
The LSST Transients
, et al. (1 additional authors not shown)
Abstract:
The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering…
▽ More
The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering and measuring millions of time-varying objects.
In this challenge, we pose the question: how well can we classify objects in the sky that vary in brightness from simulated LSST time-series data, with all its challenges of non-representativity? In this note we explain the need for a data challenge to help classify such astronomical sources and describe the PLAsTiCC data set and Kaggle data challenge, noting that while the references are provided for context, they are not needed to participate in the challenge.
△ Less
Submitted 28 September, 2018;
originally announced October 2018.
-
The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Selection of a performance metric for classification probabilities balancing diverse science goals
Authors:
A. I. Malz,
R. Hložek,
T. Allam Jr,
A. Bahmanyar,
R. Biswas,
M. Dai,
L. Galbany,
E. E. O. Ishida,
S. W. Jha,
D. O. Jones,
R. Kessler,
M. Lochner,
A. A. Mahabal,
K. S. Mandel,
J. R. Martínez-Galarza,
J. D. McEwen,
D. Muthukrishna,
G. Narayan,
H. Peiris,
C. M. Peters,
K. A. Ponder,
C. N. Setzer,
The LSST Dark Energy Science Collaboration,
The LSST Transients,
Variable Stars Science Collaboration
Abstract:
Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic…
▽ More
Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic classification is more appropriate for the data but are incompatible with the traditional metrics used on deterministic classifications. Furthermore, large survey collaborations intend to use these classification probabilities for diverse science objectives, indicating a need for a metric that balances a variety of goals. We describe the process used to develop an optimal performance metric for an open classification challenge that seeks probabilistic classifications and must serve many scientific interests. The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC) is an open competition aiming to identify promising techniques for obtaining classification probabilities of transient and variable objects by engaging a broader community both within and outside astronomy. Using mock classification probability submissions emulating archetypes of those anticipated of PLAsTiCC, we compare the sensitivity of metrics of classification probabilities under various weighting schemes, finding that they yield qualitatively consistent results. We choose as a metric for PLAsTiCC a weighted modification of the cross-entropy because it can be meaningfully interpreted. Finally, we propose extensions of our methodology to ever more complex challenge goals and suggest some guiding principles for approaching the choice of a metric of probabilistic classifications.
△ Less
Submitted 31 July, 2021; v1 submitted 28 September, 2018;
originally announced September 2018.
-
The shape of the inner Milky Way halo from observations of the Pal 5 and GD-1 stellar streams
Authors:
Jo Bovy,
Anita Bahmanyar,
Tobias K. Fritz,
Nitya Kallivayalil
Abstract:
We constrain the shape of the Milky Way's halo by dynamical modeling of the observed phase-space tracks of the Pal 5 and GD-1 tidal streams. We find that the only information about the potential gleaned from the tracks of these streams are precise measurements of the shape of the gravitational potential---the ratio of vertical to radial acceleration---at the location of the streams, with weaker co…
▽ More
We constrain the shape of the Milky Way's halo by dynamical modeling of the observed phase-space tracks of the Pal 5 and GD-1 tidal streams. We find that the only information about the potential gleaned from the tracks of these streams are precise measurements of the shape of the gravitational potential---the ratio of vertical to radial acceleration---at the location of the streams, with weaker constraints on the radial and vertical accelerations separately. The latter will improve significantly with precise proper-motion measurements from Gaia. We measure that the overall potential flattening is 0.95 +/- 0.04 at the location of GD-1 ([R,z] ~ [12.5,6.7] kpc) and 0.94 +/- 0.05 at the position of Pal 5 ([R,z] ~ [8.4,16.8] kpc). Combined with constraints on the force field near the Galactic disk, we determine that the axis ratio of the dark-matter halo's density distribution is 1.05 +/- 0.14 within the inner 20 kpc, with a hint that the halo becomes more flattened near the edge of this volume. The halo mass within 20 kpc is 1.1 +/- 0.1 x 10^{11} M_sun. A dark-matter halo this close to spherical is in tension with the predictions from numerical simulations of the formation of dark-matter halos.
△ Less
Submitted 9 February, 2017; v1 submitted 5 September, 2016;
originally announced September 2016.
