Showing 1–22 of 22 results for author: Kalmbach, J B

Probabilistic Forward Modeling of Galaxy Catalogs with Normalizing Flows

Authors: John Franklin Crenshaw, J. Bryce Kalmbach, Alexander Gagliano, Ziang Yan, Andrew J. Connolly, Alex I. Malz, Samuel J. Schmidt, The LSST Dark Energy Science Collaboration

Abstract: Evaluating the accuracy and calibration of the redshift posteriors produced by photometric redshift (photo-z) estimators is vital for enabling precision cosmology and extragalactic astrophysics with modern wide-field photometric surveys. Evaluating photo-z posteriors on a per-galaxy basis is difficult, however, as real galaxies have a true redshift but not a true redshift posterior. We introduce P… ▽ More Evaluating the accuracy and calibration of the redshift posteriors produced by photometric redshift (photo-z) estimators is vital for enabling precision cosmology and extragalactic astrophysics with modern wide-field photometric surveys. Evaluating photo-z posteriors on a per-galaxy basis is difficult, however, as real galaxies have a true redshift but not a true redshift posterior. We introduce PZFlow, a Python package for the probabilistic forward modeling of galaxy catalogs with normalizing flows. For catalogs simulated with PZFlow, there is a natural notion of "true" redshift posteriors that can be used for photo-z validation. We use PZFlow to simulate a photometric galaxy catalog where each galaxy has a redshift, noisy photometry, shape information, and a true redshift posterior. We also demonstrate the use of an ensemble of normalizing flows for photo-z estimation. We discuss how PZFlow will be used to validate the photo-z estimation pipeline of the Dark Energy Science Collaboration (DESC), and the wider applicability of PZFlow for statistical modeling of any tabular data. △ Less

Submitted 7 May, 2024; originally announced May 2024.

Comments: 19 pages, 13 figures, submitted to AJ

Using AI for Wavefront Estimation with the Rubin Observatory Active Optics System

Authors: John Franklin Crenshaw, Andrew J. Connolly, Joshua E. Meyers, J. Bryce Kalmbach, Guillem Megias Homar, Tiago Ribeiro, Krzysztof Suberlak, Sandrine Thomas, Te-wei Tsai

Abstract: The Vera C. Rubin Observatory will, over a period of 10 years, repeatedly survey the southern sky. To ensure that images generated by Rubin meet the quality requirements for precision science, the observatory will use an Active Optics System (AOS) to correct for alignment and mirror surface perturbations introduced by gravity and temperature gradients in the optical system. To accomplish this Rubi… ▽ More The Vera C. Rubin Observatory will, over a period of 10 years, repeatedly survey the southern sky. To ensure that images generated by Rubin meet the quality requirements for precision science, the observatory will use an Active Optics System (AOS) to correct for alignment and mirror surface perturbations introduced by gravity and temperature gradients in the optical system. To accomplish this Rubin will use out-of-focus images from sensors located at the edge of the focal plane to learn and correct for perturbations to the wavefront. We have designed and integrated a deep learning model for wavefront estimation into the AOS pipeline. In this paper, we compare the performance of this deep learning approach to Rubin's baseline algorithm when applied to images from two different simulations of the Rubin optical system. We show the deep learning approach is faster and more accurate, achieving the atmospheric error floor both for high-quality images, and low-quality images with heavy blending and vignetting. Compared to the baseline algorithm, the deep learning model is 40x faster, the median error 2x better under ideal conditions, 5x better in the presence of vignetting by the Rubin camera, and 14x better in the presence of blending in crowded fields. In addition, the deep learning model surpasses the required optical quality in simulations of the AOS closed loop. This system promises to increase the survey area useful for precision science by up to 8%. We discuss how this system might be deployed when commissioning and operating Rubin. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Comments: 24 pages, 21 figures

Journal ref: AJ 167 86 (2024)

The DECam Ecliptic Exploration Project (DEEP) VI: first multi-year observations of trans-Neptunian objects

Authors: Hayden Smotherman, Pedro H. Bernardinelli, Stephen K. N. Portillo, Andrew J. Connolly, J. Bryce Kalmbach, Steven Stetzler, Mario Juric, Dino Bektesvic, Zachary Langford, Fred C. Adams, William J. Oldroyd, Matthew J. Holman, Colin Orion Chandler, Cesar Fuentes, David W. Gerdes, Hsing Wen Lin, Larissa Markwardt, Andrew McNeill, Michael Mommert, Kevin J. Napier, Matthew J. Payne, Darin Ragozzine, Andrew S. Rivkin, Hilke Schlichting, Scott S. Sheppard , et al. (3 additional authors not shown)

Abstract: We present the first set of trans-Neptunian objects (TNOs) observed on multiple nights in data taken from the DECam Ecliptic Exploration Project (DEEP). Of these 110 TNOs, 105 do not coincide with previously known TNOs and appear to be new discoveries. Each individual detection for our objects resulted from a digital tracking search at TNO rates of motion, using two to four hour exposure sets, and… ▽ More We present the first set of trans-Neptunian objects (TNOs) observed on multiple nights in data taken from the DECam Ecliptic Exploration Project (DEEP). Of these 110 TNOs, 105 do not coincide with previously known TNOs and appear to be new discoveries. Each individual detection for our objects resulted from a digital tracking search at TNO rates of motion, using two to four hour exposure sets, and the detections were subsequently linked across multiple observing seasons. This procedure allows us to find objects with magnitudes $m_{VR} \approx 26$. The object discovery processing also included a comprehensive population of objects injected into the images, with a recovery and linking rate of at least $94\%$. The final orbits were obtained using a specialized orbit fitting procedure that accounts for the positional errors derived from the digital tracking procedure. Our results include robust orbits and magnitudes for classical TNOs with absolute magnitudes $H \sim 10$, as well as a dynamically detached object found at 76 au (semi-major axis $a\approx 77 \, \mathrm{au}$). We find a disagreement between our population of classical TNOs and the CFEPS-L7 three component model for the Kuiper belt. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: Accepted to AJ, companion paper do DEEP III. Objects will be released in the journal version (or contacting the authors)

The DECam Ecliptic Exploration Project (DEEP) III: Survey characterization and simulation methods

Authors: Pedro H. Bernardinelli, Hayden Smotherman, Zachary Langford, Stephen K. N. Portillo, Andrew J. Connolly, J. Bryce Kalmbach, Steven Stetzler, Mario Juric, William J. Oldroyd, Hsing Wen Lin, Fred C. Adams, Colin Orion Chandler, Cesar Fuentes, David W. Gerdes, Matthew J. Holman, Larissa Markwardt, Andrew McNeill, Michael Mommert, Kevin J. Napier, Matthew J. Payne, Darin Ragozzine, Andrew S. Rivkin, Hilke Schlichting, Scott S. Sheppard, Ryder Strauss , et al. (2 additional authors not shown)

Abstract: We present a detailed study of the observational biases of the DECam Ecliptic Exploration Project's (DEEP) B1 data release and survey simulation software that enables direct statistical comparisons between models and our data. We inject a synthetic population of objects into the images, and then subsequently recover them in the same processing as our real detections. This enables us to characteriz… ▽ More We present a detailed study of the observational biases of the DECam Ecliptic Exploration Project's (DEEP) B1 data release and survey simulation software that enables direct statistical comparisons between models and our data. We inject a synthetic population of objects into the images, and then subsequently recover them in the same processing as our real detections. This enables us to characterize the survey's completeness as a function of apparent magnitudes and on-sky rates of motion. We study the statistically optimal functional form for the magnitude, and develop a methodology that can estimate the magnitude and rate efficiencies for all survey's pointing groups simultaneously. We have determined that our peak completeness is on average 80\% in each pointing group, and our magnitude drops to $25\%$ of this value at $m_{25} = 26.22$. We describe the freely available survey simulation software and its methodology. We conclude by using it to infer that our effective search area for objects at 40 au is $14.8°^2$, and that our lack of dynamically cold distant objects means that there at most $8\times 10^3$ objects with $60 < a < 80$ au and absolute magnitudes $H \leq 8$. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: Accepted to AJ, companion paper to DEEP VI

The DECam Ecliptic Exploration Project (DEEP): V. The Absolute Magnitude Distribution of the Cold Classical Kuiper Belt

Authors: Kevin J. Napier, Hsing-Wen Lin, David W. Gerdes, Fred C. Adams, Anna M. Simpson, Matthew W. Porter, Katherine G. Weber, Larissa Markwardt, Gabriel Gowman, Hayden Smotherman, Pedro H. Bernardinelli, Mario Jurić, Andrew J. Connolly, J. Bryce Kalmbach, Stephen K. N. Portillo, David E. Trilling, Ryder Strauss, William J. Oldroyd, Chadwick A. Trujillo, Colin Orion Chandler, Matthew J. Holman, Hilke E. Schlichting, Andrew McNeill, the DEEP Collaboration

Abstract: The DECam Ecliptic Exploration Project (DEEP) is a deep survey of the trans-Neptunian solar system being carried out on the 4-meter Blanco telescope at Cerro Tololo Inter-American Observatory in Chile using the Dark Energy Camera (DECam). By using a shift-and-stack technique to achieve a mean limiting magnitude of $r \sim 26.2$, DEEP achieves an unprecedented combination of survey area and depth,… ▽ More The DECam Ecliptic Exploration Project (DEEP) is a deep survey of the trans-Neptunian solar system being carried out on the 4-meter Blanco telescope at Cerro Tololo Inter-American Observatory in Chile using the Dark Energy Camera (DECam). By using a shift-and-stack technique to achieve a mean limiting magnitude of $r \sim 26.2$, DEEP achieves an unprecedented combination of survey area and depth, enabling quantitative leaps forward in our understanding of the Kuiper Belt populations. This work reports results from an analysis of twenty 3 sq.\ deg.\ DECam fields along the invariable plane. We characterize the efficiency and false-positive rates for our moving-object detection pipeline, and use this information to construct a Bayesian signal probability for each detected source. This procedure allows us to treat all of our Kuiper Belt Object (KBO) detections statistically, simultaneously accounting for efficiency and false positives. We detect approximately 2300 candidate sources with KBO-like motion at S/N $>6.5$. We use a subset of these objects to compute the luminosity function of the Kuiper Belt as a whole, as well as the Cold Classical (CC) population. We also investigate the absolute magnitude ($H$) distribution of the CCs, and find consistency with both an exponentially tapered power-law, which is predicted by streaming instability models of planetesimal formation, and a rolling power law. Finally, we provide an updated mass estimate for the Cold Classical Kuiper Belt of $M_{CC}(H_r < 12) = 0.0017^{+0.0010}_{-0.0004} M_{\oplus}$, assuming albedo $p = 0.15$ and density $ρ= 1$ g cm$^{-3}$. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: Accepted by PSJ

Stellar Karaoke: deep blind separation of terrestrial atmospheric effects out of stellar spectra by velocity whitening

Authors: Nima Sedaghat, Brianna M. Smart, J. Bryce Kalmbach, Erin L. Howard, Hamidreza Amindavar

Abstract: We report a study exploring how the use of deep neural networks with astronomical Big Data may help us find and uncover new insights into underlying phenomena: through our experiments towards unsupervised knowledge extraction from astronomical Big Data we serendipitously found that deep convolutional autoencoders tend to reject telluric lines in stellar spectra. With further experiments we found t… ▽ More We report a study exploring how the use of deep neural networks with astronomical Big Data may help us find and uncover new insights into underlying phenomena: through our experiments towards unsupervised knowledge extraction from astronomical Big Data we serendipitously found that deep convolutional autoencoders tend to reject telluric lines in stellar spectra. With further experiments we found that only when the spectra are in the barycentric frame does the network automatically identify the statistical independence between two components, stellar vs telluric, and rejects the latter. We exploit this finding and turn it into a proof-of-concept method for removal of the telluric lines from stellar spectra in a fully unsupervised fashion: we increase the inter-observation entropy of telluric absorption lines by imposing a random, virtual radial velocity to the observed spectrum. This technique results in a non-standard form of ``whitening'' in the atmospheric components of the spectrum, decorrelating them across multiple observations. We process more than 250,000 spectra from the High Accuracy Radial velocity Planetary Search (HARPS) and with qualitative and quantitative evaluations against a database of known telluric lines, show that most of the telluric lines are successfully rejected. Our approach, `Stellar Karaoke', has zero need for prior knowledge about parameters such as observation time, location, or the distribution of atmospheric molecules and processes each spectrum in milliseconds. We also train and test on Sloan Digital Sky Survey (SDSS) and see a significant performance drop due to the low resolution. We discuss directions for develo** tools on top of the introduced method in the future. △ Less

Submitted 6 November, 2023; v1 submitted 31 December, 2022; originally announced January 2023.

Journal ref: MNRAS, 526(1):1559-1572, 2023

Deep Drilling in the Time Domain with DECam: Survey Characterization

Authors: Melissa L. Graham, Robert A. Knop, Thomas Kennedy, Peter E. Nugent, Eric Bellm, Márcio Catelan, Avi Patel, Hayden Smotherman, Monika Soraisam, Steven Stetzler, Lauren N. Aldoroty, Autumn Awbrey, Karina Baeza-Villagra, Pedro H. Bernardinelli, Federica Bianco, Dillon Brout, Riley Clarke, William I. Clarkson, Thomas Collett, James R. A. Davenport, Shenming Fu, John E. Gizis, Ari Heinze, Lei Hu, Saurabh W. Jha , et al. (19 additional authors not shown)

Abstract: This paper presents a new optical imaging survey of four deep drilling fields (DDFs), two Galactic and two extragalactic, with the Dark Energy Camera (DECam) on the 4 meter Blanco telescope at the Cerro Tololo Inter-American Observatory (CTIO). During the first year of observations in 2021, $>$4000 images covering 21 square degrees (7 DECam pointings), with $\sim$40 epochs (nights) per field and 5… ▽ More This paper presents a new optical imaging survey of four deep drilling fields (DDFs), two Galactic and two extragalactic, with the Dark Energy Camera (DECam) on the 4 meter Blanco telescope at the Cerro Tololo Inter-American Observatory (CTIO). During the first year of observations in 2021, $>$4000 images covering 21 square degrees (7 DECam pointings), with $\sim$40 epochs (nights) per field and 5 to 6 images per night per filter in $g$, $r$, $i$, and/or $z$, have become publicly available (the proprietary period for this program is waived). We describe the real-time difference-image pipeline and how alerts are distributed to brokers via the same distribution system as the Zwicky Transient Facility (ZTF). In this paper, we focus on the two extragalactic deep fields (COSMOS and ELAIS-S1), characterizing the detected sources and demonstrating that the survey design is effective for probing the discovery space of faint and fast variable and transient sources. We describe and make publicly available 4413 calibrated light curves based on difference-image detection photometry of transients and variables in the extragalactic fields. We also present preliminary scientific analysis regarding Solar System small bodies, stellar flares and variables, Galactic anomaly detection, fast-rising transients and variables, supernovae, and active galactic nuclei. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Comments: 22 pages, 17 figures, 2 tables. Accepted to MNRAS

Analysis of Ring Galaxies Detected Using Deep Learning with Real and Simulated Data

Authors: Harish Krishnakumar, J. Bryce Kalmbach

Abstract: Understanding the formation and evolution of ring galaxies, galaxies with an atypical ring-like structure, will improve understanding of black holes and galaxy dynamics as a whole. Current catalogs of rings are extremely limited: manual analysis takes months to accumulate an appreciable sample of rings and existing computational methods are vastly limited in terms of accuracy and detection rate. W… ▽ More Understanding the formation and evolution of ring galaxies, galaxies with an atypical ring-like structure, will improve understanding of black holes and galaxy dynamics as a whole. Current catalogs of rings are extremely limited: manual analysis takes months to accumulate an appreciable sample of rings and existing computational methods are vastly limited in terms of accuracy and detection rate. Without a sizable sample of rings, further research into their properties is severely restricted. This project investigates the usage of a convolutional neural network (CNN) to identify rings from unclassified samples of galaxies. A CNN was trained on a sample of 100,000 simulated galaxies, transfer learned to a sample of real galaxies and applied to a previously unclassified dataset to generate a catalog of rings which was then manually verified. Data augmentation with a generative adversarial network (GAN) to simulate images of galaxies was also used. A catalog of 1151 rings was extracted with 7.4 times the precision and 15.4 times the detection rate of conventional algorithms. The properties of these galaxies were then estimated from their photometry and compared to the Galaxy Zoo 2 catalog of rings. With upcoming surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time obtaining images of billions of galaxies, similar models could be crucial in classifying large populations of rings to better understand the peculiar mechanisms by which they form and evolve. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: 15 pages, 16 figures. Submitted to AJ

The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package

Authors: The Astropy Collaboration, Adrian M. Price-Whelan, Pey Lian Lim, Nicholas Earl, Nathaniel Starkman, Larry Bradley, David L. Shupe, Aarya A. Patil, Lia Corrales, C. E. Brasseur, Maximilian Nöthe, Axel Donath, Erik Tollerud, Brett M. Morris, Adam Ginsburg, Eero Vaher, Benjamin A. Weaver, James Tocknell, William Jamieson, Marten H. van Kerkwijk, Thomas P. Robitaille, Bruce Merry, Matteo Bachetti, H. Moritz Günther, Thomas L. Aldcroft , et al. (111 additional authors not shown)

Abstract: The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as… ▽ More The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as of the recent major release, version 5.0, and provide major updates for the Project. We then discuss supporting a broader ecosystem of interoperable packages, including connections with several astronomical observatories and missions. We also revisit the future outlook of the Astropy Project and the current status of Learn Astropy. We conclude by raising and discussing the current and future challenges facing the Project. △ Less

Submitted 28 June, 2022; originally announced June 2022.

Comments: 43 pages, 5 figures. To appear in ApJ. The author list has two parts: the authors that made significant contributions to the writing and/or coordination of the paper, followed by maintainers of and contributors to the Astropy Project. The position in the author list does not correspond to contributions to the Astropy Project as a whole

Sifting Through the Static: Moving Object Detection in Difference Images

Authors: Hayden Smotherman, Andrew J. Connolly, J. Bryce Kalmbach, Stephen K. N. Portillo, Dino Bektesevic, Siegfried Eggl, Mario Juric, Joachim Moeyens, Peter J. Whidden

Abstract: Trans-Neptunian Objects (TNOs) provide a window into the history of the Solar System, but they can be challenging to observe due to their distance from the Sun and relatively low brightness. Here we report the detection of 75 moving objects that we could not link to any other known objects, the faintest of which has a VR magnitude of $25.02 \pm 0.93$ using the KBMOD platform. We recover an additio… ▽ More Trans-Neptunian Objects (TNOs) provide a window into the history of the Solar System, but they can be challenging to observe due to their distance from the Sun and relatively low brightness. Here we report the detection of 75 moving objects that we could not link to any other known objects, the faintest of which has a VR magnitude of $25.02 \pm 0.93$ using the KBMOD platform. We recover an additional 24 sources with previously-known orbits. We place constraints on the barycentric distance, inclination, and longitude of ascending node of these objects. The unidentified objects have a median barycentric distance of 41.28 au, placing them in the outer Solar System. The observed inclination and magnitude distribution of all detected objects is consistent with previously published KBO distributions. We describe extensions to KBMOD, including a robust percentile-based lightcurve filter, an in-line graphics processing unit (GPU) filter, new coadded stamp generation, and a convolutional neural network (CNN) stamp filter, which allow KBMOD to take advantage of difference images. These enchancements mark a significant improvement in the readiness of KBMOD for deployment on future big data surveys such as LSST. △ Less

Submitted 7 September, 2021; originally announced September 2021.

Comments: Accepted: Astronomical Journal

THOR: An Algorithm for Cadence-Independent Asteroid Discovery

Authors: Joachim Moeyens, Mario Juric, Jes Ford, Dino Bektesevic, Andrew J. Connolly, Siegfried Eggl, Željko Ivezić, R. Lynne Jones, J. Bryce Kalmbach, Hayden Smotherman

Abstract: We present "Tracklet-less Heliocentric Orbit Recovery" (THOR), an algorithm for linking of observations of Solar System objects across multiple epochs that does not require intra-night tracklets or a predefined cadence of observations within a search window. By sparsely covering regions of interest in the phase space with "test orbits", transforming nearby observations over a few nights into the c… ▽ More We present "Tracklet-less Heliocentric Orbit Recovery" (THOR), an algorithm for linking of observations of Solar System objects across multiple epochs that does not require intra-night tracklets or a predefined cadence of observations within a search window. By sparsely covering regions of interest in the phase space with "test orbits", transforming nearby observations over a few nights into the co-rotating frame of the test orbit at each epoch, and then performing a generalized Hough transform on the transformed detections followed by orbit determination (OD) filtering, candidate clusters of observations belonging to the same objects can be recovered at moderate computational cost and little to no constraints on cadence. We validate the effectiveness of this approach by running on simulations as well as on real data from the Zwicky Transient Facility (ZTF). Applied to a short, 2-week, slice of ZTF observations, we demonstrate THOR can recover 97.4% of all previously known and discoverable objects in the targeted ($a > 1.7$ au) population with 5 or more observations and with purity between 97.7% and 100%. This includes 10 likely new discoveries, and a recovery of an $e \sim 1$ comet C/2018 U1 (the comet would have been a ZTF discovery had THOR been running in 2018 when the data were taken). The THOR package and demo Jupyter notebooks are open source and available at https://github.com/moeyensj/thor. △ Less

Submitted 3 May, 2021; originally announced May 2021.

Comments: 22 pages, 11 figures

DESC DC2 Data Release Note

Authors: LSST Dark Energy Science Collaboration, Bela Abolfathi, Robert Armstrong, Humna Awan, Yadu N. Babuji, Franz Erik Bauer, George Beckett, Rahul Biswas, Joanne R. Bogart, Dominique Boutigny, Kyle Chard, James Chiang, Johann Cohen-Tanugi, Andrew J. Connolly, Scott F. Daniel, Seth W. Digel, Alex Drlica-Wagner, Richard Dubois, Eric Gawiser, Thomas Glanzman, Salman Habib, Andrew P. Hearin, Katrin Heitmann, Fabio Hernandez, Renée Hložek , et al. (32 additional authors not shown)

Abstract: In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with th… ▽ More In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with the LSST Science Pipelines (19.0.0). In this Note, we describe the public data release of the resulting object catalogs for the coadded images of five years of simulated observations along with associated truth catalogs. We include a brief description of the major features of the available data sets. To enable convenient access to the data products, we have developed a web portal connected to Globus data services. We describe how to access the data and provide example Jupyter Notebooks in Python to aid first interactions with the data. We welcome feedback and questions about the data release via a GitHub repository. △ Less

Submitted 13 June, 2022; v1 submitted 12 January, 2021; originally announced January 2021.

Comments: 25 pages, 3 figures; 9 tables. A detailed changelog can be found in Appendix A. To obtain data, visit the DESC Data Portal at https://data.lsstdesc.org/

The LSST DESC DC2 Simulated Sky Survey

Authors: LSST Dark Energy Science Collaboration, Bela Abolfathi, David Alonso, Robert Armstrong, Éric Aubourg, Humna Awan, Yadu N. Babuji, Franz Erik Bauer, Rachel Bean, George Beckett, Rahul Biswas, Joanne R. Bogart, Dominique Boutigny, Kyle Chard, James Chiang, Chuck F. Claver, Johann Cohen-Tanugi, Céline Combet, Andrew J. Connolly, Scott F. Daniel, Seth W. Digel, Alex Drlica-Wagner, Richard Dubois, Emmanuel Gangler, Eric Gawiser , et al. (55 additional authors not shown)

Abstract: We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses… ▽ More We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep (WFD) area of approximately 300 deg^2 as well as a deep drilling field (DDF) of approximately 1 deg^2. We simulate 5 years of the planned 10-year survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the dataset to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic testbed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time-domain cosmology. △ Less

Submitted 26 January, 2021; v1 submitted 12 October, 2020; originally announced October 2020.

Comments: 39 pages, 19 figures, version accepted for publication in ApJS

Photometric Redshifts with the LSST II: The Impact of Near-Infrared and Near-Ultraviolet Photometry

Authors: Melissa L. Graham, Andrew J. Connolly, Winnie Wang, Samuel J. Schmidt, Christopher B. Morrison, Željko Ivezić, Sébastien Fabbro, Patrick Côté, Scott F. Daniel, R. Lynne Jones, Mario Jurić, Peter Yoachim, J. Bryce Kalmbach

Abstract: Accurate photometric redshift (photo-$z$) estimates are essential to the cosmological science goals of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). In this work we use simulated photometry for mock galaxy catalogs to explore how LSST photo-$z$ estimates can be improved by the addition of near-infrared (NIR) and/or ultraviolet (UV) photometry from the Euclid, WFIRST, and/or… ▽ More Accurate photometric redshift (photo-$z$) estimates are essential to the cosmological science goals of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). In this work we use simulated photometry for mock galaxy catalogs to explore how LSST photo-$z$ estimates can be improved by the addition of near-infrared (NIR) and/or ultraviolet (UV) photometry from the Euclid, WFIRST, and/or CASTOR space telescopes. Generally, we find that deeper optical photometry can reduce the standard deviation of the photo-$z$ estimates more than adding NIR or UV filters, but that additional filters are the only way to significantly lower the fraction of galaxies with catastrophically under- or over-estimated photo-$z$. For Euclid, we find that the addition of ${JH}$ $5σ$ photometric detections can reduce the standard deviation for galaxies with $z>1$ ($z>0.3$) by ${\sim}20\%$ (${\sim}10\%$), and the fraction of outliers by ${\sim}40\%$ (${\sim}25\%$). For WFIRST, we show how the addition of deep ${YJHK}$ photometry could reduce the standard deviation by ${\gtrsim}50\%$ at $z>1.5$ and drastically reduce the fraction of outliers to just ${\sim}2\%$ overall. For CASTOR, we find that the addition of its ${UV}$ and $u$-band photometry could reduce the standard deviation by ${\sim}30\%$ and the fraction of outliers by ${\sim}50\%$ for galaxies with $z<0.5$. We also evaluate the photo-$z$ results within sky areas that overlap with both the NIR and UV surveys, and when spectroscopic training sets built from the surveys' small-area deep fields are used. △ Less

Submitted 16 April, 2020; originally announced April 2020.

Comments: 21 pages, 16 figures, 4 tables, accepted to AJ

Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Authors: S. J. Schmidt, A. I. Malz, J. Y. H. Soo, I. A. Almosallam, M. Brescia, S. Cavuoti, J. Cohen-Tanugi, A. J. Connolly, J. DeRose, P. E. Freeman, M. L. Graham, K. G. Iyer, M. J. Jarvis, J. B. Kalmbach, E. Kovacs, A. B. Lee, G. Longo, C. B. Morrison, J. A. Newman, E. Nourbakhsh, E. Nuss, T. Pospisil, H. Tranin, R. H. Wechsler, R. Zhou , et al. (2 additional authors not shown)

Abstract: Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive exper… ▽ More Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced for The Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. We report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performancemetrics. △ Less

Submitted 31 July, 2021; v1 submitted 10 January, 2020; originally announced January 2020.

Journal ref: MNRAS 499 2 1587 (2020)

Applying Information Theory to Design Optimal Filters for Photometric Redshifts

Authors: J. Bryce Kalmbach, Jacob T. VanderPlas, Andrew J. Connolly

Abstract: In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wav… ▽ More In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wavelengths that optimize photometric redshifts for $z <= 2.3$ and $i < 25.3$. We create a simulated catalog for these optimal filters and use our filters with a photometric redshift estimation code to show that we can improve the standard deviation of the photometric redshift error by 7.1% overall and improve outliers 9.9% over the standard filters proposed for the Large Synoptic Survey Telescope (LSST). We compare features of our optimal filters to LSST and find that the LSST filters incorporate key features for optimal photometric redshift estimation. Finally, we describe how information theory can be applied to a range of optimization problems in astronomy. △ Less

Submitted 5 January, 2020; originally announced January 2020.

Comments: 29 pages, 17 figures, accepted to ApJ

Enabling Deep All-Sky Searches of Outer Solar System Objects

Authors: Mario Jurić, R. Lynne Jones, J. Bryce Kalmbach, Peter Whidden, Dino Bektešević, Hayden Smotherman, Joachim Moeyens, Andrew J. Connolly, Michele T. Bannister, Wesley Fraser, David Gerdes, Michael Mommert, Darin Ragozzine, Megan E. Schwamb, David Trilling

Abstract: A foundational goal of the Large Synoptic Survey Telescope (LSST) is to map the Solar System small body populations that provide key windows into understanding of its formation and evolution. This is especially true of the populations of the Outer Solar System -- objects at the orbit of Neptune $r > 30$AU and beyond. In this whitepaper, we propose a minimal change to the LSST cadence that can grea… ▽ More A foundational goal of the Large Synoptic Survey Telescope (LSST) is to map the Solar System small body populations that provide key windows into understanding of its formation and evolution. This is especially true of the populations of the Outer Solar System -- objects at the orbit of Neptune $r > 30$AU and beyond. In this whitepaper, we propose a minimal change to the LSST cadence that can greatly enhance LSST's ability to discover faint distant Solar System objects across the entire wide-fast-deep (WFD) survey area. Specifically, we propose that the WFD cadence be constrained so as to deliver least one sequence of $\gtrsim 10$ visits per year taken in a $\sim 10$ day period in any combination of $g, r$, and $i$ bands. Combined with advanced shift-and-stack algorithms (Whidden et al. 2019) this modification would enable a nearly complete census of the outer Solar System to $\sim 25.5$ magnitude, yielding $4-8$x more KBO discoveries than with single-epoch baseline, and enabling rapid identification and follow-up of unusual distant Solar System objects in $\gtrsim 5$x greater volume of space. These increases would enhance the science cases discussed in Schwamb et al. (2018) whitepaper, including probing Neptune's past migration history as well as discovering hypothesized planet(s) beyond the orbit of Neptune (or at least placing significant constraints on their existence). △ Less

Submitted 24 January, 2019; originally announced January 2019.

Comments: White Paper submitted in response to the Call for LSST Cadence Optimization White Papers

Fast algorithms for slow moving asteroids: constraints on the distribution of Kuiper Belt Objects

Authors: Peter J. Whidden, J. Bryce Kalmbach, Andrew J. Connolly, R. Lynne Jones, Hayden Smotherman, Dino Bektesevic, Colin Slater, Andrew C. Becker, Željko Ivezić, Mario Jurić, Bryce Bolin, Joachim Moeyens, Francisco Förster, V. Zach Golkhou

Abstract: We introduce a new computational technique for searching for faint moving sources in astronomical images. Starting from a maximum likelihood estimate for the probability of the detection of a source within a series of images, we develop a massively parallel algorithm for searching through candidate asteroid trajectories that utilizes Graphics Processing Units (GPU). This technique can search over… ▽ More We introduce a new computational technique for searching for faint moving sources in astronomical images. Starting from a maximum likelihood estimate for the probability of the detection of a source within a series of images, we develop a massively parallel algorithm for searching through candidate asteroid trajectories that utilizes Graphics Processing Units (GPU). This technique can search over 10^10 possible asteroid trajectories in stacks of the order 10-15 4K x 4K images in under a minute using a single consumer grade GPU. We apply this algorithm to data from the 2015 campaign of the High Cadence Transient Survey (HiTS) obtained with the Dark Energy Camera (DECam). We find 39 previously unknown Kuiper Belt Objects in the 150 square degrees of the survey. Comparing these asteroids to an existing model for the inclination distribution of the Kuiper Belt we demonstrate that we recover a KBO population above our detection limit consistent with previous studies. Software used in this analysis is made available as an open source package. △ Less

Submitted 8 January, 2019; originally announced January 2019.

Comments: Accepted to AJ

Estimating Spectra from Photometry

Authors: J. Bryce Kalmbach, Andrew J. Connolly

Abstract: Measuring the physical properties of galaxies such as redshift frequently requires the use of Spectral Energy Distributions (SEDs). SED template sets are, however, often small in number and cover limited portions of photometric color space. Here we present a new method to estimate SEDs as a function of color from a small training set of template SEDs. We first cover the mathematical background beh… ▽ More Measuring the physical properties of galaxies such as redshift frequently requires the use of Spectral Energy Distributions (SEDs). SED template sets are, however, often small in number and cover limited portions of photometric color space. Here we present a new method to estimate SEDs as a function of color from a small training set of template SEDs. We first cover the mathematical background behind the technique before demonstrating our ability to reconstruct spectra based upon colors and then compare to other common interpolation and extrapolation methods. When the photometric filters and spectra overlap we show reduction of error in the estimated spectra of over 65% compared to the more commonly used techniques. We also show an expansion of the method to wavelengths beyond the range of the photometric filters. Finally, we demonstrate the usefulness of our technique by generating 50 additional SED templates from an original set of 10 and applying the new set to photometric redshift estimation. We are able to reduce the photometric redshifts standard deviation by at least 22.0% and the outlier rejected bias by over 86.2% compared to original set for z $\leq$ 3. △ Less

Submitted 6 November, 2017; originally announced November 2017.

Comments: 23 pages, 9 figures, accepted to AJ

DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs

Authors: Yao-Yuan Mao, Eve Kovacs, Katrin Heitmann, Thomas D. Uram, Andrew J. Benson, Duncan Campbell, Sofía A. Cora, Joseph DeRose, Tiziana Di Matteo, Salman Habib, Andrew P. Hearin, J. Bryce Kalmbach, K. Simon Krughoff, François Lanusse, Zarija Lukić, Rachel Mandelbaum, Jeffrey A. Newman, Nelson Padilla, Enrique Paillas, Adrian Pope, Paul M. Ricker, Andrés N. Ruiz, Ananth Tenneti, Cristian Vega-Martínez, Risa H. Wechsler , et al. (2 additional authors not shown)

Abstract: The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline developm… ▽ More The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs. △ Less

Submitted 8 February, 2018; v1 submitted 27 September, 2017; originally announced September 2017.

Comments: 16+4 pages, 9 figures, 2+1 tables. Published in the ApJ Supplement. Code repository at https://github.com/LSSTDESC/descqa

Journal ref: ApJS (2018), 234, 36

The LSST Data Management System

Authors: Mario Jurić, Jeffrey Kantor, K-T Lim, Robert H. Lupton, Gregory Dubois-Felsmann, Tim Jenness, Tim S. Axelrod, Jovan Aleksić, Roberta A. Allsman, Yusra AlSayyad, Jason Alt, Robert Armstrong, Jim Basney, Andrew C. Becker, Jacek Becla, Steven J. Bickerton, Rahul Biswas, James Bosch, Dominique Boutigny, Matias Carrasco Kind, David R. Ciardi, Andrew J. Connolly, Scott F. Daniel, Gregory E. Daues, Frossie Economou , et al. (40 additional authors not shown)

Abstract: The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pachón in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide… ▽ More The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pachón in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is develo** a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline. △ Less

Submitted 24 December, 2015; originally announced December 2015.

Comments: 10 pages, 3 figures, to appear in the Proceedings of ADASS XXV

Segregation and Stability of Binary Granular Mixtures

Authors: A. G. Swartz, J. B. Kalmbach, J. Olson, R. J. Zieve

Abstract: We measure stability of two-dimensional granular mixtures in a rotating drum and relate grain configurations to stability. For our system, the smaller but smoother grains cluster near the center of the drum, while the larger, rougher grains remain near the outer edge. One consequence of the size segregation is that the smaller grains heavily influence the stability of the heap. We find that the… ▽ More We measure stability of two-dimensional granular mixtures in a rotating drum and relate grain configurations to stability. For our system, the smaller but smoother grains cluster near the center of the drum, while the larger, rougher grains remain near the outer edge. One consequence of the size segregation is that the smaller grains heavily influence the stability of the heap. We find that the maximum angle of stability is a non-linear function of composition, changing particularly rapidly when small grains are first added to a homogeneous pile of large grains. We conclude that the grain configuration within the central portion of the heap plays a prominent role in stability. △ Less

Submitted 6 June, 2007; originally announced June 2007.

Comments: 7 pages, 7 figures