-
Software Architecture and System Design of Rubin Observatory
Authors:
William O'Mullane,
Frossie Economou,
Kian-Tat Lim,
Fritz Mueller,
Tim Jenness,
Gregory P. Dubois-Felsmann,
Leanne P. Guy,
Ian S. Sullivan,
Yusra AlSayyad,
John D. Swinbank,
K. Simon Krughoff
Abstract:
Starting from a description of the Rubin Observatory Data Management System Architecture, and drawing on our experience with and involvement in a range of other projects including Gaia, SDSS, UKIRT, and JCMT, we derive a series of generic design patterns and lessons learned.
Starting from a description of the Rubin Observatory Data Management System Architecture, and drawing on our experience with and involvement in a range of other projects including Gaia, SDSS, UKIRT, and JCMT, we derive a series of generic design patterns and lessons learned.
△ Less
Submitted 24 November, 2022;
originally announced November 2022.
-
Faro: A framework for measuring the scientific performance of petascale Rubin Observatory data products
Authors:
Leanne P. Guy,
Keith Bechtol,
Jeffrey L. Carlin,
Erik Dennihy,
Peter S. Ferguson,
K. Simon Krughoff,
Robert H. Lupton,
Colin T. Slater,
Krzysztof Findeisen,
Arun Kannawadi,
Lee S. Kelvin,
Nate B. Lust,
Lauren A. MacArthur,
Michael N. Martinez,
Sophie L. Reed,
Dan S. Taranu,
W. Michael Wood-Vasey
Abstract:
The Vera C. Rubin Observatory will advance many areas of astronomy over the next decade with its unique wide-fast-deep multi-color imaging survey, the Legacy Survey of Space and Time (LSST). The LSST will produce approximately 20TB of raw data per night, which will be automatically processed by the LSST Science Pipelines to generate science-ready data products -- processed images, catalogs and ale…
▽ More
The Vera C. Rubin Observatory will advance many areas of astronomy over the next decade with its unique wide-fast-deep multi-color imaging survey, the Legacy Survey of Space and Time (LSST). The LSST will produce approximately 20TB of raw data per night, which will be automatically processed by the LSST Science Pipelines to generate science-ready data products -- processed images, catalogs and alerts. To ensure that these data products enable transformative science with LSST, stringent requirements have been placed on their quality and scientific fidelity, for example on image quality and depth, astrometric and photometric performance, and object recovery completeness. In this paper we introduce faro, a framework for automatically and efficiently computing scientific performance metrics on the LSST data products for units of data of varying granularity, ranging from single-detector to full-survey summary statistics. By measuring and monitoring metrics, we are able to evaluate trends in algorithmic performance and conduct regression testing during development, compare the performance of one algorithm against another, and verify that the LSST data products will meet performance requirements by comparing to specifications. We present initial results using faro to characterize the performance of the data products produced on simulated and precursor data sets, and discuss plans to use faro to verify the performance of the LSST commissioning data products.
△ Less
Submitted 30 June, 2022;
originally announced June 2022.
-
Rubin Science Platform on Google: the story so far
Authors:
William O'Mullane,
Frossie Economou,
Flora Huang,
Dan Speck,
Hsin-Fang Chiang,
Melissa L. Graham,
Russ Allbery,
Christine Banek,
Jonathan Sick,
Adam J. Thornton,
Jess Masciarelli,
Kian-Tat Lim,
Fritz Mueller,
Sergey Padolski,
Tim Jenness,
K. Simon Krughoff,
Michelle Gower,
Leanne P. Guy,
Gregory P. Dubois-Felsmann
Abstract:
We describe Rubin Observatory's experience with offering a data access facility (and associated services including our Science Platform) deployed on Google Cloud infrastructure as part of our pre-Operations Data Preview program.
We describe Rubin Observatory's experience with offering a data access facility (and associated services including our Science Platform) deployed on Google Cloud infrastructure as part of our pre-Operations Data Preview program.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
DESC DC2 Data Release Note
Authors:
LSST Dark Energy Science Collaboration,
Bela Abolfathi,
Robert Armstrong,
Humna Awan,
Yadu N. Babuji,
Franz Erik Bauer,
George Beckett,
Rahul Biswas,
Joanne R. Bogart,
Dominique Boutigny,
Kyle Chard,
James Chiang,
Johann Cohen-Tanugi,
Andrew J. Connolly,
Scott F. Daniel,
Seth W. Digel,
Alex Drlica-Wagner,
Richard Dubois,
Eric Gawiser,
Thomas Glanzman,
Salman Habib,
Andrew P. Hearin,
Katrin Heitmann,
Fabio Hernandez,
Renée Hložek
, et al. (32 additional authors not shown)
Abstract:
In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with th…
▽ More
In preparation for cosmological analyses of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), the LSST Dark Energy Science Collaboration (LSST DESC) has created a 300 deg$^2$ simulated survey as part of an effort called Data Challenge 2 (DC2). The DC2 simulated sky survey, in six optical bands with observations following a reference LSST observing cadence, was processed with the LSST Science Pipelines (19.0.0). In this Note, we describe the public data release of the resulting object catalogs for the coadded images of five years of simulated observations along with associated truth catalogs. We include a brief description of the major features of the available data sets. To enable convenient access to the data products, we have developed a web portal connected to Globus data services. We describe how to access the data and provide example Jupyter Notebooks in Python to aid first interactions with the data. We welcome feedback and questions about the data release via a GitHub repository.
△ Less
Submitted 13 June, 2022; v1 submitted 12 January, 2021;
originally announced January 2021.
-
The LSST DESC DC2 Simulated Sky Survey
Authors:
LSST Dark Energy Science Collaboration,
Bela Abolfathi,
David Alonso,
Robert Armstrong,
Éric Aubourg,
Humna Awan,
Yadu N. Babuji,
Franz Erik Bauer,
Rachel Bean,
George Beckett,
Rahul Biswas,
Joanne R. Bogart,
Dominique Boutigny,
Kyle Chard,
James Chiang,
Chuck F. Claver,
Johann Cohen-Tanugi,
Céline Combet,
Andrew J. Connolly,
Scott F. Daniel,
Seth W. Digel,
Alex Drlica-Wagner,
Richard Dubois,
Emmanuel Gangler,
Eric Gawiser
, et al. (55 additional authors not shown)
Abstract:
We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses…
▽ More
We describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep (WFD) area of approximately 300 deg^2 as well as a deep drilling field (DDF) of approximately 1 deg^2. We simulate 5 years of the planned 10-year survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the dataset to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic testbed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time-domain cosmology.
△ Less
Submitted 26 January, 2021; v1 submitted 12 October, 2020;
originally announced October 2020.
-
The LSST DESC Data Challenge 1: Generation and Analysis of Synthetic Images for Next Generation Surveys
Authors:
F. Javier Sánchez,
Chris W. Walter,
Humna Awan,
James Chiang,
Scott F. Daniel,
Eric Gawiser,
Tom Glanzman,
David P. Kirkby,
Rachel Mandelbaum,
Anže Slosar,
W. Michael Wood-Vasey,
Yusra AlSayyad,
Colin J. Burke,
Seth W. Digel,
Mike Jarvis,
Tony Johnson,
Heather Kelly,
Simon Krughoff,
Robert H. Lupton,
Phil J. Marshall,
John R. Peterson,
Paul A. Price,
Glenn Sembroski,
Brian Van Klaveren,
Matthew P. Wiesner
, et al. (1 additional authors not shown)
Abstract:
Data Challenge 1 (DC1) is the first synthetic dataset produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST dataset. DC1 is comprised of $r$-band observations of 40 deg$^{2}$ to 10-year LSST depth. W…
▽ More
Data Challenge 1 (DC1) is the first synthetic dataset produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST dataset. DC1 is comprised of $r$-band observations of 40 deg$^{2}$ to 10-year LSST depth. We present each stage of the simulation and analysis process: a) generation, by synthesizing sources from cosmological N-body simulations in individual sensor-visit images with different observing conditions; b) reduction using a development version of the LSST Science Pipelines; and c) matching to the input cosmological catalog for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star-galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: i) survey properties have an impact of 50\% of the statistical uncertainty for the scales and models used in DC1 ii) a selection to eliminate artifacts in the catalogs is necessary to avoid biases in the measured clustering; iii) the presence of bright objects has a significant impact (2- to 6-$σ$) in the estimated power spectra at small scales ($\ell > 1200$), highlighting the impact of blending in studies at small angular scales in LSST;
△ Less
Submitted 5 July, 2020; v1 submitted 3 January, 2020;
originally announced January 2020.
-
Why is the LSST Science Platform built on Kubernetes?
Authors:
Christine Banek,
Adam Thornton,
Frossie Economou,
Angelo Fausti,
K. Simon Krughoff,
Jonathan Sick
Abstract:
LSST has chosen Kubernetes as the platform for deploying and operating the LSST Science Platform. We first present the background reasoning behind this decision, including both instrument-agnostic as well as LSST-specific requirements. We then discuss the basic principles of Kubernetes and Helm, and how they are used as the deployment base for the LSST Science Platform. Furthermore, we provide an…
▽ More
LSST has chosen Kubernetes as the platform for deploying and operating the LSST Science Platform. We first present the background reasoning behind this decision, including both instrument-agnostic as well as LSST-specific requirements. We then discuss the basic principles of Kubernetes and Helm, and how they are used as the deployment base for the LSST Science Platform. Furthermore, we provide an example of how an external group may use these publicly available software resources to deploy their own instance of the LSST Science Platform, and customize it to their needs. Finally, we discuss how more astronomy software can follow these patterns to gain similar benefits.
△ Less
Submitted 14 November, 2019;
originally announced November 2019.
-
The Zwicky Transient Facility Alert Distribution System
Authors:
Maria T. Patterson,
Eric C. Bellm,
Ben Rusholme,
Frank J. Masci,
Mario Juric,
K. Simon Krughoff,
V. Zach Golkhou,
Matthew J. Graham,
Shrinivas R. Kulkarni,
George Helou
Abstract:
The Zwicky Transient Facility (ZTF) survey generates real-time alerts for optical transients, variables, and moving objects discovered in its wide-field survey. We describe the ZTF alert stream distribution and processing (filtering) system. The system uses existing open-source technologies developed in industry: Kafka, a real-time streaming platform, and Avro, a binary serialization format. The t…
▽ More
The Zwicky Transient Facility (ZTF) survey generates real-time alerts for optical transients, variables, and moving objects discovered in its wide-field survey. We describe the ZTF alert stream distribution and processing (filtering) system. The system uses existing open-source technologies developed in industry: Kafka, a real-time streaming platform, and Avro, a binary serialization format. The technologies used in this system provide a number of advantages for the ZTF use case, including (1) built-in replication, scalability, and stream rewind for the distribution mechanism; (2) structured messages with strictly enforced schemas and dynamic ty** for fast parsing; and (3) a Python-based stream processing interface that is similar to batch for a familiar and user-friendly plug-in filter system, all in a modular, primarily containerized system. The production deployment has successfully supported streaming up to 1.2 million alerts or roughly 70 GB of data per night, with each alert available to a consumer within about 10 s of alert candidate production. Data transfer rates of about 80,000 alerts/minute have been observed. In this paper, we discuss this alert distribution and processing system, the design motivations for the technology choices for the framework, performance in production, and how this system may be generally suitable for other alert stream use cases, including the upcoming Large Synoptic Survey Telescope.
△ Less
Submitted 6 February, 2019;
originally announced February 2019.
-
An Overview of the LSST Image Processing Pipelines
Authors:
James Bosch,
Yusra AlSayyad,
Robert Armstrong,
Eric Bellm,
Hsin-Fang Chiang,
Siegfried Eggl,
Krzysztof Findeisen,
Merlin Fisher-Levine,
Leanne P. Guy,
Augustin Guyonnet,
Željko Ivezić,
Tim Jenness,
Gábor Kovács,
K. Simon Krughoff,
Robert H. Lupton,
Nate B. Lust,
Lauren A. MacArthur,
Joshua Meyers,
Fred Moolekamp,
Christopher B. Morrison,
Timothy D. Morton,
William O'Mullane,
John K. Parejko,
Andrés A. Plazas,
Paul A. Price
, et al. (9 additional authors not shown)
Abstract:
The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient alerts, deep catalogs of the static sky, and forced photometry light-curves for billions of objects at hundreds of epochs, spanning at least a decade. The algorithm…
▽ More
The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient alerts, deep catalogs of the static sky, and forced photometry light-curves for billions of objects at hundreds of epochs, spanning at least a decade. The algorithms running in these pipelines are individually sophisticated and interact in subtle ways. This paper provides an overview of those pipelines, focusing more on those interactions than the details of any individual algorithm.
△ Less
Submitted 7 December, 2018;
originally announced December 2018.
-
DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
Authors:
Yao-Yuan Mao,
Eve Kovacs,
Katrin Heitmann,
Thomas D. Uram,
Andrew J. Benson,
Duncan Campbell,
Sofía A. Cora,
Joseph DeRose,
Tiziana Di Matteo,
Salman Habib,
Andrew P. Hearin,
J. Bryce Kalmbach,
K. Simon Krughoff,
François Lanusse,
Zarija Lukić,
Rachel Mandelbaum,
Jeffrey A. Newman,
Nelson Padilla,
Enrique Paillas,
Adrian Pope,
Paul M. Ricker,
Andrés N. Ruiz,
Ananth Tenneti,
Cristian Vega-Martínez,
Risa H. Wechsler
, et al. (2 additional authors not shown)
Abstract:
The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline developm…
▽ More
The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.
△ Less
Submitted 8 February, 2018; v1 submitted 27 September, 2017;
originally announced September 2017.
-
The Hyper Suprime-Cam Software Pipeline
Authors:
James Bosch,
Robert Armstrong,
Steven Bickerton,
Hisanori Furusawa,
Hiroyuki Ikeda,
Michitaro Koike,
Robert Lupton,
Sogo Mineo,
Paul Price,
Tadafumi Takata,
Masayuki Tanaka,
Naoki Yasuda,
Yusra AlSayyad,
Andrew C. Becker,
William Coulton,
Jean Coupon,
Jose Garmilla,
Song Huang,
K. Simon Krughoff,
Dustin Lang,
Alexie Leauthaud,
Kian-Tat Lim,
Nate B. Lust,
Lauren A. MacArthur,
Rachel Mandelbaum
, et al. (10 additional authors not shown)
Abstract:
In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope's Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated…
▽ More
In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope's Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.
△ Less
Submitted 18 May, 2017;
originally announced May 2017.
-
The LSST Data Management System
Authors:
Mario Jurić,
Jeffrey Kantor,
K-T Lim,
Robert H. Lupton,
Gregory Dubois-Felsmann,
Tim Jenness,
Tim S. Axelrod,
Jovan Aleksić,
Roberta A. Allsman,
Yusra AlSayyad,
Jason Alt,
Robert Armstrong,
Jim Basney,
Andrew C. Becker,
Jacek Becla,
Steven J. Bickerton,
Rahul Biswas,
James Bosch,
Dominique Boutigny,
Matias Carrasco Kind,
David R. Ciardi,
Andrew J. Connolly,
Scott F. Daniel,
Gregory E. Daues,
Frossie Economou
, et al. (40 additional authors not shown)
Abstract:
The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pachón in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide…
▽ More
The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pachón in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy.
The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is develo** a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.
△ Less
Submitted 24 December, 2015;
originally announced December 2015.
-
Efficient Iterative Processing in the SciDB Parallel Array Engine
Authors:
Emad Soroush,
Magdalena Balazinska,
Simon Krughoff,
Andrew Connolly
Abstract:
Many scientific data-intensive applications perform iterative computations on array data. There exist multiple engines specialized for array processing. These engines efficiently support various types of operations, but none includes native support for iterative processing. In this paper, we develop a model for iterative array computations and a series of optimizations. We evaluate the benefits of…
▽ More
Many scientific data-intensive applications perform iterative computations on array data. There exist multiple engines specialized for array processing. These engines efficiently support various types of operations, but none includes native support for iterative processing. In this paper, we develop a model for iterative array computations and a series of optimizations. We evaluate the benefits of an optimized, native support for iterative array processing on the SciDB engine and real workloads from the astronomy domain.
△ Less
Submitted 31 May, 2015;
originally announced June 2015.
-
Improving the LSST dithering pattern and cadence for dark energy studies
Authors:
Christopher M. Carroll,
Eric Gawiser,
Peter L. Kurczynski,
Rachel A. Bailey,
Rahul Biswas,
David Cinabro,
Saurabh W. Jha,
R. Lynne Jones,
K. Simon Krughoff,
Aneesa Sonawalla,
W. Michael Wood-Vasey
Abstract:
The Large Synoptic Survey Telescope (LSST) will explore the entire southern sky over 10 years starting in 2022 with unprecedented depth and time sampling in six filters, $ugrizy$. Artificial power on the scale of the 3.5 deg LSST field-of-view will contaminate measurements of baryonic acoustic oscillations (BAO), which fall at the same angular scale at redshift $z \sim 1$. Using the HEALPix framew…
▽ More
The Large Synoptic Survey Telescope (LSST) will explore the entire southern sky over 10 years starting in 2022 with unprecedented depth and time sampling in six filters, $ugrizy$. Artificial power on the scale of the 3.5 deg LSST field-of-view will contaminate measurements of baryonic acoustic oscillations (BAO), which fall at the same angular scale at redshift $z \sim 1$. Using the HEALPix framework, we demonstrate the impact of an "un-dithered" survey, in which $17\%$ of each LSST field-of-view is overlapped by neighboring observations, generating a honeycomb pattern of strongly varying survey depth and significant artificial power on BAO angular scales. We find that adopting large dithers (i.e., telescope pointing offsets) of amplitude close to the LSST field-of-view radius reduces artificial structure in the galaxy distribution by a factor of $\sim$10. We propose an observing strategy utilizing large dithers within the main survey and minimal dithers for the LSST Deep Drilling Fields. We show that applying various magnitude cutoffs can further increase survey uniformity. We find that a magnitude cut of $r < 27.3$ removes significant spurious power from the angular power spectrum with a minimal reduction in the total number of observed galaxies over the ten-year LSST run. We also determine the effectiveness of the observing strategy for Type Ia SNe and predict that the main survey will contribute $\sim$100,000 Type Ia SNe. We propose a concentrated survey where LSST observes one-third of its main survey area each year, increasing the number of main survey Type Ia SNe by a factor of $\sim$1.5, while still enabling the successful pursuit of other science drivers.
△ Less
Submitted 11 March, 2015; v1 submitted 20 January, 2015;
originally announced January 2015.
-
The Effective Number Density of Galaxies for Weak Lensing Measurements in the LSST Project
Authors:
C. Chang,
M. Jarvis,
B. Jain,
S. M. Kahn,
D. Kirkby,
A. Connolly,
S. Krughoff,
E. Peng,
J. R. Peterson
Abstract:
Future weak lensing surveys potentially hold the highest statistical power for constraining cosmological parameters compared to other cosmological probes. The statistical power of a weak lensing survey is determined by the sky coverage, the inverse of the noise in shear measurements, and the galaxy number density. The combination of the latter two factors is often expressed in terms of…
▽ More
Future weak lensing surveys potentially hold the highest statistical power for constraining cosmological parameters compared to other cosmological probes. The statistical power of a weak lensing survey is determined by the sky coverage, the inverse of the noise in shear measurements, and the galaxy number density. The combination of the latter two factors is often expressed in terms of $n_{\rm eff}$ -- the "effective number density of galaxies used for weak lensing measurements". In this work, we estimate $n_{\rm eff}$ for the Large Synoptic Survey Telescope (LSST) project, the most powerful ground-based lensing survey planned for the next two decades. We investigate how the following factors affect the resulting $n_{\rm eff}$ of the survey with detailed simulations: (1) survey time, (2) shear measurement algorithm, (3) algorithm for combining multiple exposures, (4) inclusion of data from multiple filter bands, (5) redshift distribution of the galaxies, and (6) masking and blending. For the first time, we quantify in a general weak lensing analysis pipeline the sensitivity of $n_{\rm eff}$ to the above factors.
We find that with current weak lensing algorithms, expected distributions of observing parameters, and all lensing data ($r$- and $i$-band, covering 18,000 degree$^{2}$ of sky) for LSST, $n_{\rm eff} \approx37$ arcmin$^{-2}$ before considering blending and masking, $n_{\rm eff} \approx31$ arcmin$^{-2}$ when rejecting seriously blended galaxies and $n_{\rm eff} \approx26$ arcmin$^{-2}$ when considering an additional 15% loss of galaxies due to masking. With future improvements in weak lensing algorithms, these values could be expected to increase by up to 20%. Throughout the paper, we also stress the ways in which $n_{\rm eff}$ depends on our ability to understand and control systematic effects in the measurements.
△ Less
Submitted 3 December, 2017; v1 submitted 3 May, 2013;
originally announced May 2013.
-
Effect of Measurement Errors on Predicted Cosmological Constraints from Shear Peak Statistics with LSST
Authors:
D. Bard,
J. M. Kratochvil,
C. Chang,
M. May,
S. M. Kahn,
Y. AlSayyad,
Z. Ahmad,
J. Bankert,
A. Connolly,
R. R. Gibson,
K. Gilmore,
E. Grace,
Z. Haiman,
M. Hannel,
K. M. Huffenberger,
J. G. Jernigan,
L. Jones,
S. Krughoff,
S. Lorenz,
S. Marshall,
A. Meert,
S. Nagarajan,
E. Peng,
J. Peterson,
A. P. Rasmussen
, et al. (4 additional authors not shown)
Abstract:
The statistics of peak counts in reconstructed shear maps contain information beyond the power spectrum, and can improve cosmological constraints from measurements of the power spectrum alone if systematic errors can be controlled. We study the effect of galaxy shape measurement errors on predicted cosmological constraints from the statistics of shear peak counts with the Large Synoptic Survey Tel…
▽ More
The statistics of peak counts in reconstructed shear maps contain information beyond the power spectrum, and can improve cosmological constraints from measurements of the power spectrum alone if systematic errors can be controlled. We study the effect of galaxy shape measurement errors on predicted cosmological constraints from the statistics of shear peak counts with the Large Synoptic Survey Telescope (LSST). We use the LSST image simulator in combination with cosmological N-body simulations to model realistic shear maps for different cosmological models. We include both galaxy shape noise and, for the first time, measurement errors on galaxy shapes. We find that the measurement errors considered have relatively little impact on the constraining power of shear peak counts for LSST.
△ Less
Submitted 4 January, 2013;
originally announced January 2013.
-
Atmospheric PSF Interpolation for Weak Lensing in Short Exposure Imaging Data
Authors:
C. Chang,
P. J. Marshall,
J. G. Jernigan,
J. R. Peterson,
S. M. Kahn,
S. F. Gull,
Y. AlSayyad,
Z. Ahmad,
J. Bankert,
D. Bard,
A. Connolly,
R. R. Gibson,
K. Gilmore,
E. Grace,
M. Hannel,
M. A. Hodge,
L. Jones,
S. Krughoff,
S. Lorenz,
S. Marshall,
A. Meert,
S. Nagarajan,
E. Peng,
A. P. Rasmussen,
M. Shmakova
, et al. (3 additional authors not shown)
Abstract:
A main science goal for the Large Synoptic Survey Telescope (LSST) is to measure the cosmic shear signal from weak lensing to extreme accuracy. One difficulty, however, is that with the short exposure time ($\simeq$15 seconds) proposed, the spatial variation of the Point Spread Function (PSF) shapes may be dominated by the atmosphere, in addition to optics errors. While optics errors mainly cause…
▽ More
A main science goal for the Large Synoptic Survey Telescope (LSST) is to measure the cosmic shear signal from weak lensing to extreme accuracy. One difficulty, however, is that with the short exposure time ($\simeq$15 seconds) proposed, the spatial variation of the Point Spread Function (PSF) shapes may be dominated by the atmosphere, in addition to optics errors. While optics errors mainly cause the PSF to vary on angular scales similar or larger than a single CCD sensor, the atmosphere generates stochastic structures on a wide range of angular scales. It thus becomes a challenge to infer the multi-scale, complex atmospheric PSF patterns by interpolating the sparsely sampled stars in the field. In this paper we present a new method, PSFent, for interpolating the PSF shape parameters, based on reconstructing underlying shape parameter maps with a multi-scale maximum entropy algorithm. We demonstrate, using images from the LSST Photon Simulator, the performance of our approach relative to a 5th-order polynomial fit (representing the current standard) and a simple boxcar smoothing technique. Quantitatively, PSFent predicts more accurate PSF models in all scenarios and the residual PSF errors are spatially less correlated. This improvement in PSF interpolation leads to a factor of 3.5 lower systematic errors in the shear power spectrum on scales smaller than $\sim13'$, compared to polynomial fitting. We estimate that with PSFent and for stellar densities greater than $\simeq1/{\rm arcmin}^{2}$, the spurious shear correlation from PSF interpolation, after combining a complete 10-year dataset from LSST, is lower than the corresponding statistical uncertainties on the cosmic shear power spectrum, even under a conservative scenario.
△ Less
Submitted 12 November, 2012; v1 submitted 6 June, 2012;
originally announced June 2012.
-
Spurious Shear in Weak Lensing with LSST
Authors:
C. Chang,
S. M. Kahn,
J. G. Jernigan,
J. R. Peterson,
Y. AlSayyad,
Z. Ahmad,
J. Bankert,
D. Bard,
A. Connolly,
R. R. Gibson,
K. Gilmore,
E. Grace,
M. Hannel,
M. A. Hodge,
M. J. Jee,
L. Jones,
S. Krughoff,
S. Lorenz,
P. J. Marshall,
S. Marshall,
A. Meert,
S. Nagarajan,
E. Peng,
A. P. Rasmussen,
M. Shmakova
, et al. (3 additional authors not shown)
Abstract:
The complete 10-year survey from the Large Synoptic Survey Telescope (LSST) will image $\sim$ 20,000 square degrees of sky in six filter bands every few nights, bringing the final survey depth to $r\sim27.5$, with over 4 billion well measured galaxies. To take full advantage of this unprecedented statistical power, the systematic errors associated with weak lensing measurements need to be controll…
▽ More
The complete 10-year survey from the Large Synoptic Survey Telescope (LSST) will image $\sim$ 20,000 square degrees of sky in six filter bands every few nights, bringing the final survey depth to $r\sim27.5$, with over 4 billion well measured galaxies. To take full advantage of this unprecedented statistical power, the systematic errors associated with weak lensing measurements need to be controlled to a level similar to the statistical errors.
This work is the first attempt to quantitatively estimate the absolute level and statistical properties of the systematic errors on weak lensing shear measurements due to the most important physical effects in the LSST system via high fidelity ray-tracing simulations. We identify and isolate the different sources of algorithm-independent, \textit{additive} systematic errors on shear measurements for LSST and predict their impact on the final cosmic shear measurements using conventional weak lensing analysis techniques. We find that the main source of the errors comes from an inability to adequately characterise the atmospheric point spread function (PSF) due to its high frequency spatial variation on angular scales smaller than $\sim10'$ in the single short exposures, which propagates into a spurious shear correlation function at the $10^{-4}$--$10^{-3}$ level on these scales. With the large multi-epoch dataset that will be acquired by LSST, the stochastic errors average out, bringing the final spurious shear correlation function to a level very close to the statistical errors. Our results imply that the cosmological constraints from LSST will not be severely limited by these algorithm-independent, additive systematic effects.
△ Less
Submitted 16 October, 2012; v1 submitted 6 June, 2012;
originally announced June 2012.
-
Milky Way Tomography IV: Dissecting Dust
Authors:
Michael Berry,
Željko Ivezić,
Branimir Sesar,
Mario Jurić,
Edward F. Schlafly,
Jillian Bellovary,
Douglas Finkbeiner,
Dijana Vrbanec,
Timothy C. Beers,
Keira J. Brooks,
Donald P. Schneider,
Robert R. Gibson,
Amy Kimball,
Lynne Jones,
Peter Yoachim,
Simon Krughoff,
Andrew J. Connolly,
Sarah Loebman,
Nicholas A. Bond,
David Schlegel,
Julianne Dalcanton,
Brian Yanny,
Steven R. Majewski,
Gillian R. Knapp,
James E. Gunn
, et al. (6 additional authors not shown)
Abstract:
We use SDSS photometry of 73 million stars to simultaneously obtain best-fit main-sequence stellar energy distribution (SED) and amount of dust extinction along the line of sight towards each star. Using a subsample of 23 million stars with 2MASS photometry, whose addition enables more robust results, we show that SDSS photometry alone is sufficient to break degeneracies between intrinsic stellar…
▽ More
We use SDSS photometry of 73 million stars to simultaneously obtain best-fit main-sequence stellar energy distribution (SED) and amount of dust extinction along the line of sight towards each star. Using a subsample of 23 million stars with 2MASS photometry, whose addition enables more robust results, we show that SDSS photometry alone is sufficient to break degeneracies between intrinsic stellar color and dust amount when the shape of extinction curve is fixed. When using both SDSS and 2MASS photometry, the ratio of the total to selective absorption, $R_V$, can be determined with an uncertainty of about 0.1 for most stars in high-extinction regions. These fits enable detailed studies of the dust properties and its spatial distribution, and of the stellar spatial distribution at low Galactic latitudes. Our results are in good agreement with the extinction normalization given by the Schlegel et al. (1998, SFD) dust maps at high northern Galactic latitudes, but indicate that the SFD extinction map appears to be consistently overestimated by about 20% in the southern sky, in agreement with Schlafly et al. (2010). The constraints on the shape of the dust extinction curve across the SDSS and 2MASS bandpasses support the models by Fitzpatrick (1999) and Cardelli et al. (1989). For the latter, we find an $R_V=3.0\pm0.1$(random) $\pm0.1$(systematic) over most of the high-latitude sky. At low Galactic latitudes (|b|<5), we demonstrate that the SFD map cannot be reliably used to correct for extinction as most stars are embedded in dust, rather than behind it. We introduce a method for efficient selection of candidate red giant stars in the disk, dubbed "dusty parallax relation", which utilizes a correlation between distance and the extinction along the line of sight. We make these best-fit parameters, as well as all the input SDSS and 2MASS data, publicly available in a user-friendly format.
△ Less
Submitted 21 November, 2011;
originally announced November 2011.
-
Spectroscopic Determination of the Low Redshift Type Ia Supernova Rate from the Sloan Digital Sky Survey
Authors:
K. Simon Krughoff,
Andrew Connolly,
Joshua Frieman,
Mark SubbaRao,
Gary Kilper,
Donald Schneider
Abstract:
Supernova rates are directly coupled to high mass stellar birth and evolution. As such, they are one of the few direct measures of the history of cosmic stellar evolution. In this paper we describe an probabilistic technique for identifying supernovae within spectroscopic samples of galaxies. We present a study of 52 type Ia supernovae ranging in age from -14 days to +40 days extracted from a pare…
▽ More
Supernova rates are directly coupled to high mass stellar birth and evolution. As such, they are one of the few direct measures of the history of cosmic stellar evolution. In this paper we describe an probabilistic technique for identifying supernovae within spectroscopic samples of galaxies. We present a study of 52 type Ia supernovae ranging in age from -14 days to +40 days extracted from a parent sample of \simeq 50,000 spectra from the SDSS DR5. We find a Supernova Rate (SNR) of 0.472^{+0.048}_{-0.039}(Systematic)^{+0.081}_{-0.071}(Statistical)SNu at a redshift of <z> = 0.1. This value is higher than other values at low redshift at the 1σ, but is consistent at the 3σ level. The 52 supernova candidates used in this study comprise the third largest sample of supernovae used in a type Ia rate determination to date. In this paper we demonstrate the potential for the described approach for detecting supernovae in future spectroscopic surveys.
△ Less
Submitted 7 February, 2011;
originally announced February 2011.
-
LSST Science Book, Version 2.0
Authors:
LSST Science Collaboration,
Paul A. Abell,
Julius Allison,
Scott F. Anderson,
John R. Andrew,
J. Roger P. Angel,
Lee Armus,
David Arnett,
S. J. Asztalos,
Tim S. Axelrod,
Stephen Bailey,
D. R. Ballantyne,
Justin R. Bankert,
Wayne A. Barkhouse,
Jeffrey D. Barr,
L. Felipe Barrientos,
Aaron J. Barth,
James G. Bartlett,
Andrew C. Becker,
Jacek Becla,
Timothy C. Beers,
Joseph P. Bernstein,
Rahul Biswas,
Michael R. Blanton,
Joshua S. Bloom
, et al. (223 additional authors not shown)
Abstract:
A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south…
▽ More
A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: map** the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy.
△ Less
Submitted 1 December, 2009;
originally announced December 2009.
-
Probing Spectroscopic Variability of Galaxies & Narrow-Line Active Galactic Nuclei in the Sloan Digital Sky Survey
Authors:
Ching-Wa Yip,
Andrew Connolly,
Daniel Vanden Berk,
Ryan Scranton,
Simon Krughoff,
Alex Szalay,
Laszlo Dobos,
Christy Tremonti,
Manuchehr Taghizadeh-Popp,
Tamas Budavari,
Istvan Csabai,
Rosemary Wyse,
Zeljko Ivezic
Abstract:
Under the unified model for active galactic nuclei (AGNs), narrow-line (Type 2) AGNs are, in fact, broad-line (Type 1) AGNs but each with a heavily obscured accretion disk. We would therefore expect the optical continuum emission from Type 2 AGN to be composed mainly of stellar light and non-variable on the time-scales of months to years. In this work we probe the spectroscopic variability of ga…
▽ More
Under the unified model for active galactic nuclei (AGNs), narrow-line (Type 2) AGNs are, in fact, broad-line (Type 1) AGNs but each with a heavily obscured accretion disk. We would therefore expect the optical continuum emission from Type 2 AGN to be composed mainly of stellar light and non-variable on the time-scales of months to years. In this work we probe the spectroscopic variability of galaxies and narrow-line AGNs using the multi-epoch data in the Sloan Digital Sky Survey (SDSS) Data Release 6. The sample contains 18,435 sources for which there exist pairs of spectroscopic observations (with a maximum separation in time of ~700 days) covering a wavelength range of 3900-8900 angstrom. To obtain a reliable repeatability measurement between each spectral pair, we consider a number of techniques for spectrophotometric calibration resulting in an improved spectrophotometric calibration of a factor of two. From these data we find no obvious continuum and emission-line variability in the narrow-line AGNs on average -- the spectroscopic variability of the continuum is 0.07+/-0.26 mag in the g band and, for the emission-line ratios log10([NII]/Halpha) and log10([OIII]/Hbeta), the variability is 0.02+/-0.03 dex and 0.06+/-0.08 dex, respectively. From the continuum variability measurement we set an upper limit on the ratio between the flux of varying spectral component, presumably related to AGN activities, and that of host galaxy to be ~30%. We provide the corresponding upper limits for other spectral classes, including those from the BPT diagram, eClass galaxy classification, stars and quasars.
△ Less
Submitted 31 March, 2009; v1 submitted 24 November, 2008;
originally announced November 2008.
-
LSST: from Science Drivers to Reference Design and Anticipated Data Products
Authors:
Željko Ivezić,
Steven M. Kahn,
J. Anthony Tyson,
Bob Abel,
Emily Acosta,
Robyn Allsman,
David Alonso,
Yusra AlSayyad,
Scott F. Anderson,
John Andrew,
James Roger P. Angel,
George Z. Angeli,
Reza Ansari,
Pierre Antilogus,
Constanza Araujo,
Robert Armstrong,
Kirk T. Arndt,
Pierre Astier,
Éric Aubourg,
Nicole Auza,
Tim S. Axelrod,
Deborah J. Bard,
Jeff D. Barr,
Aurelian Barrau,
James G. Bartlett
, et al. (288 additional authors not shown)
Abstract:
(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the…
▽ More
(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and map** the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pachón in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$σ$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $δ<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.
△ Less
Submitted 23 May, 2018; v1 submitted 15 May, 2008;
originally announced May 2008.
-
Sky in Google Earth: The Next Frontier in Astronomical Data Discovery and Visualization
Authors:
Ryan Scranton,
Andrew Connolly,
Simon Krughoff,
Jeremy Brewer,
Alberto Conti,
Carol Christian,
Brian McLean,
Craig Sosin,
Greg Coombe,
Paul Heckbert
Abstract:
Astronomy began as a visual science, first through careful observations of the sky using either an eyepiece or the naked eye, then on to the preservation of those images with photographic media and finally the digital encoding of that information via CCDs. This last step has enabled astronomy to move into a fully automated era -- where data is recorded, analyzed and interpreted often without any…
▽ More
Astronomy began as a visual science, first through careful observations of the sky using either an eyepiece or the naked eye, then on to the preservation of those images with photographic media and finally the digital encoding of that information via CCDs. This last step has enabled astronomy to move into a fully automated era -- where data is recorded, analyzed and interpreted often without any direct visual inspection. Sky in Google Earth completes that circle by providing an intuitive visual interface to some of the largest astronomical imaging surveys covering the full sky. By streaming imagery, catalogs, time domain data, and ancillary information directly to a user, Sky can provide the general public as well as professional and amateur astronomers alike with a wealth of information for use in education and research. We provide here a brief introduction to Sky in Google Earth, focusing on its extensible environment, how it may be integrated into the research process and how it can bring astronomical research to a broader community. With an open interface available on Linux, Mac OS X and Windows, applications developed within Sky are accessible not just within the Google framework but through any visual browser that supports the Keyhole Markup Language. We present Sky as the embodiment of a virtual telescope.
△ Less
Submitted 10 September, 2007; v1 submitted 5 September, 2007;
originally announced September 2007.
-
Inter-cluster filaments in a $Λ$CDM Universe
Authors:
Joerg M. Colberg,
K. Simon Krughoff,
Andrew J. Connolly
Abstract:
The large--scale structure (LSS) in the Universe comprises a complicated filamentary network of matter. We study this network using a high--resolution simulation of structure formation of a $Λ$ Cold Dark Matter cosmology. We investigate the distribution of matter between neighbouring large haloes whose masses are comparable to massive clusters of galaxies. We identify a total of 228 filaments be…
▽ More
The large--scale structure (LSS) in the Universe comprises a complicated filamentary network of matter. We study this network using a high--resolution simulation of structure formation of a $Λ$ Cold Dark Matter cosmology. We investigate the distribution of matter between neighbouring large haloes whose masses are comparable to massive clusters of galaxies. We identify a total of 228 filaments between neighbouring clusters. Roughly half of the filaments are either warped or lie off the cluster--cluster axis. We find that straight filaments on the average are shorter than warped ones. More massive clusters are connected to more filaments than less massive ones on average. This finding indicates that the most massive clusters form at the intersections of the filamentary backbone of LSS. For straight filaments, we compute mass profiles. Radial profiles show a fairly well--defined radius, $r_s$, beyond which the profiles follow an $r^{-2}$ power law fairly closely. For the majority of filaments, $r_s$ lies between 1.5 $h^{-1}$ Mpc and 2.0 $h^{-1}$ Mpc. The enclosed overdensity inside $r_s$ varies between a few times up to 25 times mean density, independent of the length of the filaments. Along the filaments' axes, material is not distributed uniformly. Towards the clusters, the density rises, indicating the presence of the cluster infall regions. In addition, we also find some sheet--like connections between clusters. In roughly a fifth of all cluster--cluster connections where we could not identify a filament or sheet, projection effects lead to filamentary structures in the projected mass distribution. (abridged)
△ Less
Submitted 4 February, 2005; v1 submitted 29 June, 2004;
originally announced June 2004.
