A Gateway to Astronomical Image Processing: Vera C. RubinObservatory LSST Science Pipelines on AWS
Authors:
Dino Bektesevic,
Hsin-Fang Chiang,
Kian-Tat Lim,
Todd L. Miller,
Greg Thain,
Tim Jenness,
James Bosch,
Andrei Salnikov,
Andrew Connolly
Abstract:
The Legacy Survey of Space and Time, operated by the Vera C. Rubin Observatory, is a 10-year astronomical survey due to start operations in 2022 that will image half the sky every three nights. LSST will produce ~20TB of raw data per night which will be calibrated and analyzed in almost real time. Given the volume of LSST data, the traditional subset-download-process paradigm of data reprocessing…
▽ More
The Legacy Survey of Space and Time, operated by the Vera C. Rubin Observatory, is a 10-year astronomical survey due to start operations in 2022 that will image half the sky every three nights. LSST will produce ~20TB of raw data per night which will be calibrated and analyzed in almost real time. Given the volume of LSST data, the traditional subset-download-process paradigm of data reprocessing faces significant challenges. We describe here, the first steps towards a gateway for astronomical science that would enable astronomers to analyze images and catalogs at scale. In this first step we focus on executing the Rubin LSST Science Pipelines, a collection of image and catalog processing algorithms, on Amazon Web Services (AWS). We describe our initial impressions on the performance, scalability and cost of deploying such a system in the cloud.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
