Showing 1–46 of 46 results for author: Lochner, M

TEGLIE: Transformer encoders as strong gravitational lens finders in KiDS

Authors: Margherita Grespan, Hareesh Thuruthipilly, Agnieszka Pollo, Michelle Lochner, Marek Biesiada, Verlon Etsebeth

Abstract: We apply a state-of-the-art transformer algorithm to 221 deg$^2$ of the Kilo Degree Survey (KiDS) to search for new strong gravitational lenses (SGL). We test four transformer encoders trained on simulated data from the Strong Lens Finding Challenge on KiDS survey data. The best performing model is fine-tuned on real images of SGL candidates identified in previous searches. To expand the dataset f… ▽ More We apply a state-of-the-art transformer algorithm to 221 deg$^2$ of the Kilo Degree Survey (KiDS) to search for new strong gravitational lenses (SGL). We test four transformer encoders trained on simulated data from the Strong Lens Finding Challenge on KiDS survey data. The best performing model is fine-tuned on real images of SGL candidates identified in previous searches. To expand the dataset for fine-tuning, data augmentation techniques are employed, including rotation, flip**, transposition, and white noise injection. The network fine-tuned with rotated, flipped, and transposed images exhibited the best performance and is used to hunt for SGL in the overlap** region of the Galaxy And Mass Assembly (GAMA) and KiDS surveys on galaxies up to $z$=0.8. Candidate SGLs are matched with those from other surveys and examined using GAMA data to identify blended spectra resulting from the signal from multiple objects in a fiber. We observe that fine-tuning the transformer encoder to the KiDS data reduces the number of false positives by 70%. Additionally, applying the fine-tuned model to a sample of $\sim$ 5,000,000 galaxies results in a list of $\sim$ 51,000 SGL candidates. Upon visual inspection, this list is narrowed down to 231 candidates. Combined with the SGL candidates identified in the model testing, our final sample includes 264 candidates, with 71 high-confidence SGLs of which 44 are new discoveries. We propose fine-tuning via real augmented images as a viable approach to mitigating false positives when transitioning from simulated lenses to real surveys. Additionally, we provide a list of 121 false positives that exhibit features similar to lensed objects, which can benefit the training of future machine learning models in this field. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: 28 pages, 21 figures, accepted in A&A on 16/05/2024

A Classifier-Based Approach to Multi-Class Anomaly Detection for Astronomical Transients

Authors: Rithwik Gupta, Daniel Muthukrishna, Michelle Lochner

Abstract: Automating real-time anomaly detection is essential for identifying rare transients in the era of large-scale astronomical surveys. Modern survey telescopes are generating tens of thousands of alerts per night, and future telescopes, such as the Vera C. Rubin Observatory, are projected to increase this number dramatically. Currently, most anomaly detection algorithms for astronomical transients re… ▽ More Automating real-time anomaly detection is essential for identifying rare transients in the era of large-scale astronomical surveys. Modern survey telescopes are generating tens of thousands of alerts per night, and future telescopes, such as the Vera C. Rubin Observatory, are projected to increase this number dramatically. Currently, most anomaly detection algorithms for astronomical transients rely either on hand-crafted features extracted from light curves or on features generated through unsupervised representation learning, which are then coupled with standard machine learning anomaly detection algorithms. In this work, we introduce an alternative approach to detecting anomalies: using the penultimate layer of a neural network classifier as the latent space for anomaly detection. We then propose a novel method, named Multi-Class Isolation Forests (MCIF), which trains separate isolation forests for each class to derive an anomaly score for a light curve from the latent space representation given by the classifier. This approach significantly outperforms a standard isolation forest. We also use a simpler input method for real-time transient classifiers which circumvents the need for interpolation in light curves and helps the neural network model inter-passband relationships and handle irregular sampling. Our anomaly detection pipeline identifies rare classes including kilonovae, pair-instability supernovae, and intermediate luminosity transients shortly after trigger on simulated Zwicky Transient Facility light curves. Using a sample of our simulations that matched the population of anomalies expected in nature (54 anomalies and 12,040 common transients), our method was able to discover $41\pm3$ anomalies (~75% recall) after following up the top 2000 (~15%) ranked transients. Our novel method shows that classifiers can be effectively repurposed for real-time anomaly detection. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Comments: 16 pages, 14 figures, 1 table, submitted to MNRAS

Enabling Unsupervised Discovery in Astronomical Images through Self-Supervised Representations

Authors: Koketso Mohale, Michelle Lochner

Abstract: Unsupervised learning, a branch of machine learning that can operate on unlabelled data, has proven to be a powerful tool for data exploration and discovery in astronomy. As large surveys and new telescopes drive a rapid increase in data size and richness, these techniques offer the promise of discovering new classes of objects and of efficient sorting of data into similar types. However, unsuperv… ▽ More Unsupervised learning, a branch of machine learning that can operate on unlabelled data, has proven to be a powerful tool for data exploration and discovery in astronomy. As large surveys and new telescopes drive a rapid increase in data size and richness, these techniques offer the promise of discovering new classes of objects and of efficient sorting of data into similar types. However, unsupervised learning techniques generally require feature extraction to derive simple but informative representations of images. In this paper, we explore the use of self-supervised deep learning as a method of automated representation learning. We apply the algorithm Bootstrap Your Own Latent (BYOL) to Galaxy Zoo DECaLS images to obtain a lower dimensional representation of each galaxy, known as features. We briefly validate these features using a small supervised classification problem. We then move on to apply an automated clustering algorithm, demonstrating that this fully unsupervised approach is able to successfully group together galaxies with similar morphology. The same features prove useful for anomaly detection, where we use the framework astronomaly to search for merger candidates. While the focus of this work is on optical images, we also explore the versatility of this technique by applying the exact same approach to a small radio galaxy dataset. This work aims to demonstrate that applying deep representation learning is key to unlocking the potential of unsupervised discovery in future datasets from telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array. △ Less

Submitted 19 April, 2024; v1 submitted 23 November, 2023; originally announced November 2023.

Comments: 22 pages, 22 figures, comments welcome

Journal ref: MNRAS Volume 530, Issue 1, May 2024, Pages 1274--1295

Astronomaly at scale: searching for anomalies amongst 4 million galaxies

Authors: Verlon Etsebeth, Michelle Lochner, Mike Walmsley, Margherita Grespan

Abstract: Modern astronomical surveys are producing datasets of unprecedented size and richness, increasing the potential for high-impact scientific discovery. This possibility, coupled with the challenge of exploring a large number of sources, has led to the development of novel machine-learning-based anomaly detection approaches, such as Astronomaly. For the first time, we test the scalability of Astronom… ▽ More Modern astronomical surveys are producing datasets of unprecedented size and richness, increasing the potential for high-impact scientific discovery. This possibility, coupled with the challenge of exploring a large number of sources, has led to the development of novel machine-learning-based anomaly detection approaches, such as Astronomaly. For the first time, we test the scalability of Astronomaly by applying it to almost 4 million images of galaxies from the Dark Energy Camera Legacy Survey. We use a trained deep learning algorithm to learn useful representations of the images and pass these to the anomaly detection algorithm isolation forest, coupled with Astronomaly's active learning method, to discover interesting sources. We find that data selection criteria have a significant impact on the trade-off between finding rare sources such as strong lenses and introducing artefacts into the dataset. We demonstrate that active learning is required to identify the most interesting sources and reduce artefacts, while anomaly detection methods alone are insufficient. Using Astronomaly, we find 1635 anomalies among the top 2000 sources in the dataset after applying active learning, including eight strong gravitational lens candidates, 1609 galaxy merger candidates, and 18 previously unidentified sources exhibiting highly unusual morphology. Our results show that by leveraging the human-machine interface, Astronomaly is able to rapidly identify sources of scientific interest even in large datasets. △ Less

Submitted 29 March, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: 15 pages, 9 figures. Comments welcome, especially suggestions about the anomalous sources

Journal ref: MNRAS Volume 529, Issue 1, March 2024, Pages 732--747

Euclid Preparation XXXIII. Characterization of convolutional neural networks for the identification of galaxy-galaxy strong lensing events

Authors: Euclid Collaboration, L. Leuzzi, M. Meneghetti, G. Angora, R. B. Metcalf, L. Moscardini, P. Rosati, P. Bergamini, F. Calura, B. Clément, R. Gavazzi, F. Gentile, M. Lochner, C. Grillo, G. Vernardos, N. Aghanim, A. Amara, L. Amendola, S. Andreon, N. Auricchio, S. Bardelli, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia , et al. (194 additional authors not shown)

Abstract: Forthcoming imaging surveys will potentially increase the number of known galaxy-scale strong lenses by several orders of magnitude. For this to happen, images of tens of millions of galaxies will have to be inspected to identify potential candidates. In this context, deep learning techniques are particularly suitable for the finding patterns in large data sets, and convolutional neural networks (… ▽ More Forthcoming imaging surveys will potentially increase the number of known galaxy-scale strong lenses by several orders of magnitude. For this to happen, images of tens of millions of galaxies will have to be inspected to identify potential candidates. In this context, deep learning techniques are particularly suitable for the finding patterns in large data sets, and convolutional neural networks (CNNs) in particular can efficiently process large volumes of images. We assess and compare the performance of three network architectures in the classification of strong lensing systems on the basis of their morphological characteristics. We train and test our models on different subsamples of a data set of forty thousand mock images, having characteristics similar to those expected in the wide survey planned with the ESA mission \Euclid, gradually including larger fractions of faint lenses. We also evaluate the importance of adding information about the colour difference between the lens and source galaxies by repeating the same training on single-band and multi-band images. Our models find samples of clear lenses with $\gtrsim 90\%$ precision and completeness, without significant differences in the performance of the three architectures. Nevertheless, when including lenses with fainter arcs in the training set, the three models' performance deteriorates with accuracy values of $\sim 0.87$ to $\sim 0.75$ depending on the model. Our analysis confirms the potential of the application of CNNs to the identification of galaxy-scale strong lenses. We suggest that specific training with separate classes of lenses might be needed for detecting the faint lenses since the addition of the colour information does not yield a significant improvement in the current analysis, with the accuracy ranging from $\sim 0.89$ to $\sim 0.78$ for the different models. △ Less

Submitted 26 January, 2024; v1 submitted 17 July, 2023; originally announced July 2023.

Comments: 23 pages,12 figures

Journal ref: Astronomy & Astrophysics,2024, 681, A68

A unique, ring-like radio source with quadrilateral structure detected with machine learning

Authors: Michelle Lochner, Lawrence Rudnick, Ian Heywood, Kenda Knowles, Stanislav S. Shabala

Abstract: We report the discovery of a unique object in the MeerKAT Galaxy Cluster Legacy Survey (MGCLS) using the machine learning anomaly detection framework Astronomaly. This strange, ring-like source is 30' from the MGCLS field centred on Abell 209, and is not readily explained by simple physical models. With an assumed host galaxy at redshift 0.55, the luminosity (10^25 W/Hz) is comparable to powerful… ▽ More We report the discovery of a unique object in the MeerKAT Galaxy Cluster Legacy Survey (MGCLS) using the machine learning anomaly detection framework Astronomaly. This strange, ring-like source is 30' from the MGCLS field centred on Abell 209, and is not readily explained by simple physical models. With an assumed host galaxy at redshift 0.55, the luminosity (10^25 W/Hz) is comparable to powerful radio galaxies. The source consists of a ring of emission 175 kpc across, quadrilateral enhanced brightness regions bearing resemblance to radio jets, two "ears" separated by 368 kpc, and a diffuse envelope. All of the structures appear spectrally steep, ranging from -1.0 to -1.5. The ring has high polarization (25%) except on the bright patches (<10%). We compare this source to the Odd Radio Circles recently discovered in ASKAP data and discuss several possible physical models, including a termination shock from starburst activity, an end-on radio galaxy, and a supermassive black hole merger event. No simple model can easily explain the observed structure of the source. This work, as well as other recent discoveries, demonstrates the power of unsupervised machine learning in mining large datasets for scientifically interesting sources. △ Less

Submitted 8 February, 2023; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: 8 pages, 7 figures, published in MNRAS

Journal ref: MNRAS Volume 520, Issue 1, January 2023, Pages 1439-1446

Impact of Rubin Observatory cadence choices on supernovae photometric classification

Authors: Catarina S. Alves, Hiranya V. Peiris, Michelle Lochner, Jason D. McEwen, Richard Kessler

Abstract: The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will discover an unprecedented number of supernovae (SNe), making spectroscopic classification for all the events infeasible. LSST will thus rely on photometric classification, whose accuracy depends on the not-yet-finalized LSST observing strategy. In this work, we analyze the impact of cadence choices on classification perfor… ▽ More The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will discover an unprecedented number of supernovae (SNe), making spectroscopic classification for all the events infeasible. LSST will thus rely on photometric classification, whose accuracy depends on the not-yet-finalized LSST observing strategy. In this work, we analyze the impact of cadence choices on classification performance using simulated multi-band light curves. First, we simulate SNe with an LSST baseline cadence, a non-rolling cadence, and a presto-color cadence which observes each sky location three times per night instead of twice. Each simulated dataset includes a spectroscopically-confirmed training set, which we augment to be representative of the test set as part of the classification pipeline. Then, we use the photometric transient classification library snmachine to build classifiers. We find that the active region of the rolling cadence used in the baseline observing strategy yields a 25% improvement in classification performance relative to the background region. This improvement in performance in the actively-rolling region is also associated with an increase of up to a factor of 2.7 in the number of cosmologically-useful Type Ia supernovae relative to the background region. However, adding a third visit per night as implemented in presto-color degrades classification performance due to more irregularly sampled light curves. Overall, our results establish desiderata on the observing cadence related to classification of full SNe light curves, which in turn impacts photometric SNe cosmology with LSST. △ Less

Submitted 15 March, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

Comments: 22 pages, 14 figures. Changed to match version accepted by the Astrophysical Journal Supplement Series (accepted 06/02/2023)

Designing an Optimal LSST Deep Drilling Program for Cosmology with Type Ia Supernovae

Authors: Philippe Gris, Nicolas Regnault, Humna Awan, Isobel Hook, Saurabh W. Jha, Michelle Lochner, Bruno Sanchez, Dan Scolnic, Mark Sullivan, Peter Yoachim, the LSST Dark Energy Science Collaboration

Abstract: The Vera C. Rubin Observatory's Legacy Survey of Space and Time is forecast to collect a large sample of Type Ia supernovae (SNe Ia) that could be instrumental in unveiling the nature of Dark Energy. The feat, however, requires measuring the two components of the Hubble diagram - distance modulus and redshift - with a high degree of accuracy. Distance is estimated from SNe Ia parameters extracted… ▽ More The Vera C. Rubin Observatory's Legacy Survey of Space and Time is forecast to collect a large sample of Type Ia supernovae (SNe Ia) that could be instrumental in unveiling the nature of Dark Energy. The feat, however, requires measuring the two components of the Hubble diagram - distance modulus and redshift - with a high degree of accuracy. Distance is estimated from SNe Ia parameters extracted from light curve fits, where the average quality of light curves is primarily driven by survey parameters such as the cadence and the number of visits per band. An optimal observing strategy is thus critical for measuring cosmological parameters with high accuracy. We present in this paper a three-stage analysis aiming at quantifying the impact of the Deep Drilling (DD) strategy parameters on three critical aspects of the survey: the redshift completeness (originating from the Malmquist cosmological bias), the number of well-measured SNe Ia, and the cosmological measurements. Analyzing the current LSST survey simulations, we demonstrate that the current DD survey plans are characterized by a low completeness ($z~\sim$ 0.55-0.65), and irregular and low cadences (few days) that dramatically decrease the size of the well-measured SNe Ia sample. We then propose a modus operandi that provides the number of visits (per band) required to reach higher redshifts. The results of this approach are used to design a set of optimized DD surveys for SNe Ia cosmology. We show that most accurate cosmological measurements are achieved with Deep Rolling surveys characterized by a high cadence (one day), a rolling strategy (each field observed at least two seasons), and two sets of fields: ultra-deep ($z \gtrsim 0.8$) and deep ($z \gtrsim 0.6$) fields. We also demonstrate that a deterministic scheduler including a gap recovery mechanism is critical to achieve a high quality DD survey required for SNe Ia cosmology. △ Less

Submitted 16 May, 2022; originally announced May 2022.

Comments: 26 pages, 16 figures

LADUMA: Discovery of a luminous OH megamaser at $z > 0.5$

Authors: Marcin Glowacki, Jordan D. Collier, Amir Kazemi-Moridani, Bradley Frank, Hayley Roberts, Jeremy Darling, Hans-Rainer Klöckner, Nathan Adams, Andrew J. Baker, Matthew Bershady, Tariq Blecher, Sarah-Louise Blyth, Rebecca Bowler, Barbara Catinella, Laurent Chemin, Steven M. Crawford, Catherine Cress, Romeel Davé, Roger Deane, Erwin de Blok, Jacinta Delhaize, Kenneth Duncan, Ed Elson, Sean February, Eric Gawiser , et al. (43 additional authors not shown)

Abstract: In the local Universe, OH megamasers (OHMs) are detected almost exclusively in infrared-luminous galaxies, with a prevalence that increases with IR luminosity, suggesting that they trace gas-rich galaxy mergers. Given the proximity of the rest frequencies of OH and the hyperfine transition of neutral atomic hydrogen (HI), radio surveys to probe the cosmic evolution of HI in galaxies also offer exc… ▽ More In the local Universe, OH megamasers (OHMs) are detected almost exclusively in infrared-luminous galaxies, with a prevalence that increases with IR luminosity, suggesting that they trace gas-rich galaxy mergers. Given the proximity of the rest frequencies of OH and the hyperfine transition of neutral atomic hydrogen (HI), radio surveys to probe the cosmic evolution of HI in galaxies also offer exciting prospects for exploiting OHMs to probe the cosmic history of gas-rich mergers. Using observations for the Looking At the Distant Universe with the MeerKAT Array (LADUMA) deep HI survey, we report the first untargeted detection of an OHM at $z > 0.5$, LADUMA J033046.20$-$275518.1 (nicknamed "Nkalakatha"). The host system, WISEA J033046.26$-$275518.3, is an infrared-luminous radio galaxy whose optical redshift $z \approx 0.52$ confirms the MeerKAT emission line detection as OH at a redshift $z_{\rm OH} = 0.5225 \pm 0.0001$ rather than HI at lower redshift. The detected spectral line has 18.4$σ$ peak significance, a width of $459 \pm 59\,{\rm km\,s^{-1}}$, and an integrated luminosity of $(6.31 \pm 0.18\,{\rm [statistical]}\,\pm 0.31\,{\rm [systematic]}) \times 10^3\,L_\odot$, placing it among the most luminous OHMs known. The galaxy's far-infrared luminosity $L_{\rm FIR} = (1.576 \pm 0.013) \times 10^{12}\,L_\odot$ marks it as an ultra-luminous infrared galaxy; its ratio of OH and infrared luminosities is similar to those for lower-redshift OHMs. A comparison between optical and OH redshifts offers a slight indication of an OH outflow. This detection represents the first step towards a systematic exploitation of OHMs as a tracer of galaxy growth at high redshifts. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Comments: 10 pages, 4 figures. Accepted to ApJ Letters

Snowmass2021 Cosmic Frontier White Paper: Enabling Flagship Dark Energy Experiments to Reach their Full Potential

Authors: Jonathan A. Blazek, Doug Clowe, Thomas E. Collett, Ian P. Dell'Antonio, Mark Dickinson, Lluís Galbany, Eric Gawiser, Katrin Heitmann, Renée Hložek, Mustapha Ishak, Saurabh W. Jha, Alex G. Kim, C. Danielle Leonard, Anja von der Linden, Michelle Lochner, Rachel Mandelbaum, Peter Melchior, Joel Meyers, Jeffrey A. Newman, Peter Nugent, Saul Perlmutter, Daniel J. Perrefort, Javier Sánchez, Samuel J. Schmidt, Sukhdeep Singh , et al. (3 additional authors not shown)

Abstract: A new generation of powerful dark energy experiments will open new vistas for cosmology in the next decade. However, these projects cannot reach their utmost potential without data from other telescopes. This white paper focuses in particular on the compelling benefits of ground-based spectroscopic and photometric observations to complement the Vera C. Rubin Observatory, as well as smaller program… ▽ More A new generation of powerful dark energy experiments will open new vistas for cosmology in the next decade. However, these projects cannot reach their utmost potential without data from other telescopes. This white paper focuses in particular on the compelling benefits of ground-based spectroscopic and photometric observations to complement the Vera C. Rubin Observatory, as well as smaller programs in aid of a DESI-2 experiment and CMB-S4. These additional data sets will both improve dark energy constraints from these flagship projects beyond what would possible on their own and open completely new windows into fundamental physics. For example, additional photometry and single-object spectroscopy will provide necessary follow-up information for supernova and strong lensing cosmology, while highly-multiplexed spectroscopy both from smaller facilities over wide fields and from larger facilities over narrower regions of sky will yield more accurate photometric redshift estimates for weak lensing and galaxy clustering measurements from the Rubin Observatory, provide critical spectroscopic host galaxy redshifts for supernova Hubble diagrams, provide improved understanding of limiting astrophysical systematic effects, and enable new measurements that probe the nature of gravity. A common thread is that access to complementary data from a range of telescopes/instruments would have a substantial impact on the rate of advance of dark energy science in the coming years. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Comments: White paper submitted to the Proceedings of the US Community Study on the Future of Particle Physics (Snowmass 2021)

A Hitchhiker's Guide to Anomaly Detection with Astronomaly

Authors: Michelle Lochner, Bruce A. Bassett

Abstract: The next generation of telescopes such as the SKA and the Rubin Observatory will produce enormous data sets, requiring automated anomaly detection to enable scientific discovery. Here, we present an overview and friendly user guide to the Astronomaly framework for active anomaly detection in astronomical data. Astronomaly uses active learning to combine the raw processing power of machine learning… ▽ More The next generation of telescopes such as the SKA and the Rubin Observatory will produce enormous data sets, requiring automated anomaly detection to enable scientific discovery. Here, we present an overview and friendly user guide to the Astronomaly framework for active anomaly detection in astronomical data. Astronomaly uses active learning to combine the raw processing power of machine learning with the intuition and experience of a human user, enabling personalised recommendations of interesting anomalies. It makes use of a Python backend to perform data processing, feature extraction and machine learning to detect anomalous objects; and a JavaScript frontend to allow interaction with the data, labelling of interesting anomalous and active learning. Astronomaly is designed to be modular, extendable and run on almost any type of astronomical data. In this paper, we detail the structure of the Astronomaly code and provide guidelines for basic usage. △ Less

Submitted 25 January, 2022; originally announced January 2022.

Comments: 10 pages, 3 figures, to be published in Proc. ADASS XXXI (2021), coincides with v1.2 release of Astronomaly (https://github.com/MichelleLochner/astronomaly)

Real-time Detection of Anomalies in Multivariate Time Series of Astronomical Data

Authors: Daniel Muthukrishna, Kaisey S. Mandel, Michelle Lochner, Sara Webb, Gautham Narayan

Abstract: Astronomical transients are stellar objects that become temporarily brighter on various timescales and have led to some of the most significant discoveries in cosmology and astronomy. Some of these transients are the explosive deaths of stars known as supernovae while others are rare, exotic, or entirely new kinds of exciting stellar explosions. New astronomical sky surveys are observing unprecede… ▽ More Astronomical transients are stellar objects that become temporarily brighter on various timescales and have led to some of the most significant discoveries in cosmology and astronomy. Some of these transients are the explosive deaths of stars known as supernovae while others are rare, exotic, or entirely new kinds of exciting stellar explosions. New astronomical sky surveys are observing unprecedented numbers of multi-wavelength transients, making standard approaches of visually identifying new and interesting transients infeasible. To meet this demand, we present two novel methods that aim to quickly and automatically detect anomalous transient light curves in real-time. Both methods are based on the simple idea that if the light curves from a known population of transients can be accurately modelled, any deviations from model predictions are likely anomalies. The first approach is a probabilistic neural network built using Temporal Convolutional Networks (TCNs) and the second is an interpretable Bayesian parametric model of a transient. We show that the flexibility of neural networks, the attribute that makes them such a powerful tool for many regression tasks, is what makes them less suitable for anomaly detection when compared with our parametric model. △ Less

Submitted 15 December, 2021; originally announced December 2021.

Comments: 9 pages, 5 figures, Accepted at the NeurIPS 2021 workshop on Machine Learning and the Physical Sciences

The MeerKAT Galaxy Cluster Legacy Survey I. Survey Overview and Highlights

Authors: K. Knowles, W. D. Cotton, L. Rudnick, F. Camilo, S. Goedhart, R. Deane, M. Ramatsoku, M. F. Bietenholz, M. Brüggen, C. Button, H. Chen, J. O. Chibueze, T. E. Clarke, F. de Gasperin, R. Ianjamasimanana, G. I. G. Józsa, M. Hilton, K. C. Kesebonye, K. Kolokythas, R. C. Kraan-Korteweg, G. Lawrie, M. Lochner, S. I. Loubser, P. Marchegiani, N. Mhlahlo , et al. (126 additional authors not shown)

Abstract: MeerKAT's large number of antennas, spanning 8 km with a densely packed 1 km core, create a powerful instrument for wide-area surveys, with high sensitivity over a wide range of angular scales. The MeerKAT Galaxy Cluster Legacy Survey (MGCLS) is a programme of long-track MeerKAT L-band (900-1670 MHz) observations of 115 galaxy clusters, observed for $\sim$6-10 hours each in full polarisation. The… ▽ More MeerKAT's large number of antennas, spanning 8 km with a densely packed 1 km core, create a powerful instrument for wide-area surveys, with high sensitivity over a wide range of angular scales. The MeerKAT Galaxy Cluster Legacy Survey (MGCLS) is a programme of long-track MeerKAT L-band (900-1670 MHz) observations of 115 galaxy clusters, observed for $\sim$6-10 hours each in full polarisation. The first legacy product data release (DR1), made available with this paper, includes the MeerKAT visibilities, basic image cubes at $\sim$8" resolution, and enhanced spectral and polarisation image cubes at $\sim$8" and 15" resolutions. Typical sensitivities for the full-resolution MGCLS image products are $\sim$3-5 μJy/beam. The basic cubes are full-field and span 4 deg^2. The enhanced products consist of the inner 1.44 deg^2 field of view, corrected for the primary beam. The survey is fully sensitive to structures up to $\sim$10' scales and the wide bandwidth allows spectral and Faraday rotation map**. HI map** at 209 kHz resolution can be done at $0<z<0.09$ and $0.19<z<0.48$. In this paper, we provide an overview of the survey and DR1 products, including caveats for usage. We present some initial results from the survey, both for their intrinsic scientific value and to highlight the capabilities for further exploration with these data. These include a primary beam-corrected compact source catalogue of $\sim$626,000 sources for the full survey, and an optical/infrared cross-matched catalogue for compact sources in Abell 209 and Abell S295. We examine dust unbiased star-formation rates as a function of clustercentric radius in Abell 209 and present a catalogue of 99 diffuse cluster sources (56 are new), some of which have no suitable characterisation. We also highlight some of the radio galaxies which challenge current paradigms and present first results from HI studies of four targets. △ Less

Submitted 10 November, 2021; originally announced November 2021.

Comments: 43 pages, 33 figures, 6 tables. Accepted for publication in Astronomy and Astrophysics

Real-Time Detection of Anomalies in Large-Scale Transient Surveys

Authors: Daniel Muthukrishna, Kaisey S. Mandel, Michelle Lochner, Sara Webb, Gautham Narayan

Abstract: New time-domain surveys, such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), will observe millions of transient alerts each night, making standard approaches of visually identifying new and interesting transients infeasible. We present two novel methods of automatically detecting anomalous transient light curves in real-time. Both methods are based on the simple idea that… ▽ More New time-domain surveys, such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), will observe millions of transient alerts each night, making standard approaches of visually identifying new and interesting transients infeasible. We present two novel methods of automatically detecting anomalous transient light curves in real-time. Both methods are based on the simple idea that if the light curves from a known population of transients can be accurately modelled, any deviations from model predictions are likely anomalies. The first modelling approach is a probabilistic neural network built using Temporal Convolutional Networks (TCNs) and the second is an interpretable Bayesian parametric model of a transient. We demonstrate our methods' ability to provide anomaly scores as a function of time on light curves from the Zwicky Transient Facility. We show that the flexibility of neural networks, the attribute that makes them such a powerful tool for many regression tasks, is what makes them less suitable for anomaly detection when compared with our parametric model. The parametric model is able to identify anomalies with respect to common supernova classes with high precision and recall scores, achieving area under the precision-recall curves (AUCPR) above 0.79 for most rare classes such as kilonovae, tidal disruption events, intermediate luminosity transients, and pair-instability supernovae. Our ability to identify anomalies improves over the lifetime of the light curves. Our framework, used in conjunction with transient classifiers, will enable fast and prioritised followup of unusual transients from new large-scale surveys. △ Less

Submitted 5 October, 2022; v1 submitted 29 October, 2021; originally announced November 2021.

Comments: 27 pages, 23 figures, accepted for publication in MNRAS

Practical Galaxy Morphology Tools from Deep Supervised Representation Learning

Authors: Mike Walmsley, Anna M. M. Scaife, Chris Lintott, Michelle Lochner, Verlon Etsebeth, Tobias Géron, Hugh Dickinson, Lucy Fortson, Sandor Kruk, Karen L. Masters, Kameswara Bharadwaj Mantha, Brooke D. Simmons

Abstract: Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several rec… ▽ More Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. "#diffuse"), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100% accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly-labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled datasets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code Zoobot. Zoobot is accessible to researchers with no prior experience in deep learning. △ Less

Submitted 8 June, 2022; v1 submitted 25 October, 2021; originally announced October 2021.

Comments: 20 pages plus appendix. Accepted to MNRAS (open-access DOI below). Code, documentation, pretrained models: https://github.com/mwalmsley/zoobot (PyTorch and TensorFlow)

Journal ref: MNRAS Volume 513, Issue 2, June 2022, Pages 1581-1599

Optimization of the Observing Cadence for the Rubin Observatory Legacy Survey of Space and Time: a pioneering process of community-focused experimental design

Authors: Federica B. Bianco, Željko Ivezić, R. Lynne Jones, Melissa L. Graham, Phil Marshall, Abhijit Saha, Michael A. Strauss, Peter Yoachim, Tiago Ribeiro, Timo Anguita, Franz E. Bauer, Eric C. Bellm, Robert D. Blum, William N. Brandt, Sarah Brough, Màrcio Catelan, William I. Clarkson, Andrew J. Connolly, Eric Gawiser, John Gizis, Renee Hlozek, Sugata Kaviraj, Charles T. Liu, Michelle Lochner, Ashish A. Mahabal , et al. (21 additional authors not shown)

Abstract: Vera C. Rubin Observatory is a ground-based astronomical facility under construction, a joint project of the National Science Foundation and the U.S. Department of Energy, designed to conduct a multi-purpose 10-year optical survey of the southern hemisphere sky: the Legacy Survey of Space and Time. Significant flexibility in survey strategy remains within the constraints imposed by the core scienc… ▽ More Vera C. Rubin Observatory is a ground-based astronomical facility under construction, a joint project of the National Science Foundation and the U.S. Department of Energy, designed to conduct a multi-purpose 10-year optical survey of the southern hemisphere sky: the Legacy Survey of Space and Time. Significant flexibility in survey strategy remains within the constraints imposed by the core science goals of probing dark energy and dark matter, cataloging the Solar System, exploring the transient optical sky, and map** the Milky Way. The survey's massive data throughput will be transformational for many other astrophysics domains and Rubin's data access policy sets the stage for a huge potential users' community. To ensure that the survey science potential is maximized while serving as broad a community as possible, Rubin Observatory has involved the scientific community at large in the process of setting and refining the details of the observing strategy. The motivation, history, and decision-making process of this strategy optimization are detailed in this paper, giving context to the science-driven proposals and recommendations for the survey strategy included in this Focus Issue. △ Less

Submitted 1 September, 2021; v1 submitted 3 August, 2021; originally announced August 2021.

Comments: Submitted as the opening paper of the Astrophysical Journal Focus Issue on Rubin LSST cadence and survey strategy

Considerations for optimizing photometric classification of supernovae from the Rubin Observatory

Authors: Catarina S. Alves, Hiranya V. Peiris, Michelle Lochner, Jason D. McEwen, Tarek Allam Jr, Rahul Biswas

Abstract: The Vera C. Rubin Observatory will increase the number of observed supernovae (SNe) by an order of magnitude; however, it is impossible to spectroscopically confirm the class for all the SNe discovered. Thus, photometric classification is crucial but its accuracy depends on the not-yet-finalized observing strategy of Rubin Observatory's Legacy Survey of Space and Time (LSST). We quantitatively ana… ▽ More The Vera C. Rubin Observatory will increase the number of observed supernovae (SNe) by an order of magnitude; however, it is impossible to spectroscopically confirm the class for all the SNe discovered. Thus, photometric classification is crucial but its accuracy depends on the not-yet-finalized observing strategy of Rubin Observatory's Legacy Survey of Space and Time (LSST). We quantitatively analyze the impact of the LSST observing strategy on SNe classification using simulated multi-band light curves from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC). First, we augment the simulated training set to be representative of the photometric redshift distribution per supernovae class, the cadence of observations, and the flux uncertainty distribution of the test set. Then we build a classifier using the photometric transient classification library snmachine, based on wavelet features obtained from Gaussian process fits, yielding similar performance to the winning PLAsTiCC entry. We study the classification performance for SNe with different properties within a single simulated observing strategy. We find that season length is important, with light curves of 150 days yielding the highest performance. Cadence also has an important impact on SNe classification; events with median inter-night gap <3.5 days yield higher classification performance. Interestingly, we find that large gaps (>10 days) in light curve observations do not impact performance if sufficient observations are available on either side, due to the effectiveness of the Gaussian process interpolation. This analysis is the first exploration of the impact of observing strategy on photometric supernova classification with LSST. △ Less

Submitted 29 October, 2021; v1 submitted 15 July, 2021; originally announced July 2021.

Comments: 18 pages, 13 figures. Changed to match version accepted by the Astrophysical Journal Supplement Series (accepted 28/10/2021). Software publicly available at https://github.com/LSSTDESC/snmachine

Journal ref: 2022 ApJS 258 23

The Deeper, Wider, Faster Program: Exploring stellar flare activity with deep, fast cadenced DECam imaging via machine learning

Authors: Sara Webb, Chris Flynn, Jeff Cooke, Jielai Zhang, Ashish Mahabal, Tim Abbott, Rebecca Allen, Igor Andreoni, Sarah Bird, Simon Goode, Michelle Lochner, Tyler Pritchard

Abstract: We present our 500 pc distance-limited study of stellar fares using the Dark Energy Camera as part of the Deeper, Wider, Faster Program. The data was collected via continuous 20-second cadence g band imaging and we identify 19,914 sources with precise distances from Gaia DR2 within twelve, ~3 square-degree, fields over a range of Galactic latitudes. An average of ~74 minutes is spent on each field… ▽ More We present our 500 pc distance-limited study of stellar fares using the Dark Energy Camera as part of the Deeper, Wider, Faster Program. The data was collected via continuous 20-second cadence g band imaging and we identify 19,914 sources with precise distances from Gaia DR2 within twelve, ~3 square-degree, fields over a range of Galactic latitudes. An average of ~74 minutes is spent on each field per visit. All light curves were accessed through a novel unsupervised machine learning technique designed for anomaly detection. We identify 96 flare events occurring across 80 stars, the majority of which are M dwarfs. Integrated are energies range from $\sim 10^{31}-10^{37}$ erg, with a proportional relationship existing between increased are energy with increased distance from the Galactic plane, representative of stellar age leading to declining yet more energetic are events. In agreement with previous studies we observe an increase in flaring fraction from M0 -> M6 spectral types. Furthermore, we find a decrease in the flaring fraction of stars as vertical distance from the galactic plane is increased, with a steep decline present around ~100 pc. We find that ~70% of identified flares occur on short timescales of ~8 minutes. Finally we present our associated are rates, finding a volumetric rate of $2.9 \pm 0.3 \times 10^{-6}$ flares pc$^{-3}$ hr$^{-1}$. △ Less

Submitted 22 June, 2021; originally announced June 2021.

Comments: 20 pages, 14 figures, 6 tables

Multi-tasking the growth of cosmological structures

Authors: Louis Perenon, Matteo Martinelli, Stéphane Ilić, Roy Maartens, Michelle Lochner, Chris Clarkson

Abstract: Next-generation large-scale structure surveys will deliver a significant increase in the precision of growth data, allowing us to use `agnostic' methods to study the evolution of perturbations without the assumption of a cosmological model. We focus on a particular machine learning tool, Gaussian processes, to reconstruct the growth rate $f$, the root mean square of matter fluctuations $σ_8$, and… ▽ More Next-generation large-scale structure surveys will deliver a significant increase in the precision of growth data, allowing us to use `agnostic' methods to study the evolution of perturbations without the assumption of a cosmological model. We focus on a particular machine learning tool, Gaussian processes, to reconstruct the growth rate $f$, the root mean square of matter fluctuations $σ_8$, and their product $fσ_8$. We apply this method to simulated data, representing the precision of upcoming Stage IV galaxy surveys. We extend the standard single-task approach to a multi-task approach that reconstructs the three functions simultaneously, thereby taking into account their inter-dependence. We find that this multi-task approach outperforms the single-task approach for future surveys and will allow us to detect departures from the standard model with higher significance. By contrast, the limited sensitivity of current data severely hinders the use of agnostic methods, since the Gaussian processes parameters need to be fine tuned in order to obtain robust reconstructions. △ Less

Submitted 18 October, 2021; v1 submitted 4 May, 2021; originally announced May 2021.

Comments: 14 pages; 7 figures; Significant improvements. Version accepted by Phys. Dark Universe

Journal ref: Phys.Dark Univ. 34 (2021) 100898

The Impact of Observing Strategy on Cosmological Constraints with LSST

Authors: Michelle Lochner, Dan Scolnic, Husni Almoubayyed, Timo Anguita, Humna Awan, Eric Gawiser, Satya Gontcho A Gontcho, Philippe Gris, Simon Huber, Saurabh W. Jha, R. Lynne Jones, Alex G. Kim, Rachel Mandelbaum, Phil Marshall, Tanja Petrushevska, Nicolas Regnault, Christian N. Setzer, Sherry H. Suyu, Peter Yoachim, Rahul Biswas, Tristan Blaineau, Isobel Hook, Marc Moniez, Eric Neilsen, Hiranya Peiris , et al. (2 additional authors not shown)

Abstract: The generation-defining Vera C. Rubin Observatory will make state-of-the-art measurements of both the static and transient universe through its Legacy Survey for Space and Time (LSST). With such capabilities, it is immensely challenging to optimize the LSST observing strategy across the survey's wide range of science drivers. Many aspects of the LSST observing strategy relevant to the LSST Dark En… ▽ More The generation-defining Vera C. Rubin Observatory will make state-of-the-art measurements of both the static and transient universe through its Legacy Survey for Space and Time (LSST). With such capabilities, it is immensely challenging to optimize the LSST observing strategy across the survey's wide range of science drivers. Many aspects of the LSST observing strategy relevant to the LSST Dark Energy Science Collaboration, such as survey footprint definition, single visit exposure time and the cadence of repeat visits in different filters, are yet to be finalized. Here, we present metrics used to assess the impact of observing strategy on the cosmological probes considered most sensitive to survey design; these are large-scale structure, weak lensing, type Ia supernovae, kilonovae and strong lens systems (as well as photometric redshifts, which enable many of these probes). We evaluate these metrics for over 100 different simulated potential survey designs. Our results show that multiple observing strategy decisions can profoundly impact cosmological constraints with LSST; these include adjusting the survey footprint, ensuring repeat nightly visits are taken in different filters and enforcing regular cadence. We provide public code for our metrics, which makes them readily available for evaluating further modifications to the survey design. We conclude with a set of recommendations and highlight observing strategy factors that require further research. △ Less

Submitted 12 April, 2021; originally announced April 2021.

Comments: 49 pages, 17 figures

Journal ref: ApJS 259 58, 2022

Results of the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC)

Authors: R. Hložek, K. A. Ponder, A. I. Malz, M. Dai, G. Narayan, E. E. O. Ishida, T. Allam Jr, A. Bahmanyar, R. Biswas, L. Galbany, S. W. Jha, D. O. Jones, R. Kessler, M. Lochner, A. A. Mahabal, K. S. Mandel, J. R. Martínez-Galarza, J. D. McEwen, D. Muthukrishna, H. V. Peiris, C. M. Peters, C. N. Setzer

Abstract: Next-generation surveys like the Legacy Survey of Space and Time (LSST) on the Vera C. Rubin Observatory will generate orders of magnitude more discoveries of transients and variable stars than previous surveys. To prepare for this data deluge, we developed the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC), a competition which aimed to catalyze the development of ro… ▽ More Next-generation surveys like the Legacy Survey of Space and Time (LSST) on the Vera C. Rubin Observatory will generate orders of magnitude more discoveries of transients and variable stars than previous surveys. To prepare for this data deluge, we developed the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC), a competition which aimed to catalyze the development of robust classifiers under LSST-like conditions of a non-representative training set for a large photometric test set of imbalanced classes. Over 1,000 teams participated in PLAsTiCC, which was hosted in the Kaggle data science competition platform between Sep 28, 2018 and Dec 17, 2018, ultimately identifying three winners in February 2019. Participants produced classifiers employing a diverse set of machine learning techniques including hybrid combinations and ensemble averages of a range of approaches, among them boosted decision trees, neural networks, and multi-layer perceptrons. The strong performance of the top three classifiers on Type Ia supernovae and kilonovae represent a major improvement over the current state-of-the-art within astronomy. This paper summarizes the most promising methods and evaluates their results in detail, highlighting future directions both for classifier development and simulation needs for a next generation PLAsTiCC data set. △ Less

Submitted 22 December, 2020; originally announced December 2020.

Comments: 20 pages, 14 figures

Astronomaly: Personalised Active Anomaly Detection in Astronomical Data

Authors: Michelle Lochner, Bruce A. Bassett

Abstract: Survey telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array will discover billions of static and dynamic astronomical sources. Properly mined, these enormous datasets will likely be wellsprings of rare or unknown astrophysical phenomena. The challenge is that the datasets are so large that most data will never be seen by human eyes; currently the most robust instrument w… ▽ More Survey telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array will discover billions of static and dynamic astronomical sources. Properly mined, these enormous datasets will likely be wellsprings of rare or unknown astrophysical phenomena. The challenge is that the datasets are so large that most data will never be seen by human eyes; currently the most robust instrument we have to detect relevant anomalies. Machine learning is a useful tool for anomaly detection in this regime. However, it struggles to distinguish between interesting anomalies and irrelevant data such as instrumental artefacts or rare astronomical sources that are simply not of interest to a particular scientist. Active learning combines the flexibility and intuition of the human brain with the raw processing power of machine learning. By strategically choosing specific objects for expert labelling, it minimises the amount of data that scientists have to look through while maximising potential scientific return. Here we introduce Astronomaly: a general anomaly detection framework with a novel active learning approach designed to provide personalised recommendations. Astronomaly can operate on most types of astronomical data, including images, light curves and spectra. We use the Galaxy Zoo dataset to demonstrate the effectiveness of Astronomaly, as well as simulated data to thoroughly test our new active learning approach. We find that for both datasets, Astronomaly roughly doubles the number of interesting anomalies found in the first 100 objects viewed by the user. Astronomaly is easily extendable to include new feature extraction techniques, anomaly detection algorithms and even different active learning approaches. The code is publicly available at https://github.com/MichelleLochner/astronomaly. △ Less

Submitted 6 October, 2021; v1 submitted 21 October, 2020; originally announced October 2020.

Comments: 26 pages, 11 figures. Matches published version. 2 minute video introducing Astronomaly: https://youtu.be/vyU0gJFiFxA

Journal ref: Astronomy and Computing, Volume 36, July 2021, 100481

Unsupervised machine learning for transient discovery in Deeper, Wider, Faster light curves

Authors: Sara Webb, Michelle Lochner, Daniel Muthukrishna, Jeff Cooke, Chris Flynn, Ashish Mahabal, Simon Goode, Igor Andreoni, Tyler Pritchard, Timothy M. C. Abbott

Abstract: Identification of anomalous light curves within time-domain surveys is often challenging. In addition, with the growing number of wide-field surveys and the volume of data produced exceeding astronomers ability for manual evaluation, outlier and anomaly detection is becoming vital for transient science. We present an unsupervised method for transient discovery using a clustering technique and the… ▽ More Identification of anomalous light curves within time-domain surveys is often challenging. In addition, with the growing number of wide-field surveys and the volume of data produced exceeding astronomers ability for manual evaluation, outlier and anomaly detection is becoming vital for transient science. We present an unsupervised method for transient discovery using a clustering technique and the Astronomaly package. As proof of concept, we evaluate 85553 minute-cadenced light curves collected over two 1.5 hour periods as part of the Deeper, Wider, Faster program, using two different telescope dithering strategies. By combining the clustering technique HDBSCAN with the isolation forest anomaly detection algorithm via the visual interface of Astronomaly, we are able to rapidly isolate anomalous sources for further analysis. We successfully recover the known variable sources, across a range of catalogues from within the fields, and find a further 7 uncatalogued variables and two stellar flare events, including a rarely observed ultra fast flare (5 minute) from a likely M-dwarf. △ Less

Submitted 11 August, 2020; originally announced August 2020.

Comments: Accepted 7 Aug 2020, 19 pages, 8 figures,

Enhancing LSST Science with Euclid Synergy

Authors: P. Capak, J-C. Cuillandre, F. Bernardeau, F. Castander, R. Bowler, C. Chang, C. Grillmair, P. Gris, T. Eifler, C. Hirata, I. Hook, B. Jain, K. Kuijken, M. Lochner, P. Oesch, S. Paltani, J. Rhodes, B. Robertson, D. Rubin, R. Scaramella, C. Scarlata, D. Scolnic, J. Silverman, S. Wachter, Y. Wang , et al. (1 additional authors not shown)

Abstract: This white paper is the result of the Tri-Agency Working Group (TAG) appointed to develop synergies between missions and is intended to clarify what LSST observations are needed in order to maximally enhance the combined science output of LSST and Euclid. To facilitate LSST planning we provide a range of possible LSST surveys with clear metrics based on the improvement in the Dark Energy figure of… ▽ More This white paper is the result of the Tri-Agency Working Group (TAG) appointed to develop synergies between missions and is intended to clarify what LSST observations are needed in order to maximally enhance the combined science output of LSST and Euclid. To facilitate LSST planning we provide a range of possible LSST surveys with clear metrics based on the improvement in the Dark Energy figure of merit (FOM). To provide a quantifiable metric we present five survey options using only between 0.3 and 3.8% of the LSST 10 year survey. We also provide information so that the LSST DDF cadence can possibly be matched to those of \emph{Euclid} in common deep fields, SXDS, COSMOS, CDFS, and a proposed new LSST deep field (near the Akari Deep Field South). Co-coordination of observations from the Large Synoptic Survey Telescope (LSST) and Euclid will lead to a significant number of synergies. The combination of optical multi-band imaging from LSST with high resolution optical and near-infrared photometry and spectroscopy from \emph{Euclid} will not only improve constraints on Dark Energy, but provide a wealth of science on the Milky Way, local group, local large scale structure, and even on first galaxies during the epoch of reionization. A detailed paper has been published on the Dark Energy science case (Rhodes et al.) by a joint LSST/Euclid working group as well as a white paper describing LSST/Euclid/WFIRST synergies (Jain et al.), and we will briefly describe other science cases here. A companion white paper argues the general science case for an extension of the LSST footprint to the north at airmass < 1.8, and we support the white papers for southern extensions of the LSST survey. △ Less

Submitted 23 April, 2019; originally announced April 2019.

Comments: LSST Survey White Paper Submitted in Dec 2018

Mini-survey of the northern sky to Dec <+30

Authors: P. Capak, D. Sconlic, J-C. Cuillandre, F. Castander, A. Bolton, R. Bowler, C. Chang, A. Dey, T. Eifler, D. Eisenstein, C. Grillmair, P. Gris, N. Hernitschek, I. Hook, C. Hirata, B. Jain K. Kuijken, M. Lochner, J. Newman, P. Oesch, K. Olsen, J. Rhodes, B. Robertson, D. Rubin, C. Scarlata, J. Silverman , et al. (3 additional authors not shown)

Abstract: We propose an extension of the LSST survey to cover the northern sky to DEC < +30 (accessible at airmass <1.8). This survey will increase the LSST sky coverage by ~9,600 square degrees from 18,900 to 28,500 square degrees (a 50% increase) but use only 0.6-2.5% of the time depending on the synergies with other surveys. This increased area addresses a wide range of science cases that enhance all of… ▽ More We propose an extension of the LSST survey to cover the northern sky to DEC < +30 (accessible at airmass <1.8). This survey will increase the LSST sky coverage by ~9,600 square degrees from 18,900 to 28,500 square degrees (a 50% increase) but use only 0.6-2.5% of the time depending on the synergies with other surveys. This increased area addresses a wide range of science cases that enhance all of the primary LSST science goals by significant amounts. The science enabled includes: increasing the area of the sky accessible for follow-up of multi-messenger transients including gravitational waves, map** the milky way halo and halo dwarfs including discovery of RR Lyrae stars in the outer galactic halo, discovery of z>7 quasars in combination Euclid, enabling a second generation DESI and other spectroscopic surveys, and enhancing all areas of science by improving synergies with Euclid, WFIRST, and unique northern survey facilities. This white paper is the result of the Tri-Agency Working Group (TAG) appointed to develop synergies between missions and presents a unified plan for northern coverage. The range of time estimates reflects synergies with other surveys. If the modified DESC WFD survey, the ecliptic plane mini survey, and the north galactic spur mini survey are executed this plan would only need 0.6% of the LSST time, however if none of these are included the overall request is 2.5% of the 10 year survey life. In other words, the majority of these observations are already suggested as part of these other surveys and the intent of this white paper is to propose a unified baseline plan to carry out a broad range of objectives to facilitate a combination of multiple science objectives. A companion white paper gives Euclid specific science goals, and we support the white papers for southern extensions of the LSST survey. △ Less

Submitted 23 April, 2019; originally announced April 2019.

Comments: LSST Survey White Paper Submitted in Dec 2018

Deep Multi-object Spectroscopy to Enhance Dark Energy Science from LSST

Authors: Jeffrey A. Newman, Jonathan Blazek, Nora Elisa Chisari, Douglas Clowe, Ian Dell'Antonio, Eric Gawiser, Renée A. Hložek, Alex G. Kim, Anja von der Linden, Michelle Lochner, Rachel Mandelbaum, Elinor Medezinski, Peter Melchior, F. Javier Sánchez, Samuel J. Schmidt, Sukhdeep Singh, Rongpu Zhou

Abstract: Community access to deep (i ~ 25), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 8-40m telescopes would greatly improve measurements of cosmological parameters from LSST. The largest gain would come from improvements to LSST photometric redshifts, which are employed directly or indirectly for every major LSST cosmological probe; deep spectroscopic datasets will en… ▽ More Community access to deep (i ~ 25), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 8-40m telescopes would greatly improve measurements of cosmological parameters from LSST. The largest gain would come from improvements to LSST photometric redshifts, which are employed directly or indirectly for every major LSST cosmological probe; deep spectroscopic datasets will enable reduced uncertainties in the redshifts of individual objects via optimized training. Such spectroscopy will also determine the relationship of galaxy SEDs to their environments, key observables for studies of galaxy evolution. The resulting data will also constrain the impact of blending on photo-z's. Focused spectroscopic campaigns can also improve weak lensing cosmology by constraining the intrinsic alignments between the orientations of galaxies. Galaxy cluster studies can be enhanced by measuring motions of galaxies in and around clusters and by testing photo-z performance in regions of high density. Photometric redshift and intrinsic alignment studies are best-suited to instruments on large-aperture telescopes with wider fields of view (e.g., Subaru/PFS, MSE, or GMT/MANIFEST) but cluster investigations can be pursued with smaller-field instruments (e.g., Gemini/GMOS, Keck/DEIMOS, or TMT/WFOS), so deep MOS work can be distributed amongst a variety of telescopes. However, community access to large amounts of nights for surveys will still be needed to accomplish this work. In two companion white papers we present gains from shallower, wide-area MOS and from single-target imaging and spectroscopy. △ Less

Submitted 21 March, 2019; originally announced March 2019.

Comments: Science white paper submitted to the Astro2020 decadal survey. A table of time requirements is available at http://d-scholarship.pitt.edu/36036/

Wide-field Multi-object Spectroscopy to Enhance Dark Energy Science from LSST

Authors: Rachel Mandelbaum, Jonathan Blazek, Nora Elisa Chisari, Thomas Collett, Lluís Galbany, Eric Gawiser, Renée A. Hložek, Alex G. Kim, C. Danielle Leonard, Michelle Lochner, Jeffrey A. Newman, Daniel J. Perrefort, Samuel J. Schmidt, Sukhdeep Singh, Mark Sullivan

Abstract: LSST will open new vistas for cosmology in the next decade, but it cannot reach its full potential without data from other telescopes. Cosmological constraints can be greatly enhanced using wide-field ($>20$ deg$^2$ total survey area), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 4-15m telescopes. This could come in the form of suitably-designed large surveys and… ▽ More LSST will open new vistas for cosmology in the next decade, but it cannot reach its full potential without data from other telescopes. Cosmological constraints can be greatly enhanced using wide-field ($>20$ deg$^2$ total survey area), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 4-15m telescopes. This could come in the form of suitably-designed large surveys and/or community access to add new targets to existing projects. First, photometric redshifts can be calibrated with high precision using cross-correlations of photometric samples against spectroscopic samples at $0 < z < 3$ that span thousands of sq. deg. Cross-correlations of faint LSST objects and lensing maps with these spectroscopic samples can also improve weak lensing cosmology by constraining intrinsic alignment systematics, and will also provide new tests of modified gravity theories. Large samples of LSST strong lens systems and supernovae can be studied most efficiently by piggybacking on spectroscopic surveys covering as much of the LSST extragalactic footprint as possible (up to $\sim20,000$ square degrees). Finally, redshifts can be measured efficiently for a high fraction of the supernovae in the LSST Deep Drilling Fields (DDFs) by targeting their hosts with wide-field spectrographs. Targeting distant galaxies, supernovae, and strong lens systems over wide areas in extended surveys with (e.g.) DESI or MSE in the northern portion of the LSST footprint or 4MOST in the south could realize many of these gains; DESI, 4MOST, Subaru/PFS, or MSE would all be well-suited for DDF surveys. The most efficient solution would be a new wide-field, highly-multiplexed spectroscopic instrument in the southern hemisphere with $>6$m aperture. In two companion white papers we present gains from deep, small-area MOS and from single-target imaging and spectroscopy. △ Less

Submitted 21 March, 2019; originally announced March 2019.

Comments: Submitted to the call for Astro2020 science white papers; tables with estimates of telescope time needed for a supernova host survey can be seen at http://d-scholarship.pitt.edu/id/eprint/36041

The Role of Machine Learning in the Next Decade of Cosmology

Authors: Michelle Ntampaka, Camille Avestruz, Steven Boada, Joao Caldeira, Jessi Cisewski-Kehe, Rosanne Di Stefano, Cora Dvorkin, August E. Evrard, Arya Farahi, Doug Finkbeiner, Shy Genel, Alyssa Goodman, Andy Goulding, Shirley Ho, Arthur Kosowsky, Paul La Plante, Francois Lanusse, Michelle Lochner, Rachel Mandelbaum, Daisuke Nagai, Jeffrey A. Newman, Brian Nord, J. E. G. Peek, Austin Peel, Barnabas Poczos , et al. (5 additional authors not shown)

Abstract: In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster an… ▽ More In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors. △ Less

Submitted 14 January, 2021; v1 submitted 26 February, 2019; originally announced February 2019.

Comments: Submitted to the Astro2020 call for science white papers

Optimizing the LSST Observing Strategy for Dark Energy Science: DESC Recommendations for the Deep Drilling Fields and other Special Programs

Authors: Daniel M. Scolnic, Michelle Lochner, Phillipe Gris, Nicolas Regnault, Renée Hložek, Greg Aldering, Tarek Allam Jr, Humna Awan, Rahul Biswas, Jonathan Blazek, Chihway Chang, Eric Gawiser, Ariel Goobar, Isobel M. Hook, Saurabh W. Jha, Jason D. McEwen, Rachel Mandelbaum, Phil Marshall, Eric Neilsen, Jason Rhodes, Daniel Rothchild, Ignacio Sevilla Noarbe, Anže Slosar, Peter Yoachim

Abstract: We review the measurements of dark energy enabled by observations of the Deep Drilling Fields and the optimization of survey design for cosmological measurements. This white paper is the result of efforts by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy for the DDFs that will benefit all cosmolo… ▽ More We review the measurements of dark energy enabled by observations of the Deep Drilling Fields and the optimization of survey design for cosmological measurements. This white paper is the result of efforts by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy for the DDFs that will benefit all cosmological analyses with LSST. It is accompanied by the DESC-WFD white paper (Lochner et al.). We argue for altering the nominal deep drilling plan to have $>6$ month seasons, interweaving $gri$ and $zy$ observations every 3 days with 2, 4, 8, 25, 4 visits in $grizy$, respectively. These recommendations are guided by metrics optimizing constraints on dark energy and mitigation of systematic uncertainties, including specific requirements on total number of visits after Y1 and Y10 for photometric redshifts (photo-$z$) and weak lensing systematics. We specify the precise locations for the previously-chosen LSST deep fields (ELAIS-S1, XMM-LSS, CDF-S, and COSMOS) and recommend Akari Deep Field South as the planned fifth deep field in order to synergize with Euclid and WFIRST. Our recommended DDF strategy uses $6.2\%$ of the LSST survey time. We briefly discuss synergy with white papers from other collaborations, as well as additional mini-surveys and Target-of-Opportunity programs that lead to better measurements of dark energy. △ Less

Submitted 30 November, 2018; originally announced December 2018.

Comments: The LSST DESC response (DDF) to the Call for White Papers on LSST Cadence Optimization. Comments welcome

Optimizing the LSST Observing Strategy for Dark Energy Science: DESC Recommendations for the Wide-Fast-Deep Survey

Authors: Michelle Lochner, Daniel M. Scolnic, Humna Awan, Nicolas Regnault, Philippe Gris, Rachel Mandelbaum, Eric Gawiser, Husni Almoubayyed, Christian N. Setzer, Simon Huber, Melissa L. Graham, Renée Hložek, Rahul Biswas, Tim Eifler, Daniel Rothchild, Tarek Allam Jr, Jonathan Blazek, Chihway Chang, Thomas Collett, Ariel Goobar, Isobel M. Hook, Mike Jarvis, Saurabh W. Jha, Alex G. Kim, Phil Marshall , et al. (11 additional authors not shown)

Abstract: Cosmology is one of the four science pillars of LSST, which promises to be transformative for our understanding of dark energy and dark matter. The LSST Dark Energy Science Collaboration (DESC) has been tasked with deriving constraints on cosmological parameters from LSST data. Each of the cosmological probes for LSST is heavily impacted by the choice of observing strategy. This white paper is wri… ▽ More Cosmology is one of the four science pillars of LSST, which promises to be transformative for our understanding of dark energy and dark matter. The LSST Dark Energy Science Collaboration (DESC) has been tasked with deriving constraints on cosmological parameters from LSST data. Each of the cosmological probes for LSST is heavily impacted by the choice of observing strategy. This white paper is written by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy that will benefit all cosmological analyses with LSST. It is accompanied by the DESC DDF (Deep Drilling Fields) white paper (Scolnic et al.). We use a variety of metrics to understand the effects of the observing strategy on measurements of weak lensing, large-scale structure, clusters, photometric redshifts, supernovae, strong lensing and kilonovae. In order to reduce systematic uncertainties, we conclude that the current baseline observing strategy needs to be significantly modified to result in the best possible cosmological constraints. We provide some key recommendations: moving the WFD (Wide-Fast-Deep) footprint to avoid regions of high extinction, taking visit pairs in different filters, changing the 2x15s snaps to a single exposure to improve efficiency, focusing on strategies that reduce long gaps (>15 days) between observations, and prioritizing spatial uniformity at several intervals during the 10-year survey. △ Less

Submitted 14 December, 2018; v1 submitted 30 November, 2018; originally announced December 2018.

Comments: The LSST DESC response (WFD) to the Call for White Papers on LSST Cadence Optimization. Comments welcome

Classification of Multiwavelength Transients with Machine Learning

Authors: K. Sooknunan, M. Lochner, Bruce A. Bassett, H. V. Peiris, R. Fender, A. J. Stewart, M. Pietka, P. A. Woudt, J. D. McEwen, O. Lahav

Abstract: With the advent of powerful telescopes such as the Square Kilometer Array and the Vera C. Rubin Observatory, we are entering an era of multiwavelength transient astronomy that will lead to a dramatic increase in data volume. Machine learning techniques are well suited to address this data challenge and rapidly classify newly detected transients. We present a multiwavelength classification algorith… ▽ More With the advent of powerful telescopes such as the Square Kilometer Array and the Vera C. Rubin Observatory, we are entering an era of multiwavelength transient astronomy that will lead to a dramatic increase in data volume. Machine learning techniques are well suited to address this data challenge and rapidly classify newly detected transients. We present a multiwavelength classification algorithm consisting of three steps: (1) interpolation and augmentation of the data using Gaussian processes; (2) feature extraction using wavelets; and (3) classification with random forests. Augmentation provides improved performance at test time by balancing the classes and adding diversity into the training set. In the first application of machine learning to the classification of real radio transient data, we apply our technique to the Green Bank Interferometer and other radio light curves. We find we are able to accurately classify most of the 11 classes of radio variables and transients after just eight hours of observations, achieving an overall test accuracy of 78 percent. We fully investigate the impact of the small sample size of 82 publicly available light curves and use data augmentation techniques to mitigate the effect. We also show that on a significantly larger simulated representative training set that the algorithm achieves an overall accuracy of 97 percent, illustrating that the method is likely to provide excellent performance on future surveys. Finally, we demonstrate the effectiveness of simultaneous multiwavelength observations by showing how incorporating just one optical data point into the analysis improves the accuracy of the worst performing class by 19 percent. △ Less

Submitted 8 March, 2021; v1 submitted 20 November, 2018; originally announced November 2018.

Comments: 16 pages, 12 figures

Journal ref: Monthly Notices of the Royal Astronomical Society, Volume 502, Issue 1, March 2021, Pages 206-224

The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Data set

Authors: The PLAsTiCC team, Tarek Allam Jr., Anita Bahmanyar, Rahul Biswas, Mi Dai, Lluís Galbany, Renée Hložek, Emille E. O. Ishida, Saurabh W. Jha, David O. Jones, Richard Kessler, Michelle Lochner, Ashish A. Mahabal, Alex I. Malz, Kaisey S. Mandel, Juan Rafael Martínez-Galarza, Jason D. McEwen, Daniel Muthukrishna, Gautham Narayan, Hiranya Peiris, Christina M. Peters, Kara Ponder, Christian N. Setzer, The LSST Dark Energy Science Collaboration, The LSST Transients , et al. (1 additional authors not shown)

Abstract: The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering… ▽ More The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering and measuring millions of time-varying objects. In this challenge, we pose the question: how well can we classify objects in the sky that vary in brightness from simulated LSST time-series data, with all its challenges of non-representativity? In this note we explain the need for a data challenge to help classify such astronomical sources and describe the PLAsTiCC data set and Kaggle data challenge, noting that while the references are provided for context, they are not needed to participate in the challenge. △ Less

Submitted 28 September, 2018; originally announced October 2018.

Comments: Research note to accompany the https://www.kaggle.com/c/PLAsTiCC-2018 challenge

The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Selection of a performance metric for classification probabilities balancing diverse science goals

Authors: A. I. Malz, R. Hložek, T. Allam Jr, A. Bahmanyar, R. Biswas, M. Dai, L. Galbany, E. E. O. Ishida, S. W. Jha, D. O. Jones, R. Kessler, M. Lochner, A. A. Mahabal, K. S. Mandel, J. R. Martínez-Galarza, J. D. McEwen, D. Muthukrishna, G. Narayan, H. Peiris, C. M. Peters, K. A. Ponder, C. N. Setzer, The LSST Dark Energy Science Collaboration, The LSST Transients, Variable Stars Science Collaboration

Abstract: Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic… ▽ More Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic classification is more appropriate for the data but are incompatible with the traditional metrics used on deterministic classifications. Furthermore, large survey collaborations intend to use these classification probabilities for diverse science objectives, indicating a need for a metric that balances a variety of goals. We describe the process used to develop an optimal performance metric for an open classification challenge that seeks probabilistic classifications and must serve many scientific interests. The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC) is an open competition aiming to identify promising techniques for obtaining classification probabilities of transient and variable objects by engaging a broader community both within and outside astronomy. Using mock classification probability submissions emulating archetypes of those anticipated of PLAsTiCC, we compare the sensitivity of metrics of classification probabilities under various weighting schemes, finding that they yield qualitatively consistent results. We choose as a metric for PLAsTiCC a weighted modification of the cross-entropy because it can be meaningfully interpreted. Finally, we propose extensions of our methodology to ever more complex challenge goals and suggest some guiding principles for approaching the choice of a metric of probabilistic classifications. △ Less

Submitted 31 July, 2021; v1 submitted 28 September, 2018; originally announced September 2018.

Journal ref: AJ 158 5 171 (2019)

DeepSource: Point Source Detection using Deep Learning

Authors: A. Vafaei Sadr, Etienne. E. Vos, Bruce A. Bassett, Zafiirah Hosenie, N. Oozeer, Michelle Lochner

Abstract: Point source detection at low signal-to-noise is challenging for astronomical surveys, particularly in radio interferometry images where the noise is correlated. Machine learning is a promising solution, allowing the development of algorithms tailored to specific telescope arrays and science cases. We present DeepSource - a deep learning solution - that uses convolutional neural networks to achiev… ▽ More Point source detection at low signal-to-noise is challenging for astronomical surveys, particularly in radio interferometry images where the noise is correlated. Machine learning is a promising solution, allowing the development of algorithms tailored to specific telescope arrays and science cases. We present DeepSource - a deep learning solution - that uses convolutional neural networks to achieve these goals. DeepSource enhances the Signal-to-Noise Ratio (SNR) of the original map and then uses dynamic blob detection to detect sources. Trained and tested on two sets of 500 simulated 1 deg x 1 deg MeerKAT images with a total of 300,000 sources, DeepSource is essentially perfect in both purity and completeness down to SNR = 4 and outperforms PyBDSF in all metrics. For uniformly-weighted images it achieves a Purity x Completeness (PC) score at SNR = 3 of 0.73, compared to 0.31 for the best PyBDSF model. For natural-weighting we find a smaller improvement of ~40% in the PC score at SNR = 3. If instead we ask where either of the purity or completeness first drop to 90%, we find that DeepSource reaches this value at SNR = 3.6 compared to the 4.3 of PyBDSF (natural-weighting). A key advantage of DeepSource is that it can learn to optimally trade off purity and completeness for any science case under consideration. Our results show that deep learning is a promising approach to point source detection in astronomical images. △ Less

Submitted 7 July, 2018; originally announced July 2018.

Comments: 15 pages, 13 figures, submitted to MNRAS

Journal ref: MNRAS, Volume 484, Issue 2, April 2019, Pages 2793-2806

Radio Galaxy Shape Measurement with Hamiltonian Monte Carlo in the Visibility Domain

Authors: M. Rivi, M. Lochner, S. T. Balan, I. Harrison, F. B. Abdalla

Abstract: Radio weak lensing, while a highly promising complementary probe to optical weak lensing, will require incredible precision in the measurement of galaxy shape parameters. In this paper, we extend the Bayesian Inference for Radio Observations model fitting approach to measure galaxy shapes directly from visibility data of radio continuum surveys, instead of from image data. We apply a Hamiltonian M… ▽ More Radio weak lensing, while a highly promising complementary probe to optical weak lensing, will require incredible precision in the measurement of galaxy shape parameters. In this paper, we extend the Bayesian Inference for Radio Observations model fitting approach to measure galaxy shapes directly from visibility data of radio continuum surveys, instead of from image data. We apply a Hamiltonian Monte Carlo (HMC) technique for sampling the posterior, which is more efficient than the standard Monte Carlo Markov Chain method when dealing with a large dimensional parameter space. Adopting the exponential profile for galaxy model fitting allows us to analytically calculate the likelihood gradient required by HMC, allowing a faster and more accurate sampling. The method is tested on SKA1-MID simulated observations at 1.4 GHz of a field containing up to 1000 star-forming galaxies. It is also applied to a simulated observation of the weak lensing precursor survey SuperCLASS. In both cases we obtain reliable measurements of the galaxies' ellipticity and size for all sources with SNR $\ge 10$, and we also find relationships between the convergence properties of the HMC technique and some source parameters. Direct shape measurement in the visibility domain achieves high accuracy at the expected source number densities of the current and next SKA precursor continuum surveys. The proposed method can be easily extended for the fitting of other galaxy and scientific parameters, as well as simultaneously marginalising over systematic and instrumental effects. △ Less

Submitted 1 November, 2018; v1 submitted 17 May, 2018; originally announced May 2018.

Comments: 15 pages, 10 figures, 3 tables

Journal ref: MNRAS 2019, 482(1): 1096-1109

Machine learning cosmological structure formation

Authors: Luisa Lucie-Smith, Hiranya V. Peiris, Andrew Pontzen, Michelle Lochner

Abstract: We train a machine learning algorithm to learn cosmological structure formation from N-body simulations. The algorithm infers the relationship between the initial conditions and the final dark matter haloes, without the need to introduce approximate halo collapse models. We gain insights into the physics driving halo formation by evaluating the predictive performance of the algorithm when provided… ▽ More We train a machine learning algorithm to learn cosmological structure formation from N-body simulations. The algorithm infers the relationship between the initial conditions and the final dark matter haloes, without the need to introduce approximate halo collapse models. We gain insights into the physics driving halo formation by evaluating the predictive performance of the algorithm when provided with different types of information about the local environment around dark matter particles. The algorithm learns to predict whether or not dark matter particles will end up in haloes of a given mass range, based on spherical overdensities. We show that the resulting predictions match those of spherical collapse approximations such as extended Press-Schechter theory. Additional information on the shape of the local gravitational potential is not able to improve halo collapse predictions; the linear density field contains sufficient information for the algorithm to also reproduce ellipsoidal collapse predictions based on the Sheth-Tormen model. We investigate the algorithm's performance in terms of halo mass and radial position and perform blind analyses on independent initial conditions realisations to demonstrate the generality of our results. △ Less

Submitted 29 June, 2018; v1 submitted 12 February, 2018; originally announced February 2018.

Comments: 10 pages, 7 figures. Minor changes to match version published in MNRAS. Accepted on 22/06/2018

Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream

Authors: Gautham Narayan, Tayeb Zaidi, Monika D. Soraisam, Zhe Wang, Michelle Lochner, Thomas Matheson, Abhijit Saha, Shuo Yang, Zhenge Zhao, John Kececioglu, Carlos Scheidegger, Richard T. Snodgrass, Tim Axelrod, Tim Jenness, Robert S. Maier, Stephen T. Ridgway, Robert L. Seaman, Eric Michael Evans, Navdeep Singh, Clark Taylor, Jackson Toeniskoetter, Eric Welch, Songzhe Zhu

Abstract: The unprecedented volume and rate of transient events that will be discovered by the Large Synoptic Survey Telescope (LSST) demands that the astronomical community update its followup paradigm. Alert-brokers -- automated software system to sift through, characterize, annotate and prioritize events for followup -- will be critical tools for managing alert streams in the LSST era. The Arizona-NOAO T… ▽ More The unprecedented volume and rate of transient events that will be discovered by the Large Synoptic Survey Telescope (LSST) demands that the astronomical community update its followup paradigm. Alert-brokers -- automated software system to sift through, characterize, annotate and prioritize events for followup -- will be critical tools for managing alert streams in the LSST era. The Arizona-NOAO Temporal Analysis and Response to Events System (ANTARES) is one such broker. In this work, we develop a machine learning pipeline to characterize and classify variable and transient sources only using the available multiband optical photometry. We describe three illustrative stages of the pipeline, serving the three goals of early, intermediate and retrospective classification of alerts. The first takes the form of variable vs transient categorization, the second, a multi-class ty** of the combined variable and transient dataset, and the third, a purity-driven subty** of a transient class. While several similar algorithms have proven themselves in simulations, we validate their performance on real observations for the first time. We quantitatively evaluate our pipeline on sparse, unevenly sampled, heteroskedastic data from various existing observational campaigns, and demonstrate very competitive classification performance. We describe our progress towards adapting the pipeline developed in this work into a real-time broker working on live alert streams from time-domain surveys. △ Less

Submitted 22 January, 2018; originally announced January 2018.

Comments: 33 pages, 14 figures, submitted to ApJS

MeerKLASS: MeerKAT Large Area Synoptic Survey

Authors: Mario G. Santos, Michelle Cluver, Matt Hilton, Matt Jarvis, Gyula I. G. Jozsa, Lerothodi Leeuw, Oleg Smirnov, Russ Taylor, Filipe Abdalla, Jose Afonso, David Alonso, David Bacon, Bruce A. Bassett, Gianni Bernardi, Philip Bull, Stefano Camera, H. Cynthia Chiang, Sergio Colafrancesco, Pedro G. Ferreira, Jose Fonseca, Kurt van der Heyden, Ian Heywood, Kenda Knowles, Michelle Lochner, Yin-Zhe Ma , et al. (13 additional authors not shown)

Abstract: We discuss the ground-breaking science that will be possible with a wide area survey, using the MeerKAT telescope, known as MeerKLASS (MeerKAT Large Area Synoptic Survey). The current specifications of MeerKAT make it a great fit for science applications that require large survey speeds but not necessarily high angular resolutions. In particular, for cosmology, a large survey over… ▽ More We discuss the ground-breaking science that will be possible with a wide area survey, using the MeerKAT telescope, known as MeerKLASS (MeerKAT Large Area Synoptic Survey). The current specifications of MeerKAT make it a great fit for science applications that require large survey speeds but not necessarily high angular resolutions. In particular, for cosmology, a large survey over $\sim 4,000 \, {\rm deg}^2$ for $\sim 4,000$ hours will potentially provide the first ever measurements of the baryon acoustic oscillations using the 21cm intensity map** technique, with enough accuracy to impose constraints on the nature of dark energy. The combination with multi-wavelength data will give unique additional information, such as exquisite constraints on primordial non-Gaussianity using the multi-tracer technique, as well as a better handle on foregrounds and systematics. Such a wide survey with MeerKAT is also a great match for HI galaxy studies, providing unrivalled statistics in the pre-SKA era for galaxies resolved in the HI emission line beyond local structures at z > 0.01. It will also produce a large continuum galaxy sample down to a depth of about 5\,$μ$Jy in L-band, which is quite unique over such large areas and will allow studies of the large-scale structure of the Universe out to high redshifts, complementing the galaxy HI survey to form a transformational multi-wavelength approach to study galaxy dynamics and evolution. Finally, the same survey will supply unique information for a range of other science applications, including a large statistical investigation of galaxy clusters as well as produce a rotation measure map across a huge swathe of the sky. The MeerKLASS survey will be a crucial step on the road to using SKA1-MID for cosmological applications and other commensal surveys, as described in the top priority SKA key science projects (abridged). △ Less

Submitted 18 September, 2017; originally announced September 2017.

Comments: Larger version of the paper submitted to the Proceedings of Science, "MeerKAT Science: On the Pathway to the SKA", Stellenbosch, 25-27 May 2016

Science-Driven Optimization of the LSST Observing Strategy

Authors: LSST Science Collaboration, Phil Marshall, Timo Anguita, Federica B. Bianco, Eric C. Bellm, Niel Brandt, Will Clarkson, Andy Connolly, Eric Gawiser, Zeljko Ivezic, Lynne Jones, Michelle Lochner, Michael B. Lund, Ashish Mahabal, David Nidever, Knut Olsen, Stephen Ridgway, Jason Rhodes, Ohad Shemmer, David Trilling, Kathy Vivas, Lucianne Walkowicz, Beth Willman, Peter Yoachim, Scott Anderson , et al. (80 additional authors not shown)

Abstract: The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white… ▽ More The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible. △ Less

Submitted 14 August, 2017; originally announced August 2017.

Comments: 312 pages, 90 figures. Browse the current version at https://github.com/LSSTScienceCollaborations/ObservingStrategy, new contributions welcome!

Redshifts for galaxies in radio continuum surveys from Bayesian model fitting of HI 21-cm lines

Authors: Ian Harrison, Michelle Lochner, Michael L. Brown

Abstract: We introduce a new Bayesian HI spectral line fitting technique capable of obtaining spectroscopic redshifts for millions of galaxies in radio surveys with the Square Kilometere Array (SKA). This technique is especially well-suited to the low signal-to-noise regime that the redshifted 21-cm HI emission line is expected to be observed in, especially with SKA Phase 1, allowing for robust source detec… ▽ More We introduce a new Bayesian HI spectral line fitting technique capable of obtaining spectroscopic redshifts for millions of galaxies in radio surveys with the Square Kilometere Array (SKA). This technique is especially well-suited to the low signal-to-noise regime that the redshifted 21-cm HI emission line is expected to be observed in, especially with SKA Phase 1, allowing for robust source detection. After selecting a set of continuum objects relevant to large, cosmological-scale surveys with the first phase of the SKA dish array (SKA1-MID), we simulate data corresponding to their HI line emission as observed by the same telescope. We then use the MultiNest nested sampling code to find the best-fitting parametrised line profile, providing us with a full joint posterior probability distribution for the galaxy properties, including redshift. This provides high quality redshifts, with redshift errors $Δz / z <10^{-5}$, from radio data alone for some 1.8 million galaxies in a representative 5000 square degree survey with the SKA1-MID instrument with up-to-date sensitivity profiles. Interestingly, we find that the SNR definition commonly used in forecast papers does not correlate well with the actual detectability of an HI line using our method. We further detail how our method could be improved with per-object priors and how it may be also used to give robust constraints on other observables such as the HI mass function. We also make our line fitting code publicly available for application to other data sets. △ Less

Submitted 26 April, 2017; originally announced April 2017.

Comments: 10 pages, 8 figures, comments welcome. The anaylsis code is available at https://github.com/MichelleLochner/radio-z. The busy read should direct their attention to Figure 4. Submitted to MNRAS

zBEAMS: A unified solution for supernova cosmology with redshift uncertainties

Authors: Ethan Roberts, Michelle Lochner, José Fonseca, Bruce A. Bassett, Pierre-Yves Lablanche, Shankar Agarwal

Abstract: Supernova cosmology without spectra will be an important component of future surveys such as LSST. This lack of supernova spectra results in uncertainty in the redshifts which, if ignored, leads to significantly biased estimates of cosmological parameters. Here we present a hierarchical Bayesian formalism -- zBEAMS -- that addresses this problem by marginalising over the unknown or uncertain super… ▽ More Supernova cosmology without spectra will be an important component of future surveys such as LSST. This lack of supernova spectra results in uncertainty in the redshifts which, if ignored, leads to significantly biased estimates of cosmological parameters. Here we present a hierarchical Bayesian formalism -- zBEAMS -- that addresses this problem by marginalising over the unknown or uncertain supernova redshifts to produce unbiased cosmological estimates that are competitive with supernova data with spectroscopically confirmed redshifts. zBEAMS provides a unified treatment of both photometric redshifts and host galaxy misidentification (occurring due to chance galaxy alignments or faint hosts), effectively correcting the inevitable contamination in the Hubble diagram. Like its predecessor BEAMS, our formalism also takes care of non-Ia supernova contamination by marginalising over the unknown supernova type. We illustrate this technique with simulations of supernovae with photometric redshifts and host galaxy misidentification. A novel feature of the photometric redshift case is the important role played by the redshift distribution of the supernovae. △ Less

Submitted 26 October, 2017; v1 submitted 25 April, 2017; originally announced April 2017.

Comments: Matches published version, 18 pages, 6 figures, Code available: https://github.com/MichelleLochner/zBEAMS

Journal ref: JCAP 10, (2017) 036

Photometric Supernova Classification With Machine Learning

Authors: Michelle Lochner, Jason D. McEwen, Hiranya V. Peiris, Ofer Lahav, Max K. Winter

Abstract: Automated photometric supernova classification has become an active area of research in recent years in light of current and upcoming imaging surveys such as the Dark Energy Survey (DES) and the Large Synoptic Survey Telescope, given that spectroscopic confirmation of type for all supernovae discovered will be impossible. Here, we develop a multi-faceted classification pipeline, combining existing… ▽ More Automated photometric supernova classification has become an active area of research in recent years in light of current and upcoming imaging surveys such as the Dark Energy Survey (DES) and the Large Synoptic Survey Telescope, given that spectroscopic confirmation of type for all supernovae discovered will be impossible. Here, we develop a multi-faceted classification pipeline, combining existing and new approaches. Our pipeline consists of two stages: extracting descriptive features from the light curves and classification using a machine learning algorithm. Our feature extraction methods vary from model-dependent techniques, namely SALT2 fits, to more independent techniques fitting parametric models to curves, to a completely model-independent wavelet approach. We cover a range of representative machine learning algorithms, including naive Bayes, k-nearest neighbors, support vector machines, artificial neural networks and boosted decision trees (BDTs). We test the pipeline on simulated multi-band DES light curves from the Supernova Photometric Classification Challenge. Using the commonly used area under the curve (AUC) of the Receiver Operating Characteristic as a metric, we find that the SALT2 fits and the wavelet approach, with the BDTs algorithm, each achieves an AUC of 0.98, where 1 represents perfect classification. We find that a representative training set is essential for good classification, whatever the feature set or algorithm, with implications for spectroscopic follow-up. Importantly, we find that by using either the SALT2 or the wavelet feature sets with a BDT algorithm, accurate classification is possible purely from light curve data, without the need for any redshift information. △ Less

Submitted 7 September, 2016; v1 submitted 2 March, 2016; originally announced March 2016.

Comments: Matches published version. 15 pages, 7 figures

Journal ref: ApJS (2016), 225(2), p.31

Bayesian Inference for Radio Observations - Going beyond deconvolution

Authors: Michelle Lochner, Bruce A. Bassett, Martin Kunz, Iniyan Natarajan, Nadeem Oozeer, Oleg Smirnov, Jon Zwart

Abstract: Radio interferometers suffer from the problem of missing information in their data, due to the gaps between the antennas. This results in artifacts, such as bright rings around sources, in the images obtained. Multiple deconvolution algorithms have been proposed to solve this problem and produce cleaner radio images. However, these algorithms are unable to correctly estimate uncertainties in deriv… ▽ More Radio interferometers suffer from the problem of missing information in their data, due to the gaps between the antennas. This results in artifacts, such as bright rings around sources, in the images obtained. Multiple deconvolution algorithms have been proposed to solve this problem and produce cleaner radio images. However, these algorithms are unable to correctly estimate uncertainties in derived scientific parameters or to always include the effects of instrumental errors. We propose an alternative technique called Bayesian Inference for Radio Observations (BIRO) which uses a Bayesian statistical framework to determine the scientific parameters and instrumental errors simultaneously directly from the raw data, without making an image. We use a simple simulation of Westerbork Synthesis Radio Telescope data including pointing errors and beam parameters as instrumental effects, to demonstrate the use of BIRO. △ Less

Submitted 14 September, 2015; originally announced September 2015.

Comments: Conference proceedings of IAU Symposium 306. 3 pages, 4 figures

Journal ref: Proceedings of the International Astronomical Union, Symposium 306, (2015) 9

Bayesian Inference for Radio Observations

Authors: Michelle Lochner, Iniyan Natarajan, Jonathan T. L. Zwart, Oleg Smirnov, Bruce A. Bassett, Nadeem Oozeer, Martin Kunz

Abstract: New telescopes like the Square Kilometre Array (SKA) will push into a new sensitivity regime and expose systematics, such as direction-dependent effects, that could previously be ignored. Current methods for handling such systematics rely on alternating best estimates of instrumental calibration and models of the underlying sky, which can lead to inadequate uncertainty estimates and biased results… ▽ More New telescopes like the Square Kilometre Array (SKA) will push into a new sensitivity regime and expose systematics, such as direction-dependent effects, that could previously be ignored. Current methods for handling such systematics rely on alternating best estimates of instrumental calibration and models of the underlying sky, which can lead to inadequate uncertainty estimates and biased results because any correlations between parameters are ignored. These deconvolution algorithms produce a single image that is assumed to be a true representation of the sky, when in fact it is just one realization of an infinite ensemble of images compatible with the noise in the data. In contrast, here we report a Bayesian formalism that simultaneously infers both systematics and science. Our technique, Bayesian Inference for Radio Observations (BIRO), determines all parameters directly from the raw data, bypassing image-making entirely, by sampling from the joint posterior probability distribution. This enables it to derive both correlations and accurate uncertainties, making use of the flexible software MEQTREES to model the sky and telescope simultaneously. We demonstrate BIRO with two simulated sets of Westerbork Synthesis Radio Telescope data sets. In the first, we perform joint estimates of 103 scientific (flux densities of sources) and instrumental (pointing errors, beamwidth and noise) parameters. In the second example, we perform source separation with BIRO. Using the Bayesian evidence, we can accurately select between a single point source, two point sources and an extended Gaussian source, allowing for 'super-resolution' on scales much smaller than the synthesized beam. △ Less

Submitted 21 May, 2015; v1 submitted 21 January, 2015; originally announced January 2015.

Comments: Published in MNRAS. See https://vimeo.com/117391380 for a video of MultiNest converging to the correct source model

Journal ref: MNRAS 2015 450 (2): 1308-1319

Towards the Future of Supernova Cosmology

Authors: Michelle Lochner, Bruce A. Bassett, Melvin Varughese, Renée Hlozek, Martin Kunz, Mat Smith, James Newling

Abstract: For future surveys, spectroscopic follow-up for all supernovae will be extremely difficult. However, one can use light curve fitters, to obtain the probability that an object is a Type Ia. One may consider applying a probability cut to the data, but we show that the resulting non-Ia contamination can lead to biases in the estimation of cosmological parameters. A different method, which allows the… ▽ More For future surveys, spectroscopic follow-up for all supernovae will be extremely difficult. However, one can use light curve fitters, to obtain the probability that an object is a Type Ia. One may consider applying a probability cut to the data, but we show that the resulting non-Ia contamination can lead to biases in the estimation of cosmological parameters. A different method, which allows the use of the full dataset and results in unbiased cosmological parameter estimation, is Bayesian Estimation Applied to Multiple Species (BEAMS). BEAMS is a Bayesian approach to the problem which includes the uncertainty in the types in the evaluation of the posterior. Here we outline the theory of BEAMS and demonstrate its effectiveness using both simulated datasets and SDSS-II data. We also show that it is possible to use BEAMS if the data are correlated, by introducing a numerical marginalisation over the types of the objects. This is largely a pedagogical introduction to BEAMS with references to the main BEAMS papers. △ Less

Submitted 23 October, 2014; v1 submitted 8 March, 2013; originally announced March 2013.

Comments: Replaced under married name Lochner (formally Knights). 3 pages, 2 figures. To appear in the Proceedings of 13th Marcel Grossmann Meeting (MG13), Stockholm, Sweden, 1-7 July 2012

Extending BEAMS to incorporate correlated systematic uncertainties

Authors: Michelle Lochner, Bruce A. Bassett, Melvin Varughese, Renée Hlozek, Martin Kunz, Mat Smith, James Newling

Abstract: New supernova surveys such as the Dark Energy Survey, Pan-STARRS and the LSST will produce an unprecedented number of photometric supernova candidates, most with no spectroscopic data. Avoiding biases in cosmological parameters due to the resulting inevitable contamination from non-Ia supernovae can be achieved with the BEAMS formalism, allowing for fully photometric supernova cosmology studies. H… ▽ More New supernova surveys such as the Dark Energy Survey, Pan-STARRS and the LSST will produce an unprecedented number of photometric supernova candidates, most with no spectroscopic data. Avoiding biases in cosmological parameters due to the resulting inevitable contamination from non-Ia supernovae can be achieved with the BEAMS formalism, allowing for fully photometric supernova cosmology studies. Here we extend BEAMS to deal with the case in which the supernovae are correlated by systematic uncertainties. The analytical form of the full BEAMS posterior requires evaluating 2^N terms, where N is the number of supernova candidates. This `exponential catastrophe' is computationally unfeasible even for N of order 100. We circumvent the exponential catastrophe by marginalising numerically instead of analytically over the possible supernova types: we augment the cosmological parameters with nuisance parameters describing the covariance matrix and the types of all the supernovae, τ_i, that we include in our MCMC analysis. We show that this method deals well even with large, unknown systematic uncertainties without a major increase in computational time, whereas ignoring the correlations can lead to significant biases and incorrect credible contours. We then compare the numerical marginalisation technique with a perturbative expansion of the posterior based on the insight that future surveys will have exquisite light curves and hence the probability that a given candidate is a Type Ia will be close to unity or zero, for most objects. Although this perturbative approach changes computation of the posterior from a 2^N problem into an N^2 or N^3 one, we show that it leads to biases in general through a small number of misclassifications, implying that numerical marginalisation is superior. △ Less

Submitted 23 October, 2014; v1 submitted 15 May, 2012; originally announced May 2012.

Comments: Resubmitted under married name Lochner (formally Knights). Version 3: major changes, including a large scale analysis with thousands of MCMC chains. Matches version published in JCAP. 23 pages, 8 figures

Journal ref: JCAP 01, (2013) 039