Showing 1–50 of 115 results for author: Masters, D

Euclid: ERO -- NISP-only sources and the search for luminous $z=6-8$ galaxies

Authors: J. R. Weaver, S. Taamoli, C. J. R. McPartland, L. Zalesky, N. Allen, S. Toft, D. B. Sanders, H. Atek, R. A. A. Bowler, D. Stern, C. J. Conselice, B. Mobasher, I. Szapudi, P. R. M. Eisenhardt, G. Murphree, I. Valdes, K. Ito, S. Belladitta, P. A. Oesch, S. Serjeant, D. J. Mortlock, N. A. Hatch, M. Kluge, B. Milvang-Jensen, G. Rodighiero , et al. (163 additional authors not shown)

Abstract: This paper presents a search for high redshift galaxies from the Euclid Early Release Observations program "Magnifying Lens." The 1.5 deg$^2$ area covered by the twin Abell lensing cluster fields is comparable in size to the few other deep near-infrared surveys such as COSMOS, and so provides an opportunity to significantly increase known samples of rare UV-bright galaxies at $z\approx6-8$ (… ▽ More This paper presents a search for high redshift galaxies from the Euclid Early Release Observations program "Magnifying Lens." The 1.5 deg$^2$ area covered by the twin Abell lensing cluster fields is comparable in size to the few other deep near-infrared surveys such as COSMOS, and so provides an opportunity to significantly increase known samples of rare UV-bright galaxies at $z\approx6-8$ ($M_{\rm UV}\lesssim-22$). Beyond their still uncertain role in reionisation, these UV-bright galaxies are ideal laboratories from which to study galaxy formation and constrain the bright-end of the UV luminosity function. Of the 501994 sources detected from a combined $Y_{\rm E}$, $J_{\rm E}$, and $H_{\rm E}$ NISP detection image, 168 do not have any appreciable VIS/$I_{\rm E}$ flux. These objects span a range in spectral colours, separated into two classes: 139 extremely red sources; and 29 Lyman-break galaxy candidates. Best-fit redshifts and spectral templates suggest the former is composed of both $z\gtrsim5$ dusty star-forming galaxies and $z\approx1-3$ quiescent systems. The latter is composed of more homogeneous Lyman break galaxies at $z\approx6-8$. In both cases, contamination by L- and T-type dwarfs cannot be ruled out with Euclid images alone. Additional contamination from instrumental persistence is investigated using a novel time series analysis. This work lays the foundation for future searches within the Euclid Deep Fields, where thousands more $z\gtrsim6$ Lyman break systems and extremely red sources will be identified. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 22 pages, 13 figures, paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. V. The Flagship galaxy mock catalogue: a comprehensive simulation for the Euclid mission

Authors: Euclid Collaboration, F. J. Castander, P. Fosalba, J. Stadel, D. Potter, J. Carretero, P. Tallada-Crespí, L. Pozzetti, M. Bolzonella, G. A. Mamon, L. Blot, K. Hoffmann, M. Huertas-Company, P. Monaco, E. J. Gonzalez, G. De Lucia, C. Scarlata, M. -A. Breton, L. Linke, C. Viglione, S. -S. Li, Z. Zhai, Z. Baghkhani, K. Pardede, C. Neissner , et al. (344 additional authors not shown)

Abstract: We present the Flagship galaxy mock, a simulated catalogue of billions of galaxies designed to support the scientific exploitation of the Euclid mission. Euclid is a medium-class mission of the European Space Agency optimised to determine the properties of dark matter and dark energy on the largest scales of the Universe. It probes structure formation over more than 10 billion years primarily from… ▽ More We present the Flagship galaxy mock, a simulated catalogue of billions of galaxies designed to support the scientific exploitation of the Euclid mission. Euclid is a medium-class mission of the European Space Agency optimised to determine the properties of dark matter and dark energy on the largest scales of the Universe. It probes structure formation over more than 10 billion years primarily from the combination of weak gravitational lensing and galaxy clustering data. The breath of Euclid's data will also foster a wide variety of scientific analyses. The Flagship simulation was developed to provide a realistic approximation to the galaxies that will be observed by Euclid and used in its scientific analyses. We ran a state-of-the-art N-body simulation with four trillion particles, producing a lightcone on the fly. From the dark matter particles, we produced a catalogue of 16 billion haloes in one octant of the sky in the lightcone up to redshift z=3. We then populated these haloes with mock galaxies using a halo occupation distribution and abundance matching approach, calibrating the free parameters of the galaxy mock against observed correlations and other basic galaxy properties. Modelled galaxy properties include luminosity and flux in several bands, redshifts, positions and velocities, spectral energy distributions, shapes and sizes, stellar masses, star formation rates, metallicities, emission line fluxes, and lensing properties. We selected a final sample of 3.4 billion galaxies with a magnitude cut of H_E<26, where we are complete. We have performed a comprehensive set of validation tests to check the similarity to observational data and theoretical models. In particular, our catalogue is able to closely reproduce the main characteristics of the weak lensing and galaxy clustering samples to be used in the mission's main cosmological analysis. (abridged) △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. III. The NISP Instrument

Authors: Euclid Collaboration, K. Jahnke, W. Gillard, M. Schirmer, A. Ealet, T. Maciaszek, E. Prieto, R. Barbier, C. Bonoli, L. Corcione, S. Dusini, F. Grupp, F. Hormuth, S. Ligori, L. Martin, G. Morgante, C. Padilla, R. Toledo-Moreo, M. Trifoglio, L. Valenziano, R. Bender, F. J. Castander, B. Garilli, P. B. Lilje, H. -W. Rix , et al. (412 additional authors not shown)

Abstract: The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the proc… ▽ More The Near-Infrared Spectrometer and Photometer (NISP) on board the Euclid satellite provides multiband photometry and R>=450 slitless grism spectroscopy in the 950-2020nm wavelength range. In this reference article we illuminate the background of NISP's functional and calibration requirements, describe the instrument's integral components, and provide all its key properties. We also sketch the processes needed to understand how NISP operates and is calibrated, and its technical potentials and limitations. Links to articles providing more details and technical background are included. NISP's 16 HAWAII-2RG (H2RG) detectors with a plate scale of 0.3" pix^-1 deliver a field-of-view of 0.57deg^2. In photo mode, NISP reaches a limiting magnitude of ~24.5AB mag in three photometric exposures of about 100s exposure time, for point sources and with a signal-to-noise ratio (SNR) of 5. For spectroscopy, NISP's point-source sensitivity is a SNR = 3.5 detection of an emission line with flux ~2x10^-16erg/s/cm^2 integrated over two resolution elements of 13.4A, in 3x560s grism exposures at 1.6 mu (redshifted Ha). Our calibration includes on-ground and in-flight characterisation and monitoring of detector baseline, dark current, non-linearity, and sensitivity, to guarantee a relative photometric accuracy of better than 1.5%, and relative spectrophotometry to better than 0.7%. The wavelength calibration must be better than 5A. NISP is the state-of-the-art instrument in the NIR for all science beyond small areas available from HST and JWST - and an enormous advance due to its combination of field size and high throughput of telescope and instrument. During Euclid's 6-year survey covering 14000 deg^2 of extragalactic sky, NISP will be the backbone for determining distances of more than a billion galaxies. Its NIR data will become a rich reference imaging and spectroscopy data set for the coming decades. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue 'Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. II. The VIS Instrument

Authors: Euclid Collaboration, M. Cropper, A. Al-Bahlawan, J. Amiaux, S. Awan, R. Azzollini, K. Benson, M. Berthe, J. Boucher, E. Bozzo, C. Brockley-Blatt, G. P. Candini, C. Cara, R. A. Chaudery, R. E. Cole, P. Danto, J. Denniston, A. M. Di Giorgio, B. Dryer, J. Endicott, J. -P. Dubois, M. Farina, E. Galli, L. Genolet, J. P. D. Gow , et al. (403 additional authors not shown)

Abstract: This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift ran… ▽ More This paper presents the specification, design, and development of the Visible Camera (VIS) on the ESA Euclid mission. VIS is a large optical-band imager with a field of view of 0.54 deg^2 sampled at 0.1" with an array of 609 Megapixels and spatial resolution of 0.18". It will be used to survey approximately 14,000 deg^2 of extragalactic sky to measure the distortion of galaxies in the redshift range z=0.1-1.5 resulting from weak gravitational lensing, one of the two principal cosmology probes of Euclid. With photometric redshifts, the distribution of dark matter can be mapped in three dimensions, and, from how this has changed with look-back time, the nature of dark energy and theories of gravity can be constrained. The entire VIS focal plane will be transmitted to provide the largest images of the Universe from space to date, reaching m_AB>24.5 with S/N >10 in a single broad I_E~(r+i+z) band over a six year survey. The particularly challenging aspects of the instrument are the control and calibration of observational biases, which lead to stringent performance requirements and calibration regimes. With its combination of spatial resolution, calibration knowledge, depth, and area covering most of the extra-Galactic sky, VIS will also provide a legacy data set for many other fields. This paper discusses the rationale behind the VIS concept and describes the instrument design and development before reporting the pre-launch performance derived from ground calibrations and brief results from the in-orbit commissioning. VIS should reach fainter than m_AB=25 with S/N>10 for galaxies of full-width half-maximum of 0.3" in a 1.3" diameter aperture over the Wide Survey, and m_AB>26.4 for a Deep Survey that will cover more than 50 deg^2. The paper also describes how VIS works with the other Euclid components of survey, telescope, and science data processing to extract the cosmological information. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue `Euclid on Sky', which contains Euclid key reference papers and first results from the Euclid Early Release Observations

Euclid. I. Overview of the Euclid mission

Authors: Euclid Collaboration, Y. Mellier, Abdurro'uf, J. A. Acevedo Barroso, A. Achúcarro, J. Adamek, R. Adam, G. E. Addison, N. Aghanim, M. Aguena, V. Ajani, Y. Akrami, A. Al-Bahlawan, A. Alavi, I. S. Albuquerque, G. Alestas, G. Alguero, A. Allaoui, S. W. Allen, V. Allevato, A. V. Alonso-Tetilla, B. Altieri, A. Alvarez-Candal, A. Amara, L. Amendola , et al. (1086 additional authors not shown)

Abstract: The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14… ▽ More The current standard model of cosmology successfully describes a variety of measurements, but the nature of its main ingredients, dark matter and dark energy, remains unknown. Euclid is a medium-class mission in the Cosmic Vision 2015-2025 programme of the European Space Agency (ESA) that will provide high-resolution optical imaging, as well as near-infrared imaging and spectroscopy, over about 14,000 deg^2 of extragalactic sky. In addition to accurate weak lensing and clustering measurements that probe structure formation over half of the age of the Universe, its primary probes for cosmology, these exquisite data will enable a wide range of science. This paper provides a high-level overview of the mission, summarising the survey characteristics, the various data-processing steps, and data products. We also highlight the main science objectives and expected performance. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Paper submitted as part of the A&A special issue`Euclid on Sky'

SPHEREx: NASA's Near-Infrared Spectrophotmetric All-Sky Survey

Authors: Brendan P. Crill, Michael Werner, Rachel Akeson, Matthew Ashby, Lindsey Bleem, James J. Bock, Sean Bryan, Jill Burnham, Joyce Byunh, Tzu-Ching Chang, Yi-Kuan Chiang, Walter Cook, Asantha Cooray, Andrew Davis, Olivier Doré, C. Darren Dowell, Gregory Dubois-Felsmann, Tim Eifler, Andreas Faisst, Salman Habib, Chen Heinrich, Katrin Heitmann, Grigory Heaton, Christopher Hirata, Viktor Hristov , et al. (29 additional authors not shown)

Abstract: SPHEREx, the Spectro-Photometer for the History of the Universe, Epoch of Reionization, and ices Explorer, is a NASA MIDEX mission planned for launch in 2024. SPHEREx will carry out the first all-sky spectral survey at wavelengths between 0.75 micron and 5 micron with spectral resolving power ~40 between 0.75 and 3.8 micron and ~120 between 3.8 and 5 micron At the end of its two-year mission, SPHE… ▽ More SPHEREx, the Spectro-Photometer for the History of the Universe, Epoch of Reionization, and ices Explorer, is a NASA MIDEX mission planned for launch in 2024. SPHEREx will carry out the first all-sky spectral survey at wavelengths between 0.75 micron and 5 micron with spectral resolving power ~40 between 0.75 and 3.8 micron and ~120 between 3.8 and 5 micron At the end of its two-year mission, SPHEREx will provide 0.75-to-5 micron spectra of each 6.2"x6.2" pixel on the sky - 14 billion spectra in all. This paper updates an earlier description of SPHEREx presenting changes made during the mission's Preliminary Design Phase, including a discussion of instrument integration and test and a summary of the data processing, analysis, and distribution plans. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Journal ref: Proceedings Volume 11443, Space Telescopes and Instrumentation 2020: Optical, Infrared, and Millimeter Wave; 114430I (2020)

WFC3 Infrared Spectroscopic Parallel (WISP) Survey: Photometric and Emission Line Data Release

Authors: A. J. Battisti, M. B. Bagley, M. Rafelski, I. Baronchelli, Y. S. Dai, A. L. Henry, H. Atek, J. Colbert, M. A. Malkan, P. J. McCarthy, C. Scarlata, B. Siana, H. I. Teplitz, A. Alavi, K. Boyett, A. J. Bunker, J. P. Gardner, N. P. Hathi, D. Masters, V. Mehta, M. Rutkowski, K. Shahinyan, B. Sunnquist, X. Wang

Abstract: We present reduced images and catalogues of photometric and emission line data ($\sim$230,000 and $\sim$8,000 sources, respectively) for the WFC3 Infrared Spectroscopic Parallel (WISP) Survey. These data are made publicly available on the Mikulski Archive for Space Telescopes (MAST) and include reduced images from various facilities: ground-based $ugri$, HST WFC3, and Spitzer IRAC (Infrared Array… ▽ More We present reduced images and catalogues of photometric and emission line data ($\sim$230,000 and $\sim$8,000 sources, respectively) for the WFC3 Infrared Spectroscopic Parallel (WISP) Survey. These data are made publicly available on the Mikulski Archive for Space Telescopes (MAST) and include reduced images from various facilities: ground-based $ugri$, HST WFC3, and Spitzer IRAC (Infrared Array Camera). Coverage in at least one additional filter beyond the WFC3/IR data are available for roughly half of the fields (227 out of 483), with $\sim$20% (86) having coverage in six or more filters from $u$-band to IRAC 3.6$μ$m (0.35-3.6$μ$m). For the lower spatial resolution (and shallower) ground-based and IRAC data, we perform PSF-matched, prior-based, deconfusion photometry (i.e., forced-photometry) using the TPHOT software to optimally extract measurements or upper limits. We present the methodology and software used for the WISP emission line detection and visual inspection. The former adopts a continuous wavelet transformation that significantly reduces the number of spurious sources as candidates before the visual inspection stage. We combine both WISP catalogues and perform SED fitting on galaxies with reliable spectroscopic redshifts and multi-band photometry to measure their stellar masses. We stack WISP spectra as functions of stellar mass and redshift and measure average emission line fluxes and ratios. We find that WISP emission line sources are typically `normal' star-forming galaxies based on the Mass-Excitation diagram ([OIII]/H$β$ vs. $M_\star$; $0.74<z_\mathrm{grism}<2.31$), the galaxy main sequence (SFR vs. $M_\star$; $0.30<z_\mathrm{grism}<1.45$), $S_{32}$ ratio vs. $M_\star$ ($0.30<z_\mathrm{grism}<0.73$), and $O_{32}$ and $R_{23}$ ratios vs. $M_\star$ ($1.27<z_\mathrm{grism}<1.45$). △ Less

Submitted 6 April, 2024; originally announced April 2024.

Comments: 36 pages, 21 figures, 17 tables. Accepted for publication in MNRAS. The WISP Photometric and Emission Line catalogues and reduced images are in the process of being added as HLSPs to the WISP MAST website (https://archive.stsci.edu/prepds/wisp/). Please email the first-author (provided in paper) to request access to files prior to the MAST release

GenCast: Diffusion-based ensemble forecasting for medium-range weather

Authors: Ilan Price, Alvaro Sanchez-Gonzalez, Ferran Alet, Tom R. Andersson, Andrew El-Kadi, Dominic Masters, Timo Ewalds, Jacklynn Stott, Shakir Mohamed, Peter Battaglia, Remi Lam, Matthew Willson

Abstract: Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for… ▽ More Weather forecasts are fundamentally uncertain, so predicting the range of probable weather scenarios is crucial for important decisions, from warning the public about hazardous weather, to planning renewable energy use. Here, we introduce GenCast, a probabilistic weather model with greater skill and speed than the top operational medium-range weather forecast in the world, the European Centre for Medium-Range Forecasts (ECMWF)'s ensemble forecast, ENS. Unlike traditional approaches, which are based on numerical weather prediction (NWP), GenCast is a machine learning weather prediction (MLWP) method, trained on decades of reanalysis data. GenCast generates an ensemble of stochastic 15-day global forecasts, at 12-hour steps and 0.25 degree latitude-longitude resolution, for over 80 surface and atmospheric variables, in 8 minutes. It has greater skill than ENS on 97.4% of 1320 targets we evaluated, and better predicts extreme weather, tropical cyclones, and wind power production. This work helps open the next chapter in operational weather forecasting, where critical weather-dependent decisions are made with greater accuracy and efficiency. △ Less

Submitted 1 May, 2024; v1 submitted 25 December, 2023; originally announced December 2023.

Comments: Main text 11 pages, Appendices 76 pages

The Universe SPHEREx Will See: Empirically Based Galaxy Simulations and Redshift Predictions

Authors: Richard M. Feder, Daniel C. Masters, Bomee Lee, James J. Bock, Yi-Kuan Chiang, Ami Choi, Olivier Dore, Shoubaneh Hemmati, Olivier Ilbert

Abstract: We simulate galaxy properties and redshift estimation for SPHEREx, the next NASA Medium Class Explorer. To make robust models of the galaxy population and test spectro-photometric redshift performance for SPHEREx, we develop a set of synthetic spectral energy distributions based on detailed fits to COSMOS2020 photometry spanning 0.1-8 micron. Given that SPHEREx obtains low-resolution spectra, emis… ▽ More We simulate galaxy properties and redshift estimation for SPHEREx, the next NASA Medium Class Explorer. To make robust models of the galaxy population and test spectro-photometric redshift performance for SPHEREx, we develop a set of synthetic spectral energy distributions based on detailed fits to COSMOS2020 photometry spanning 0.1-8 micron. Given that SPHEREx obtains low-resolution spectra, emission lines will be important for some fraction of galaxies. Here we expand on previous work, using better photometry and photometric redshifts from COSMOS2020, and tight empirical relations to predict robust emission line strengths and ratios. A second galaxy catalog derived from the GAMA survey is generated to ensure the bright ($m_{AB}<18$ in the i-band) sample is representative over larger areas. Using template fitting to estimate photometric continuum redshifts, we forecast redshift recovery of 19 million galaxies over 30000 sq. deg. with $σ_z<0.003(1+z)$, 445 million with $σ_z<0.1(1+z)$ and 810 million with $σ_z<0.2(1+z)$. We also find through idealized tests that emission line information from spectrally dithered flux measurements can yield redshifts with accuracy beyond that implied by the naive SPHEREx channel resolution, motivating the development of a hybrid continuum-line redshift estimation approach. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Comments: 33 pages, 30 figures, 3 tables. Submitted to ApJ. Comments welcome

Predicting the Spectroscopic Features of Galaxies by Applying Manifold Learning on Their Broad-Band Colors: Proof of Concept and Potential Applications for Euclid, Roman, and Rubin LSST

Authors: Marziye Jafariyazani, Daniel Masters, Andreas Faisst, Harry Teplitz, Olivier Ilbert

Abstract: Entering the era of large-scale galaxy surveys which will deliver unprecedented amounts of photometric and spectroscopic data, there is a growing need for more efficient, data driven, and less model-dependent techniques to analyze spectral energy distribution of galaxies. In this work, we demonstrate that by taking advantage of manifold learning approaches, we can estimate spectroscopic features o… ▽ More Entering the era of large-scale galaxy surveys which will deliver unprecedented amounts of photometric and spectroscopic data, there is a growing need for more efficient, data driven, and less model-dependent techniques to analyze spectral energy distribution of galaxies. In this work, we demonstrate that by taking advantage of manifold learning approaches, we can estimate spectroscopic features of large samples of galaxies from their broadband photometry when spectroscopy is available only for a fraction of the sample. This will be done by applying the Self Organizing Map (SOM) algorithm on broadband colors of galaxies and map** partially available spectroscopic information into the trained maps. In this pilot study, we focus on estimating 4000A break in a magnitude-limited sample of galaxies in the COSMOS field. We use observed galaxy colors (ugrizYJH) as well as spectroscopic measurements for a fraction of the sample from LEGA-C and zCOSMOS spectroscopic surveys to estimate this feature for our parent photometric sample. We recover the D4000 feature for galaxies which only have broadband colors with uncertainties about twice of the uncertainty of the employed spectroscopic surveys. Using these measurements we observe a positive correlation between D4000 and stellar mass of the galaxies in our sample with weaker D4000 features for higher redshift galaxies at fixed stellar masses. These can be explained with downsizing scenario for the formation of galaxies and the decrease in their specific star formation rate as well as the aging of their stellar populations over this time period. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Comments: Submitted to The Astrophysical Journal

Generating QM1B with PySCF$_{\text{IPU}}$

Authors: Alexander Mathiasen, Hatem Helal, Kerstin Klaser, Paul Balanca, Josef Dean, Carlo Luschi, Dominique Beaini, Andrew Fitzgibbon, Dominic Masters

Abstract: The emergence of foundation models in Computer Vision and Natural Language Processing have resulted in immense progress on downstream tasks. This progress was enabled by datasets with billions of training examples. Similar benefits are yet to be unlocked for quantum chemistry, where the potential of deep learning is constrained by comparatively small datasets with 100k to 20M training examples. Th… ▽ More The emergence of foundation models in Computer Vision and Natural Language Processing have resulted in immense progress on downstream tasks. This progress was enabled by datasets with billions of training examples. Similar benefits are yet to be unlocked for quantum chemistry, where the potential of deep learning is constrained by comparatively small datasets with 100k to 20M training examples. These datasets are limited in size because the labels are computed using the accurate (but computationally demanding) predictions of Density Functional Theory (DFT). Notably, prior DFT datasets were created using CPU supercomputers without leveraging hardware acceleration. In this paper, we take a first step towards utilising hardware accelerators by introducing the data generator PySCF$_{\text{IPU}}$ using Intelligence Processing Units (IPUs). This allowed us to create the dataset QM1B with one billion training examples containing 9-11 heavy atoms. We demonstrate that a simple baseline neural network (SchNet 9M) improves its performance by simply increasing the amount of training data without additional inductive biases. To encourage future researchers to use QM1B responsibly, we highlight several limitations of QM1B and emphasise the low-resolution of our DFT options, which also serves as motivation for even larger, more accurate datasets. Code and dataset are available on Github: http://github.com/graphcore-research/pyscf-ipu △ Less

Submitted 2 November, 2023; originally announced November 2023.

Comments: 15 pages, 7 figures. NeurIPS 2023 Track Datasets and Benchmarks

ACM Class: I.2.6; J.2

Euclid preparation. XXXI. The effect of the variations in photometric passbands on photometric-redshift accuracy

Authors: Euclid Collaboration, Stéphane Paltani, J. Coupon, W. G. Hartley, A. Alvarez-Ayllon, F. Dubath, J. J. Mohr, M. Schirmer, J. -C. Cuillandre, G. Desprez, O. Ilbert, K. Kuijken, N. Aghanim, B. Altieri, A. Amara, N. Auricchio, M. Baldi, R. Bender, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco , et al. (192 additional authors not shown)

Abstract: The technique of photometric redshifts has become essential for the exploitation of multi-band extragalactic surveys. While the requirements on photo-zs for the study of galaxy evolution mostly pertain to the precision and to the fraction of outliers, the most stringent requirement in their use in cosmology is on the accuracy, with a level of bias at the sub-percent level for the Euclid cosmology… ▽ More The technique of photometric redshifts has become essential for the exploitation of multi-band extragalactic surveys. While the requirements on photo-zs for the study of galaxy evolution mostly pertain to the precision and to the fraction of outliers, the most stringent requirement in their use in cosmology is on the accuracy, with a level of bias at the sub-percent level for the Euclid cosmology mission. A separate, and challenging, calibration process is needed to control the bias at this level of accuracy. The bias in photo-zs has several distinct origins that may not always be easily overcome. We identify here one source of bias linked to the spatial or time variability of the passbands used to determine the photometric colours of galaxies. We first quantified the effect as observed on several well-known photometric cameras, and found in particular that, due to the properties of optical filters, the redshifts of off-axis sources are usually overestimated. We show using simple simulations that the detailed and complex changes in the shape can be mostly ignored and that it is sufficient to know the mean wavelength of the passbands of each photometric observation to correct almost exactly for this bias; the key point is that this mean wavelength is independent of the spectral energy distribution of the source}. We use this property to propose a correction that can be computationally efficiently implemented in some photo-z algorithms, in particular template-fitting. We verified that our algorithm, implemented in the new photo-z code Phosphoros, can effectively reduce the bias in photo-zs on real data using the CFHTLS T007 survey, with an average measured bias Delta z over the redshift range 0.4<z<0.7 decreasing by about 0.02, specifically from Delta z~0.04 to Delta z~0.02 around z=0.5. Our algorithm is also able to produce corrected photometry for other applications. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Comments: 19 pages, 13 figures; Accepted for publication in A&A

Journal ref: A&A 681, A66 (2024)

The Farmer: A reproducible profile-fitting photometry package for deep galaxy surveys

Authors: J. R. Weaver, L. Zalesky, V. Kokorev, C. J. R. McPartland, N. Chartab, K. M. L. Gould, M. Shuntov, I. Davidzon, A. Faisst, N. Stickley, P. L. Capak, S. Toft, D. Masters, B. Mobasher, D. B. Sanders, O. B. Kauffmann, H. J. McCracken, O. Ilbert, G. Brammer, A. Moneti

Abstract: While space-borne optical and near-infrared facilities have succeeded in delivering a precise and spatially resolved picture of our Universe, their small survey area is known to under-represent the true diversity of galaxy populations. Ground-based surveys have reached comparable depths but at lower spatial resolution, resulting in source confusion that hampers accurate photometry extractions. Wha… ▽ More While space-borne optical and near-infrared facilities have succeeded in delivering a precise and spatially resolved picture of our Universe, their small survey area is known to under-represent the true diversity of galaxy populations. Ground-based surveys have reached comparable depths but at lower spatial resolution, resulting in source confusion that hampers accurate photometry extractions. What once was limited to the infrared regime has now begun to challenge ground-based ultra-deep surveys, affecting detection and photometry alike. Failing to address these challenges will mean forfeiting a representative view into the distant Universe. We introduce The Farmer: an automated, reproducible profile-fitting photometry package that pairs a library of smooth parametric models from The Tractor (Lang et al. 2016) with a decision tree that determines the best-fit model in concert with neighboring sources. Photometry is measured by fitting the models on other bands leaving brightness free to vary. The resulting photometric measurements are naturally total, and no aperture corrections are required. Supporting diagnostics (e.g. $χ^2$) enable measurement validation. As fitting models is relatively time intensive, The Farmer is built with high-performance computing routines. We benchmark The Farmer on a set of realistic COSMOS-like images and find accurate photometry, number counts, and galaxy shapes. The Farmer is already being utilized to produce catalogs for several large-area deep extragalactic surveys where it has been shown to tackle some of the most challenging optical and near-infrared data available, with the promise of extending to other ultra-deep surveys expected in the near future. The Farmer is available to download from GitHub and Zenodo. △ Less

Submitted 11 October, 2023; originally announced October 2023.

Comments: 30 pages, 17 figures, accepted for publication in ApJS. The Farmer software is publicly accessible on Github at https://github.com/astroweaver/the_farmer

Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets

Authors: Dominique Beaini, Shenyang Huang, Joao Alex Cunha, Zhiyi Li, Gabriela Moisescu-Pareja, Oleksandr Dymov, Samuel Maddrell-Mander, Callum McLean, Frederik Wenkel, Luis Müller, Jama Hussein Mohamud, Ali Parviz, Michael Craig, Michał Koziarski, Jiarui Lu, Zhaocheng Zhu, Cristian Gabellini, Kerstin Klaser, Josef Dean, Cas Wognum, Maciej Sypetkowski, Guillaume Rabusseau, Reihaneh Rabbany, Jian Tang, Christopher Morris , et al. (10 additional authors not shown)

Abstract: Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by… ▽ More Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by size into three distinct categories: ToyMix, LargeMix and UltraLarge. These datasets push the boundaries in both the scale and the diversity of supervised labels for molecular learning. They cover nearly 100 million molecules and over 3000 sparsely defined tasks, totaling more than 13 billion individual labels of both quantum and biological nature. In comparison, our datasets contain 300 times more data points than the widely used OGB-LSC PCQM4Mv2 dataset, and 13 times more than the quantum-only QM1B dataset. In addition, to support the development of foundational models based on our proposed datasets, we present the Graphium graph machine learning library which simplifies the process of building and training molecular machine learning models for multi-task and multi-level molecular datasets. Finally, we present a range of baseline results as a starting point of multi-task and multi-level training on these datasets. Empirically, we observe that performance on low-resource biological datasets show improvement by also training on large amounts of quantum data. This indicates that there may be potential in multi-task and multi-level training of a foundation model and fine-tuning it to resource-constrained downstream tasks. △ Less

Submitted 18 October, 2023; v1 submitted 6 October, 2023; originally announced October 2023.

DESI Complete Calibration of the Color-Redshift Relation (DC3R2): Results from early DESI data

Authors: J. McCullough, D. Gruen, A. Amon, A. Roodman, D. Masters, A. Raichoor, D. Schlegel, R. Canning, F. J. Castander, J. DeRose, R. Miquel, J. Myles, J. A. Newman, A. Slosar, J. Speagle, M. J. Wilson, J. Aguilar, S. Ahlen, S. Bailey, D. Brooks, T. Claybaugh, S. Cole, K. Dawson, A. de la Macorra, P. Doel , et al. (24 additional authors not shown)

Abstract: We present initial results from the Dark Energy Spectroscopic Instrument (DESI) Complete Calibration of the Color-Redshift Relation (DC3R2) secondary target survey. Our analysis uses 230k galaxies that overlap with KiDS-VIKING $ugriZYJHK_s$ photometry to calibrate the color-redshift relation and to inform photometric redshift (photo-z) inference methods of future weak lensing surveys. Together wit… ▽ More We present initial results from the Dark Energy Spectroscopic Instrument (DESI) Complete Calibration of the Color-Redshift Relation (DC3R2) secondary target survey. Our analysis uses 230k galaxies that overlap with KiDS-VIKING $ugriZYJHK_s$ photometry to calibrate the color-redshift relation and to inform photometric redshift (photo-z) inference methods of future weak lensing surveys. Together with Emission Line Galaxies (ELGs), Luminous Red Galaxies (LRGs), and the Bright Galaxy Survey (BGS) that provide samples of complementary color, the DC3R2 targets help DESI to span 56% of the color space visible to Euclid and LSST with high confidence spectroscopic redshifts. The effects of spectroscopic completeness and quality are explored, as well as systematic uncertainties introduced with the use of common Self Organizing Maps trained on different photometry than the analysis sample. We further examine the dependence of redshift on magnitude at fixed color, important for the use of bright galaxy spectra to calibrate redshifts in a fainter photometric galaxy sample. We find that noise in the KiDS-VIKING photometry introduces a dominant, apparent magnitude dependence of redshift at fixed color, which indicates a need for carefully chosen deep drilling fields, and survey simulation to model this effect for future weak lensing surveys. △ Less

Submitted 22 June, 2024; v1 submitted 22 September, 2023; originally announced September 2023.

Comments: 19 pages, 16 figures, published in MNRAS, interactive visualizations at https://jmccull.github.io/DC3R2_Overview

Journal ref: MNRAS, Volume 531, 2024, p 2582-2602

Enhanced weathering in the U.S. Corn Belt delivers carbon removal with agronomic benefits

Authors: David J. Beerling, Dimitar Z. Epihov, Ilsa B. Kantola, Michael D. Masters, Tom Reershemius, Noah J. Planavsky, Christopher T. Reinhard, Jacob S. Jordan, Sarah J. Thorne, James Weber, Maria Val Martin, Robert P. Freckleton, Sue E. Hartley, Rachael H. James, Christopher R. Pearce, Evan H. DeLucia, Steven A. Banwart

Abstract: Enhanced weathering (EW) with crushed basalt on farmlands is a promising scalable atmospheric carbon dioxide removal strategy that urgently requires performance assessment with commercial farming practices. Our large-scale replicated EW field trial in the heart of the U.S. Corn Belt shows cumulative time-integrated carbon sequestration of 15.4 +/- 4.1 t CO2 ha-1 over four years, with additional em… ▽ More Enhanced weathering (EW) with crushed basalt on farmlands is a promising scalable atmospheric carbon dioxide removal strategy that urgently requires performance assessment with commercial farming practices. Our large-scale replicated EW field trial in the heart of the U.S. Corn Belt shows cumulative time-integrated carbon sequestration of 15.4 +/- 4.1 t CO2 ha-1 over four years, with additional emissions mitigation of ~0.1 - 0.4 t CO2,e ha-1 yr-1 for soil nitrous oxide, a potent long-lived greenhouse gas. Maize and soybean yields increased 12-16% with EW following improved soil fertility, decreased soil acidification, and upregulation of root nutrient transport genes. Our findings suggest that widespread adoption of EW across farming sectors has the potential to contribute significantly to net-zero greenhouse gas emissions goals and global food and soil security. △ Less

Submitted 6 July, 2023; originally announced July 2023.

PopSparse: Accelerated block sparse matrix multiplication on IPU

Authors: Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

Abstract: Reducing the computational cost of running large scale neural networks using sparsity has attracted great attention in the deep learning community. While much success has been achieved in reducing FLOP and parameter counts while maintaining acceptable task performance, achieving actual speed improvements has typically been much more difficult, particularly on general purpose accelerators (GPAs) su… ▽ More Reducing the computational cost of running large scale neural networks using sparsity has attracted great attention in the deep learning community. While much success has been achieved in reducing FLOP and parameter counts while maintaining acceptable task performance, achieving actual speed improvements has typically been much more difficult, particularly on general purpose accelerators (GPAs) such as NVIDIA GPUs using low precision number formats. In this work we introduce PopSparse, a library that enables fast sparse operations on Graphcore IPUs by leveraging both the unique hardware characteristics of IPUs as well as any block structure defined in the data. We target two different types of sparsity: static, where the sparsity pattern is fixed at compile-time; and dynamic, where it can change each time the model is run. We present benchmark results for matrix multiplication for both of these modes on IPU with a range of block sizes, matrix sizes and densities. Results indicate that the PopSparse implementations are faster than dense matrix multiplications on IPU at a range of sparsity levels with large matrix size and block size. Furthermore, static sparsity in general outperforms dynamic sparsity. While previous work on GPAs has shown speedups only for very high sparsity (typically 99\% and above), the present work demonstrates that our static sparse implementation outperforms equivalent dense calculations in FP16 at lower sparsity (around 90%). IPU code is available to view and run at ipu.dev/sparsity-benchmarks, GPU code will be made available shortly. △ Less

Submitted 5 April, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

GPS++: Reviving the Art of Message Passing for Molecular Property Prediction

Authors: Dominic Masters, Josef Dean, Kerstin Klaser, Zhiyi Li, Sam Maddrell-Mander, Adam Sanders, Hatem Helal, Deniz Beker, Andrew Fitzgibbon, Shenyang Huang, Ladislav Rampášek, Dominique Beaini

Abstract: We present GPS++, a hybrid Message Passing Neural Network / Graph Transformer model for molecular property prediction. Our model integrates a well-tuned local message passing component and biased global attention with other key ideas from prior literature to achieve state-of-the-art results on large-scale molecular dataset PCQM4Mv2. Through a thorough ablation study we highlight the impact of indi… ▽ More We present GPS++, a hybrid Message Passing Neural Network / Graph Transformer model for molecular property prediction. Our model integrates a well-tuned local message passing component and biased global attention with other key ideas from prior literature to achieve state-of-the-art results on large-scale molecular dataset PCQM4Mv2. Through a thorough ablation study we highlight the impact of individual components and find that nearly all of the model's performance can be maintained without any use of global self-attention, showing that message passing is still a competitive approach for 3D molecular property prediction despite the recent dominance of graph transformers. We also find that our approach is significantly more accurate than prior art when 3D positional information is not available. △ Less

Submitted 12 May, 2023; v1 submitted 6 February, 2023; originally announced February 2023.

Comments: arXiv admin note: text overlap with arXiv:2212.02229

A broad-line quasar with unexplained extreme velocity offsets: post-shock outflow?

Authors: V. Rusakov, C. L. Steinhardt, M. Schramm, A. L. Faisst, D. Masters, B. Mobasher, P. Pattarakijwanich

Abstract: The quasar SDSS 0956+5128 exhibits three distinct velocity components with large offsets in emission: the systemic velocity of [O II], [O III] and [Ne III] narrow lines have redshift $z=0.7142$; broad Mg II line is shifted by $-1200$ km s$^{-1}$ with respect to the narrow lines; broad H$α$, H$β$ lines are at $-4100$ km s$^{-1}$. We present new Hubble Space Telescope spectra of Ly$α$ and C IV emiss… ▽ More The quasar SDSS 0956+5128 exhibits three distinct velocity components with large offsets in emission: the systemic velocity of [O II], [O III] and [Ne III] narrow lines have redshift $z=0.7142$; broad Mg II line is shifted by $-1200$ km s$^{-1}$ with respect to the narrow lines; broad H$α$, H$β$ lines are at $-4100$ km s$^{-1}$. We present new Hubble Space Telescope spectra of Ly$α$ and C IV emission lines and high-resolution images of the quasar. The offsets of these lines are consistent with the velocity component of the Balmer emission, and the photometry in optical and near-infrared wavelengths does not show any signs of recent mergers in the host galaxy or irregularities in the location of the quasar. The data do not confirm predictions of the previous most-likely hypotheses involving a special orientation and morphology of the quasar disk, such as in the recoiling black hole scenario, neither it is consistent with accretion disk winds. Instead, based on the cumulative evidence, we propose a new scenario, in which the broad line region is in the state of outflow caused by a strong shock wave, with a supernova as a possible event for producing the shock ejecta. △ Less

Submitted 4 January, 2023; originally announced January 2023.

Comments: 15 pages, 4 figures, accepted for publication in ApJ

Journal ref: The Astrophysical Journal, Volume 944,no: 2: 217; 2023

GPS++: An Optimised Hybrid MPNN/Transformer for Molecular Property Prediction

Authors: Dominic Masters, Josef Dean, Kerstin Klaser, Zhiyi Li, Sam Maddrell-Mander, Adam Sanders, Hatem Helal, Deniz Beker, Ladislav Rampášek, Dominique Beaini

Abstract: This technical report presents GPS++, the first-place solution to the Open Graph Benchmark Large-Scale Challenge (OGB-LSC 2022) for the PCQM4Mv2 molecular property prediction task. Our approach implements several key principles from the prior literature. At its core our GPS++ method is a hybrid MPNN/Transformer model that incorporates 3D atom positions and an auxiliary denoising task. The effectiv… ▽ More This technical report presents GPS++, the first-place solution to the Open Graph Benchmark Large-Scale Challenge (OGB-LSC 2022) for the PCQM4Mv2 molecular property prediction task. Our approach implements several key principles from the prior literature. At its core our GPS++ method is a hybrid MPNN/Transformer model that incorporates 3D atom positions and an auxiliary denoising task. The effectiveness of GPS++ is demonstrated by achieving 0.0719 mean absolute error on the independent test-challenge PCQM4Mv2 split. Thanks to Graphcore IPU acceleration, GPS++ scales to deep architectures (16 layers), training at 3 minutes per epoch, and large ensemble (112 models), completing the final predictions in 1 hour 32 minutes, well under the 4 hour inference budget allocated. Our implementation is publicly available at: https://github.com/graphcore/ogb-lsc-pcqm4mv2. △ Less

Submitted 6 December, 2022; v1 submitted 18 November, 2022; originally announced December 2022.

Evolution of Gas, and Star Formation from z = 0 to 5

Authors: Nick Scoville, Andreas Faisst, John Weaver, Sune Toft, Henry McCracken, Olivier Ilbert, Tanio Diaz-Santos, Johannes Staguhn, ** Koda, Caitlin Casey, David Sanders, Bahram Mobasher, Nima Chartab, Zahra Sattari, Peter Capak, Paul Vanden Bout, Angela Bongiorno, Catherine Vlahakis, Kartik Sheth, Min Yun, Herve Aussel, Clotilde Laigle, Dan Masters

Abstract: ALMA observations of the long wavelength dust continuum are used to estimate the gas masses in a sample of 708 star-forming (SF) galaxies at z = 0.3 to 4.5. We determine the dependence of gas masses and star formation efficiencies (SFE=SFR per unit gass mass). We find that 70 percent of the increase in SFRs of the MS is due to the increased gas masses at earlier epochs while 30 percent is due to i… ▽ More ALMA observations of the long wavelength dust continuum are used to estimate the gas masses in a sample of 708 star-forming (SF) galaxies at z = 0.3 to 4.5. We determine the dependence of gas masses and star formation efficiencies (SFE=SFR per unit gass mass). We find that 70 percent of the increase in SFRs of the MS is due to the increased gas masses at earlier epochs while 30 percent is due to increased efficiency of SF. For galaxies above the MS this is reversed with 70 percent of the increased SFR relative to the MS being due to elevated SFEs. Thus, the major evolution of star formation activity at early epochs is driven by increased gas masses, while the starburst activity taking galaxies above the MS is due to enhanced triggering of star formation (likely due to galactic merging). The interstellar gas peaks at z = 2 and dominates the stellar mass down to z = 1.2. Accretion rates needed to maintain continuity of the MS evolution exceed 100 Msun per yr at z > 2. The galactic gas contents are likely the driving determinant for both the rise in SF and AGN activity from z = 5 to their peak at z = 2 and subsequent fall to lower z. We suggest that for self-gravitating clouds with supersonic turbulence, cloud collisions and the filamentary structure of the clouds regulate the star formation activity. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Comments: AAS Russel Lecture June 2022 (N. Scoville), 18 pages. arXiv admin note: text overlap with arXiv:1702.04729

A Machine Learning Approach to Predict Missing Flux Densities in Multi-band Galaxy Surveys

Authors: Nima Chartab, Bahram Mobasher, Asantha Cooray, Shoubaneh Hemmati, Zahra Sattari, Henry C. Ferguson, David B. Sanders, John R. Weaver, Daniel Stern, Henry J. McCracken, Daniel C. Masters, Sune Toft, Peter L. Capak, Iary Davidzon, Mark Dickinson, Jason Rhodes, Andrea Moneti, Olivier Ilbert, Lukas Zalesky, Conor McPartland, Istvan Szapudi, Anton M. Koekemoer, Harry I. Teplitz, Mauro Giavalisco

Abstract: We present a new method based on information theory to find the optimal number of bands required to measure the physical properties of galaxies with a desired accuracy. As a proof of concept, using the recently updated COSMOS catalog (COSMOS2020), we identify the most relevant wavebands for measuring the physical properties of galaxies in a Hawaii Two-0 (H20)- and UVISTA-like survey for a sample o… ▽ More We present a new method based on information theory to find the optimal number of bands required to measure the physical properties of galaxies with a desired accuracy. As a proof of concept, using the recently updated COSMOS catalog (COSMOS2020), we identify the most relevant wavebands for measuring the physical properties of galaxies in a Hawaii Two-0 (H20)- and UVISTA-like survey for a sample of $i<25$ AB mag galaxies. We find that with available $i$-band fluxes, $r$, $u$, IRAC/$ch2$ and $z$ bands provide most of the information regarding the redshift with importance decreasing from $r$-band to $z$-band. We also find that for the same sample, IRAC/$ch2$, $Y$, $r$ and $u$ bands are the most relevant bands in stellar mass measurements with decreasing order of importance. Investigating the inter-correlation between the bands, we train a model to predict UVISTA observations in near-IR from H20-like observations. We find that magnitudes in $YJH$ bands can be simulated/predicted with an accuracy of $1σ$ mag scatter $\lesssim 0.2$ for galaxies brighter than 24 AB mag in near-IR bands. One should note that these conclusions depend on the selection criteria of the sample. For any new sample of galaxies with a different selection, these results should be remeasured. Our results suggest that in the presence of a limited number of bands, a machine learning model trained over the population of observed galaxies with extensive spectral coverage outperforms template-fitting. Such a machine learning model maximally comprises the information acquired over available extensive surveys and breaks degeneracies in the parameter space of template-fitting inevitable in the presence of a few bands. △ Less

Submitted 31 August, 2022; originally announced August 2022.

Comments: 15 pages, 14 figures, accepted for publication in ApJ

COSMOS2020: Manifold Learning to Estimate Physical Parameters in Large Galaxy Surveys

Authors: I. Davidzon, K. Jegatheesan, O. Ilbert, S. de la Torre, S. K. Leslie, C. Laigle, S. Hemmati, D. C. Masters, D. Blanquez-Sese, O. B. Kauffmann, G. E. Magdis, K. Małek, H. J. McCracken, B. Mobasher, A. Moneti, D. B. Sanders, M. Shuntov, S. Toft, J. R. Weaver

Abstract: We present a novel method to estimate galaxy physical properties from spectral energy distributions (SEDs), alternate to template fitting techniques and based on self-organizing maps (SOM) to learn the high-dimensional manifold of a photometric galaxy catalog. The method has been previously tested with hydrodynamical simulations in Davidzon et al. (2019) while here is applied to real data for the… ▽ More We present a novel method to estimate galaxy physical properties from spectral energy distributions (SEDs), alternate to template fitting techniques and based on self-organizing maps (SOM) to learn the high-dimensional manifold of a photometric galaxy catalog. The method has been previously tested with hydrodynamical simulations in Davidzon et al. (2019) while here is applied to real data for the first time. It is crucial for its implementation to build the SOM with a high quality, panchromatic data set, which we elect to be the "COSMOS2020" galaxy catalog. After the training and calibration steps with COSMOS2020, other galaxies can be processed through SOM to obtain an estimate of their stellar mass and star formation rate (SFR). Both quantities result to be in good agreement with independent measurements derived from more extended photometric baseline, and also their combination (i.e., the SFR vs. stellar mass diagram) shows a main sequence of star forming galaxies consistent with previous studies. We discuss the advantages of this method compared to traditional SED fitting, highlighting the impact of having, instead of the usual synthetic templates, a collection of empirical SEDs built by the SOM in a "data-driven" way. Such an approach also allows, even for extremely large data sets, an efficient visual inspection to identify photometric errors or peculiar galaxy types. Considering in addition the computational speed of this new estimator, we argue that it will play a valuable role in the analysis of oncoming large-area surveys like Euclid or the Legacy Survey of Space and Time at the Vera Cooper Rubin Telescope. △ Less

Submitted 13 June, 2022; originally announced June 2022.

Comments: to appear on A&A

Journal ref: A&A 665, A34 (2022)

8-bit Numerical Formats for Deep Neural Networks

Authors: Badreddine Noune, Philip Jones, Daniel Justus, Dominic Masters, Carlo Luschi

Abstract: Given the current trend of increasing size and complexity of machine learning architectures, it has become of critical importance to identify new approaches to improve the computational efficiency of model training. In this context, we address the advantages of floating-point over fixed-point representation, and present an in-depth study on the use of 8-bit floating-point number formats for activa… ▽ More Given the current trend of increasing size and complexity of machine learning architectures, it has become of critical importance to identify new approaches to improve the computational efficiency of model training. In this context, we address the advantages of floating-point over fixed-point representation, and present an in-depth study on the use of 8-bit floating-point number formats for activations, weights, and gradients for both training and inference. We explore the effect of different bit-widths for exponents and significands and different exponent biases. The experimental results demonstrate that a suitable choice of these low-precision formats enables faster training and reduced power consumption without any degradation in accuracy for a range of deep learning models for image classification and language processing. △ Less

Submitted 6 June, 2022; originally announced June 2022.

Euclid preparation: XX. The Complete Calibration of the Color-Redshift Relation survey: LBT observations and data release

Authors: Euclid Collaboration, R. Saglia, S. De Nicola, M. Fabricius, V. Guglielmo, J. Snigula, R. Zöller, R. Bender, J. Heidt, D. Masters, D. Stern, S. Paltani, A. Amara, N. Auricchio, M. Baldi, C. Bodendorf, D. Bonino, E. Branchini, M. Brescia, J. Brinchmann, S. Camera, V. Capobianco, C. Carbone, J. Carretero, M. Castellano , et al. (161 additional authors not shown)

Abstract: The Complete Calibration of the Color-Redshift Relation survey (C3R2) is a spectroscopic programme designed to empirically calibrate the galaxy color-redshift relation to the Euclid depth (I_E=24.5), a key ingredient for the success of Stage IV dark energy projects based on weak lensing cosmology. A spectroscopic calibration sample as representative as possible of the galaxies in the Euclid weak l… ▽ More The Complete Calibration of the Color-Redshift Relation survey (C3R2) is a spectroscopic programme designed to empirically calibrate the galaxy color-redshift relation to the Euclid depth (I_E=24.5), a key ingredient for the success of Stage IV dark energy projects based on weak lensing cosmology. A spectroscopic calibration sample as representative as possible of the galaxies in the Euclid weak lensing sample is being collected, selecting galaxies from a self-organizing map (SOM) representation of the galaxy color space. Here, we present the results of a near-infrared H- and K-bands spectroscopic campaign carried out using the LUCI instruments at the LBT. For a total of 251 galaxies, we present new highly-reliable redshifts in the 1.3<= z <=1.7 and 2<= z<=2.7 ranges. The newly-determined redshifts populate 49 SOM cells which previously contained no spectroscopic measurements and almost double the occupation numbers of an additional 153 SOM cells. A final optical ground-based observational effort is needed to calibrate the missing cells in particular in the redshift range 1.7<= z<=2.7 that lack spectroscopic calibration. In the end, Euclid itself will deliver telluric-free NIR spectra that can complete the calibration. △ Less

Submitted 7 September, 2022; v1 submitted 3 June, 2022; originally announced June 2022.

Comments: A&A language edited version

Journal ref: A&A 664, A196 (2022)

Science with the Ultraviolet Explorer (UVEX)

Authors: S. R. Kulkarni, Fiona A. Harrison, Brian W. Grefenstette, Hannah P. Earnshaw, Igor Andreoni, Danielle A. Berg, Joshua S. Bloom, S. Bradley Cenko, Ryan Chornock, Jessie L. Christiansen, Michael W. Coughlin, Alexander Wuollet Criswell, Behnam Darvish, Kaustav K. Das, Kishalay De, Luc Dessart, Don Dixon, Bas Dorsman, Kareem El-Badry, Christopher Evans, K. E. Saavik Ford, Christoffer Fremling, Boris T. Gansicke, Suvi Gezari, Y. Goetberg , et al. (31 additional authors not shown)

Abstract: UVEX is a proposed medium class Explorer mission designed to provide crucial missing capabilities that will address objectives central to a broad range of modern astrophysics. The UVEX design has two co-aligned wide-field imagers operating in the FUV and NUV and a powerful broadband medium resolution spectrometer. In its two-year baseline mission, UVEX will perform a multi-cadence synoptic all-sky… ▽ More UVEX is a proposed medium class Explorer mission designed to provide crucial missing capabilities that will address objectives central to a broad range of modern astrophysics. The UVEX design has two co-aligned wide-field imagers operating in the FUV and NUV and a powerful broadband medium resolution spectrometer. In its two-year baseline mission, UVEX will perform a multi-cadence synoptic all-sky survey 50/100 times deeper than GALEX in the NUV/FUV, cadenced surveys of the Large and Small Magellanic Clouds, rapid target of opportunity followup, as well as spectroscopic followup of samples of stars and galaxies. The science program is built around three pillars. First, UVEX will explore the low-mass, low-metallicity galaxy frontier through imaging and spectroscopic surveys that will probe key aspects of the evolution of galaxies by understanding how star formation and stellar evolution at low metallicities affect the growth and evolution of low-metallicity, low-mass galaxies in the local universe. Such galaxies contain half the mass in the local universe, and are analogs for the first galaxies, but observed at distances that make them accessible to detailed study. Second, UVEX will explore the dynamic universe through time-domain surveys and prompt spectroscopic followup capability will probe the environments, energetics, and emission processes in the early aftermaths of gravitational wave-discovered compact object mergers, discover hot, fast UV transients, and diagnose the early stages of stellar explosions. Finally, UVEX will become a key community resource by leaving a large all-sky legacy data set, enabling a wide range of scientific studies and filling a gap in the new generation of wide-field, sensitive optical and infrared surveys provided by the Rubin, Euclid, and Roman observatories. This paper discusses the scientific potential of UVEX, and the broad scientific program. △ Less

Submitted 17 January, 2023; v1 submitted 30 November, 2021; originally announced November 2021.

Comments: 69 pages, 43 figures

Euclid preparation: XVIII. Cosmic Dawn Survey. Spitzer observations of the Euclid deep fields and calibration fields

Authors: Andrea Moneti, H. J. McCracken, M. Shuntov, O. B. Kauffmann, P. Capak, I. Davidzon, O. Ilbert, C. Scarlata, S. Toft, J. Weaver, R. Chary, J. Cuby, A. L. Faisst, D. C. Masters, C. McPartland, B. Mobasher, D. B. Sanders, R. Scaramella, D. Stern, I. Szapudi, H. Teplitz, L. Zalesky, A. Amara, N. Auricchio, C. Bodendorf , et al. (172 additional authors not shown)

Abstract: We present a new infrared survey covering the three Euclid deep fields and four other Euclid calibration fields using Spitzer's Infrared Array Camera (IRAC). We have combined these new observations with all relevant IRAC archival data of these fields in order to produce the deepest possible mosaics of these regions. In total, these observations represent nearly 11% of the total Spitzer mission tim… ▽ More We present a new infrared survey covering the three Euclid deep fields and four other Euclid calibration fields using Spitzer's Infrared Array Camera (IRAC). We have combined these new observations with all relevant IRAC archival data of these fields in order to produce the deepest possible mosaics of these regions. In total, these observations represent nearly 11% of the total Spitzer mission time. The resulting mosaics cover a total of approximately 71.5deg$^2$ in the 3.6 and 4.5um bands, and approximately 21.8deg$^2$ in the 5.8 and 8um bands. They reach at least 24 AB magnitude (measured to sigma, in a 2.5 arcsec aperture) in the 3.6um band and up to ~ 5 mag deeper in the deepest regions. The astrometry is tied to the Gaia astrometric reference system, and the typical astrometric uncertainty for sources with 16<[3.6]<19 is <0.15 arcsec. The photometric calibration is in excellent agreement with previous WISE measurements. We have extracted source number counts from the 3.6um band mosaics and they are in excellent agreement with previous measurements. Given that the Spitzer Space Telescope has now been decommissioned these mosaics are likely to be the definitive reduction of these IRAC data. This survey therefore represents an essential first step in assembling multi-wavelength data on the Euclid deep fields which are set to become some of the premier fields for extragalactic astronomy in the 2020s. △ Less

Submitted 26 October, 2021; originally announced October 2021.

Comments: 15 pages with 11 figures, approved by Euclid Consortium Publication Board and submitted to Astronomy and Astrophysics. Data products will become available via the IRSA website once the paper is accepted. This paper is a companion to "COSMOS2020: A panchromatic view of the Universe to z~10 from two complementary catalogs" by John Weaver et al., which is being posted in parallel

Journal ref: A&A 658, A126 (2022)

COSMOS2020: A panchromatic view of the Universe to $z\sim10$ from two complementary catalogs

Authors: J. R. Weaver, O. B. Kauffmann, O. Ilbert, H. J. McCracken, A. Moneti, S. Toft, G. Brammer, M. Shuntov, I. Davidzon, B. C. Hsieh, C. Laigle, A. Anastasiou, C. K. Jespersen, J. Vinther, P. Capak, C. M. Casey, C. J. R. McPartland, B. Milvang-Jensen, B. Mobasher, D. B. Sanders, L. Zalesky, S. Arnouts, H. Aussel, J. S. Dunlop, A. Faisst , et al. (32 additional authors not shown)

Abstract: The Cosmic Evolution Survey (COSMOS) has become a cornerstone of extragalactic astronomy. Since the last public catalog in 2015, a wealth of new imaging and spectroscopic data has been collected in the COSMOS field. This paper describes the collection, processing, and analysis of this new imaging data to produce a new reference photometric redshift catalog. Source detection and multi-wavelength ph… ▽ More The Cosmic Evolution Survey (COSMOS) has become a cornerstone of extragalactic astronomy. Since the last public catalog in 2015, a wealth of new imaging and spectroscopic data has been collected in the COSMOS field. This paper describes the collection, processing, and analysis of this new imaging data to produce a new reference photometric redshift catalog. Source detection and multi-wavelength photometry is performed for 1.7 million sources across the $2\,\mathrm{deg}^{2}$ of the COSMOS field, $\sim$966,000 of which are measured with all available broad-band data using both traditional aperture photometric methods and a new profile-fitting photometric extraction tool, The Farmer, which we have developed. A detailed comparison of the two resulting photometric catalogs is presented. Photometric redshifts are computed for all sources in each catalog utilizing two independent photometric redshift codes. Finally, a comparison is made between the performance of the photometric methodologies and of the redshift codes to demonstrate an exceptional degree of self-consistency in the resulting photometric redshifts. The $i<21$ sources have sub-percent photometric redshift accuracy and even the faintest sources at $25<i<27$ reach a precision of $5\,\%$. Finally, these results are discussed in the context of previous, current, and future surveys in the COSMOS field. Compared to COSMOS2015, reaches the same photometric redshift precision at almost one magnitude deeper. Both photometric catalogs and their photometric redshift solutions and physical parameters will be made available through the usual astronomical archive systems (ESO Phase 3, IPAC IRSA, and CDS). △ Less

Submitted 26 October, 2021; originally announced October 2021.

Comments: 39 pages, 21 figures, accepted for publication in The Astrophysical Journal Supplement Series. Production of IRAC mosaics are presented in Moneti et al. "Euclid Preparation: XVIII. Cosmic Dawn Survey. Spitzer observations of the Euclid deep fields and calibration fields" which has been posted simultaneously. Catalogs can be accessed online now at https://cosmos2020.calet.org

Categorizing models using Self-Organizing Maps: an application to modified gravity theories probed by cosmic shear

Authors: Agnès Ferté, Shoubaneh Hemmati, Daniel Masters, Brigitte Montminy, Peter L. Taylor, Eric Huff, Jason Rhodes

Abstract: We propose to use Self-Organizing Maps (SOM) to map the impact of physical models onto observables. Using this approach, we are be able to determine how theories relate to each other given their signatures. In cosmology this will be particularly useful to determine cosmological models (such as dark energy, modified gravity or inflationary models) that should be tested by the new generation of expe… ▽ More We propose to use Self-Organizing Maps (SOM) to map the impact of physical models onto observables. Using this approach, we are be able to determine how theories relate to each other given their signatures. In cosmology this will be particularly useful to determine cosmological models (such as dark energy, modified gravity or inflationary models) that should be tested by the new generation of experiments. As a first example, we apply this approach to the representation of a subset of the space of modified gravity theories probed by cosmic shear. We therefore train a SOM on shear correlation functions in the $f(R)$, dilaton and symmetron models. The results indicate these three theories have similar signatures on shear for small values of their parameters but the dilaton has different signature for higher values. We also show that modified gravity (especially the dilaton model) has a different impact on cosmic shear compared to a dynamical dark energy so both need to be tested by galaxy surveys. △ Less

Submitted 7 June, 2023; v1 submitted 25 October, 2021; originally announced October 2021.

Comments: 6 pages, 5 figures

Euclid Preparation: XIV. The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Data Release 3

Authors: Euclid Collaboration, S. A. Stanford, D. Masters, B. Darvish, D. Stern, J. G. Cohen, P. Capak, N. Hernitschek, I. Davidzon, J. Rhodes, D. B. Sanders, B. Mobasher, F. J. Castander, S. Paltani, N. Aghanim, A. Amara, N. Auricchio, A. Balestra, R. Bender, C. Bodendorf, D. Bonino, E. Branchini, J. Brinchmann, V. Capobianco, C. Carbone , et al. (161 additional authors not shown)

Abstract: The Complete Calibration of the Color-Redshift Relation (C3R2) survey is obtaining spectroscopic redshifts in order to map the relation between galaxy color and redshift to a depth of i ~ 24.5 (AB). The primary goal is to enable sufficiently accurate photometric redshifts for Stage IV dark energy projects, particularly Euclid and the Roman Space Telescope, which are designed to constrain cosmologi… ▽ More The Complete Calibration of the Color-Redshift Relation (C3R2) survey is obtaining spectroscopic redshifts in order to map the relation between galaxy color and redshift to a depth of i ~ 24.5 (AB). The primary goal is to enable sufficiently accurate photometric redshifts for Stage IV dark energy projects, particularly Euclid and the Roman Space Telescope, which are designed to constrain cosmological parameters through weak lensing. We present 676 new high-confidence spectroscopic redshifts obtained by the C3R2 survey in the 2017B-2019B semesters using the DEIMOS, LRIS, and MOSFIRE multi-object spectrographs on the Keck telescopes. Combined with the 4454 redshifts previously published by this project, the C3R2 survey has now obtained and published 5130 high-quality galaxy spectra and redshifts. If we restrict consideration to only the 0.2 < z(phot) < 2.6 range of interest for the Euclid cosmological goals, then with the current data release C3R2 has increased the spectroscopic redshift coverage of the Euclid color space from 51% (as reported by Masters et al. 2015) to the current 91%. Once completed and combined with extensive data collected by other spectroscopic surveys, C3R2 should provide the spectroscopic calibration set needed to enable photometric redshifts to meet the cosmology requirements for Euclid, and make significant headway toward solving the problem for Roman. △ Less

Submitted 16 February, 2022; v1 submitted 21 June, 2021; originally announced June 2021.

Comments: 14 pages, 7 figures, 4 tables. Accepted for publication in The Astrophysical Journal Supplement. Survey website with links to the C3R2 redshift catalog and the spectroscopic data hosted by the Keck Observatory Archive can be found at https://sites.google.com/view/c3r2-survey/home

Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence

Authors: Antoine Labatie, Dominic Masters, Zach Eaton-Rosen, Carlo Luschi

Abstract: We investigate the reasons for the performance degradation incurred with batch-independent normalization. We find that the prototypical techniques of layer normalization and instance normalization both induce the appearance of failure modes in the neural network's pre-activations: (i) layer normalization induces a collapse towards channel-wise constant functions; (ii) instance normalization induce… ▽ More We investigate the reasons for the performance degradation incurred with batch-independent normalization. We find that the prototypical techniques of layer normalization and instance normalization both induce the appearance of failure modes in the neural network's pre-activations: (i) layer normalization induces a collapse towards channel-wise constant functions; (ii) instance normalization induces a lack of variability in instance statistics, symptomatic of an alteration of the expressivity. To alleviate failure mode (i) without aggravating failure mode (ii), we introduce the technique "Proxy Normalization" that normalizes post-activations using a proxy distribution. When combined with layer normalization or group normalization, this batch-independent normalization emulates batch normalization's behavior and consistently matches or exceeds its performance. △ Less

Submitted 3 April, 2022; v1 submitted 7 June, 2021; originally announced June 2021.

Comments: NeurIPS 2021 camera-ready

Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training

Authors: Dominic Masters, Antoine Labatie, Zach Eaton-Rosen, Carlo Luschi

Abstract: Much recent research has been dedicated to improving the efficiency of training and inference for image classification. This effort has commonly focused on explicitly improving theoretical efficiency, often measured as ImageNet validation accuracy per FLOP. These theoretical savings have, however, proven challenging to achieve in practice, particularly on high-performance training accelerators.… ▽ More Much recent research has been dedicated to improving the efficiency of training and inference for image classification. This effort has commonly focused on explicitly improving theoretical efficiency, often measured as ImageNet validation accuracy per FLOP. These theoretical savings have, however, proven challenging to achieve in practice, particularly on high-performance training accelerators. In this work, we focus on improving the practical efficiency of the state-of-the-art EfficientNet models on a new class of accelerator, the Graphcore IPU. We do this by extending this family of models in the following ways: (i) generalising depthwise convolutions to group convolutions; (ii) adding proxy-normalized activations to match batch normalization performance with batch-independent statistics; (iii) reducing compute by lowering the training resolution and inexpensively fine-tuning at higher resolution. We find that these three methods improve the practical efficiency for both training and inference. Code available at https://github.com/graphcore/graphcore-research/tree/main/Making_EfficientNet_More_Efficient . △ Less

Submitted 26 August, 2021; v1 submitted 7 June, 2021; originally announced June 2021.

Euclid preparation: XI. Mean redshift determination from galaxy redshift probabilities for cosmic shear tomography

Authors: Euclid Collaboration, O. Ilbert, S. de la Torre, N. Martinet, A. H. Wright, S. Paltani, C. Laigle, I. Davidzon, E. Jullo, H. Hildebrandt, D. C. Masters, A. Amara, C. J. Conselice, S. Andreon, N. Auricchio, R. Azzollini, C. Baccigalupi, A. Balaguera-Antolínez, M. Baldi, A. Balestra, S. Bardelli, R. Bender, A. Biviano, C. Bodendorf, D. Bonino , et al. (140 additional authors not shown)

Abstract: The analysis of weak gravitational lensing in wide-field imaging surveys is considered to be a major cosmological probe of dark energy. Our capacity to constrain the dark energy equation of state relies on the accurate knowledge of the galaxy mean redshift $\langle z \rangle$. We investigate the possibility of measuring $\langle z \rangle$ with an accuracy better than $0.002\,(1+z)$, in ten tomogr… ▽ More The analysis of weak gravitational lensing in wide-field imaging surveys is considered to be a major cosmological probe of dark energy. Our capacity to constrain the dark energy equation of state relies on the accurate knowledge of the galaxy mean redshift $\langle z \rangle$. We investigate the possibility of measuring $\langle z \rangle$ with an accuracy better than $0.002\,(1+z)$, in ten tomographic bins spanning the redshift interval $0.2<z<2.2$, the requirements for the cosmic shear analysis of Euclid. We implement a sufficiently realistic simulation to understand the advantages, complementarity, but also shortcoming of two standard approaches: the direct calibration of $\langle z \rangle$ with a dedicated spectroscopic sample and the combination of the photometric redshift probability distribution function (zPDF) of individual galaxies. We base our study on the Horizon-AGN hydrodynamical simulation that we analyse with a standard galaxy spectral energy distribution template-fitting code. Such procedure produces photometric redshifts with realistic biases, precision and failure rate. We find that the Euclid current design for direct calibration is sufficiently robust to reach the requirement on the mean redshift, provided that the purity level of the spectroscopic sample is maintained at an extremely high level of $>99.8\%$. The zPDF approach could also be successful if we debias the zPDF using a spectroscopic training sample. This approach requires deep imaging data, but is weakly sensitive to spectroscopic redshift failures in the training sample. We improve the debiasing method and confirm our finding by applying it to real-world weak-lensing data sets (COSMOS and KiDS+VIKING-450). △ Less

Submitted 6 January, 2021; originally announced January 2021.

Comments: 21 pages, 10 figures, accepted in A&A

Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies

Authors: J. Myles, A. Alarcon, A. Amon, C. Sánchez, S. Everett, J. DeRose, J. McCullough, D. Gruen, G. M. Bernstein, M. A. Troxel, S. Dodelson, A. Campos, N. MacCrann, B. Yin, M. Raveri, A. Amara, M. R. Becker, A. Choi, J. Cordero, K. Eckert, M. Gatti, G. Giannini, J. Gschwend, R. A. Gruendl, I. Harrison , et al. (83 additional authors not shown)

Abstract: Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey is an essential component to map** the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the Dark Energy Survey Year 3 Weak Lensing Source Catalogue to four tomographic bins… ▽ More Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey is an essential component to map** the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the Dark Energy Survey Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: Self-Organizing Map $p(z)$ (SOMPZ), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SR), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of $σ_{\langle z \rangle}\sim 0.01$ on the mean redshift in each tomographic bin. △ Less

Submitted 14 June, 2021; v1 submitted 15 December, 2020; originally announced December 2020.

Comments: See https://www.darkenergysurvey.org/des-year-3-cosmology-results-papers/ for the full DES Y3 cosmology release. 30 pages, 18 figures

Identifying and Repairing Catastrophic Errors in Galaxy Properties Using Dimensionality Reduction

Authors: Beryl Hovis-Afflerbach, Charles L. Steinhardt, Daniel Masters, Mara Salvato

Abstract: Our understanding of galaxy evolution is derived from large surveys designed to maximize efficiency by only observing the minimum amount needed to infer properties for a typical galaxy. However, for a few percent of galaxies in every survey, these observations are insufficient and derived properties can be catastrophically wrong. Further, it is currently difficult or impossible to determine which… ▽ More Our understanding of galaxy evolution is derived from large surveys designed to maximize efficiency by only observing the minimum amount needed to infer properties for a typical galaxy. However, for a few percent of galaxies in every survey, these observations are insufficient and derived properties can be catastrophically wrong. Further, it is currently difficult or impossible to determine which objects have failed, so that these contaminate every study of galaxy properties. We develop a novel method to identify these objects by combining the astronomical codes which infer galaxy properties with the dimensionality reduction algorithm t-SNE, which groups similar objects to determine which inferred properties are out of place. This method provides an improvement for the COSMOS catalog, which already uses existing techniques for catastrophic error removal, and therefore should improve the quality of large catalogs and any studies which are sensitive to large redshift errors. △ Less

Submitted 14 December, 2020; originally announced December 2020.

Comments: 11 pages, 7 figures. Accepted for publication in ApJ

The End of Galaxy Surveys

Authors: Jason Rhodes, Eric Huff, Daniel Masters, Anna Nierenberg

Abstract: For nearly a century, imaging and spectroscopic surveys of galaxies have given us information about the contents of the universe. We attempt to define the logical endpoint of such surveys by defining not the next galaxy survey, but the final galaxy survey at NIR wavelengths; this would be the galaxy survey that exhausts the information content useful for addressing extant questions. Such a survey… ▽ More For nearly a century, imaging and spectroscopic surveys of galaxies have given us information about the contents of the universe. We attempt to define the logical endpoint of such surveys by defining not the next galaxy survey, but the final galaxy survey at NIR wavelengths; this would be the galaxy survey that exhausts the information content useful for addressing extant questions. Such a survey would require incredible advances in a number of technologies and the survey details will depend on the as yet poorly constrained properties of the earliest galaxies. Using an exposure time calculator, we define nominal surveys for extracting the useful information for three science cases: dark energy cosmology, galaxy evolution, and supernovae. We define scaling relations that trade off sky background, telescope aperture, and focal plane size to allow for a survey of a given depth over a given area. For optimistic assumptions, a 280m telescope with a marginally resolved focal plane of 20 deg$^2$ operating at L2 could potentially exhaust the cosmological information content of galaxies in a 10 year survey. For galaxy evolution (making use of gravitational lensing to magnify the earliest galaxies) and SN, the same telescope would suffice. We discuss the technological advances needed to complete the last galaxy survey. While the final galaxy survey remains well outside of our technical reach today, we present scaling relations that show how we can progress toward the goal of exhausting the information content encoded in the shapes, positions, and colors of galaxies. △ Less

Submitted 12 October, 2020; originally announced October 2020.

Comments: 16 pages, 3 figures, to appear in AJ

Investigating the Effect of Galaxy Interactions on AGN Enhancement at $0.5<z<3.0$

Authors: Ekta A. Shah, Jeyhan S. Kartaltepe, Christina T. Magagnoli, Isabella G. Cox, Caleb T. Wetherell, Brittany N. Vanderhoof, Antonello Calabro, Nima Chartab, Christopher J. Conselice, Darren J. Croton, Jennifer Donley, Laura de Groot, Alexander de la Vega, Nimish P. Hathi, Olivier Ilbert, Hanae Inami, Dale D. Kocevski, Anton M. Koekemoer, Brian C. Lemaux, Kameswara Bharadwaj Mantha, Stefano Marchesi, Marie Martig, Daniel C. Masters, Elizabeth J. McGrath, Daniel H. McIntosh , et al. (8 additional authors not shown)

Abstract: Galaxy interactions and mergers are thought to play an important role in the evolution of galaxies. Studies in the nearby universe show a higher AGN fraction in interacting and merging galaxies than their isolated counterparts, indicating that such interactions are important contributors to black hole growth. To investigate the evolution of this role at higher redshifts, we have compiled the large… ▽ More Galaxy interactions and mergers are thought to play an important role in the evolution of galaxies. Studies in the nearby universe show a higher AGN fraction in interacting and merging galaxies than their isolated counterparts, indicating that such interactions are important contributors to black hole growth. To investigate the evolution of this role at higher redshifts, we have compiled the largest known sample of major spectroscopic galaxy pairs (2381 with $ΔV <5000$ km s$^{-1}$) at $0.5<z<3.0$ from observations in the COSMOS and CANDELS surveys. We identify X-ray and IR AGN among this kinematic pair sample, a visually identified sample of mergers and interactions, and a mass-, redshift-, and environment-matched control sample for each in order to calculate AGN fractions and the level of AGN enhancement as a function of relative velocity, redshift, and X-ray luminosity. While we see a slight increase in AGN fraction with decreasing projected separation, overall, we find no significant enhancement relative to the control sample at any separation. In the closest projected separation bin ($<25$ kpc, $ΔV <1000$ km s$^{-1}$), we find enhancements of a factor of 0.94$^{+0.21}_{-0.16}$ and 1.00$^{+0.58}_{-0.31}$ for X-ray and IR-selected AGN, respectively. While we conclude that galaxy interactions do not significantly enhance AGN activity on average over $0.5<z<3.0$ at these separations, given the errors and the small sample size at the closest projected separations, our results would be consistent with the presence of low-level AGN enhancement. △ Less

Submitted 6 October, 2020; originally announced October 2020.

Comments: Accepted for publication in ApJ, 28 pages, 15 figures

Euclid preparation: VIII. The Complete Calibration of the Colour-Redshift Relation survey: VLT/KMOS observations and data release

Authors: Euclid Collaboration, V. Guglielmo, R. Saglia, F. J. Castander, A. Galametz, S. Paltani, R. Bender, M. Bolzonella, P. Capak, O. Ilbert, D. C. Masters, D. Stern, S. Andreon, N. Auricchio, A. Balaguera-Antolínez, M. Baldi, S. Bardelli, A. Biviano, C. Bodendorf, D. Bonino, E. Bozzo, E. Branchini, S. Brau-Nogue, M. Brescia, C. Burigana , et al. (123 additional authors not shown)

Abstract: The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample tha… ▽ More The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample that is as representative as possible of the galaxies of the Euclid weak lensing sample. In order to minimise the number of spectroscopic observations to fill the gaps in current knowledge of the P(z|C), self-organising map (SOM) representations of the galaxy colour space have been constructed. Here we present the first results of an ESO@ VLT Large Programme approved in the context of C3R2, which makes use of the two VLT optical and near-infrared multi-object spectrographs, FORS2 and KMOS. This paper focuses on high-quality spectroscopic redshifts of high-z galaxies observed with the KMOS spectrograph in the H- and K-bands. A total of 424 highly-reliable z are measured in the 1.3<=z<=2.5 range, with total success rates of 60.7% in the H-band and 32.8% in the K-band. The newly determined z fill 55% of high and 35% of lower priority empty SOM grid cells. We measured Halpha fluxes in a 1."2 radius aperture from the spectra of the spectroscopically confirmed galaxies and converted them into star formation rates. In addition, we performed an SED fitting analysis on the same sample in order to derive stellar masses, E(B-V), total magnitudes, and SFRs. We combine the results obtained from the spectra with those derived via SED fitting, and we show that the spectroscopic failures come from either weakly star-forming galaxies (at z<1.7, i.e. in the H-band) or low S/N spectra (in the K-band) of z>2 galaxies. △ Less

Submitted 6 July, 2020; originally announced July 2020.

Comments: 21 pages, 12 figures

Cosmology with the Wide-Field Infrared Survey Telescope -- Multi-Probe Strategies

Authors: Tim Eifler, Hironao Miyatake, Elisabeth Krause, Chen Heinrich, Vivian Miranda, Christopher Hirata, Jiachuan Xu, Shoubaneh Hemmati, Melanie Simet, Peter Capak, Ami Choi, Olivier Dore, Cyrille Doux, Xiao Fang, Rebekah Hounsell, Eric Huff, Hung-** Huang, Mike Jarvis, Dan Masters, Eduardo Rozo, Dan Scolnic, David N. Spergel, Michael Troxel, Anja von der Linden, Yun Wang , et al. (3 additional authors not shown)

Abstract: We simulate the scientific performance of the Wide-Field Infrared Survey Telescope (WFIRST) High Latitude Survey (HLS) on dark energy and modified gravity. The 1.6 year HLS Reference survey is currently envisioned to image 2000 deg$^2$ in multiple bands to a depth of $\sim$26.5 in Y, J, H and to cover the same area with slit-less spectroscopy beyond z=3. The combination of deep, multi-band photome… ▽ More We simulate the scientific performance of the Wide-Field Infrared Survey Telescope (WFIRST) High Latitude Survey (HLS) on dark energy and modified gravity. The 1.6 year HLS Reference survey is currently envisioned to image 2000 deg$^2$ in multiple bands to a depth of $\sim$26.5 in Y, J, H and to cover the same area with slit-less spectroscopy beyond z=3. The combination of deep, multi-band photometry and deep spectroscopy will allow scientists to measure the growth and geometry of the Universe through a variety of cosmological probes (e.g., weak lensing, galaxy clusters, galaxy clustering, BAO, Type Ia supernova) and, equally, it will allow an exquisite control of observational and astrophysical systematic effects. In this paper we explore multi-probe strategies that can be implemented given WFIRST's instrument capabilities. We model cosmological probes individually and jointly and account for correlated systematics and statistical uncertainties due to the higher order moments of the density field. We explore different levels of observational systematics for the WFIRST survey (photo-z and shear calibration) and ultimately run a joint likelihood analysis in N-dim parameter space. We find that the WFIRST reference survey alone (no external data sets) can achieve a standard dark energy FoM of >300 when including all probes. This assumes no information from external data sets and realistic assumptions for systematics. Our study of the HLS reference survey should be seen as part of a future community driven effort to simulate and optimize the science return of WFIRST. △ Less

Submitted 10 April, 2020; originally announced April 2020.

Comments: comments welcome

Cosmology with the Wide-Field Infrared Survey Telescope -- Synergies with the Rubin Observatory Legacy Survey of Space and Time

Authors: Tim Eifler, Melanie Simet, Elisabeth Krause, Christopher Hirata, Hung-** Huang, Xiao Fang, Vivian Miranda, Rachel Mandelbaum, Cyrille Doux, Chen Heinrich, Eric Huff, Hironao Miyatake, Shoubaneh Hemmati, Jiachuan Xu, Paul Rogozenski, Peter Capak, Ami Choi, Olivier Dore, Bhuvnesh Jain, Mike Jarvis, Niall MacCrann, Dan Masters, Eduardo Rozo, David N. Spergel, Michael Troxel , et al. (5 additional authors not shown)

Abstract: We explore synergies between the space-based Wide-Field Infrared Survey Telescope (WFIRST) and the ground-based Rubin Observatory Legacy Survey of Space and Time (LSST). In particular, we consider a scenario where the currently envisioned survey strategy for WFIRST's High Latitude Survey (HLS), i.e., 2000 square degrees in four narrow photometric bands is altered in favor of a strategy that combin… ▽ More We explore synergies between the space-based Wide-Field Infrared Survey Telescope (WFIRST) and the ground-based Rubin Observatory Legacy Survey of Space and Time (LSST). In particular, we consider a scenario where the currently envisioned survey strategy for WFIRST's High Latitude Survey (HLS), i.e., 2000 square degrees in four narrow photometric bands is altered in favor of a strategy that combines rapid coverage of the LSST area (to full LSST depth) in one band. We find that a 5-month WFIRST survey in the W-band can cover the full LSST survey area providing high-resolution imaging for >95% of the LSST Year 10 gold galaxy sample. We explore a second, more ambitious scenario where WFIRST spends 1.5 years covering the LSST area. For this second scenario we quantify the constraining power on dark energy equation of state parameters from a joint weak lensing and galaxy clustering analysis, and compare it to an LSST-only survey and to the Reference WFIRST HLS survey. Our survey simulations are based on the WFIRST exposure time calculator and redshift distributions from the CANDELS catalog. Our statistical uncertainties account for higher-order correlations of the density field, and we include a wide range of systematic effects, such as uncertainties in shape and redshift measurements, and modeling uncertainties of astrophysical systematics, such as galaxy bias, intrinsic galaxy alignment, and baryonic physics. Assuming the 5-month WFIRST wide scenario, we find a significant increase in constraining power for the joint LSST+WFIRST wide survey compared to LSST Y10 (FoM(Wwide)= 2.4 FoM(LSST)) and compared to LSST+WFIRST HLS (FoM(Wwide)= 5.5 FoM(HLS)). △ Less

Submitted 11 April, 2020; v1 submitted 9 April, 2020; originally announced April 2020.

Comments: added references, comments welcome

Euclid: The selection of quiescent and star-forming galaxies using observed colours

Authors: L. Bisigello, U. Kuchner, C. J. Conselice, S. Andreon, M. Bolzonella, P. -A. Duc, B. Garilli, A. Humphrey, C. Maraston, M. Moresco, L. Pozzetti, C. Tortora, G. Zamorani, N. Auricchio, J. Brinchmann, V. Capobianco, J. Carretero, F. J. Castander, M. Castellano, S. Cavuoti, A. Cimatti, R. Cledassou, G. Congedo, L. Conversi, L. Corcione , et al. (49 additional authors not shown)

Abstract: The Euclid mission will observe well over a billion galaxies out to $z\sim6$ and beyond. This will offer an unrivalled opportunity to investigate several key questions for understanding galaxy formation and evolution. The first step for many of these studies will be the selection of a sample of quiescent and star-forming galaxies, as is often done in the literature by using well known colour techn… ▽ More The Euclid mission will observe well over a billion galaxies out to $z\sim6$ and beyond. This will offer an unrivalled opportunity to investigate several key questions for understanding galaxy formation and evolution. The first step for many of these studies will be the selection of a sample of quiescent and star-forming galaxies, as is often done in the literature by using well known colour techniques such as the `UVJ' diagram. However, given the limited number of filters available for the Euclid telescope, the recovery of such rest-frame colours will be challenging. We therefore investigate the use of observed Euclid colours, on their own and together with ground-based u-band observations, for selecting quiescent and star-forming galaxies. The most efficient colour combination, among the ones tested in this work, consists of the (u-VIS) and (VIS-J) colours. We find that this combination allows users to select a sample of quiescent galaxies complete to above $\sim70\%$ and with less than 15$\%$ contamination at redshifts in the range $0.75<z<1$. For galaxies at high-z or without the u-band complementary observations, the (VIS-Y) and (J-H) colours represent a valid alternative, with $>65\%$ completeness level and contamination below 20$\%$ at $1<z<2$ for finding quiescent galaxies. In comparison, the sample of quiescent galaxies selected with the traditional UVJ technique is only $\sim20\%$ complete at $z<3$, when recovering the rest-frame colours using mock Euclid observations. This shows that our new methodology is the most suitable one when only Euclid bands, along with u-band imaging, are available. △ Less

Submitted 16 March, 2020; originally announced March 2020.

Comments: 19 pages, 15 figures, 5 tables, accepted for publication in MNRAS

Spectroscopic Confirmation of a Coma Cluster Progenitor at z ~ 2.2

Authors: Behnam Darvish, Nick Z. Scoville, Christopher Martin, David Sobral, Bahram Mobasher, Alessandro Rettura, Jorryt Matthee, Peter Capak, Nima Chartab, Shoubaneh Hemmati, Daniel Masters, Hooshang Nayyeri, Donal O'Sullivan, Ana Paulino-Afonso, Zahra Sattari, Abtin Shahidi, Mara Salvato, Brian C. Lemaux, Olivier Le Fevre, Olga Cucciati

Abstract: We report the spectroscopic confirmation of a new protocluster in the COSMOS field at $z$ $\sim$ 2.2, COSMOS Cluster 2.2 (CC2.2), originally identified as an overdensity of narrowband selected H$α$ emitting candidates. With only two masks of Keck/MOSFIRE near-IR spectroscopy in both $H$ ($\sim$ 1.47-1.81 $μ$m) and $K$ ($\sim$ 1.92-2.40 $μ$m) bands ($\sim$ 1.5 hour each), we confirm 35 unique proto… ▽ More We report the spectroscopic confirmation of a new protocluster in the COSMOS field at $z$ $\sim$ 2.2, COSMOS Cluster 2.2 (CC2.2), originally identified as an overdensity of narrowband selected H$α$ emitting candidates. With only two masks of Keck/MOSFIRE near-IR spectroscopy in both $H$ ($\sim$ 1.47-1.81 $μ$m) and $K$ ($\sim$ 1.92-2.40 $μ$m) bands ($\sim$ 1.5 hour each), we confirm 35 unique protocluster members with at least two emission lines detected with S/N $>$ 3. Combined with 12 extra members from the zCOSMOS-deep spectroscopic survey (47 in total), we estimate a mean redshift and a line-of-sight velocity dispersion of $z_{mean}$=2.23224 $\pm$ 0.00101 and $σ_{los}$=645 $\pm$ 69 km s$^{-1}$ for this protocluster, respectively. Assuming virialization and spherical symmetry for the system, we estimate a total mass of $M_{vir}$ $\sim$ $(1-2) \times$10$^{14}$ $M_{\odot}$ for the structure. We evaluate a number density enhancement of $δ_{g}$ $\sim$ 7 for this system and we argue that the structure is likely not fully virialized at $z$ $\sim$ 2.2. However, in a spherical collapse model, $δ_{g}$ is expected to grow to a linear matter enhancement of $\sim$ 1.9 by $z$=0, exceeding the collapse threshold of 1.69, and leading to a fully collapsed and virialized Coma-type structure with a total mass of $M_{dyn}$($z$=0) $\sim$ 9.2$\times$10$^{14}$ $M_{\odot}$ by now. This observationally efficient confirmation suggests that large narrowband emission-line galaxy surveys, when combined with ancillary photometric data, can be used to effectively trace the large-scale structure and protoclusters at a time when they are mostly dominated by star-forming galaxies. △ Less

Submitted 13 June, 2020; v1 submitted 14 February, 2020; originally announced February 2020.

A Method to Distinguish Quiescent and Dusty Star-forming Galaxies with Machine Learning

Authors: Charles L. Steinhardt, John R. Weaver, Jack Maxfield, Iary Davidzon, Andreas L. Faisst, Dan Masters, Madeline Schemel, Sune Toft

Abstract: Large photometric surveys provide a rich source of observations of quiescent galaxies, including a surprisingly large population at z>1. However, identifying large, but clean, samples of quiescent galaxies has proven difficult because of their near-degeneracy with interlopers such as dusty, star-forming galaxies. We describe a new technique for selecting quiescent galaxies based upon t-distributed… ▽ More Large photometric surveys provide a rich source of observations of quiescent galaxies, including a surprisingly large population at z>1. However, identifying large, but clean, samples of quiescent galaxies has proven difficult because of their near-degeneracy with interlopers such as dusty, star-forming galaxies. We describe a new technique for selecting quiescent galaxies based upon t-distributed stochastic neighbor embedding (t-SNE), an unsupervised machine learning algorithm for dimensionality reduction. This t-SNE selection provides an improvement both over UVJ, removing interlopers which otherwise would pass color selection, and over photometric template fitting, more strongly towards high redshift. Due to the similarity between the colors of high- and low-redshift quiescent galaxies, under our assumptions t-SNE outperforms template fitting in 63% of trials at redshifts where a large training sample already exists. It also may be able to select quiescent galaxies more efficiently at higher redshifts than the training sample. △ Less

Submitted 13 February, 2020; originally announced February 2020.

Comments: ApJ, in press

The BUFFALO HST Survey

Authors: Charles L. Steinhardt, Mathilde Jauzac, Ana Acebron, Hakim Atek, Peter Capak, Iary Davidzon, Dominique Eckert, David Harvey, Anton M. Koekemoer, Claudia D. P. Lagos, Guillaume Mahler, Mireia Montes, Anna Niemiec, Mario Nonino, P. A. Oesch, Johan Richard, Steven A. Rodney, Matthieu Schaller, Keren Sharon, Louis-Gregory Strolger, Joseph Allingham, Adam Amara, Yannick Bah'e, Celine Boehm, Sownak Bose , et al. (70 additional authors not shown)

Abstract: The Beyond Ultra-deep Frontier Fields and Legacy Observations (BUFFALO) is a 101 orbit + 101 parallel Cycle 25 Hubble Space Telescope Treasury program taking data from 2018-2020. BUFFALO will expand existing coverage of the Hubble Frontier Fields (HFF) in WFC3/IR F105W, F125W, and F160W and ACS/WFC F606W and F814W around each of the six HFF clusters and flanking fields. This additional area has no… ▽ More The Beyond Ultra-deep Frontier Fields and Legacy Observations (BUFFALO) is a 101 orbit + 101 parallel Cycle 25 Hubble Space Telescope Treasury program taking data from 2018-2020. BUFFALO will expand existing coverage of the Hubble Frontier Fields (HFF) in WFC3/IR F105W, F125W, and F160W and ACS/WFC F606W and F814W around each of the six HFF clusters and flanking fields. This additional area has not been observed by HST but is already covered by deep multi-wavelength datasets, including Spitzer and Chandra. As with the original HFF program, BUFFALO is designed to take advantage of gravitational lensing from massive clusters to simultaneously find high-redshift galaxies which would otherwise lie below HST detection limits and model foreground clusters to study properties of dark matter and galaxy assembly. The expanded area will provide a first opportunity to study both cosmic variance at high redshift and galaxy assembly in the outskirts of the large HFF clusters. Five additional orbits are reserved for transient followup. BUFFALO data including mosaics, value-added catalogs and cluster mass distribution models will be released via MAST on a regular basis, as the observations and analysis are completed for the six individual clusters. △ Less

Submitted 13 February, 2020; v1 submitted 27 January, 2020; originally announced January 2020.

Comments: Accepted ApJS; MAST archive will be live concurrent with publication

FOBOS: A Next-Generation Spectroscopic Facility at the W. M. Keck Observatory

Authors: K. Bundy, K. Westfall, N. MacDonald, R. Kupke, M. Savage, C. Poppett, A. Alabi, G. Becker, J. Burchett, P. Capak, A. Coil, M. Cooper, D. Cowley, W. Deich, D. Dillon, J. Edelstein, P. Guhathakurta, J. Hennawi, M. Kassis, K. -G. Lee, D. Masters, T. Miller, J. Newman, J. O'Meara, J. X. Prochaska , et al. (16 additional authors not shown)

Abstract: High-multiplex and deep spectroscopic follow-up of upcoming panoramic deep-imaging surveys like LSST, Euclid, and WFIRST is a widely recognized and increasingly urgent necessity. No current or planned facility at a U.S. observatory meets the sensitivity, multiplex, and rapid-response time needed to exploit these future datasets. FOBOS, the Fiber-Optic Broadband Optical Spectrograph, is a near-term… ▽ More High-multiplex and deep spectroscopic follow-up of upcoming panoramic deep-imaging surveys like LSST, Euclid, and WFIRST is a widely recognized and increasingly urgent necessity. No current or planned facility at a U.S. observatory meets the sensitivity, multiplex, and rapid-response time needed to exploit these future datasets. FOBOS, the Fiber-Optic Broadband Optical Spectrograph, is a near-term fiber-based facility that addresses these spectroscopic needs by optimizing depth over area and exploiting the aperture advantage of the existing 10m Keck II Telescope. The result is an instrument with a uniquely blue-sensitive wavelength range (0.31-1.0 um) at R~3500, high-multiplex (1800 fibers), and a factor 1.7 greater survey speed and order-of-magnitude greater sampling density than Subaru's Prime Focus Spectrograph (PFS). In the era of panoramic deep imaging, FOBOS will excel at building the deep, spectroscopic reference data sets needed to interpret vast imaging data. At the same time, its flexible focal plane, including a mode with 25 deployable integral-field units (IFUs) across a 20 arcmin diameter field, enables an expansive range of scientific investigations. Its key programmatic areas include (1) nested stellar-parameter training sets that enable studies of the Milky Way and M31 halo sub-structure, as well as local group dwarf galaxies, (2) a comprehensive picture of galaxy formation thanks to detailed map** of the baryonic environment at z~2 and statistical linking of evolving populations to the present day, and (3) dramatic enhancements in cosmological constraints via precise photometric redshifts and determined redshift distributions. In combination with Keck I instrumentation, FOBOS also provides instant access to medium-resolution spectroscopy for transient sources with full coverage from the UV to the K-band. △ Less

Submitted 16 July, 2019; originally announced July 2019.

Comments: Submitted to the Astro2020 Decadal Survey as a facilities white paper

Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets

Authors: Joshua S. Speagle, Alexie Leauthaud, Song Huang, Christopher P. Bradshaw, Felipe Ardila, Peter L. Capak, Daniel J. Eisenstein, Daniel C. Masters, Rachel Mandelbaum, Surhud More, Melanie Simet, Cristóbal Sifón

Abstract: Although photometric redshifts (photo-z's) are crucial ingredients for current and upcoming large-scale surveys, the high-quality spectroscopic redshifts currently available to train, validate, and test them are substantially non-representative in both magnitude and color. We investigate the nature and structure of this bias by tracking how objects from a heterogeneous training sample contribute t… ▽ More Although photometric redshifts (photo-z's) are crucial ingredients for current and upcoming large-scale surveys, the high-quality spectroscopic redshifts currently available to train, validate, and test them are substantially non-representative in both magnitude and color. We investigate the nature and structure of this bias by tracking how objects from a heterogeneous training sample contribute to photo-z predictions as a function of magnitude and color, and illustrate that the underlying redshift distribution at fixed color can evolve strongly as a function of magnitude. We then test the robustness of the galaxy-galaxy lensing signal in 120 deg$^2$ of HSC-SSP DR1 data to spectroscopic completeness and photo-z biases, and find that their impacts are sub-dominant to current statistical uncertainties. Our methodology provides a framework to investigate how spectroscopic incompleteness can impact photo-z-based weak lensing predictions in future surveys such as LSST and WFIRST. △ Less

Submitted 13 June, 2019; originally announced June 2019.

Comments: Submitted to MNRAS; 21 pages, 12 figures

Horizon-AGN virtual observatory -- 2: Template-free estimates of galaxy properties from colours

Authors: Iary Davidzon, Clotilde Laigle, Peter L. Capak, Olivier Ilbert, Daniel C. Masters, Shoubaneh Hemmati, Nikolaos Apostolakos, Jean Coupon, Sylvain de la Torre, Julien Devriendt, Yohan Dubois, Daichi Kashino, Stephane Paltani, Christophe Pichon

Abstract: Using the Horizon-AGN hydrodynamical simulation and self-organising maps (SOMs), we show how to compress the complex data structure of a cosmological simulation into a 2-d grid which is much easier to analyse. We first verify the tight correlation between the observed 0.3$\!-\!5μ$m broad-band colours of Horizon-AGN galaxies and their high-resolution spectra. The correlation is found to extend to p… ▽ More Using the Horizon-AGN hydrodynamical simulation and self-organising maps (SOMs), we show how to compress the complex data structure of a cosmological simulation into a 2-d grid which is much easier to analyse. We first verify the tight correlation between the observed 0.3$\!-\!5μ$m broad-band colours of Horizon-AGN galaxies and their high-resolution spectra. The correlation is found to extend to physical properties such as redshift, stellar mass, and star formation rate (SFR). This direct map** from colour to physical parameter space is shown to work also after including photometric uncertainties that mimic the COSMOS survey. We then label the SOM grid with a simulated calibration sample and estimate redshift and SFR for COSMOS-like galaxies up to $z\sim3$. In comparison to state-of-the-art techniques based on synthetic templates, our method is comparable in performance but less biased at estimating redshifts, and significantly better at predicting SFRs. In particular our "data-driven" approach, in contrast to model libraries, intrinsically allows for the complexity of galaxy formation and can handle sample biases. We advocate that obtaining the calibration for this method should be one of the goals of next-generation galaxy surveys. △ Less

Submitted 11 February, 2020; v1 submitted 30 May, 2019; originally announced May 2019.

Comments: Published on MNRAS in November 2019. Horizon-AGN photometric catalogues are available at https://www.horizon-simulation.org/data.html

Bringing manifold learning and dimensionality reduction to SED fitters

Authors: Shoubaneh Hemmati, Peter Capak, Milad Pourrahmani, Hooshang Nayyeri, Daniel Stern, Bahram Mobasher, Behnam Darvish, Iary Davidzon, Olivier Ilbert, Daniel Masters, Abtin Shahidi

Abstract: We show unsupervised machine learning techniques are a valuable tool for both visualizing and computationally accelerating the estimation of galaxy physical properties from photometric data. As a proof of concept, we use self organizing maps (SOMs) to visualize a spectral energy distribution (SED) model library in the observed photometry space. The resulting visual maps allow for a better understa… ▽ More We show unsupervised machine learning techniques are a valuable tool for both visualizing and computationally accelerating the estimation of galaxy physical properties from photometric data. As a proof of concept, we use self organizing maps (SOMs) to visualize a spectral energy distribution (SED) model library in the observed photometry space. The resulting visual maps allow for a better understanding of how the observed data maps to physical properties and to better optimize the model libraries for a given set of observational data. Next, the SOMs are used to estimate the physical parameters of 14,000 z~1 galaxies in the COSMOS field and found to be in agreement with those measured with SED fitting. However, the SOM method is able to estimate the full probability distribution functions for each galaxy up to about a million times faster than direct model fitting. We conclude by discussing how this speed up and learning how the galaxy data manifold maps to physical parameter space and visualizing this map** in lower dimensions helps overcome other challenges in galaxy formation and evolution. △ Less

Submitted 24 May, 2019; originally announced May 2019.

Comments: 6 pages, 5 figures, submitted to ApJL

The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Analysis and Data Release 2

Authors: Daniel C. Masters, Daniel K. Stern, Judith G. Cohen, Peter L. Capak, S. Adam Stanford, Nina Hernitschek, Audrey Galametz, Iary Davidzon, Jason D. Rhodes, Dave Sanders, Bahram Mobasher, Francisco Castander, Kerianne Pruett, Sotiria Fotopoulou

Abstract: The Complete Calibration of the Color-Redshift Relation (C3R2) survey is a multi-institution, multi-instrument survey that aims to map the empirical relation of galaxy color to redshift to i~24.5 (AB), thereby providing a firm foundation for weak lensing cosmology with the Stage IV dark energy missions Euclid and WFIRST. Here we present 3171 new spectroscopic redshifts obtained in the 2016B and 20… ▽ More The Complete Calibration of the Color-Redshift Relation (C3R2) survey is a multi-institution, multi-instrument survey that aims to map the empirical relation of galaxy color to redshift to i~24.5 (AB), thereby providing a firm foundation for weak lensing cosmology with the Stage IV dark energy missions Euclid and WFIRST. Here we present 3171 new spectroscopic redshifts obtained in the 2016B and 2017A semesters with a combination of DEIMOS, LRIS, and MOSFIRE on the Keck telescopes. The observations come from all of the Keck partners: Caltech, NASA, the University of Hawaii, and the University of California. Combined with the 1283 redshifts published in DR1, the C3R2 survey has now obtained and published 4454 high quality galaxy redshifts. We discuss updates to the survey design and provide a catalog of photometric and spectroscopic data. Initial tests of the calibration method performance are given, indicating that the sample, once completed and combined with extensive data collected by other spectroscopic surveys, should allow us to meet the cosmology requirements for Euclid, and make significant headway toward solving the problem for WFIRST. We use the full spectroscopic sample to demonstrate that galaxy brightness is weakly correlated with redshift once a galaxy is localized in the Euclid or WFIRST color space, with potentially important implications for the spectroscopy needed to calibrate redshifts for faint WFIRST and LSST sources. △ Less

Submitted 12 April, 2019; originally announced April 2019.

Comments: ApJ accepted. Survey website with links to the C3R2 redshift catalog and spectroscopic data hosted by KOA can be found at https://sites.google.com/view/c3r2-survey/home

WFIRST: The Essential Cosmology Space Observatory for the Coming Decade

Authors: O. Doré, C. Hirata, Y. Wang, D. Weinberg, T. Eifler, R. J. Foley, C. He Heinrich, E. Krause, S. Perlmutter, A. Pisani, D. Scolnic, D. N. Spergel, N. Suntzeff, G. Aldering, C. Baltay, P. Capak, A. Choi, S. Deustua, C. Dvorkin, S. M. Fall, X. Fang, A. Fruchter, L. Galbany, S. Ho, R. Hounsell , et al. (24 additional authors not shown)

Abstract: Two decades after its discovery, cosmic acceleration remains the most profound mystery in cosmology and arguably in all of physics. Either the Universe is dominated by a form of dark energy with exotic physical properties not predicted by standard model physics, or General Relativity is not an adequate description of gravity over cosmic distances. WFIRST emerged as a top priority of Astro2010 in p… ▽ More Two decades after its discovery, cosmic acceleration remains the most profound mystery in cosmology and arguably in all of physics. Either the Universe is dominated by a form of dark energy with exotic physical properties not predicted by standard model physics, or General Relativity is not an adequate description of gravity over cosmic distances. WFIRST emerged as a top priority of Astro2010 in part because of its ability to address the mystery of cosmic acceleration through both high precision measurements of the cosmic expansion history and the growth of cosmic structures with multiple and redundant probes. We illustrate in this white paper how mission design changes since Astro2010 have made WFIRST an even more powerful dark energy facility and have improved the ability of WFIRST to respond to changes in the experimental landscape. WFIRST is the space-based probe of DE the community needs in the mid-2020s. △ Less

Submitted 1 April, 2019; originally announced April 2019.

Comments: 7 pages, 2 figures, Astro2020 Science White Paper