-
Forward Modeling of Spectroscopic Galaxy Surveys: Application to SDSS
Authors:
Martina Fagioli,
Julian Riebartsch,
Andrina Nicola,
Jörg Herbel,
Adam Amara,
Alexandre Refregier,
Chihway Chang,
Laurenz Gamper,
Luca Tortorelli
Abstract:
Galaxy spectra are essential to probe the spatial distribution of galaxies in our Universe. To better interpret current and future spectroscopic galaxy redshift surveys, it is important to be able to simulate these data sets. We describe Uspec, a forward modeling tool to generate galaxy spectra taking into account some intrinsic galaxy properties as well as instrumental responses of a given telesc…
▽ More
Galaxy spectra are essential to probe the spatial distribution of galaxies in our Universe. To better interpret current and future spectroscopic galaxy redshift surveys, it is important to be able to simulate these data sets. We describe Uspec, a forward modeling tool to generate galaxy spectra taking into account some intrinsic galaxy properties as well as instrumental responses of a given telescope. The model for the intrinsic properties of the galaxy population, i.e., the luminosity functions, and size and spectral coefficients distribu- tions, was developed in an earlier work for broad-band imaging surveys [1], and we now aim to test the model further using spectroscopic data. We apply Uspec to the SDSS/CMASS sample of Luminous Red Galaxies (LRGs). We construct selection cuts that match those used to build this LRG sample, which we then apply to data and simulations in the same way. The resulting real and simulated average spectra show a good statistical agreement overall, with residual differences likely coming from a bluer galaxy population of the simulated sam- ple. We also do not explore the impact of non-solar element ratios in our simulations. For a quantitative comparison, we perform Principal Component Analysis (PCA) of the sets of spectra. By comparing the PCs constructed from simulations and data, we find good agree- ment for all components. The distributions of the eigencoefficients also show an appreciable overlap. We are therefore able to properly simulate the LRG sample taking into account the SDSS/BOSS instrumental responses. The differences between the two samples can be ascribed to the intrinsic properties of the simulated galaxy population, which can be reduced by further improvements of our modelling method in the future. We discuss how these results can be useful for the forward modeling of upcoming large spectroscopic surveys.
△ Less
Submitted 29 October, 2018; v1 submitted 14 March, 2018;
originally announced March 2018.
-
PyCosmo: An Integrated Cosmological Boltzmann Solver
Authors:
Alexandre Refregier,
Lukas Gamper,
Adam Amara,
Lavinia Heisenberg
Abstract:
As wide-field surveys yield ever more precise measurements, cosmology has entered a phase of high precision requiring highly accurate and fast theoretical predictions. At the heart of most cosmological model predictions is a numerical solution of the Einstein-Boltzmann equations governing the evolution of linear perturbations in the Universe. We present PyCosmo, a new Python-based framework to sol…
▽ More
As wide-field surveys yield ever more precise measurements, cosmology has entered a phase of high precision requiring highly accurate and fast theoretical predictions. At the heart of most cosmological model predictions is a numerical solution of the Einstein-Boltzmann equations governing the evolution of linear perturbations in the Universe. We present PyCosmo, a new Python-based framework to solve this set of equations using a special pur- pose solver based on symbolic manipulations, automatic generation of C++ code and sparsity optimisation. The code uses a consistency relation of the field equations to adapt the time step and does not rely on physical approximations for speed-up. After reviewing the system of first-order linear homogeneous differential equations to be solved, we describe the numerical scheme implemented in PyCosmo. We then compare the predictions and performance of the code for the computation of the transfer functions of cosmological perturbations and compare it to existing cosmological Boltzmann codes. We find that we achieve comparable execution times for comparable accuracies. While PyCosmo does not yet have all the features of other codes, our approach is complementary to existing cosmological Boltzmann solvers and can be used as an independent test of their numerical solutions. The symbolic representation of the Einstein-Boltzmann equation system in PyCosmo provides a convenient interface for implementing extended cosmological models. We also discuss how the PyCosmo framework can also be used as a general framework to compute cosmological quantities as well as observables for both interactive and high-performance batch jobs applications. Information about the PyCosmo package and future code releases are available at http://www.cosmology.ethz.ch/research/software-lab.html.
△ Less
Submitted 17 August, 2017;
originally announced August 2017.
-
Updated Core Libraries of the ALPS Project
Authors:
A. Gaenko,
A. E. Antipov,
G. Carcassi,
T. Chen,
X. Chen,
Q. Dong,
L. Gamper,
J. Gukelberger,
R. Igarashi,
S. Iskakov,
M. Könz,
J. P. F. LeBlanc,
R. Levy,
P. N. Ma,
J. E. Paki,
H. Shinaoka,
S. Todo,
M. Troyer,
E. Gull
Abstract:
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated systems. The libraries provide a convenient set of well-documented and reusable components for develo** condensed matter physics simulation code, and the applications strive to make commo…
▽ More
The open source ALPS (Algorithms and Libraries for Physics Simulations) project provides a collection of physics libraries and applications, with a focus on simulations of lattice models and strongly correlated systems. The libraries provide a convenient set of well-documented and reusable components for develo** condensed matter physics simulation code, and the applications strive to make commonly used and proven computational algorithms available to a non-expert community. In this paper we present an updated and refactored version of the core ALPS libraries geared at the computational physics software development community, rewritten with focus on documentation, ease of installation, and software maintainability.
△ Less
Submitted 15 December, 2016; v1 submitted 13 September, 2016;
originally announced September 2016.
-
SPOKES: an End-to-End Simulation Facility for Spectroscopic Cosmological Surveys
Authors:
B. Nord,
A. Amara,
A. Refregier,
La. Gamper,
Lu. Gamper,
B. Hambrecht,
C. Chang,
J. E. Forero-Romero,
S. Serrano,
C. Cunha,
O. Coles,
A. Nicola,
M. Busha,
A. Bauer,
W. Saunders,
S. Jouvel,
D. Kirk,
R. Wechsler
Abstract:
The nature of dark matter, dark energy and large-scale gravity pose some of the most pressing questions in cosmology today. These fundamental questions require highly precise measurements, and a number of wide-field spectroscopic survey instruments are being designed to meet this requirement. A key component in these experiments is the development of a simulation tool to forecast science performan…
▽ More
The nature of dark matter, dark energy and large-scale gravity pose some of the most pressing questions in cosmology today. These fundamental questions require highly precise measurements, and a number of wide-field spectroscopic survey instruments are being designed to meet this requirement. A key component in these experiments is the development of a simulation tool to forecast science performance, define requirement flow-downs, optimize implementation, demonstrate feasibility, and prepare for exploitation. We present SPOKES (SPectrOscopic KEn Simulation), an end-to-end simulation facility for spectroscopic cosmological surveys designed to address this challenge. SPOKES is based on an integrated infrastructure, modular function organization, coherent data handling and fast data access. These key features allow reproducibility of pipeline runs, enable ease of use and provide flexibility to update functions within the pipeline. The cyclic nature of the pipeline offers the possibility to make the science output an efficient measure for design optimization and feasibility testing. We present the architecture, first science, and computational performance results of the simulation pipeline. The framework is general, but for the benchmark tests, we use the Dark Energy Spectrometer (DESpec), one of the early concepts for the upcoming project, the Dark Energy Spectroscopic Instrument (DESI). We discuss how the SPOKES framework enables a rigorous process to optimize and exploit spectroscopic survey experiments in order to derive high-precision cosmological measurements optimally.
△ Less
Submitted 3 February, 2016;
originally announced February 2016.
-
Calibrated Ultra Fast Image Simulations for the Dark Energy Survey
Authors:
Claudio Bruderer,
Chihway Chang,
Alexandre Refregier,
Adam Amara,
Joel Berge,
Lukas Gamper
Abstract:
Weak lensing by large-scale structure is a powerful technique to probe the dark components of the universe. To understand the measurement process of weak lensing and the associated systematic effects, image simulations are becoming increasingly important. For this purpose we present a first implementation of the $\textit{Monte Carlo Control Loops}$ ($\textit{MCCL}$; Refregier & Amara 2014), a cohe…
▽ More
Weak lensing by large-scale structure is a powerful technique to probe the dark components of the universe. To understand the measurement process of weak lensing and the associated systematic effects, image simulations are becoming increasingly important. For this purpose we present a first implementation of the $\textit{Monte Carlo Control Loops}$ ($\textit{MCCL}$; Refregier & Amara 2014), a coherent framework for studying systematic effects in weak lensing. It allows us to model and calibrate the shear measurement process using image simulations from the Ultra Fast Image Generator (UFig; Berge et al. 2013). We apply this framework to a subset of the data taken during the Science Verification period (SV) of the Dark Energy Survey (DES). We calibrate the UFig simulations to be statistically consistent with DES images. We then perform tolerance analyses by perturbing the simulation parameters and study their impact on the shear measurement at the one-point level. This allows us to determine the relative importance of different input parameters to the simulations. For spatially constant systematic errors and six simulation parameters, the calibration of the simulation reaches the weak lensing precision needed for the DES SV survey area. Furthermore, we find a sensitivity of the shear measurement to the intrinsic ellipticity distribution, and an interplay between the magnitude-size and the pixel value diagnostics in constraining the noise model. This work is the first application of the $\textit{MCCL}$ framework to data and shows how it can be used to methodically study the impact of systematics on the cosmic shear measurement.
△ Less
Submitted 10 April, 2015;
originally announced April 2015.
-
Modelling the Transfer Function for the Dark Energy Survey
Authors:
C. Chang,
M. T. Busha,
R. H. Wechsler,
A. Refregier,
A. Amara,
E. Rykof,
M. R. Becker,
C. Bruderer,
L. Gamper,
B. Leistedt,
H. Peiris,
T. Abbott,
F. B. Abdalla,
E. Balbinot,
M. Banerji,
R. A. Bernstein,
E. Bertin,
D. Brooks,
A. Carnero Rosell,
S. Desai,
L. N. da Costa,
C. E Cunha,
T. Eifler,
A. E. Evrard,
A. Fausti Neto
, et al. (18 additional authors not shown)
Abstract:
We present a forward-modelling simulation framework designed to model the data products from the Dark Energy Survey (DES). This forward-model process can be thought of as a transfer function -- a map** from cosmological and astronomical signals to the final data products used by the scientists. Using output from the cosmological simulations (the Blind Cosmology Challenge), we generate simulated…
▽ More
We present a forward-modelling simulation framework designed to model the data products from the Dark Energy Survey (DES). This forward-model process can be thought of as a transfer function -- a map** from cosmological and astronomical signals to the final data products used by the scientists. Using output from the cosmological simulations (the Blind Cosmology Challenge), we generate simulated images (the Ultra Fast Image Simulator, Berge et al. 2013) and catalogs representative of the DES data. In this work we simulate the 244 sq. deg coadd images and catalogs in 5 bands for the DES Science Verification (SV) data. The simulation output is compared with the corresponding data to show that major characteristics of the images and catalogs can be captured. We also point out several directions of future improvements. Two practical examples, star/galaxy classification and proximity effects on object detection, are then used to demonstrate how one can use the simulations to address systematics issues in data analysis. With clear understanding of the simplifications in our model, we show that one can use the simulations side-by-side with data products to interpret the measurements. This forward modelling approach is generally applicable for other upcoming and future surveys. It provides a powerful tool for systematics studies which is sufficiently realistic and highly controllable.
△ Less
Submitted 11 March, 2015; v1 submitted 31 October, 2014;
originally announced November 2014.
-
HOPE: A Python Just-In-Time compiler for astrophysical computations
Authors:
Joel Akeret,
Lukas Gamper,
Adam Amara,
Alexandre Refregier
Abstract:
The Python programming language is becoming increasingly popular for scientific applications due to its simplicity, versatility, and the broad range of its libraries. A drawback of this dynamic language, however, is its low runtime performance which limits its applicability for large simulations and for the analysis of large data sets, as is common in astrophysics and cosmology. While various fram…
▽ More
The Python programming language is becoming increasingly popular for scientific applications due to its simplicity, versatility, and the broad range of its libraries. A drawback of this dynamic language, however, is its low runtime performance which limits its applicability for large simulations and for the analysis of large data sets, as is common in astrophysics and cosmology. While various frameworks have been developed to address this limitation, most focus on covering the complete language set, and either force the user to alter the code or are not able to reach the full speed of an optimised native compiled language. In order to combine the ease of Python and the speed of C++, we developed HOPE, a specialised Python just-in-time (JIT) compiler designed for numerical astrophysical applications. HOPE focuses on a subset of the language and is able to translate Python code into C++ while performing numerical optimisation on mathematical expressions at runtime. To enable the JIT compilation, the user only needs to add a decorator to the function definition. We assess the performance of HOPE by performing a series of benchmarks and compare its execution speed with that of plain Python, C++ and the other existing frameworks. We find that HOPE improves the performance compared to plain Python by a factor of 2 to 120, achieves speeds comparable to that of C++, and often exceeds the speed of the existing solutions. We discuss the differences between HOPE and the other frameworks, as well as future extensions of its capabilities. The fully documented HOPE package is available at http://hope.phys.ethz.ch and is published under the GPLv3 license on PyPI and GitHub.
△ Less
Submitted 3 December, 2014; v1 submitted 16 October, 2014;
originally announced October 2014.
-
An Ultra Fast Image Generator (UFig) for wide-field astronomy
Authors:
Joel Bergé,
Lukas Gamper,
Alexandre Réfrégier,
Adam Amara
Abstract:
Simulated wide-field images are becoming an important part of observational astronomy, either to prepare for new surveys or to test measurement methods. In order to efficiently explore vast parameter spaces, the computational speed of simulation codes is a central requirement to their implementation. We introduce the Ultra Fast Image Generator (UFig) which aims to bring wide-field imaging simulati…
▽ More
Simulated wide-field images are becoming an important part of observational astronomy, either to prepare for new surveys or to test measurement methods. In order to efficiently explore vast parameter spaces, the computational speed of simulation codes is a central requirement to their implementation. We introduce the Ultra Fast Image Generator (UFig) which aims to bring wide-field imaging simulations to the current limits of computational capabilities. We achieve this goal through: (1) models of galaxies, stars and observational conditions, which, while simple, capture the key features necessary for realistic simulations, and (2) state-of-the-art computational and implementation optimizations. We present the performances of UFig and show that it is faster than existing public simulation codes by several orders of magnitude. It allows us to produce images more quickly than SExtractor needs to analyze them. For instance, it can simulate a typical 0.25 deg^2 Subaru SuprimeCam image (10k x 8k pixels) with a 5-sigma limiting magnitude of R=26 in 30 seconds on a laptop, yielding an average simulation time for a galaxy of 30 microseconds. This code is complementary to end-to-end simulation codes and can be used as a fast, central component of observational methods relying on simulations.
△ Less
Submitted 6 September, 2012;
originally announced September 2012.
-
Topological Phases: An Expedition off Lattice
Authors:
Michael H. Freedman,
Lukas Gamper,
Charlotte Gils,
Sergei V. Isakov,
Simon Trebst,
Matthias Troyer
Abstract:
Motivated by the goal to give the simplest possible microscopic foundation for a broad class of topological phases, we study quantum mechanical lattice models where the topology of the lattice is one of the dynamical variables. However, a fluctuating geometry can remove the separation between the system size and the range of local interactions, which is important for topological protection and ult…
▽ More
Motivated by the goal to give the simplest possible microscopic foundation for a broad class of topological phases, we study quantum mechanical lattice models where the topology of the lattice is one of the dynamical variables. However, a fluctuating geometry can remove the separation between the system size and the range of local interactions, which is important for topological protection and ultimately the stability of a topological phase. In particular, it can open the door to a pathology, which has been studied in the context of quantum gravity and goes by the name of `baby universe', Here we discuss three distinct approaches to suppressing these pathological fluctuations. We complement this discussion by applying Cheeger's theory relating the geometry of manifolds to their vibrational modes to study the spectra of Hamiltonians. In particular, we present a detailed study of the statistical properties of loop gas and string net models on fluctuating lattices, both analytically and numerically.
△ Less
Submitted 1 February, 2011;
originally announced February 2011.
-
The ALPS project release 2.0: Open source software for strongly correlated systems
Authors:
B. Bauer,
L. D. Carr,
H. G. Evertz,
A. Feiguin,
J. Freire,
S. Fuchs,
L. Gamper,
J. Gukelberger,
E. Gull,
S. Guertler,
A. Hehn,
R. Igarashi,
S. V. Isakov,
D. Koop,
P. N. Ma,
P. Mates,
H. Matsuo,
O. Parcollet,
G. Pawlowski,
J. D. Picon,
L. Pollet,
E. Santos,
V. W. Scarola,
U. Schollwöck,
C. Silva
, et al. (7 additional authors not shown)
Abstract:
We present release 2.0 of the ALPS (Algorithms and Libraries for Physics Simulations) project, an open source software project to develop libraries and application programs for the simulation of strongly correlated quantum lattice models such as quantum magnets, lattice bosons, and strongly correlated fermion systems. The code development is centered on common XML and HDF5 data formats, libraries…
▽ More
We present release 2.0 of the ALPS (Algorithms and Libraries for Physics Simulations) project, an open source software project to develop libraries and application programs for the simulation of strongly correlated quantum lattice models such as quantum magnets, lattice bosons, and strongly correlated fermion systems. The code development is centered on common XML and HDF5 data formats, libraries to simplify and speed up code development, common evaluation and plotting tools, and simulation programs. The programs enable non-experts to start carrying out serial or parallel numerical simulations by providing basic implementations of the important algorithms for quantum lattice models: classical and quantum Monte Carlo (QMC) using non-local updates, extended ensemble simulations, exact and full diagonalization (ED), the density matrix renormalization group (DMRG) both in a static version and a dynamic time-evolving block decimation (TEBD) code, and quantum Monte Carlo solvers for dynamical mean field theory (DMFT). The ALPS libraries provide a powerful framework for programers to develop their own applications, which, for instance, greatly simplify the steps of porting a serial code onto a parallel, distributed memory machine. Major changes in release 2.0 include the use of HDF5 for binary data, evaluation tools in Python, support for the Windows operating system, the use of CMake as build system and binary installation packages for Mac OS X and Windows, and integration with the VisTrails workflow provenance tool. The software is available from our web server at http://alps.comp-phys.org/.
△ Less
Submitted 23 May, 2011; v1 submitted 13 January, 2011;
originally announced January 2011.
-
The ALPS project release 1.3: open source software for strongly correlated systems
Authors:
A. F. Albuquerque,
F. Alet,
P. Corboz,
P. Dayal,
A. Feiguin,
S. Fuchs,
L. Gamper,
E. Gull,
S. Guertler,
A. Honecker,
R. Igarashi,
M. Koerner,
A. Kozhevnikov,
A. Laeuchli,
S. R. Manmana,
M. Matsumoto,
I. P. McCulloch,
F. Michel,
R. M. Noack,
G. Pawlowski,
L. Pollet,
T. Pruschke,
U. Schollwock,
S. Todo,
S. Trebst
, et al. (3 additional authors not shown)
Abstract:
We present release 1.3 of the ALPS (Algorithms and Libraries for Physics Simulations) project, an international open source software project to develop libraries and application programs for the simulation of strongly correlated quantum lattice models such as quantum magnets, lattice bosons, and strongly correlated fermion systems. Development is centered on common XML and binary data formats, o…
▽ More
We present release 1.3 of the ALPS (Algorithms and Libraries for Physics Simulations) project, an international open source software project to develop libraries and application programs for the simulation of strongly correlated quantum lattice models such as quantum magnets, lattice bosons, and strongly correlated fermion systems. Development is centered on common XML and binary data formats, on libraries to simplify and speed up code development, and on full-featured simulation programs. The programs enable non-experts to start carrying out numerical simulations by providing basic implementations of the important algorithms for quantum lattice models: classical and quantum Monte Carlo (QMC) using non-local updates, extended ensemble simulations, exact and full diagonalization (ED), as well as the density matrix renormalization group (DMRG). Changes in the new release include a DMRG program for interacting models, support for translation symmetries in the diagonalization programs, the ability to define custom measurement operators, and support for inhomogeneous systems, such as lattice models with traps. The software is available from our web server at http://alps.comp-phys.org/ .
△ Less
Submitted 11 January, 2008;
originally announced January 2008.