-
Optimal 1D Ly$α$ Forest Power Spectrum Estimation -- III. DESI early data
Authors:
Naim Göksel Karaçaylı,
Paul Martini,
Julien Guy,
Corentin Ravoux,
Marie Lynn Abdul Karim,
Eric Armengaud,
Michael Walther,
J. Aguilar,
S. Ahlen,
S. Bailey,
J. Bautista,
S. F. Beltran,
D. Brooks,
L. Cabayol-Garcia,
S. Chabanier,
E. Chaussidon,
J. Chaves-Montero,
K. Dawson,
R. de la Cruz,
A. de la Macorra,
P. Doel,
A. Font-Ribera,
J. E. Forero-Romero,
S. Gontcho A Gontcho,
A. X. Gonzalez-Morales
, et al. (37 additional authors not shown)
Abstract:
The one-dimensional power spectrum $P_{\mathrm{1D}}$ of the Ly$α$ forest provides important information about cosmological and astrophysical parameters, including constraints on warm dark matter models, the sum of the masses of the three neutrino species, and the thermal state of the intergalactic medium. We present the first measurement of $P_{\mathrm{1D}}$ with the quadratic maximum likelihood e…
▽ More
The one-dimensional power spectrum $P_{\mathrm{1D}}$ of the Ly$α$ forest provides important information about cosmological and astrophysical parameters, including constraints on warm dark matter models, the sum of the masses of the three neutrino species, and the thermal state of the intergalactic medium. We present the first measurement of $P_{\mathrm{1D}}$ with the quadratic maximum likelihood estimator (QMLE) from the Dark Energy Spectroscopic Instrument (DESI) survey early data sample. This early sample of $54~600$ quasars is already comparable in size to the largest previous studies, and we conduct a thorough investigation of numerous instrumental and analysis systematic errors to evaluate their impact on DESI data with QMLE. We demonstrate the excellent performance of the spectroscopic pipeline noise estimation and the impressive accuracy of the spectrograph resolution matrix with two-dimensional image simulations of raw DESI images that we processed with the DESI spectroscopic pipeline. We also study metal line contamination and noise calibration systematics with quasar spectra on the red side of the Ly$α$ emission line. In a companion paper, we present a similar analysis based on the Fast Fourier Transform estimate of the power spectrum. We conclude with a comparison of these two approaches and implications for the upcoming DESI Year 1 analysis.
△ Less
Submitted 12 January, 2024; v1 submitted 9 June, 2023;
originally announced June 2023.
-
The Lyman-$α$ forest catalog from the Dark Energy Spectroscopic Instrument Early Data Release
Authors:
César Ramírez-Pérez,
Ignasi Pérez-Ràfols,
Andreu Font-Ribera,
M. Abdul Karim,
E. Armengaud,
J. Bautista,
S. F. Beltran,
L. Cabayol-Garcia,
Z. Cai,
S. Chabanier,
E. Chaussidon,
J. Chaves-Montero,
A. Cuceu,
R. de la Cruz,
J. García-Bellido,
A. X. Gonzalez-Morales,
C. Gordon,
H. K. Herrera-Alcantar,
V. Iršič,
M. Ishak,
N. G. Karaçaylı,
Zarija Lukić,
C. J. Manser,
P. Montero-Camacho,
L. Napolitano
, et al. (45 additional authors not shown)
Abstract:
We present and validate the catalog of Lyman-$α$ forest fluctuations for 3D analyses using the Early Data Release (EDR) from the Dark Energy Spectroscopic Instrument (DESI) survey. We used 88,511 quasars collected from DESI Survey Validation (SV) data and the first two months of the main survey (M2). We present several improvements to the method used to extract the Lyman-$α$ absorption fluctuation…
▽ More
We present and validate the catalog of Lyman-$α$ forest fluctuations for 3D analyses using the Early Data Release (EDR) from the Dark Energy Spectroscopic Instrument (DESI) survey. We used 88,511 quasars collected from DESI Survey Validation (SV) data and the first two months of the main survey (M2). We present several improvements to the method used to extract the Lyman-$α$ absorption fluctuations performed in previous analyses from the Sloan Digital Sky Survey (SDSS). In particular, we modify the weighting scheme and show that it can improve the precision of the correlation function measurement by more than 20%. This catalog can be downloaded from https://data.desi.lbl.gov/public/edr/vac/edr/lya/fuji/v0.3 and it will be used in the near future for the first DESI measurements of the 3D correlations in the Lyman-$α$ forest.
△ Less
Submitted 25 December, 2023; v1 submitted 9 June, 2023;
originally announced June 2023.
-
The Dark Energy Spectroscopic Instrument: One-dimensional power spectrum from first Lyman-$α$ forest samples with Fast Fourier Transform
Authors:
Corentin Ravoux,
Marie Lynn Abdul Karim,
Eric Armengaud,
Michael Walther,
Naim Göksel Karaçaylı,
Paul Martini,
Julien Guy,
Jessica Nicole Aguilar,
Steven Ahlen,
Stephen Bailey,
Julian Bautista,
Sergio Felipe Beltran,
David Brooks,
Laura Cabayol-Garcia,
Solène Chabanier,
Edmond Chaussidon,
Jonás Chaves-Montero,
Kyle Dawson,
Rodrigo de la Cruz,
Axel de la Macorra,
Peter Doel,
Kevin Fanning,
Andreu Font-Ribera,
Jaime Forero-Romero,
Satya Gontcho A Gontcho
, et al. (41 additional authors not shown)
Abstract:
We present the one-dimensional Lyman-$α$ forest power spectrum measurement using the first data provided by the Dark Energy Spectroscopic Instrument (DESI). The data sample comprises $26,330$ quasar spectra, at redshift $z > 2.1$, contained in the DESI Early Data Release and the first two months of the main survey. We employ a Fast Fourier Transform (FFT) estimator and compare the resulting power…
▽ More
We present the one-dimensional Lyman-$α$ forest power spectrum measurement using the first data provided by the Dark Energy Spectroscopic Instrument (DESI). The data sample comprises $26,330$ quasar spectra, at redshift $z > 2.1$, contained in the DESI Early Data Release and the first two months of the main survey. We employ a Fast Fourier Transform (FFT) estimator and compare the resulting power spectrum to an alternative likelihood-based method in a companion paper. We investigate methodological and instrumental contaminants associated to the new DESI instrument, applying techniques similar to previous Sloan Digital Sky Survey (SDSS) measurements. We use synthetic data based on log-normal approximation to validate and correct our measurement. We compare our resulting power spectrum with previous SDSS and high-resolution measurements. With relatively small number statistics, we successfully perform the FFT measurement, which is already competitive in terms of the scale range. At the end of the DESI survey, we expect a five times larger Lyman-$α$ forest sample than SDSS, providing an unprecedented precise one-dimensional power spectrum measurement.
△ Less
Submitted 24 October, 2023; v1 submitted 9 June, 2023;
originally announced June 2023.
-
The Early Data Release of the Dark Energy Spectroscopic Instrument
Authors:
DESI Collaboration,
A. G. Adame,
J. Aguilar,
S. Ahlen,
S. Alam,
G. Aldering,
D. M. Alexander,
R. Alfarsy,
C. Allende Prieto,
M. Alvarez,
O. Alves,
A. Anand,
F. Andrade-Oliveira,
E. Armengaud,
J. Asorey,
S. Avila,
A. Aviles,
S. Bailey,
A. Balaguera-Antolínez,
O. Ballester,
C. Baltay,
A. Bault,
J. Bautista,
J. Behera,
S. F. Beltran
, et al. (240 additional authors not shown)
Abstract:
The Dark Energy Spectroscopic Instrument (DESI) completed its five-month Survey Validation in May 2021. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes…
▽ More
The Dark Energy Spectroscopic Instrument (DESI) completed its five-month Survey Validation in May 2021. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes good-quality spectral information from 466,447 objects targeted as part of the Milky Way Survey, 428,758 as part of the Bright Galaxy Survey, 227,318 as part of the Luminous Red Galaxy sample, 437,664 as part of the Emission Line Galaxy sample, and 76,079 as part of the Quasar sample. In addition, the release includes spectral information from 137,148 objects that expand the scope beyond the primary samples as part of a series of secondary programs. Here, we describe the spectral data, data quality, data products, Large-Scale Structure science catalogs, access to the data, and references that provide relevant background to using these spectra.
△ Less
Submitted 15 June, 2023; v1 submitted 9 June, 2023;
originally announced June 2023.
-
Validation of the Scientific Program for the Dark Energy Spectroscopic Instrument
Authors:
DESI Collaboration,
A. G. Adame,
J. Aguilar,
S. Ahlen,
S. Alam,
G. Aldering,
D. M. Alexander,
R. Alfarsy,
C. Allende Prieto,
M. Alvarez,
O. Alves,
A. Anand,
F. Andrade-Oliveira,
E. Armengaud,
J. Asorey,
S. Avila,
A. Aviles,
S. Bailey,
A. Balaguera-Antolínez,
O. Ballester,
C. Baltay,
A. Bault,
J. Bautista,
J. Behera,
S. F. Beltran
, et al. (239 additional authors not shown)
Abstract:
The Dark Energy Spectroscopic Instrument (DESI) was designed to conduct a survey covering 14,000 deg$^2$ over five years to constrain the cosmic expansion history through precise measurements of Baryon Acoustic Oscillations (BAO). The scientific program for DESI was evaluated during a five month Survey Validation (SV) campaign before beginning full operations. This program produced deep spectra of…
▽ More
The Dark Energy Spectroscopic Instrument (DESI) was designed to conduct a survey covering 14,000 deg$^2$ over five years to constrain the cosmic expansion history through precise measurements of Baryon Acoustic Oscillations (BAO). The scientific program for DESI was evaluated during a five month Survey Validation (SV) campaign before beginning full operations. This program produced deep spectra of tens of thousands of objects from each of the stellar (MWS), bright galaxy (BGS), luminous red galaxy (LRG), emission line galaxy (ELG), and quasar target classes. These SV spectra were used to optimize redshift distributions, characterize exposure times, determine calibration procedures, and assess observational overheads for the five-year program. In this paper, we present the final target selection algorithms, redshift distributions, and projected cosmology constraints resulting from those studies. We also present a `One-Percent survey' conducted at the conclusion of Survey Validation covering 140 deg$^2$ using the final target selection algorithms with exposures of a depth typical of the main survey. The Survey Validation indicates that DESI will be able to complete the full 14,000 deg$^2$ program with spectroscopically-confirmed targets from the MWS, BGS, LRG, ELG, and quasar programs with total sample sizes of 7.2, 13.8, 7.46, 15.7, and 2.87 million, respectively. These samples will allow exploration of the Milky Way halo, clustering on all scales, and BAO measurements with a statistical precision of 0.28% over the redshift interval $z<1.1$, 0.39% over the redshift interval $1.1<z<1.9$, and 0.46% over the redshift interval $1.9<z<3.5$.
△ Less
Submitted 12 January, 2024; v1 submitted 9 June, 2023;
originally announced June 2023.
-
A Survey of Data Pricing for Data Marketplaces
Authors:
Mengxiao Zhang,
Fernando Beltran,
Jiamou Liu
Abstract:
A data marketplace is an online venue that brings data owners, data brokers, and data consumers together and facilitates commoditisation of data amongst them. Data pricing, as a key function of a data marketplace, demands quantifying the monetary value of data. A considerable number of studies on data pricing can be found in literature. This paper attempts to comprehensively review the state-of-th…
▽ More
A data marketplace is an online venue that brings data owners, data brokers, and data consumers together and facilitates commoditisation of data amongst them. Data pricing, as a key function of a data marketplace, demands quantifying the monetary value of data. A considerable number of studies on data pricing can be found in literature. This paper attempts to comprehensively review the state-of-the-art on existing data pricing studies to provide a general understanding of this emerging research area. Our key contribution lies in a new taxonomy of data pricing studies that unifies different attributes determining data prices. The basis of our framework categorises these studies by the kind of market structure, be it sell-side, buy-side, or two-sided. Then in a sell-side market, the studies are further divided by query type, which defines the way a data consumer accesses data, while in a buy-side market, the studies are divided according to privacy notion, which defines the way to quantify privacy of data owners. In a two-sided market, both privacy notion and query type are used as criteria. We systematically examine the studies falling into each category in our taxonomy. Lastly, we discuss gaps within the existing research and define future research directions.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
Overview of the Instrumentation for the Dark Energy Spectroscopic Instrument
Authors:
B. Abareshi,
J. Aguilar,
S. Ahlen,
Shadab Alam,
David M. Alexander,
R. Alfarsy,
L. Allen,
C. Allende Prieto,
O. Alves,
J. Ameel,
E. Armengaud,
J. Asorey,
Alejandro Aviles,
S. Bailey,
A. Balaguera-Antolínez,
O. Ballester,
C. Baltay,
A. Bault,
S. F. Beltran,
B. Benavides,
S. BenZvi,
A. Berti,
R. Besuner,
Florian Beutler,
D. Bianchi
, et al. (242 additional authors not shown)
Abstract:
The Dark Energy Spectroscopic Instrument (DESI) has embarked on an ambitious five-year survey to explore the nature of dark energy with spectroscopy of 40 million galaxies and quasars. DESI will determine precise redshifts and employ the Baryon Acoustic Oscillation method to measure distances from the nearby universe to z > 3.5, as well as measure the growth of structure and probe potential modifi…
▽ More
The Dark Energy Spectroscopic Instrument (DESI) has embarked on an ambitious five-year survey to explore the nature of dark energy with spectroscopy of 40 million galaxies and quasars. DESI will determine precise redshifts and employ the Baryon Acoustic Oscillation method to measure distances from the nearby universe to z > 3.5, as well as measure the growth of structure and probe potential modifications to general relativity. In this paper we describe the significant instrumentation we developed for the DESI survey. The new instrumentation includes a wide-field, 3.2-deg diameter prime-focus corrector that focuses the light onto 5020 robotic fiber positioners on the 0.812 m diameter, aspheric focal surface. The positioners and their fibers are divided among ten wedge-shaped petals. Each petal is connected to one of ten spectrographs via a contiguous, high-efficiency, nearly 50 m fiber cable bundle. The ten spectrographs each use a pair of dichroics to split the light into three channels that together record the light from 360 - 980 nm with a resolution of 2000 to 5000. We describe the science requirements, technical requirements on the instrumentation, and management of the project. DESI was installed at the 4-m Mayall telescope at Kitt Peak, and we also describe the facility upgrades to prepare for DESI and the installation and functional verification process. DESI has achieved all of its performance goals, and the DESI survey began in May 2021. Some performance highlights include RMS positioner accuracy better than 0.1", SNR per \sqrtÅ > 0.5 for a z > 2 quasar with flux 0.28e-17 erg/s/cm^2/A at 380 nm in 4000s, and median SNR = 7 of the [OII] doublet at 8e-17 erg/s/cm^2 in a 1000s exposure for emission line galaxies at z = 1.4 - 1.6. We conclude with highlights from the on-sky validation and commissioning of the instrument, key successes, and lessons learned. (abridged)
△ Less
Submitted 22 May, 2022;
originally announced May 2022.
-
Yebes 40 m radio telescope and the broad band NANOCOSMOS receivers at 7 mm and 3 mm for line surveys
Authors:
F. Tercero,
J. A. López-Pérez,
J. D. Gallego,
F. Beltrán,
O. García,
M. Patino-Esteban,
I. López-Fernández,
G. Gómez-Molina,
M. Diez,
P. García-Carreño,
I. Malo,
R. Amils,
J. M. Serna,
C. Albo,
J. M. Hernández,
B. Vaquero,
J. González-García,
L. Barbas,
J. A. López-Fernández,
V. Bujarrabal,
M. Gómez-Garrido,
J. R. Pardo,
M. Santander-García,
B. Tercero,
J. Cernicharo
, et al. (1 additional authors not shown)
Abstract:
Yebes 40\,m radio telescope is the main and largest observing instrument at Yebes Observatory and it is devoted to Very Long Baseline Interferometry (VLBI) and single dish observations since 2010. It has been covering frequency bands between 2\,GHz and 90\,GHz in discontinuous and narrow windows in most of the cases, to match the current needs of the European VLBI Network (EVN) and the Global Mill…
▽ More
Yebes 40\,m radio telescope is the main and largest observing instrument at Yebes Observatory and it is devoted to Very Long Baseline Interferometry (VLBI) and single dish observations since 2010. It has been covering frequency bands between 2\,GHz and 90\,GHz in discontinuous and narrow windows in most of the cases, to match the current needs of the European VLBI Network (EVN) and the Global Millimeter VLBI Array (GMVA). Nanocosmos project, a European Union funded synergy grant, opened the possibility to increase the instantaneous frequency coverage to observe many molecular transitions with single tunnings in single dish mode. This reduces the observing time and maximises the output from the telescope. We present the technical specifications of the recently installed 31.5-50 GHz (Q band) and 72-90.5 GHz (W band) receivers along with the main characteristics of the telescope at these frequency ranges. We have observed IRC+10216, CRL 2688 and CRL 618, which harbour a rich molecular chemistry, to demonstrate the capabilities of the new instrumentation for spectral observations in single dish mode. The results show the high sensitivity of the telescope in the Q band. The spectrum of IRC+10126 offers a signal to noise ratio never seen before for this source in this band. On the other hand, the spectrum normalised by the continuum flux towards CRL\,618 in the W band demonstrates that the 40~m radio telescope produces comparable results to those from the IRAM 30~m radio telescope, although with a smaller sensitivity. The new receivers fulfil one of the main goals of Nanocosmos and open the possibility to study the spectrum of different astrophysical media with unprecedented sensitivity.
△ Less
Submitted 30 October, 2020;
originally announced October 2020.
-
Selling Data at an Auction under Privacy Constraints
Authors:
Mengxiao Zhang,
Fernando Beltran,
Jiamou Liu
Abstract:
Private data query combines mechanism design with privacy protection to produce aggregated statistics from privately-owned data records. The problem arises in a data marketplace where data owners have personalised privacy requirements and private data valuations. We focus on the case when the data owners are single-minded, i.e., they are willing to release their data only if the data broker guaran…
▽ More
Private data query combines mechanism design with privacy protection to produce aggregated statistics from privately-owned data records. The problem arises in a data marketplace where data owners have personalised privacy requirements and private data valuations. We focus on the case when the data owners are single-minded, i.e., they are willing to release their data only if the data broker guarantees to meet their announced privacy requirements. For a data broker who wants to purchase data from such data owners, we propose the SingleMindedQuery (SMQ) mechanism, which uses a reverse auction to select data owners and determine compensations. SMQ satisfies interim incentive compatibility, individual rationality, and budget feasibility. Moreover, it uses purchased privacy expectation maximisation as a principle to produce accurate outputs for commonly-used queries such as counting, median and linear predictor. The effectiveness of our method is empirically validated by a series of experiments.
△ Less
Submitted 19 May, 2020;
originally announced May 2020.
-
Scalable Package Queries in Relational Database Systems
Authors:
Matteo Brucato,
Juan Felipe Beltran,
Azza Abouzied,
Alexandra Meliou
Abstract:
Traditional database queries follow a simple model: they define constraints that each tuple in the result must satisfy. This model is computationally efficient, as the database system can evaluate the query conditions on each tuple individually. However, many practical, real-world problems require a collection of result tuples to satisfy constraints collectively, rather than individually. In this…
▽ More
Traditional database queries follow a simple model: they define constraints that each tuple in the result must satisfy. This model is computationally efficient, as the database system can evaluate the query conditions on each tuple individually. However, many practical, real-world problems require a collection of result tuples to satisfy constraints collectively, rather than individually. In this paper, we present package queries, a new query model that extends traditional database queries to handle complex constraints and preferences over answer sets. We develop a full-fledged package query system, implemented on top of a traditional database engine. Our work makes several contributions. First, we design PaQL, a SQL-based query language that supports the declarative specification of package queries. We prove that PaQL is as least as expressive as integer linear programming, and therefore, evaluation of package queries is in general NP-hard. Second, we present a fundamental evaluation strategy that combines the capabilities of databases and constraint optimization solvers to derive solutions to package queries. The core of our approach is a set of translation rules that transform a package query to an integer linear program. Third, we introduce an offline data partitioning strategy allowing query evaluation to scale to large data sizes. Fourth, we introduce SketchRefine, a scalable algorithm for package evaluation, with strong approximation guarantees ($(1 \pmε)^6$-factor approximation). Finally, we present extensive experiments over real-world and benchmark data. The results demonstrate that SketchRefine is effective at deriving high-quality package results, and achieves runtime performance that is an order of magnitude faster than directly using ILP solvers over large datasets.
△ Less
Submitted 15 December, 2015; v1 submitted 11 December, 2015;
originally announced December 2015.
