-
Gaia data processing. SEAPipe: The source environment analysis pipeline
Authors:
D. L. Harrison,
F. van Leeuwen,
P. J. Osborne,
P. W. Burgess,
F. De Angeli,
D. W. Evans
Abstract:
Aims. To describe two potential options for the Source Environment Analysis pipeline, SEAPipe, for the Gaia mission. This pipeline will enable the discovery of sources which are new to Gaia, in the sense that they were not found by the on-board detection algorithm. These additional sources (secondaries) are discoverable in the vicinity of those Gaia sources (primaries) that were found by the on-bo…
▽ More
Aims. To describe two potential options for the Source Environment Analysis pipeline, SEAPipe, for the Gaia mission. This pipeline will enable the discovery of sources which are new to Gaia, in the sense that they were not found by the on-board detection algorithm. These additional sources (secondaries) are discoverable in the vicinity of those Gaia sources (primaries) that were found by the on-board detection.
Methods. The main algorithmic steps required are described; the 2-dimensional image reconstruction of 1-dimensional transit data, the analysis of these images to find the additional sources present, and the determination of the mean positions, proper motions, parallaxes and brightness of these sources. Additionally, the Monte Carlo simulations used to characterise the performance of the pipelines are described.
Results. The performance of the two options for SEAPipe, the vanilla and image-subtraction versions, are compared. Their selection functions are computed in terms of the magnitude of the secondary sources and their angular separations from their corresponding primary source. The completeness and purity of the resultant catalogue of secondary sources as found by each of the pipelines, given the expected magnitude distribution of the primary sources and the magnitude and angular separation distributions of the secondary sources, is also presented. The image-subtraction pipeline is shown to out-perform the vanilla pipeline.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Gaia Data Release 3: External calibration of BP/RP low-resolution spectroscopic data
Authors:
P. Montegriffo,
F. De Angeli,
R. Andrae,
M. Riello,
E. Pancino,
N. Sanna,
M. Bellazzini,
D. W. Evans,
J. M. Carrasco,
R. Sordo,
G. Busso,
C. Cacciari,
C. Jordi,
F. van Leeuwen,
A. Vallenari,
G. Altavilla,
M. A. Barstow,
A. G. A. Brown,
P. W. Burgess,
M. Castellani,
S. Cowell,
M. Davidson,
F. De Luise,
L. Delchambre,
C. Diener
, et al. (24 additional authors not shown)
Abstract:
Context. Gaia Data Release 3 contains astrometry and photometry results for about 1.8 billion sources based on observations collected by the European Space Agency (ESA) Gaia satellite during the first 34 months of its operational phase (the same period covered Gaia early Data Release 3; Gaia EDR3). Low-resolution spectra for 220 million sources are one of the important new data products included i…
▽ More
Context. Gaia Data Release 3 contains astrometry and photometry results for about 1.8 billion sources based on observations collected by the European Space Agency (ESA) Gaia satellite during the first 34 months of its operational phase (the same period covered Gaia early Data Release 3; Gaia EDR3). Low-resolution spectra for 220 million sources are one of the important new data products included in this release.
Aims. In this paper, we focus on the external calibration of low-resolution spectroscopic content, describing the input data, algorithms, data processing, and the validation of the results. Particular attention is given to the quality of the data and to a number of features that users may need to take into account to make the best use of the catalogue.
Methods. We calibrated an instrument model to relate mean Gaia spectra to the corresponding spectral energy distributions using an extended set of calibrators: this includes modelling of the instrument dispersion relation, transmission, and line spread functions. Optimisation of the model is achieved through total least-squares regression, accounting for errors in Gaia and external spectra.
Results. The resulting instrument model can be used for forward modelling of Gaia spectra or for inverse modelling of externally calibrated spectra in absolute flux units.
Conclusions. The absolute calibration derived in this paper provides an essential ingredient for users of BP/RP spectra. It allows users to connect BP/RP spectra to absolute fluxes and physical wavelengths.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Gaia Data Release 3: Processing and validation of BP/RP low-resolution spectral data
Authors:
F. De Angeli,
M. Weiler,
P. Montegriffo,
D. W. Evans,
M. Riello,
R. Andrae,
J. M. Carrasco,
G. Busso,
P. W. Burgess,
C. Cacciari,
M. Davidson,
D. L. Harrison,
S. T. Hodgkin,
C. Jordi,
P. J. Osborne,
E. Pancino,
G. Altavilla,
M. A. Barstow,
C. A. L. Bailer-Jones,
M. Bellazzini,
A. G. A. Brown,
M. Castellani,
S. Cowell,
L. Delchambre,
F. De Luise
, et al. (29 additional authors not shown)
Abstract:
(Abridged) Blue (BP) and Red (RP) Photometer low-resolution spectral data is one of the exciting new products in Gaia Data Release 3 (Gaia DR3). We calibrate about 65 billion individual transit spectra onto the same mean BP/RP instrument through a series of calibration steps, including background subtraction, calibration of the CCD geometry and an iterative procedure for the calibration of CCD eff…
▽ More
(Abridged) Blue (BP) and Red (RP) Photometer low-resolution spectral data is one of the exciting new products in Gaia Data Release 3 (Gaia DR3). We calibrate about 65 billion individual transit spectra onto the same mean BP/RP instrument through a series of calibration steps, including background subtraction, calibration of the CCD geometry and an iterative procedure for the calibration of CCD efficiency as well as variations of the line-spread function and dispersion across the focal plane and in time. The calibrated transit spectra are then combined for each source in terms of an expansion into continuous basis functions. Time-averaged mean spectra covering the optical to near-infrared wavelength range [330, 1050] nm are published for approximately 220 million objects. Most of these are brighter than G = 17.65 but some BP/RP spectra are published for sources down to G = 21.43. Their signal- to-noise ratio varies significantly over the wavelength range covered and with magnitude and colour of the observed objects, with sources around G = 15 having S/N above 100 in some wavelength ranges. The top-quality BP/RP spectra are achieved for sources with magnitudes 9 < G < 12, having S/N reaching 1000 in the central part of the RP wavelength range. Scientific validation suggests that the internal calibration was generally successful. However, there is some evidence for imperfect calibrations at the bright end G < 11, where calibrated BP/RP spectra can exhibit systematic flux variations that exceed their estimated flux uncertainties. We also report that due to long-range noise correlations, BP/RP spectra can exhibit wiggles when sampled in pseudo-wavelength.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Gaia Photometric Science Alerts
Authors:
S. T. Hodgkin,
D. L. Harrison,
E. Breedt,
T. Wevers,
G. Rixon,
A. Delgado,
A. Yoldas,
Z. Kostrzewa-Rutkowska,
Ł. Wyrzykowski,
M. van Leeuwen,
N. Blagorodnova,
H. Campbell,
D. Eappachen,
M. Fraser,
N. Ihanec,
S. E. Koposov,
K. Kruszyńska,
G. Marton,
K. A. Rybicki,
A. G. A. Brown,
P. W. Burgess,
G. Busso,
S. Cowell,
F. De Angeli,
C. Diener
, et al. (86 additional authors not shown)
Abstract:
Since July 2014, the Gaia mission has been engaged in a high-spatial-resolution, time-resolved, precise, accurate astrometric, and photometric survey of the entire sky.
Aims: We present the Gaia Science Alerts project, which has been in operation since 1 June 2016. We describe the system which has been developed to enable the discovery and publication of transient photometric events as seen by G…
▽ More
Since July 2014, the Gaia mission has been engaged in a high-spatial-resolution, time-resolved, precise, accurate astrometric, and photometric survey of the entire sky.
Aims: We present the Gaia Science Alerts project, which has been in operation since 1 June 2016. We describe the system which has been developed to enable the discovery and publication of transient photometric events as seen by Gaia.
Methods: We outline the data handling, timings, and performances, and we describe the transient detection algorithms and filtering procedures needed to manage the high false alarm rate. We identify two classes of events: (1) sources which are new to Gaia and (2) Gaia sources which have undergone a significant brightening or fading. Validation of the Gaia transit astrometry and photometry was performed, followed by testing of the source environment to minimise contamination from Solar System objects, bright stars, and fainter near-neighbours.
Results: We show that the Gaia Science Alerts project suffers from very low contamination, that is there are very few false-positives. We find that the external completeness for supernovae, $C_E=0.46$, is dominated by the Gaia scanning law and the requirement of detections from both fields-of-view. Where we have two or more scans the internal completeness is $C_I=0.79$ at 3 arcsec or larger from the centres of galaxies, but it drops closer in, especially within 1 arcsec.
Conclusions: The per-transit photometry for Gaia transients is precise to 1 per cent at $G=13$, and 3 per cent at $G=19$. The per-transit astrometry is accurate to 55 milliarcseconds when compared to Gaia DR2. The Gaia Science Alerts project is one of the most homogeneous and productive transient surveys in operation, and it is the only survey which covers the whole sky at high spatial resolution (subarcsecond), including the Galactic plane and bulge.
△ Less
Submitted 2 June, 2021;
originally announced June 2021.
-
Gaia Early Data Release 3: Photometric content and validation
Authors:
M. Riello,
F. De Angeli,
D. W. Evans,
P. Montegriffo,
J. M. Carrasco,
G. Busso,
L. Palaversa,
P. W. Burgess,
C. Diener,
M. Davidson,
N. Rowell,
C. Fabricius,
C. Jordi,
M. Bellazzini,
E. Pancino,
D. L. Harrison,
C. Cacciari,
F. van Leeuwen,
N. C. Hambly,
S. T. Hodgkin,
P. J. Osborne,
G. Altavilla,
M. A. Barstow,
A. G. A. Brown,
M. Castellani
, et al. (17 additional authors not shown)
Abstract:
Gaia Early Data Release 3 contains astrometry and photometry results for about 1.8 billion sources based on observations collected by the ESA Gaia satellite during the first 34 months of operations. This paper focuses on the photometric content, describing the input data, the algorithms, the processing, and the validation of the results. Particular attention is given to the quality of the data and…
▽ More
Gaia Early Data Release 3 contains astrometry and photometry results for about 1.8 billion sources based on observations collected by the ESA Gaia satellite during the first 34 months of operations. This paper focuses on the photometric content, describing the input data, the algorithms, the processing, and the validation of the results. Particular attention is given to the quality of the data and to a number of features that users may need to take into account to make the best use of the EDR3 catalogue. The treatment of the BP and RP background has been updated to include a better estimation of the local background, and the detection of crowding effects has been used to exclude affected data from the calibrations. The photometric calibration models have also been updated to account for flux loss over the whole magnitude range. Significant improvements in the modelling and calibration of the point and line spread functions have also helped to reduce a number of instrumental effects that were still present in DR2. EDR3 contains 1.806 billion sources with G-band photometry and 1.540 billion sources with BP and RP photometry. The median uncertainty in the G-band photometry, as measured from the standard deviation of the internally calibrated mean photometry for a given source, is 0.2 mmag at magnitude G=10 to 14, 0.8 mmag at G=17, and 2.6 mmag at G=19. The significant magnitude term found in the Gaia DR2 photometry is no longer visible, and overall there are no trends larger than 1 mmag/mag. Using one passband over the whole colour and magnitude range leaves no systematics above the 1% level in magnitude in any of the bands, and a larger systematic is present for a very small sample of bright and blue sources. A detailed description of the residual systematic effects is provided. Overall the quality of the calibrated mean photometry in EDR3 is superior with respect to DR2 for all bands.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Electromagnetic counterparts to gravitational wave events from Gaia
Authors:
Z. Kostrzewa-Rutkowska,
P. G. Jonker,
S. T. Hodgkin,
D. Eappachen,
D. L. Harrison,
S. E. Koposov,
G. Rixon,
L. Wyrzykowski,
A. Yoldas,
E. Breedt,
A. Delgado,
M. van Leeuwen,
T. Wevers,
P. W. Burgess,
F. De Angeli,
D. W. Evans,
P. J. Osborne,
M. Riello
Abstract:
The recent discoveries of gravitational wave events and in one case also its electromagnetic (EM) counterpart allow us to study the Universe in a novel way. The increased sensitivity of the LIGO and Virgo detectors has opened the possibility for regular detections of EM transient events from mergers of stellar remnants. Gravitational wave sources are expected to have sky localisation up to a few h…
▽ More
The recent discoveries of gravitational wave events and in one case also its electromagnetic (EM) counterpart allow us to study the Universe in a novel way. The increased sensitivity of the LIGO and Virgo detectors has opened the possibility for regular detections of EM transient events from mergers of stellar remnants. Gravitational wave sources are expected to have sky localisation up to a few hundred square degrees, thus Gaia as an all-sky multi-epoch photometric survey has the potential to be a good tool to search for the EM counterparts. In this paper we study the possibility of detecting EM counterparts to gravitational wave sources using the Gaia Science Alerts system. We develop an extension to current used algorithms to find transients and test its capabilities in discovering candidate transients on a sample of events from the observation periods O1 and O2 of LIGO and Virgo. For the gravitational wave events from the current run O3 we expect that about 16 (25) per cent should fall in sky regions observed by Gaia 7 (10) days after gravitational wave. The new algorithm will provide about 10 candidates per day from the whole sky.
△ Less
Submitted 23 April, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
Gaia Data Release 2: processing of the photometric data
Authors:
M. Riello,
F. De Angeli,
D. W. Evans,
G. Busso,
N. C. Hambly,
M. Davidson,
P. W. Burgess,
P. Montegriffo,
P. J. Osborne,
A. Kewley,
J. M. Carrasco,
C. Fabricius,
C. Jordi,
C. Cacciari,
F. van Leeuwen,
G. Holland
Abstract:
The second Gaia data release is based on 22 months of mission data with an average of 0.9 billion individual CCD observations per day. A data volume of this size and granularity requires a robust and reliable but still flexible system to achieve the demanding accuracy and precision constraints that Gaia is capable of delivering. The internal Gaia photometric system was initialised using an iterati…
▽ More
The second Gaia data release is based on 22 months of mission data with an average of 0.9 billion individual CCD observations per day. A data volume of this size and granularity requires a robust and reliable but still flexible system to achieve the demanding accuracy and precision constraints that Gaia is capable of delivering. The internal Gaia photometric system was initialised using an iterative process that is solely based on Gaia data. A set of calibrations was derived for the entire Gaia DR2 baseline and then used to produce the final mean source photometry. The photometric catalogue contains 2.5 billion sources comprised of three different grades depending on the availability of colour information and the procedure used to calibrate them: 1.5 billion gold, 144 million silver, and 0.9 billion bronze. These figures reflect the results of the photometric processing; the content of the data release will be different due to the validation and data quality filters applied during the catalogue preparation. The photometric processing pipeline, PhotPipe, implements all the processing and calibration workflows in terms of Map/Reduce jobs based on the Hadoop platform. This is the first example of a processing system for a large astrophysical survey project to make use of these technologies. The improvements in the generation of the integrated G-band fluxes, in the attitude modelling, in the cross-matching, and and in the identification of spurious detections led to a much cleaner input stream for the photometric processing. This, combined with the improvements in the definition of the internal photometric system and calibration flow, produced high-quality photometry. Hadoop proved to be an excellent platform choice for the implementation of PhotPipe in terms of overall performance, scalability, downtime, and manpower required for operations and maintenance.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
