-
Annotating TAP responses on-the-fly against an IVOA data model
Authors:
Mireille Louys,
Laurent Michel,
François Bonnarel,
Joann Vetter
Abstract:
With the success and widespread of the IVOA Table Access Protocol (1) for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns a…
▽ More
With the success and widespread of the IVOA Table Access Protocol (1) for discovering and querying tabular data in astronomy, more than one hundred of TAP services exposing altogether 22 thousands of tables are accessible from the IVOA Registries at the time of writing. Currently the TAP protocol presents table data and metadata via a {TAP\_SCHEMA} describing the served tables with their columns and possible joins between them. We explore here how to add an information layer, so that values within table columns can be gathered and used to populate instances of objects defined in a selected IVOA data model like Photometry, Coords, Measure, Transform or the proposed MANGO container model. This information layer is provided through annotation tags which tell how the columns' values can be interpreted as attributes of instances of that model. Then when a TAP query is processed, our server add-on interprets the ADQL query string and produces on-the-fly, when possible, the TAP response as an annotated VOTable document. The FIELD elements in the table response are mapped to corresponding model elements templated for this service. This has been prototyped in Java, using the VOLLT package library and a template annotation document representing elements from the MANGO data model. This has been exercised on examples based on Vizier and Chandra catalogs.
△ Less
Submitted 5 January, 2022;
originally announced January 2022.
-
TAP and the Data Models
Authors:
Laurent Michel,
François Bonnarel,
Mireille Louys,
Dave Morris
Abstract:
The purpose of the "TAP and the Data Models" Bird of Feathers session was to discuss the relevance of enabling TAP services to deal with IVOA standardized data models and to refine the functionalities required to implement such a capability.
The purpose of the "TAP and the Data Models" Bird of Feathers session was to discuss the relevance of enabling TAP services to deal with IVOA standardized data models and to refine the functionalities required to implement such a capability.
△ Less
Submitted 30 November, 2021;
originally announced November 2021.
-
Supporting FAIR Principles in the Astrophysics Community: the European Experience
Authors:
Marco Molinaro,
Mark Allen,
François Bonnarel,
Françoise Genova,
Markus Demleitner,
Kay Graf,
Dave Morris,
Enrique Solano,
André Schaaff
Abstract:
FAIR principles have the intent to act as a guideline for those wishing to enhance the reusability of their data holdings and put specific emphasis on enhancing the ability of machines to automatically find and use the data, in addition to supporting its reuse by individuals. Interoperability, one core of these principles, especially when dealing with automated systems' ability to interface with e…
▽ More
FAIR principles have the intent to act as a guideline for those wishing to enhance the reusability of their data holdings and put specific emphasis on enhancing the ability of machines to automatically find and use the data, in addition to supporting its reuse by individuals. Interoperability, one core of these principles, especially when dealing with automated systems' ability to interface with each other, requires open standards to avoid restrictions that negatively impact the user's experience. Open-ness of standards is best supported when the governance itself is open and includes a wide range of community participation. In this contribution we report our experience with the FAIR principles, interoperable systems and open governance in astrophysics. We report on activities that have matured within the ESCAPE project with a focus on interfacing the EOSC architecture and Interoperability Framework.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
Towards a Provenance Management System for Astronomical Observatories
Authors:
Mathieu Servillat,
François Bonnarel,
Catherine Boisson,
Mireille Louys,
Jose Enrique Ruiz,
Michèle Sanguillon
Abstract:
We present here a provenance management system adapted to astronomical projects needs. We collected use cases from various astronomy projects and defined a data model in the ecosystem developed by the IVOA (International Virtual Observatory Alliance). From those use cases, we observed that some projects already have data collections generated and archived, from which the provenance has to be extra…
▽ More
We present here a provenance management system adapted to astronomical projects needs. We collected use cases from various astronomy projects and defined a data model in the ecosystem developed by the IVOA (International Virtual Observatory Alliance). From those use cases, we observed that some projects already have data collections generated and archived, from which the provenance has to be extracted (provenance "on top"), and some projects are building complex pipelines that automatically capture provenance information during the data processing (capture "inside"). Different tools and prototypes have been developed and tested to capture, store, access and visualize the provenance information, which participate to the sha** of a full provenance management system able to handle detailed provenance information.
△ Less
Submitted 16 September, 2021;
originally announced September 2021.
-
The Virtual Observatory Ecosystem Facing the European Open Science Cloud
Authors:
Marco Molinaro,
Mark Allen,
Françoise Genova,
André Schaaff,
Margarida Castro Neves,
Markus Demleitner,
Sara Bertocco,
Dave Morris,
François Bonnarel,
Stelios Voutsinas,
Catherine Boisson,
Giuliano Taffoni
Abstract:
The International Virtual Observatory Alliance (IVOA) has developed and built, in the last two decades, an ecosystem of distributed resources, interoperable and based upon open shared technological standards. In doing so the IVOA has anticipated, putting into practice for the astrophysical domain, the ideas of FAIR-ness of data and service resources and the Open-ness of sharing scientific results,…
▽ More
The International Virtual Observatory Alliance (IVOA) has developed and built, in the last two decades, an ecosystem of distributed resources, interoperable and based upon open shared technological standards. In doing so the IVOA has anticipated, putting into practice for the astrophysical domain, the ideas of FAIR-ness of data and service resources and the Open-ness of sharing scientific results, leveraging on the underlying open standards required to fill the above. In Europe, efforts in supporting and develo** the ecosystem proposed by the IVOA specifications has been provided by a continuous set of EU funded projects up to current H2020 ESCAPE ESFRI cluster. In the meantime, in the last years, Europe has realised the importance of promoting the Open Science approach for the research communities and started the European Open Science Cloud (EOSC) project to create a distributed environment for research data, services and communities. In this framework the European VO community, had to face the move from the interoperability scenario in the astrophysics domain into a larger audience perspective that includes a cross-domain FAIR approach. Within the ESCAPE project the CEVO Work Package (Connecting ESFRI to EOSC through the VO) has one task to deal with this integration challenge: a challenge where an existing, mature, distributed e-infrastructure has to be matched to a forming, more general architecture. CEVO started its works in the first months of 2019 and has already worked on the integration of the VO Registry into the EOSC e-infrastructure. This contribution reports on the first year and a half of integration activities, that involve applications, services and resources being aware of the VO scenario and compatible with the EOSC architecture.
△ Less
Submitted 15 March, 2021;
originally announced March 2021.
-
Practical Provenance in Astronomy
Authors:
Mathieu Servillat,
François Bonnarel,
Mireille Louys,
Michèle Sanguillon
Abstract:
Recently the International Virtual Observatory Alliance (IVOA) released a standard to structure provenance metadata, and several implementations are in development in order to capture, store, access and visualize the provenance of astronomy data products. This BoF will be focused on practical needs for provenance in astronomy. A growing number of projects express the requirement to propose FAIR da…
▽ More
Recently the International Virtual Observatory Alliance (IVOA) released a standard to structure provenance metadata, and several implementations are in development in order to capture, store, access and visualize the provenance of astronomy data products. This BoF will be focused on practical needs for provenance in astronomy. A growing number of projects express the requirement to propose FAIR data (Findable, Accessible, Interoperable and Reusable) and thus manage provenance information to ensure the quality, reliability and trustworthiness of this data. The concepts are in place, but now, applied specifications and practical tools are needed to answer concrete use cases. During this session we discussed which strategies are considered by projects (observatories or data providers) to capture provenance in their context and how a end-user might query the provenance information to enhance her/his data selection and retrieval. The objective was to identify the development of tools and formats now needed to make provenance more practical needed to increase provenance take-up in the astronomical domain.
△ Less
Submitted 21 January, 2021;
originally announced January 2021.
-
Radio Astronomy visibility data discovery and access using IVOA standards
Authors:
Mireille Louys,
Katharina Lutz,
Yelena Stein,
Anais Egner,
François Bonnarel
Abstract:
Enhancing interoperable data access to radio data has become a science priority within the International Virtual Observatory Alliance (IVOA). This lead to the foundation of the IVOA Radio astronomy Interest Group. Several radio astronomers and project scientists enrolled in various projects (NRAO, ASKAP, LOFAR, JIVE, ALMA, SKA, INAF, NenuFAR, etc.) have joined. Together they are paving the way to…
▽ More
Enhancing interoperable data access to radio data has become a science priority within the International Virtual Observatory Alliance (IVOA). This lead to the foundation of the IVOA Radio astronomy Interest Group. Several radio astronomers and project scientists enrolled in various projects (NRAO, ASKAP, LOFAR, JIVE, ALMA, SKA, INAF, NenuFAR, etc.) have joined. Together they are paving the way to a better integration of their services in the virtual observatory (VO) infrastructure and propose extension of IVOA standards to help achieving this goal. Calibrated radio datasets such as cubes, images, spectra and time series can already be searched and retrieved using the ObsCore/ObsTAP specification defined in the IVOA, or by data product-specific services like SIAv2, SODA, SSA and ConeSearch. However, properties of radio visibility data are not fully implemented in the VO landscape yet. We need specific features to refine data discovery and selection that are adapted to radio astronomers' need. In this context the VO team at the Centre de Données astronomiques de Strasbourg (CDS) proposes to consider the ObsCore/ObsTAP specification and to establish cross-walks between the ObsCore and the existing Measurement Set (MS) metadata profile for data discovery of radio visibility data (VD). In order to account for the difference in granularity between radio VD datasets and science-ready datasets of the VO, the approach splits a MS data file into a list of datasets served by an ObsTAP service, thus enabling coarse grain discovery in the multi-wavelength context. Radio specific metadata such as number of antennae, frequency ranges, $uv$ plane coverage plots, frequency-phase and frequency-amplitude plots, primary and synthesized beams are also provided either by adding column metadata or by using the DataLink technique.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
Implementation feedback of the IVOA Provenance data model
Authors:
Mireille Louys,
François Bonnarel,
Daniel Durand,
Anais Egner
Abstract:
The IVOA Provenance Data model defines entities, agents and activities as container classes to describe the provenance of datasets, with the executed tasks and responsibilities attached to agents. It also provides a set of classes to describe the activities type and their configuration template, as well as the configuration applied effectively during the execution of a task. Here we highlight less…
▽ More
The IVOA Provenance Data model defines entities, agents and activities as container classes to describe the provenance of datasets, with the executed tasks and responsibilities attached to agents. It also provides a set of classes to describe the activities type and their configuration template, as well as the configuration applied effectively during the execution of a task. Here we highlight lessons learned in the implementation of the CDS ProvHiPS service distributing provenance metadata for the HST HiPS data collections, and for the HST archive original images used to produce the HiPS tiles. ProvHiPS is based on the ProvTAP protocol, the emerging TAP standard for distributing provenance metadata. ProvTAP queries may rapidly become very complex. Various graph representation strategies, including ad hoc solutions, triplestore and SQL CTE have been considered and are discussed shortly.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
Integrating the VO Framework in the EOSC
Authors:
Marco Molinaro,
Mark Allen,
Sara Bertocco,
Catherine Boisson,
François Bonnarel,
Margarida Castro Neves,
Markus Demleitner,
Françoise Genova,
Dave Morris,
André Schaaff,
Giuliano Taffoni,
Stelios Voutsinas
Abstract:
The European Open Science Cloud (EOSC) is in its early stages, but already some aspects of the EOSC vision are starting to become reality, for example the EOSC portal and the development of metadata catalogues. In the astrophysical domain already exists an open approach to science data: the Virtual Observatory view put in place by the International Virtual Observatory Alliance (IVOA) architecture…
▽ More
The European Open Science Cloud (EOSC) is in its early stages, but already some aspects of the EOSC vision are starting to become reality, for example the EOSC portal and the development of metadata catalogues. In the astrophysical domain already exists an open approach to science data: the Virtual Observatory view put in place by the International Virtual Observatory Alliance (IVOA) architecture of standards. The ESCAPE (European Science Cluster of Astronomy & Particle physics ESFRI research infrastructures) project has, among its tasks, to demonstrate that the VO architecture can be integrated within the EOSC building one and to provide guidelines to ESFRI partners (European Strategy Forum on Research Infrastructures) in doing this. This contribution reports on the progress of this integration after the first months of work inside ESCAPE.
△ Less
Submitted 19 November, 2019;
originally announced November 2019.
-
Provenance tools for Astronomy
Authors:
Michèle Sanguillon,
François Bonnarel,
Mireille Louys,
Markus Nullmeier,
Kristin Riebe,
Mathieu Servillat
Abstract:
In the context of astronomy projects, scientists have been confronted with the problem of describing in a standardized way how their data have been produced. As presented in a talk at last year's ADASS, the International Virtual Observatory Alliance (IVOA) is working on the definition of a Provenance Data Model, compatible with the W3C PROV model, which shall describe how provenance metadata can b…
▽ More
In the context of astronomy projects, scientists have been confronted with the problem of describing in a standardized way how their data have been produced. As presented in a talk at last year's ADASS, the International Virtual Observatory Alliance (IVOA) is working on the definition of a Provenance Data Model, compatible with the W3C PROV model, which shall describe how provenance metadata can be modeled, stored and exchanged in astronomy. In this poster, we present the current status of our developments of libraries and tools, mainly open source, which implement the IVOA Provenance Data Model in order to produce, serve, load and visualize provenance information. These implementations are also needed to validate and adjust the data model and the standard definitions for accessing provenance. The provenance tools developed and created for the W3C framework are reused and extended when possible to tackle the domain of astronomical data.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Provenance as a requirement for large-scale complex astronomical instruments
Authors:
Mathieu Servillat,
Catherine Boisson,
Julien Lefaucheur,
Karl Kosack,
Michèle Sanguillon,
Mireille Louys,
François Bonnarel
Abstract:
We developed several pieces of software to enable the tracking of provenance information for the large-scale complex astronomical observatory CTA, the Cherenkov Telescope Array. Such major facilities produce data that will be publicly released to a large community of scientists. There are thus strong requirements to ensure data quality, reliability and trustworthiness. Among those requirements, tr…
▽ More
We developed several pieces of software to enable the tracking of provenance information for the large-scale complex astronomical observatory CTA, the Cherenkov Telescope Array. Such major facilities produce data that will be publicly released to a large community of scientists. There are thus strong requirements to ensure data quality, reliability and trustworthiness. Among those requirements, traceability and reproducibility of the data products have to be included in the development of large projects. Those requirements can be answered by structuring and storing the provenance information for each data product. We followed the Provenance data model, currently discussed at the IVOA, and implemented solutions to collect provenance information during the CTA data processing and the execution of jobs on a work cluster.
△ Less
Submitted 1 June, 2018;
originally announced June 2018.
-
IVOA Recommendation: Server-side Operations for Data Access
Authors:
François Bonnarel,
Markus Demleitner,
Patrick Dowler,
Douglas Tody,
James Dempsey
Abstract:
This document describes the Server-side Operations for Data Access (SODA) web service capability. SODA is a low-level data access capability or server side data processing that can act upon the data files, performing various kinds of operations: filtering/subsection, transformations, pixel operations, and applying functions to the data.
This document describes the Server-side Operations for Data Access (SODA) web service capability. SODA is a low-level data access capability or server side data processing that can act upon the data files, performing various kinds of operations: filtering/subsection, transformations, pixel operations, and applying functions to the data.
△ Less
Submitted 24 October, 2017;
originally announced October 2017.
-
IVOA Data Access Layer: Goals, Achievements and Current Trends
Authors:
François Bonnarel,
Patrick Dowler,
Keith Noddle,
Douglas Tody
Abstract:
The IVOA Data Access Layer (DAL) working group was created in 2002 to define protocols to homogenize data discovery, data description, data retrieval, and data access processes. We describe its history and status today, and look at current trends for future development of the DAL protocols.
The IVOA Data Access Layer (DAL) working group was created in 2002 to define protocols to homogenize data discovery, data description, data retrieval, and data access processes. We describe its history and status today, and look at current trends for future development of the DAL protocols.
△ Less
Submitted 1 December, 2016;
originally announced December 2016.
-
Contributions of the Cherenkov Telescope Array (CTA) to the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016)
Authors:
The CTA Consortium,
:,
A. Abchiche,
U. Abeysekara,
Ó. Abril,
F. Acero,
B. S. Acharya,
C. Adams,
G. Agnetta,
F. Aharonian,
A. Akhperjanian,
A. Albert,
M. Alcubierre,
J. Alfaro,
R. Alfaro,
A. J. Allafort,
R. Aloisio,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
M. Anduze,
E. O. Angüner
, et al. (1387 additional authors not shown)
Abstract:
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
IVOA Provenance data model: hints from the CTA Provenance prototype
Authors:
Michèle Sanguillon,
Mathieu Servillat,
Mireille Louys,
François Bonnarel,
Catherine Boisson,
Johan Brégeon
Abstract:
We present the last developments on the IVOA Provenance data model, mainly based on the W3C PROV concept. In the context of the Cherenkov astronomy, the data processing stages imply both assumptions and comparison to dedicated simulations. As a consequence, Provenance information is crucial to the end user in order to interpret the high level data products. The Cherenkov Telescope Array (CTA), cur…
▽ More
We present the last developments on the IVOA Provenance data model, mainly based on the W3C PROV concept. In the context of the Cherenkov astronomy, the data processing stages imply both assumptions and comparison to dedicated simulations. As a consequence, Provenance information is crucial to the end user in order to interpret the high level data products. The Cherenkov Telescope Array (CTA), currently in preparation, is thus a perfect test case for the development of an IVOA standard on Provenance information. We describe general use-cases for the computational Provenance in the CTA production pipeline and explore the proposed W3C notations like PROV-N formats, as well as Provenance access solutions.
△ Less
Submitted 11 January, 2016;
originally announced January 2016.
-
IVOA Simple Image Access
Authors:
Patrick Dowler,
Doug Tody,
François Bonnarel
Abstract:
The Simple Image Access protocol (SIA) provides capabilities for the discovery, description, access, and retrieval of multi-dimensional image datasets, including 2-D images as well as datacubes of three or more dimensions. SIA data discovery is based on the ObsCore Data Model (ObsCoreDM), which primarily describes data products by the physical axes (spatial, spectral, time, and polarization). Imag…
▽ More
The Simple Image Access protocol (SIA) provides capabilities for the discovery, description, access, and retrieval of multi-dimensional image datasets, including 2-D images as well as datacubes of three or more dimensions. SIA data discovery is based on the ObsCore Data Model (ObsCoreDM), which primarily describes data products by the physical axes (spatial, spectral, time, and polarization). Image datasets with dimension greater than 2 are often referred to as datacubes, cube or image cube datasets and may be considered examples of hypercube or n-cube data. In this document the term "image" refers to general multi-dimensional datasets and is synonymous with these other terms unless the image dimensionality is otherwise specified. SIA provides capabilities for image discovery and access. Data discovery and metadata access (using ObsCoreDM) are defined here. The capabilities for drilling down to data files (and related resources) and services for remote access are defined elsewhere, but SIA also allows for direct access to retrieval.
△ Less
Submitted 4 January, 2016;
originally announced January 2016.
-
IVOA recommendation: IVOA DataLink
Authors:
Patrick Dowler,
François Bonnarel,
Laurent Michel,
Markus Demleitner
Abstract:
This document describes the linking of data discovery metadata to access to the data itself, further detailed metadata, related resources, and to services that perform operations on the data. The web service capability supports a drill-down into the details of a specific dataset and provides a set of links to the dataset file(s) and related resources. This specification also includes a VOTable-spe…
▽ More
This document describes the linking of data discovery metadata to access to the data itself, further detailed metadata, related resources, and to services that perform operations on the data. The web service capability supports a drill-down into the details of a specific dataset and provides a set of links to the dataset file(s) and related resources. This specification also includes a VOTable-specific method of providing descriptions of one or more services and their input(s), usually using parameter values from elsewhere in the VOTable document. Providers are able to describe services that are relevant to the records (usually datasets with identifiers) by including service descriptors in a result document.
△ Less
Submitted 21 September, 2015;
originally announced September 2015.
-
Hierarchical progressive surveys. Multi-resolution HEALPix data structures for astronomical images, catalogues, and 3-dimensional data cubes
Authors:
P. Fernique,
M. G. Allen,
T. Boch,
A. Oberto,
F-X. Pineau,
D. Durand,
C. Bot,
L. Cambresy,
S. Derriere,
F. Genova,
F. Bonnarel
Abstract:
Scientific exploitation of the ever increasing volumes of astronomical data requires efficient and practical methods for data access, visualisation, and analysis. Hierarchical sky tessellation techniques enable a multi-resolution approach to organising data on angular scales from the full sky down to the individual image pixels. Aims. We aim to show that the Hierarchical progressive survey (HiPS)…
▽ More
Scientific exploitation of the ever increasing volumes of astronomical data requires efficient and practical methods for data access, visualisation, and analysis. Hierarchical sky tessellation techniques enable a multi-resolution approach to organising data on angular scales from the full sky down to the individual image pixels. Aims. We aim to show that the Hierarchical progressive survey (HiPS) scheme for describing astronomical images, source catalogues, and three-dimensional data cubes is a practical solution to managing large volumes of heterogeneous data and that it enables a new level of scientific interoperability across large collections of data of these different data types. Methods. HiPS uses the HEALPix tessellation of the sphere to define a hierarchical tile and pixel structure to describe and organise astronomical data. HiPS is designed to conserve the scientific properties of the data alongside both visualisation considerations and emphasis on the ease of implementation. We describe the development of HiPS to manage a large number of diverse image surveys, as well as the extension of hierarchical image systems to cube and catalogue data. We demonstrate the interoperability of HiPS and Multi-Order Coverage (MOC) maps and highlight the HiPS mechanism to provide links to the original data. Results. Hierarchical progressive surveys have been generated by various data centres and groups for ~200 data collections including many wide area sky surveys, and archives of pointed observations. These can be accessed and visualised in Aladin, Aladin Lite, and other applications. HiPS provides a basis for further innovations in the use of hierarchical data structures to facilitate the description and statistical analysis of large astronomical data sets.
△ Less
Submitted 9 May, 2015;
originally announced May 2015.
-
Using the Virtual Observatory: multi-instrument, multi-wavelength study of high-energy sources
Authors:
Sébastien Derriere,
Rene W. Goosmann,
Caroline Bot,
François Bonnarel
Abstract:
This paper presents a tutorial explaining the use of Virtual Observatory tools in high energy astrophysics. Most of the tools used in this paper were developed at the Strasbourg astronomical Data Center and we show how they can be applied to conduct a multi-instrument, multi-wavelength analysis of sources detected by the High Energy Stereoscopic System and the Fermi Large Area Telescope. The analy…
▽ More
This paper presents a tutorial explaining the use of Virtual Observatory tools in high energy astrophysics. Most of the tools used in this paper were developed at the Strasbourg astronomical Data Center and we show how they can be applied to conduct a multi-instrument, multi-wavelength analysis of sources detected by the High Energy Stereoscopic System and the Fermi Large Area Telescope. The analysis involves queries of different data catalogs, selection and cross-correlation techniques on multi-waveband images, and the construction of high energy color-color plots and multi-wavelength spectra. The tutorial is publicly available on the website of the European Virtual Observatory project.
△ Less
Submitted 24 November, 2014;
originally announced November 2014.
-
Simultaneous multi-band detection of Low Surface Brightness galaxies with Markovian modelling
Authors:
B. Vollmer,
B. Perret,
M. Petremand,
F. Lavigne,
Ch. Collet,
W. van Driel,
F. Bonnarel,
M. Louys,
S. Sabatini,
L. A. MacArthur
Abstract:
We present an algorithm for the detection of Low Surface Brightness (LSB) galaxies in images, called MARSIAA (MARkovian Software for Image Analysis in Astronomy), which is based on multi-scale Markovian modeling. MARSIAA can be applied simultaneously to different bands. It segments an image into a user-defined number of classes, according to their surface brightness and surroundings - typically, o…
▽ More
We present an algorithm for the detection of Low Surface Brightness (LSB) galaxies in images, called MARSIAA (MARkovian Software for Image Analysis in Astronomy), which is based on multi-scale Markovian modeling. MARSIAA can be applied simultaneously to different bands. It segments an image into a user-defined number of classes, according to their surface brightness and surroundings - typically, one or two classes contain the LSB structures. We have developed an algorithm, called DetectLSB, which allows the efficient identification of LSB galaxies from among the candidate sources selected by MARSIAA. To assess the robustness of our method, the method was applied to a set of 18 B and I band images (covering 1.3 square degrees in total) of the Virgo cluster. To further assess the completeness of the results of our method, both MARSIAA, SExtractor, and DetectLSB were applied to search for (i) mock Virgo LSB galaxies inserted into a set of deep Next Generation Virgo Survey (NGVS) gri-band subimages and (ii) Virgo LSB galaxies identified by eye in a full set of NGVS square degree gri images. MARSIAA/DetectLSB recovered ~20% more mock LSB galaxies and ~40% more LSB galaxies identified by eye than SExtractor/DetectLSB. With a 90% fraction of false positives from an entirely unsupervised pipeline, a completeness of 90% is reached for sources with r_e > 3" at a mean surface brightness level of mu_g=27.7 mag/arcsec^2 and a central surface brightness of mu^0 g=26.7 mag/arcsec^2. About 10% of the false positives are artifacts, the rest being background galaxies. We have found our method to be complementary to the application of matched filters and an optimized use of SExtractor, and to have the following advantages: it is scale-free, can be applied simultaneously to several bands, and is well adapted for crowded regions on the sky.
△ Less
Submitted 20 November, 2012;
originally announced November 2012.
-
IVOA Recommendation: Simple Spectral Access Protocol Version 1.1
Authors:
Doug Tody,
Markus Dolensky,
Jonathan McDowell,
Francois Bonnarel,
Tamas Budavari,
Ivo Busko,
Alberto Micol,
Pedro Osuna,
Jesus Salgado,
Petr Skoda,
Randy Thompson,
Frank Valdes,
the Data Access Layer working group
Abstract:
The Simple Spectral Access (SSA) Protocol (SSAP) defines a uniform interface to remotely discover and access one dimensional spectra. SSA is a member of an integrated family of data access interfaces altogether comprising the Data Access Layer (DAL) of the IVOA. SSA is based on a more general data model capable of describing most tabular spectrophotometric data, including time series and spectral…
▽ More
The Simple Spectral Access (SSA) Protocol (SSAP) defines a uniform interface to remotely discover and access one dimensional spectra. SSA is a member of an integrated family of data access interfaces altogether comprising the Data Access Layer (DAL) of the IVOA. SSA is based on a more general data model capable of describing most tabular spectrophotometric data, including time series and spectral energy distributions (SEDs) as well as 1-D spectra; however the scope of the SSA interface as specified in this document is limited to simple 1-D spectra, including simple aggregations of 1-D spectra. The form of the SSA interface is simple: clients first query the global resource registry to find services of interest and then issue a data discovery query to selected services to determine what relevant data is available from each service; the candidate datasets available are described uniformly in a VOTable format document which is returned in response to the query. Finally, the client may retrieve selected datasets for analysis. Spectrum datasets returned by an SSA spectrum service may be either precomputed, archival datasets, or they may be virtual data which is computed on the fly to respond to a client request. Spectrum datasets may conform to a standard data model defined by SSA, or may be native spectra with custom project-defined content. Spectra may be returned in any of a number of standard data formats. Spectral data is generally stored externally to the VO in a format specific to each spectral data collection; currently there is no standard way to represent astronomical spectra, and virtually every project does it differently. Hence spectra may be actively mediated to the standard SSA-defined data model at access time by the service, so that client analysis programs do not have to be familiar with the idiosyncratic details of each data collection to be accessed.
△ Less
Submitted 26 March, 2012;
originally announced March 2012.
-
Evolution of the IVOA Characterisation Data Model
Authors:
Francois Bonnarel,
Mireille Louys,
Igor Chilingarian
Abstract:
The Characterisation data model is a standard of the International Virtual Observatory Alliance (IVOA) that describes observational datasets in the multi-dimensional parameter space. Defining three properties: coverage, resolution, and sampling along different physical axes (e.g. spatial, spectral, flux) with variable level of details for the description, this model has been used in several IVOA c…
▽ More
The Characterisation data model is a standard of the International Virtual Observatory Alliance (IVOA) that describes observational datasets in the multi-dimensional parameter space. Defining three properties: coverage, resolution, and sampling along different physical axes (e.g. spatial, spectral, flux) with variable level of details for the description, this model has been used in several IVOA contexts: Simple Spectral Access Protocol, Spectrum Data Model, ObsTAP (Table Access Protocol for the Core Components of the Observation Data Model. Here we propose a new version which addresses more completely the most detailed level of description (level 4) dealing with variation maps of coverage, resolution, and sampling. It also introduces new specific axes in order to cover various photometric measurements, velocity and polarimetry. Special care is given for composed data sets. These improvements and add-ons follow the evolution of needs expressed to the uptake of VO tools in various observation domains for data discovery but also for data analysis requirements. This is also introduced to tackle use-cases designed to analyse scientifically datasets in the V0 context together with calibration/provenance information.
△ Less
Submitted 21 December, 2011;
originally announced December 2011.
-
Lessons learnt in building VO resources: binding together several VO standards into an operational service
Authors:
Igor Chilingarian,
Francois Bonnarel,
Mireille Louys,
Pierre Le Sidaner
Abstract:
The International Virtual Observatory Alliance (IVOA) developed numerous interoperability standards during the last several years. Most of them are quite simple to implement from the technical point of view and even contain "SIMPLE" in the title. Does it mean that it is also simple to build a working VO resource using those standards? Yes and no. "Yes" because the standards are indeed simple, and…
▽ More
The International Virtual Observatory Alliance (IVOA) developed numerous interoperability standards during the last several years. Most of them are quite simple to implement from the technical point of view and even contain "SIMPLE" in the title. Does it mean that it is also simple to build a working VO resource using those standards? Yes and no. "Yes" because the standards are indeed simple, and "no" because usually one needs to implement a lot more than it was thought in the beginning of the project so the time management of the team becomes difficult. In our presentation we will start with a basic case of a simple spectral data collection. Then we will describe several examples of small" technologically advanced VO resources built in CDS and VO-Paris and will show that many standards are hidden from managers' eyes at the initial stage of the project development. The projects will be: (1) the GalMer database providing access to the results of numerical simulations of galaxy interactions; (2) the full spectrum fitting service that allows one to extract internal kinematics and stellar populations from spectra of galaxies available in the VO. We conclude that: (a) with the existing set of IVOA standards one can already build very advanced VO-enabled archives and tools useful for scientists; (b) managers have to be very careful when estimating the project development timelines for VO-enabled resources.
△ Less
Submitted 21 December, 2011;
originally announced December 2011.
-
IVOA Recommendation: Data Model for Astronomical DataSet Characterisation
Authors:
Mireille Louys,
Anita Richards,
Francois Bonnarel,
Alberto Micol,
Igor Chilingarian,
Jonathan McDowell,
the IVOA Data Model Working Group
Abstract:
This document defines the high level metadata necessary to describe the physical parameter space of observed or simulated astronomical data sets, such as 2D-images, data cubes, X-ray event lists, IFU data, etc.. The Characterisation data model is an abstraction which can be used to derive a structured description of any relevant data and thus to facilitate its discovery and scientific interpretati…
▽ More
This document defines the high level metadata necessary to describe the physical parameter space of observed or simulated astronomical data sets, such as 2D-images, data cubes, X-ray event lists, IFU data, etc.. The Characterisation data model is an abstraction which can be used to derive a structured description of any relevant data and thus to facilitate its discovery and scientific interpretation. The model aims at facilitating the manipulation of heterogeneous data in any VO framework or portal. A VO Characterisation instance can include descriptions of the data axes, the range of coordinates covered by the data, and details of the data sampling and resolution on each axis. These descriptions should be in terms of physical variables, independent of instrumental signatures as far as possible.
Implementations of this model has been described in the IVOA Note available at: http://www.ivoa.net/Documents/latest/ImplementationCharacterisation.html
Utypes derived from this version of the UML model are listed and commented in the following IVOA Note: http://www.ivoa.net/Documents/latest/UtypeListCharacterisationDM.html
An XML schema has been build up from the UML model and is available at: http://www.ivoa.net/xml/Characterisation/Characterisation-v1.11.xsd
△ Less
Submitted 9 November, 2011;
originally announced November 2011.
-
IVOA Recommendation: Observation Data Model Core Components and its Implementation in the Table Access Protocol Version 1.0
Authors:
Mireille Louys,
Francois Bonnarel,
David Schade,
Patrick Dowler,
Alberto Micol,
Daniel Durand,
Doug Tody,
Laurent Michel,
Jesus Salgado,
Igor Chilingarian,
Bruno Rino,
J. D. Santander-Vela,
Petr Skoda
Abstract:
This document defines the core components of the Observation data model that are necessary to perform data discovery when querying data centers for observations of interest. It exposes use-cases to be carried out, explains the model and provides guidelines for its implementation as a data access service based on the Table Access Protocol (TAP). It aims at providing a simple model easy to understan…
▽ More
This document defines the core components of the Observation data model that are necessary to perform data discovery when querying data centers for observations of interest. It exposes use-cases to be carried out, explains the model and provides guidelines for its implementation as a data access service based on the Table Access Protocol (TAP). It aims at providing a simple model easy to understand and to implement by data providers that wish to publish their data into the Virtual Observatory. This interface integrates data modeling and data access aspects in a single service and is named ObsTAP. It will be referenced as such in the IVOA registries. There will be a separate document to cover the full Observation data model. In this document, the Observation Data Model Core Components (ObsCoreDM) defines the core components of queryable metadata required for global discovery of observational data. It is meant to allow a single query to be posed to TAP services at multiple sites to perform global data discovery without having to understand the details of the services present at each site. It defines a minimal set of basic metadata and thus allows for a reasonable cost of implementation by data providers. The combination of the ObsCoreDM with TAP is referred to as an ObsTAP service. As with most of the VO Data Models, ObsCoreDM makes use of STC, Utypes, Units and UCDs. The ObsCoreDM can be serialized as a VOTable. ObsCoreDM can make reference to more complete data models such as ObsProvDM (the Observation Provenance Data Model, to come), Characterisation DM, Spectrum DM or Simple Spectral Line Data Model (SSLDM).
△ Less
Submitted 14 November, 2011; v1 submitted 7 November, 2011;
originally announced November 2011.
-
The SPECFIND V2.0 catalogue of radio cross-identifications and spectra. SPECFIND meets the Virtual Observatory
Authors:
B. Vollmer,
B. Gassmann,
S. Derriere,
T. Boch,
M. Louys,
F. Bonnarel,
P. Dubois,
F. Genova,
F. Ochsenbein
Abstract:
The new release of the SPECFIND radio cross-identification catalogue,
SPECFIND V2.0, is presented. It contains 107488 cross-identified objects with at least three radio sources observed at three independent frequencies. Compared to the previous release the number of entry radio catalogues is increased from 20 to 97 containing 115 tables. This large increase was only made possible by the develo…
▽ More
The new release of the SPECFIND radio cross-identification catalogue,
SPECFIND V2.0, is presented. It contains 107488 cross-identified objects with at least three radio sources observed at three independent frequencies. Compared to the previous release the number of entry radio catalogues is increased from 20 to 97 containing 115 tables. This large increase was only made possible by the development of four tools at CDS which use the standards and infrastructure of the Virtual Observatory (VO). This was done in the framework of the VO-TECH European Design Study of the Sixth Framework Program. We give an overview of the different classes of radio sources that a user can encounter. Due to the increase of frequency coverage of the input radio catalogues, this release demonstrates that the SPECFIND algorithm is able to detect spectral breaks around a frequency of ~1 GHz.
△ Less
Submitted 21 December, 2009;
originally announced December 2009.
-
3D Spectroscopy in the Virtual Observatory: Current Status
Authors:
Igor Chilingarian,
Francois Bonnarel,
Mireille Louys,
Ivan Zolotukhin,
Frederic Royer,
Isabelle Jegouzo,
Pierre Le Sidaner,
Pierre Fernique,
Thomas Boch
Abstract:
Three cornerstones for the 3D data support in the Virtual Observatory are: (1) data model to describe them, (2) data access services providing access to fully-reduced datasets, and (3) client applications which can deal with 3D data. Presently all these components became available in the VO. We demonstrate an application of the IVOA Characterisation data model to description of IFU and Fabry-Per…
▽ More
Three cornerstones for the 3D data support in the Virtual Observatory are: (1) data model to describe them, (2) data access services providing access to fully-reduced datasets, and (3) client applications which can deal with 3D data. Presently all these components became available in the VO. We demonstrate an application of the IVOA Characterisation data model to description of IFU and Fabry-Perot datasets. Two services providing SSA-like access to 3D-spectral data and Characterisation metadata have been implemented by us: ASPID-SR at SAO RAS for accessing IFU and Fabry-Perot data from the Russian 6-m telescope, and the Giraffe Archive at the VO Paris portal for the VLT FLAMES-Giraffe datasets. We have implemented VO Paris Euro3D Client, handling Euro3D FITS format, that interacts with CDS Aladin and ESA VOSpec using PLASTIC to display spatial and spectral cutouts of 3D datasets. Though the prototype we are presenting is yet rather simple, it demonstrates how 3D spectroscopic data can be fully integrated into the VO infrastructure.
△ Less
Submitted 2 November, 2007;
originally announced November 2007.
-
Comprehensive Metadata Query Interface for Heterogeneous Data Archives Based on Open Source PostgreSQL ORDBMS
Authors:
Ivan Zolotukhin,
Nikolay Samokhvalov,
Francois Bonnarel,
Igor Chilingarian
Abstract:
We use PostgreSQL DBMS for storing XML metadata, described by the IVOA Characterisation Data Model. Initial XML type support in the PostgreSQL has recently been implemented. We make heavy use of this feature in order to provide comprehensive search over Characterisation metadata tree. We built a prototype of the Characterisation metadata query service, implementing two access methods: (1) HTTP-G…
▽ More
We use PostgreSQL DBMS for storing XML metadata, described by the IVOA Characterisation Data Model. Initial XML type support in the PostgreSQL has recently been implemented. We make heavy use of this feature in order to provide comprehensive search over Characterisation metadata tree. We built a prototype of the Characterisation metadata query service, implementing two access methods: (1) HTTP-GET/POST based interface implements almost direct translation of the query parameter name into XPath of the data model element in the XML serialisation; (2) Web-Service based interface to receive XQuery which is also directly translated into XPath. This service will be used in the ASPID-SR archive, containing science-ready data obtained with the Russian 6-m telescope.
△ Less
Submitted 2 November, 2007;
originally announced November 2007.
-
ASPID-SR: Prototype of a VO-compliant Science-Ready Data Archive
Authors:
Igor Chilingarian,
Victor Afanasiev,
Francois Bonnarel,
Serguei Dodonov,
Mireille Louys,
Ivan Zolotukhin
Abstract:
ASPID stands for the "Archive of Spectral, Photometric, and Interferometric Data". The world largest collection of raw 3D spectroscopic observations of galactic and extragalactic sources is provided. ASPID-SR is a prototype of an archive of heterogeneous science ready data, fed by ASPID, where we try to exploit all the power of the IVOA Characterisation Data Model. Multi-level Characterisation m…
▽ More
ASPID stands for the "Archive of Spectral, Photometric, and Interferometric Data". The world largest collection of raw 3D spectroscopic observations of galactic and extragalactic sources is provided. ASPID-SR is a prototype of an archive of heterogeneous science ready data, fed by ASPID, where we try to exploit all the power of the IVOA Characterisation Data Model. Multi-level Characterisation metadata is provided for every dataset. The archive provides powerful metadata query mechanism with access to every data model element, vital for the efficient scientific usage of a complex informational system. We provide a set of access interfaces: SIAP/SSAP, HTTP-based characterisation metadata query, Web-service accepting ADQL/x.
△ Less
Submitted 2 November, 2007;
originally announced November 2007.
-
The SIMBAD astronomical database
Authors:
Marc Wenger,
Francois Ochsenbein,
Daniel Egret,
Pascal Dubois,
Francois Bonnarel,
Suzanne Borde,
Francoise Genova,
Gerard Jasniewicz,
Suzanne Laloe,
Soizick Lesteven,
Richard Monier
Abstract:
Simbad is the reference database for identification and bibliography of astronomical objects. It contains identifications, `basic data', bibliography, and selected observational measurements for several million astronomical objects. Simbad is developed and maintained by CDS, Strasbourg. Building the database contents is achieved with the help of several contributing institutes. Scanning the bibl…
▽ More
Simbad is the reference database for identification and bibliography of astronomical objects. It contains identifications, `basic data', bibliography, and selected observational measurements for several million astronomical objects. Simbad is developed and maintained by CDS, Strasbourg. Building the database contents is achieved with the help of several contributing institutes. Scanning the bibliography is the result of the collaboration of CDS with bibliographers in Observatoire de Paris (DASGAL), Institut d'Astrophysique de Paris, and Observatoire de Bordeaux. When selecting catalogues and tables for inclusion, priority is given to optimal multi-wavelength coverage of the database, and to support of research developments linked to large projects. In parallel, the systematic scanning of the bibliography reflects the diversity and general trends of astronomical research.
A WWW interface to Simbad is available at: http://simbad.u-strasbg.fr/Simbad
△ Less
Submitted 4 February, 2000;
originally announced February 2000.
-
The ALADIN Interactive Sky Atlas
Authors:
Francois Bonnarel,
Pierre Fernique,
Olivier Bienayme,
Daniel Egret,
Francoise Genova,
Mireille Louys,
Francois Ochsenbein,
Marc Wenger,
James G. Bartlett
Abstract:
The Aladin interactive sky atlas, developed at CDS, is a service providing simultaneous access to digitized images of the sky, astronomical catalogues, and databases.
The driving motivation is to facilitate direct, visual comparison of observational data at any wavelength with images of the optical sky, and with reference catalogues.
The set of available sky images consists of the STScI Digi…
▽ More
The Aladin interactive sky atlas, developed at CDS, is a service providing simultaneous access to digitized images of the sky, astronomical catalogues, and databases.
The driving motivation is to facilitate direct, visual comparison of observational data at any wavelength with images of the optical sky, and with reference catalogues.
The set of available sky images consists of the STScI Digitized Sky Surveys, completed with high resolution images of crowded regions scanned at the MAMA facility in Paris.
A Java WWW interface to the system is available at: http://aladin.u-strasbg.fr/
△ Less
Submitted 4 February, 2000;
originally announced February 2000.
-
The CDS information hub
Authors:
Francoise Genova,
Daniel Egret,
Olivier Bienayme,
Francois Bonnarel,
Pascal Dubois,
Pierre Fernique,
Gerard Jasniewicz,
Soizick Lesteven,
Richard Monier,
Francois Ochsenbein,
Marc Wenger
Abstract:
The Centre de Donnees astronomiques de Strasbourg (CDS) provides homogeneous access to heterogeneous information of various origins: information about astronomical objects in Simbad; catalogs and observation logs in VizieR and in the catalogue service; reference images and overlays in Aladin; nomenclature in the Dictionary of Nomenclature; Yellow Page services; the AstroGLU resource discovery to…
▽ More
The Centre de Donnees astronomiques de Strasbourg (CDS) provides homogeneous access to heterogeneous information of various origins: information about astronomical objects in Simbad; catalogs and observation logs in VizieR and in the catalogue service; reference images and overlays in Aladin; nomenclature in the Dictionary of Nomenclature; Yellow Page services; the AstroGLU resource discovery tool; mirror copies of other reference services; and documentation. With the implementation of links between the CDS services, and with other on--line reference information, CDS has become a major hub in the rapidly evolving world of information retrieval in astronomy, develo** efficient tools to help astronomers to navigate in the world-wide `Virtual Observatory' under construction, from data in the observatory archives to results published in journals. The WWW interface to the CDS services is available at: http://cdsweb.u-strasbg.fr/
△ Less
Submitted 4 February, 2000;
originally announced February 2000.
