-
The VO: A powerful tool for global astronomy
Authors:
Christophe Arviset,
Mark Allen,
Alessandra Aloisi,
Bruce Berriman,
Catherine Boisson,
Baptiste Cecconi,
David Ciardi,
Janet Evans,
Giuseppina Fabbiano,
Francoise Genova,
Tim Jenness,
Bob Mann,
Tom McGlynn,
William OMullane,
David Schade,
Felix Stoehr,
Andrea Zacchi
Abstract:
Since its inception in the early 2000, the Virtual Observatory (VO), developed as a collaboration of many national and international projects, has become a major factor in the discovery and dissemination of astronomical information worldwide. The IVOA has been coordinating all these efforts worldwide to ensure a common VO framework that enables transparent access to and interoperability of astrono…
▽ More
Since its inception in the early 2000, the Virtual Observatory (VO), developed as a collaboration of many national and international projects, has become a major factor in the discovery and dissemination of astronomical information worldwide. The IVOA has been coordinating all these efforts worldwide to ensure a common VO framework that enables transparent access to and interoperability of astronomy resources (data and software) around the world. The VO is not a magic solution to all astronomy data management challenges but it does bring useful solutions in many areas borne out by the fact that VO interfaces are broadly found in astronomy major data centres and projects worldwide. Astronomy data centres have been building VO services on top of their existing data services to increase interoperability with other VO-compliant data resources to take advantage of the continuous and increasing development of VO applications. VO applications have made multi-instrument and multi-wavelength science, a difficult and fruitful part of astronomy, somewhat easier. More recently, several major new astronomy projects have been directly adopting VO standards to build their data management infrastructure, giving birth to VO built-in archives. Embracing the VO framework from the beginning brings the double gain of not needing to reinvent the wheel and ensuring from the start interoperability with other astronomy VO resources. Some of the IVOA standards are also starting to be used by neighbour disciplines like planetary sciences. There is still quite a lot to be done on the VO, in particular tackling the upcoming big data challenge and how to find interoperable solutions to the new data analysis paradigm of bringing and running the software close to the data.
△ Less
Submitted 20 March, 2018;
originally announced March 2018.
-
Visualisation of Multi-mission Astronomical Data with ESASky
Authors:
Deborah Baines,
Fabrizio Giordano,
Elena Racero,
Jesús Salgado,
Belén López Martí,
Bruno Merín,
María Henar Sarmiento,
Raúl Gutiérrez,
Iñaki Ortiz de Landaluce,
Ignacio León,
Pilar de Teodoro,
Juan González,
Sara Nieto,
Juan Carlos Segovia,
Andy Pollock,
Michael Rosa,
Christophe Arviset,
Daniel Lennon,
William O`Mullane,
Guido de Marchi
Abstract:
ESASky is a science-driven discovery portal to explore the multi-wavelength sky and visualise and access multiple astronomical archive holdings. The tool is a web application that requires no prior knowledge of any of the missions involved and gives users world-wide simplified access to the highest-level science data products from multiple astronomical space-based astronomy missions plus a number…
▽ More
ESASky is a science-driven discovery portal to explore the multi-wavelength sky and visualise and access multiple astronomical archive holdings. The tool is a web application that requires no prior knowledge of any of the missions involved and gives users world-wide simplified access to the highest-level science data products from multiple astronomical space-based astronomy missions plus a number of ESA source catalogues. The first public release of ESASky features interfaces for the visualisation of the sky in multiple wavelengths, the visualisation of query results summaries, and the visualisation of observations and catalogue sources for single and multiple targets. This paper describes these features within ESASky, developed to address use cases from the scientific community. The decisions regarding the visualisation of large amounts of data and the technologies used were made in order to maximise the responsiveness of the application and to keep the tool as useful and intuitive as possible.
△ Less
Submitted 10 January, 2017;
originally announced January 2017.
-
Batch is back: CasJobs, serving multi-TB data on the Web
Authors:
William OMullane,
Nolan Li,
Maria Nieto-Santisteban,
Alex Szalay,
Ani Thakar,
Jim Gray
Abstract:
The Sloan Digital Sky Survey (SDSS) science database describes over 140 million objects and is over 1.5 TB in size. The SDSS Catalog Archive Server (CAS) provides several levels of query interface to the SDSS data via the SkyServer website. Most queries execute in seconds or minutes. However, some queries can take hours or days, either because they require non-index scans of the largest tables,…
▽ More
The Sloan Digital Sky Survey (SDSS) science database describes over 140 million objects and is over 1.5 TB in size. The SDSS Catalog Archive Server (CAS) provides several levels of query interface to the SDSS data via the SkyServer website. Most queries execute in seconds or minutes. However, some queries can take hours or days, either because they require non-index scans of the largest tables, or because they request very large result sets, or because they represent very complex aggregations of the data. These "monster queries" not only take a long time, they also affect response times for everyone else - one or more of them can clog the entire system. To ameliorate this problem, we developed a multi-server multi-queue batch job submission and tracking system for the CAS called CasJobs. The transfer of very large result sets from queries over the network is another serious problem. Statistics suggested that much of this data transfer is unnecessary; users would prefer to store results locally in order to allow further joins and filtering. To allow local analysis, a system was developed that gives users their own personal databases (MyDB) at the server side. Users may transfer data to their MyDB, and then perform further analysis before extracting it to their own machine. MyDB tables also provide a convenient way to share results of queries with collaborators without downloading them. CasJobs is built using SOAP XML Web services and has been in operation since May 2004.
△ Less
Submitted 16 February, 2005;
originally announced February 2005.
