-
Long Term Space Data and Informatics Needs
Authors:
S. Bradley Cenko,
Richard Doyle,
Daniel Crichton,
Seetha Somasundaram,
Giuseppe Longo,
Laurent Eyer,
Pranav Sharma,
Ashish Mahabal
Abstract:
Policy Brief on "Long Term Space Data and Informatics Needs", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
Persistent space data gathering, retention, transmission, and analysis play a pivotal role in deepening our grasp of the Universe and fostering the achievement of glob…
▽ More
Policy Brief on "Long Term Space Data and Informatics Needs", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
Persistent space data gathering, retention, transmission, and analysis play a pivotal role in deepening our grasp of the Universe and fostering the achievement of global sustainable development goals. Long-term data storage and curation is crucial not only to make the wide range of burgeoning data sets available to the global science community, but also to stabilize those data sets, enabling new science in the future to analyse long-term trends over unprecedented time spans. In addition to this, over the long-term, the imperative to store all data on the ground should be ameliorated by use of space-based data stores --maintained and seen to be as reliable as any other data archive. This concept is sometimes referred to as Memory of the Sky. Storing the data must be accompanied by the ability to analyse them. Several concepts covered below acknowledge roots and inspiration based in the Virtual Observatory effort. Within this policy document, we delve into the complexities surrounding the long-term utilization of space data and informatics, shedding light on the challenges and opportunities inherent in this endeavour. Further, we present a series of pragmatic recommendations designed to address these challenges proactively.
The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Global Data in Astronomy: Challenges and Opportunities
Authors:
Renee Hložek,
Chenzhou Cui,
Mark Allen,
Patricia Whitelock,
Jess McIver,
Giuseppe Longo,
Christopher Fluke,
Ajit Kembhavi,
Pranav Sharma,
Ashish Mahabal
Abstract:
Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
Astronomy is increasingly becoming a data-driven science. Advances in our understanding of the physical mechanisms at work in the Universe require building…
▽ More
Policy Brief on "Global Data in Astronomy: Challenges and Opportunities", distilled from the corresponding panel that was part of the discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
Astronomy is increasingly becoming a data-driven science. Advances in our understanding of the physical mechanisms at work in the Universe require building ever-more sensitive telescopes to gather observations of the cosmos to test and advance our theoretical models of how the universe works. To confront the observed data with our theoretical models we require data hosting, archiving and storage and high-performance computing resources to run the theoretical calculations and compare our simulated and observed universe. We also require the sophisticated development of highly skilled human resources. Newer large projects are often run through international collaborations and partnerships, driving a need for 'open science' and collaborative structure across national boundaries. While astronomical data are useful scientifically, the data do not come with the same ethical/privacy-related restrictions as medical/biological data. Moreover, the ability to use data for new scientific analysis extends and expands the impact and reach of scientific surveys -- this is a strength that national funding agencies should capitalize on. We discuss the management and analysis of such large volumes of data and the corresponding significant challenges that require policy-level preparations.
The policy webinar took place during the G20 presidency in India (2023). A summary based on the seven panels can be found here: arxiv:2401.04623.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
AstroInformatics: Recommendations for Global Cooperation
Authors:
Ashish Mahabal,
Pranav Sharma,
Rana Adhikari,
Mark Allen,
Stefano Andreon,
Varun Bhalerao,
Federica Bianco,
Anthony Brown,
S. Bradley Cenko,
Paula Coehlo,
Jeffery Cooke,
Daniel Crichton,
Chenzhou Cui,
Reinaldo de Carvalho,
Richard Doyle,
Laurent Eyer,
Bernard Fanaroff,
Christopher Fluke,
Francisco Forster,
Kevin Govender,
Matthew J. Graham,
Renée Hložek,
Puji Irawati,
Ajit Kembhavi,
Juna Kollmeier
, et al. (23 additional authors not shown)
Abstract:
Policy Brief on "AstroInformatics, Recommendations for Global Collaboration", distilled from panel discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
The deliberations encompassed a wide array of topics, including broad astroinformatics, sky surveys, large-scale international initiatives, global data repositories, space-related data, regi…
▽ More
Policy Brief on "AstroInformatics, Recommendations for Global Collaboration", distilled from panel discussions during S20 Policy Webinar on Astroinformatics for Sustainable Development held on 6-7 July 2023.
The deliberations encompassed a wide array of topics, including broad astroinformatics, sky surveys, large-scale international initiatives, global data repositories, space-related data, regional and international collaborative efforts, as well as workforce development within the field. These discussions comprehensively addressed the current status, notable achievements, and the manifold challenges that the field of astroinformatics currently confronts.
The G20 nations present a unique opportunity due to their abundant human and technological capabilities, coupled with their widespread geographical representation. Leveraging these strengths, significant strides can be made in various domains. These include, but are not limited to, the advancement of STEM education and workforce development, the promotion of equitable resource utilization, and contributions to fields such as Earth Science and Climate Science.
We present a concise overview, followed by specific recommendations that pertain to both ground-based and space data initiatives. Our team remains readily available to furnish further elaboration on any of these proposals as required. Furthermore, we anticipate further engagement during the upcoming G20 presidencies in Brazil (2024) and South Africa (2025) to ensure the continued discussion and realization of these objectives.
The policy webinar took place during the G20 presidency in India (2023). Notes based on the seven panels will be separately published.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Data-Driven Approaches to Searches for the Technosignatures of Advanced Civilizations
Authors:
T. Joseph W. Lazio,
S. G. Djorgovski,
Andrew Howard,
Curt Cutler,
Sofia Z. Sheikh,
Stefano Cavuoti,
Denise Herzing,
Kiri Wagstaff,
Jason T. Wright,
Vishal Gajjar,
Kevin Hand,
Umaa Rebbapragada,
Bruce Allen,
Erica Cartmill,
Jacob Foster,
Dawn Gelino,
Matthew J. Graham,
Giuseppe Longo,
Ashish A. Mahabal,
Lior Pachter,
Vikram Ravi,
Gerald Sussman
Abstract:
Humanity has wondered whether we are alone for millennia. The discovery of life elsewhere in the Universe, particularly intelligent life, would have profound effects, comparable to those of recognizing that the Earth is not the center of the Universe and that humans evolved from previous species. There has been rapid growth in the fields of extrasolar planets and data-driven astronomy. In a relati…
▽ More
Humanity has wondered whether we are alone for millennia. The discovery of life elsewhere in the Universe, particularly intelligent life, would have profound effects, comparable to those of recognizing that the Earth is not the center of the Universe and that humans evolved from previous species. There has been rapid growth in the fields of extrasolar planets and data-driven astronomy. In a relatively short interval, we have seen a change from knowing of no extrasolar planets to now knowing more potentially habitable extrasolar planets than there are planets in the Solar System. In approximately the same interval, astronomy has transitioned to a field in which sky surveys can generate 1 PB or more of data. The Data-Driven Approaches to Searches for the Technosignatures of Advanced Civilizations_ study at the W. M. Keck Institute for Space Studies was intended to revisit searches for evidence of alien technologies in light of these developments. Data-driven searches, being able to process volumes of data much greater than a human could, and in a reproducible manner, can identify *anomalies* that could be clues to the presence of technosignatures. A key outcome of this workshop was that technosignature searches should be conducted in a manner consistent with Freeman Dyson's "First Law of SETI Investigations," namely "every search for alien civilizations should be planned to give interesting results even when no aliens are discovered." This approach to technosignatures is commensurate with NASA's approach to biosignatures in that no single observation or measurement can be taken as providing full certainty for the detection of life. Areas of particular promise identified during the workshop were (*) Data Mining of Large Sky Surveys, (*) All-Sky Survey at Far-Infrared Wavelengths, (*) Surveys with Radio Astronomical Interferometers, and (*) Artifacts in the Solar System.
△ Less
Submitted 29 August, 2023;
originally announced August 2023.
-
New methods to assess and improve LIGO detector duty cycle
Authors:
Ayon Biswas,
Jess McIver,
Ashish Mahabal
Abstract:
A network of three or more gravitational wave detectors simultaneously taking data is required to generate a well-localized sky map for gravitational wave sources, such as GW170817. Local seismic disturbances often cause the LIGO and Virgo detectors to lose light resonance in one or more of their component optic cavities, and the affected detector is unable to take data until resonance is recovere…
▽ More
A network of three or more gravitational wave detectors simultaneously taking data is required to generate a well-localized sky map for gravitational wave sources, such as GW170817. Local seismic disturbances often cause the LIGO and Virgo detectors to lose light resonance in one or more of their component optic cavities, and the affected detector is unable to take data until resonance is recovered. In this paper, we use machine learning techniques to gain insight into the predictive behavior of the LIGO detector optic cavities during the second LIGO-Virgo observing run. We identify a minimal set of optic cavity control signals and data features which capture interferometer behavior leading to a loss of light resonance, or lockloss. We use these channels to accurately distinguish between lockloss events and quiet interferometer operating times via both supervised and unsupervised machine learning methods. This analysis yields new insights into how components of the LIGO detectors contribute to lockloss events, which could inform detector commissioning efforts to mitigate the associated loss of uptime. Particularly, we find that the state of the component optical cavities is a better predictor of loss of lock than ground motion trends. We report prediction accuracies of 98% for times just prior to lock loss, and 90% for times up to 30 seconds prior to lockloss, which shows promise for this method to be applied in near-real time to trigger preventative detector state changes. This method can be extended to target other auxiliary subsystems or times of interest, such as transient noise or loss in detector sensitivity. Application of these techniques during the third LIGO-Virgo observing run and beyond would maximize the potential of the global detector network for multi-messenger astronomy with gravitational waves.
△ Less
Submitted 6 August, 2020; v1 submitted 26 October, 2019;
originally announced October 2019.
-
The MICA Experiment: Astrophysics in Virtual Worlds
Authors:
S. G. Djorgovski,
Piet Hut,
Rob Knop,
Giuseppe Longo,
Steve McMillan,
Enrico Vesperini,
Ciro Donalek,
Matthew Graham,
Asish Mahabal,
Franz Sauer,
Charles White,
Crista Lopes
Abstract:
We describe the work of the Meta-Institute for Computational Astrophysics (MICA), the first professional scientific organization based in virtual worlds. MICA was an experiment in the use of this technology for science and scholarship, lasting from the early 2008 to June 2012, mainly using the Second Life and OpenSimulator as platforms. We describe its goals and activities, and our future plans. W…
▽ More
We describe the work of the Meta-Institute for Computational Astrophysics (MICA), the first professional scientific organization based in virtual worlds. MICA was an experiment in the use of this technology for science and scholarship, lasting from the early 2008 to June 2012, mainly using the Second Life and OpenSimulator as platforms. We describe its goals and activities, and our future plans. We conducted scientific collaboration meetings, professional seminars, a workshop, classroom instruction, public lectures, informal discussions and gatherings, and experiments in immersive, interactive visualization of high-dimensional scientific data. Perhaps the most successful of these was our program of popular science lectures, illustrating yet again the great potential of immersive VR as an educational and outreach platform. While the members of our research groups and some collaborators found the use of immersive VR as a professional telepresence tool to be very effective, we did not convince a broader astrophysics community to adopt it at this time, despite some efforts; we discuss some possible reasons for this non-uptake. On the whole, we conclude that immersive VR has a great potential as a scientific and educational platform, as the technology matures and becomes more broadly available and accepted.
△ Less
Submitted 28 January, 2013;
originally announced January 2013.
-
Sky Surveys
Authors:
S. G. Djorgovski,
A. A. Mahabal,
A. J. Drake,
M. J. Graham,
C. Donalek
Abstract:
Sky surveys represent a fundamental data basis for astronomy. We use them to map in a systematic way the universe and its constituents, and to discover new types of objects or phenomena. We review the subject, with an emphasis on the wide-field imaging surveys, placing them in a broader scientific and historical context. Surveys are the largest data generators in astronomy, propelled by the advanc…
▽ More
Sky surveys represent a fundamental data basis for astronomy. We use them to map in a systematic way the universe and its constituents, and to discover new types of objects or phenomena. We review the subject, with an emphasis on the wide-field imaging surveys, placing them in a broader scientific and historical context. Surveys are the largest data generators in astronomy, propelled by the advances in information and computation technology, and have transformed the ways in which astronomy is done. We describe the variety and the general properties of surveys, the ways in which they may be quantified and compared, and offer some figures of merit that can be used to compare their scientific discovery potential. Surveys enable a very wide range of science; that is perhaps their key unifying characteristic. As new domains of the observable parameter space open up thanks to the advances in technology, surveys are often the initial step in their exploration. Science can be done with the survey data alone or a combination of different surveys, or with a targeted follow-up of potentially interesting selected sources. Surveys can be used to generate large, statistical samples of objects that can be studied as populations, or as tracers of larger structures. They can be also used to discover or generate samples of rare or unusual objects, and may lead to discoveries of some previously unknown types. We discuss a general framework of parameter spaces that can be used for an assessment and comparison of different surveys, and the strategies for their scientific exploration. As we move into the Petascale regime, an effective processing and scientific exploitation of such large data sets and data streams poses many challenges, some of which may be addressed in the framework of Virtual Observatory and Astroinformatics, with a broader application of data mining and knowledge discovery technologies.
△ Less
Submitted 12 June, 2012; v1 submitted 22 March, 2012;
originally announced March 2012.
-
Exploring the Time Domain With Synoptic Sky Surveys
Authors:
S. G. Djorgovski,
A. A. Mahabal,
A. J. Drake,
M. J. Graham,
C. Donalek,
R. Williams
Abstract:
Synoptic sky surveys are becoming the largest data generators in astronomy, and they are opening a new research frontier, that touches essentially every field of astronomy. Opening of the time domain to a systematic exploration will strengthen our understanding of a number of interesting known phenomena, and may lead to the discoveries of as yet unknown ones. We describe some lessons learned over…
▽ More
Synoptic sky surveys are becoming the largest data generators in astronomy, and they are opening a new research frontier, that touches essentially every field of astronomy. Opening of the time domain to a systematic exploration will strengthen our understanding of a number of interesting known phenomena, and may lead to the discoveries of as yet unknown ones. We describe some lessons learned over the past decade, and offer some ideas that may guide strategic considerations in planning and execution of the future synoptic sky surveys.
△ Less
Submitted 8 November, 2011;
originally announced November 2011.
-
Towards an Automated Classification of Transient Events in Synoptic Sky Surveys
Authors:
S. G. Djorgovski,
C. Donalek,
A. Mahabal,
B. Moghaddam,
M. Turmon,
M. Graham,
A. Drake,
N. Sharma,
Y. Chen
Abstract:
We describe the development of a system for an automated, iterative, real-time classification of transient events discovered in synoptic sky surveys. The system under development incorporates a number of Machine Learning techniques, mostly using Bayesian approaches, due to the sparse nature, heterogeneity, and variable incompleteness of the available data. The classifications are improved iterativ…
▽ More
We describe the development of a system for an automated, iterative, real-time classification of transient events discovered in synoptic sky surveys. The system under development incorporates a number of Machine Learning techniques, mostly using Bayesian approaches, due to the sparse nature, heterogeneity, and variable incompleteness of the available data. The classifications are improved iteratively as the new measurements are obtained. One novel feature is the development of an automated follow-up recommendation engine, that suggest those measurements that would be the most advantageous in terms of resolving classification ambiguities and/or characterization of the astrophysically most interesting objects, given a set of available follow-up assets and their cost functions. This illustrates the symbiotic relationship of astronomy and applied computer science through the emerging discipline of AstroInformatics.
△ Less
Submitted 20 October, 2011;
originally announced October 2011.