-
Playing catch-up in building an open research commons
Authors:
Philip E. Bourne,
Vivien Bonazzi,
Amy Brand,
Bonnie Carroll,
Ian Foster,
Ramanathan V. Guha,
Robert Hanisch,
Sallie Ann Keller,
Mary Lee Kennedy,
Christine Kirkpatrick,
Barend Mons,
Sarah M. Nusser,
Michael Stebbins,
George Strawn,
Alex Szalay
Abstract:
On August 2, 2021 a group of concerned scientists and US funding agency and federal government officials met for an informal discussion to explore the value and need for a well-coordinated US Open Research Commons (ORC); an interoperable collection of data and compute resources within both the public and private sectors which are easy to use and accessible to all.
On August 2, 2021 a group of concerned scientists and US funding agency and federal government officials met for an informal discussion to explore the value and need for a well-coordinated US Open Research Commons (ORC); an interoperable collection of data and compute resources within both the public and private sectors which are easy to use and accessible to all.
△ Less
Submitted 15 July, 2022;
originally announced August 2022.
-
Now is the time to build a national data ecosystem for materials science and chemistry research data
Authors:
E. M. Campo,
S. Shankar,
A. S. Szalay,
R. J. Hanisch
Abstract:
A call for coordinated action from government, academia, and industry.
A call for coordinated action from government, academia, and industry.
△ Less
Submitted 1 January, 2022;
originally announced January 2022.
-
The Virtual Astronomical Observatory: Re-engineering Access to Astronomical Data
Authors:
R. J. Hanisch,
G. B. Berriman,
T. J. W. Lazio,
S. Emery Bunn,
J. Evans,
T. A. McGlynn,
R. Plante
Abstract:
The U.S. Virtual Astronomical Observatory was a software infrastructure and development project designed both to begin the establishment of an operational Virtual Observatory (VO) and to provide the U.S. coordination with the international VO effort. The concept of the VO is to provide the means by which an astronomer is able to discover, access, and process data seamlessly, regardless of its phys…
▽ More
The U.S. Virtual Astronomical Observatory was a software infrastructure and development project designed both to begin the establishment of an operational Virtual Observatory (VO) and to provide the U.S. coordination with the international VO effort. The concept of the VO is to provide the means by which an astronomer is able to discover, access, and process data seamlessly, regardless of its physical location. This paper describes the origins of the VAO, including the predecessor efforts within the U.S. National Virtual Observatory, and summarizes its main accomplishments. These accomplishments include the development of both scripting toolkits that allow scientists to incorporate VO data directly into their reduction and analysis environments and high-level science applications for data discovery, integration, analysis, and catalog cross-comparison. Working with the international community, and based on the experience from the software development, the VAO was a major contributor to international standards within the International Virtual Observatory Alliance. The VAO also demonstrated how an operational virtual observatory could be deployed, providing a robust operational environment in which VO services worldwide were routinely checked for aliveness and compliance with international standards. Finally, the VAO engaged in community outreach, develo** a comprehensive web site with on-line tutorials, announcements, links to both U.S. and internationally developed tools and services, and exhibits and hands-on training .... All digital products of the VAO Project, including software, documentation, and tutorials, are stored in a repository for community access. The enduring legacy of the VAO is an increasing expectation that new telescopes and facilities incorporate VO capabilities during the design of their data management systems.
△ Less
Submitted 8 April, 2015;
originally announced April 2015.
-
Astrophysics Source Code Library Enhancements
Authors:
Robert J. Hanisch,
Alice Allen,
G. Bruce Berriman,
Kimberly DuPrie,
Jessica Mink,
Robert J. Nemiroff,
Judy Schmidt,
Lior Shamir,
Keith Shortridge,
Mark Taylor,
Peter J. Teuben,
John Wallin
Abstract:
The Astrophysics Source Code Library (ASCL; ascl.net) is a free online registry of codes used in astronomy research; it currently contains over 900 codes and is indexed by ADS. The ASCL has recently moved a new infrastructure into production. The new site provides a true database for the code entries and integrates the WordPress news and information pages and the discussion forum into one site. Pr…
▽ More
The Astrophysics Source Code Library (ASCL; ascl.net) is a free online registry of codes used in astronomy research; it currently contains over 900 codes and is indexed by ADS. The ASCL has recently moved a new infrastructure into production. The new site provides a true database for the code entries and integrates the WordPress news and information pages and the discussion forum into one site. Previous capabilities are retained and permalinks to ascl.net continue to work. This improvement offers more functionality and flexibility than the previous site, is easier to maintain, and offers new possibilities for collaboration. This presentation covers these recent changes to the ASCL.
△ Less
Submitted 7 November, 2014;
originally announced November 2014.
-
The Past, Present and Future of Astronomical Data Formats
Authors:
Jessica Mink,
Robert G. Mann,
Robert Hanisch,
Arnold Rots,
Rob Seaman,
Tim Jenness,
Brian Thomas,
William O'Mullane
Abstract:
The future of astronomy is inextricably entwined with the care and feeding of astronomical data products. Community standards such as FITS and NDF have been instrumental in the success of numerous astronomy projects. Their very success challenges us to entertain pragmatic strategies to adapt and evolve the standards to meet the aggressive data-handling requirements of facilities now being designed…
▽ More
The future of astronomy is inextricably entwined with the care and feeding of astronomical data products. Community standards such as FITS and NDF have been instrumental in the success of numerous astronomy projects. Their very success challenges us to entertain pragmatic strategies to adapt and evolve the standards to meet the aggressive data-handling requirements of facilities now being designed and built. We discuss characteristics that have made standards successful in the past, as well as desirable features for the future, and an open discussion follows.
△ Less
Submitted 4 November, 2014;
originally announced November 2014.
-
Ideas for Advancing Code Sharing (A Different Kind of Hack Day)
Authors:
Peter Teuben,
Alice Allen,
Bruce Berriman,
Kimberly DuPrie,
Robert J. Hanisch,
Jessica Mink,
Robert Nemiroff,
Lior Shamir,
Keith Shortridge,
Mark Taylor,
John Wallin
Abstract:
How do we as a community encourage the reuse of software for telescope operations, data processing, and calibration? How can we support making codes used in research available for others to examine? Continuing the discussion from last year Bring out your codes! BoF session, participants separated into groups to brainstorm ideas to mitigate factors which inhibit code sharing and nurture those which…
▽ More
How do we as a community encourage the reuse of software for telescope operations, data processing, and calibration? How can we support making codes used in research available for others to examine? Continuing the discussion from last year Bring out your codes! BoF session, participants separated into groups to brainstorm ideas to mitigate factors which inhibit code sharing and nurture those which encourage code sharing. The BoF concluded with the sharing of ideas that arose from the brainstorming sessions and a brief summary by the moderator.
△ Less
Submitted 27 December, 2013;
originally announced December 2013.
-
Astrophysics Source Code Library: Incite to Cite!
Authors:
Kimberly DuPrie,
Alice Allen,
Bruce Berriman,
Robert J. Hanisch,
Jessica Mink,
Robert J. Nemiroff,
Lior Shamir,
Keith Shortridge,
Mark B. Taylor,
Peter Teuben,
John F. Wallin
Abstract:
The Astrophysics Source Code Library (ASCL, http://ascl.net/) is an online registry of over 700 source codes that are of interest to astrophysicists, with more being added regularly. The ASCL actively seeks out codes as well as accepting submissions from the code authors, and all entries are citable and indexed by ADS. All codes have been used to generate results published in or submitted to a ref…
▽ More
The Astrophysics Source Code Library (ASCL, http://ascl.net/) is an online registry of over 700 source codes that are of interest to astrophysicists, with more being added regularly. The ASCL actively seeks out codes as well as accepting submissions from the code authors, and all entries are citable and indexed by ADS. All codes have been used to generate results published in or submitted to a refereed journal and are available either via a download site or froman identified source. In addition to being the largest directory of scientist-written astrophysics programs available, the ASCL is also an active participant in the reproducible research movement with presentations at various conferences, numerous blog posts and a journal article. This poster provides a description of the ASCL and the changes that we are starting to see in the astrophysics community as a result of the work we are doing.
△ Less
Submitted 23 December, 2013;
originally announced December 2013.
-
The Astrophysics Source Code Library: Where do we go from here?
Authors:
Alice Allen,
Bruce Berriman,
Kimberly DuPrie,
Robert J. Hanisch,
Jessica Mink,
Robert Nemiroff,
Lior Shamir,
Keith Shortridge,
Mark Taylor,
Peter Teuben,
John Wallin
Abstract:
The Astrophysics Source Code Library, started in 1999, has in the past three years grown from a repository for 40 codes to a registry of over 700 codes that are now indexed by ADS. What comes next? We examine the future of the ASCL, the challenges facing it, the rationale behind its practices, and the need to balance what we might do with what we have the resources to accomplish.
The Astrophysics Source Code Library, started in 1999, has in the past three years grown from a repository for 40 codes to a registry of over 700 codes that are now indexed by ADS. What comes next? We examine the future of the ASCL, the challenges facing it, the rationale behind its practices, and the need to balance what we might do with what we have the resources to accomplish.
△ Less
Submitted 18 December, 2013;
originally announced December 2013.
-
Practices in source code sharing in astrophysics
Authors:
Lior Shamir,
John F. Wallin,
Alice Allen,
Bruce Berriman,
Peter Teuben,
Robert J. Nemiroff,
Jessica Mink,
Robert J. Hanisch,
Kimberly DuPrie
Abstract:
While software and algorithms have become increasingly important in astronomy, the majority of authors who publish computational astronomy research do not share the source code they develop, making it difficult to replicate and reuse the work. In this paper we discuss the importance of sharing scientific source code with the entire astrophysics community, and propose that journals require authors…
▽ More
While software and algorithms have become increasingly important in astronomy, the majority of authors who publish computational astronomy research do not share the source code they develop, making it difficult to replicate and reuse the work. In this paper we discuss the importance of sharing scientific source code with the entire astrophysics community, and propose that journals require authors to make their code publicly available when a paper is published. That is, we suggest that a paper that involves a computer program not be accepted for publication unless the source code becomes publicly available. The adoption of such a policy by editors, editorial boards, and reviewers will improve the ability to replicate scientific results, and will also make the computational astronomy methods more available to other researchers who wish to apply them to their data.
△ Less
Submitted 24 April, 2013;
originally announced April 2013.
-
Astrophysics Source Code Library
Authors:
Alice Allen,
Kimberly DuPrie,
Bruce Berriman,
Robert J. Hanisch,
Jessica Mink,
Peter J. Teuben
Abstract:
The Astrophysics Source Code Library (ASCL), founded in 1999, is a free on-line registry for source codes of interest to astronomers and astrophysicists. The library is housed on the discussion forum for Astronomy Picture of the Day (APOD) and can be accessed at http://ascl.net. The ASCL has a comprehensive listing that covers a significant number of the astrophysics source codes used to generate…
▽ More
The Astrophysics Source Code Library (ASCL), founded in 1999, is a free on-line registry for source codes of interest to astronomers and astrophysicists. The library is housed on the discussion forum for Astronomy Picture of the Day (APOD) and can be accessed at http://ascl.net. The ASCL has a comprehensive listing that covers a significant number of the astrophysics source codes used to generate results published in or submitted to refereed journals and continues to grow. The ASCL currently has entries for over 500 codes; its records are citable and are indexed by ADS. The editors of the ASCL and members of its Advisory Committee were on hand at a demonstration table in the ADASS poster room to present the ASCL, accept code submissions, show how the ASCL is starting to be used by the astrophysics community, and take questions on and suggestions for improving the resource.
△ Less
Submitted 9 December, 2012;
originally announced December 2012.
-
Bring out your codes! Bring out your codes! (Increasing Software Visibility and Re-use)
Authors:
Alice Allen,
Bruce Berriman,
Robert Brunner,
Dan Burger,
Kimberly DuPrie,
Robert J. Hanisch,
Robert Mann,
Jessica Mink,
Christer Sandin,
Keith Shortridge,
Peter Teuben
Abstract:
Progress is being made in code discoverability and preservation, but as discussed at ADASS XXI, many codes still remain hidden from public view. With the Astrophysics Source Code Library (ASCL) now indexed by the SAO/NASA Astrophysics Data System (ADS), the introduction of a new journal, Astronomy & Computing, focused on astrophysics software, and the increasing success of education efforts such a…
▽ More
Progress is being made in code discoverability and preservation, but as discussed at ADASS XXI, many codes still remain hidden from public view. With the Astrophysics Source Code Library (ASCL) now indexed by the SAO/NASA Astrophysics Data System (ADS), the introduction of a new journal, Astronomy & Computing, focused on astrophysics software, and the increasing success of education efforts such as Software Carpentry and SciCoder, the community has the opportunity to set a higher standard for its science by encouraging the release of software for examination and possible reuse. We assembled representatives of the community to present issues inhibiting code release and sought suggestions for tackling these factors.
The session began with brief statements by panelists; the floor was then opened for discussion and ideas. Comments covered a diverse range of related topics and points of view, with apparent support for the propositions that algorithms should be readily available, code used to produce published scientific results should be made available, and there should be discovery mechanisms to allow these to be found easily. With increased use of resources such as GitHub (for code availability), ASCL (for code discovery), and a stated strong preference from the new journal Astronomy & Computing for code release, we expect to see additional progress over the next few years.
△ Less
Submitted 9 December, 2012;
originally announced December 2012.
-
Running a distributed virtual observatory: US Virtual Astronomical Observatory operations
Authors:
Thomas A. McGlynn,
Robert J. Hanisch,
G. Bruce Berriman,
Aniruddha R. Thakar
Abstract:
Operation of the US Virtual Astronomical Observatory shares some issues with modern physical observatories, e.g., intimidating data volumes and rapid technological change, and must also address unique concerns like the lack of direct control of the underlying and scattered data resources, and the distributed nature of the observatory itself. In this paper we discuss how the VAO has addressed these…
▽ More
Operation of the US Virtual Astronomical Observatory shares some issues with modern physical observatories, e.g., intimidating data volumes and rapid technological change, and must also address unique concerns like the lack of direct control of the underlying and scattered data resources, and the distributed nature of the observatory itself. In this paper we discuss how the VAO has addressed these challenges to provide the astronomical community with a coherent set of science-enabling tools and services. The distributed nature of our virtual observatory-with data and personnel spanning geographic, institutional and regime boundaries-is simultaneously a major operational headache and the primary science motivation for the VAO. Most astronomy today uses data from many resources. Facilitation of matching heterogeneous datasets is a fundamental reason for the virtual observatory. Key aspects of our approach include continuous monitoring and validation of VAO and VO services and the datasets provided by the community, monitoring of user requests to optimize access, caching for large datasets, and providing distributed storage services that allow user to collect results near large data repositories. Some elements are now fully implemented, while others are planned for subsequent years. The distributed nature of the VAO requires careful attention to what can be a straightforward operation at a conventional observatory, e.g., the organization of the web site or the collection and combined analysis of logs. Many of these strategies use and extend protocols developed by the international virtual observatory community.
△ Less
Submitted 20 June, 2012;
originally announced June 2012.
-
The organization and management of the Virtual Astronomical Observatory
Authors:
G. Bruce Berriman,
Robert J. Hanisch,
T. Joseph W. Lazio,
Alexander Szalay,
Giussepina Fabbiano
Abstract:
The U.S. Virtual Astronomical Observatory (VAO; http://www.us-vao.org/) has been in operation since May 2010. Its goal is to enable new science through efficient integration of distributed multi-wavelength data. This paper describes the management and organization of the VAO, and emphasizes the techniques used to ensure efficiency in a distributed organization. Management methods include using an…
▽ More
The U.S. Virtual Astronomical Observatory (VAO; http://www.us-vao.org/) has been in operation since May 2010. Its goal is to enable new science through efficient integration of distributed multi-wavelength data. This paper describes the management and organization of the VAO, and emphasizes the techniques used to ensure efficiency in a distributed organization. Management methods include using an annual program plan as the basis for establishing contracts with member organizations, regular communication, and monitoring of processes.
△ Less
Submitted 18 June, 2012;
originally announced June 2012.
-
The role in the Virtual Astronomical Observatory in the era of massive data sets
Authors:
G. Bruce Berriman,
Robert J. Hanisch,
T. Joseph W. Lazio
Abstract:
The Virtual Observatory (VO) is realizing global electronic integration of astronomy data. One of the long-term goals of the U.S. VO project, the Virtual Astronomical Observatory (VAO), is development of services and protocols that respond to the growing size and complexity of astronomy data sets. This paper describes how VAO staff are active in such development efforts, especially in innovative s…
▽ More
The Virtual Observatory (VO) is realizing global electronic integration of astronomy data. One of the long-term goals of the U.S. VO project, the Virtual Astronomical Observatory (VAO), is development of services and protocols that respond to the growing size and complexity of astronomy data sets. This paper describes how VAO staff are active in such development efforts, especially in innovative strategies and techniques that recognize the limited operating budgets likely available to astronomers even as demand increases. The project has a program of professional outreach whereby new services and protocols are evaluated.
△ Less
Submitted 18 June, 2012;
originally announced June 2012.
-
IVOA Recommendation: VOTable Format Definition Version 1.3
Authors:
François Ochsenbein,
Roy Williams,
Clive Davenhall,
Daniel Durand,
Pierre Fernique,
David Giaretta,
Robert Hanisch,
Tom McGlynn,
Alex Szalay,
Mark B. Taylor,
Andreas Wicenec
Abstract:
This document describes the structures making up the VOTable standard. The main part of this document describes the adopted part of the VOTable standard; it is followed by appendices presenting extensions which have been proposed and/or discussed, but which are not part of the standard.
This document describes the structures making up the VOTable standard. The main part of this document describes the adopted part of the VOTable standard; it is followed by appendices presenting extensions which have been proposed and/or discussed, but which are not part of the standard.
△ Less
Submitted 13 September, 2016; v1 submitted 3 October, 2011;
originally announced October 2011.
-
IVOA Recommendation: IVOA Document Standards Version 1.2
Authors:
R. J. Hanisch,
C. Arviset,
F. Genova,
B. Rino
Abstract:
This document describes the types of official IVOA documents and the process by which documents are advanced from Working Drafts to formal Recommendations.
This document describes the types of official IVOA documents and the process by which documents are advanced from Working Drafts to formal Recommendations.
△ Less
Submitted 3 October, 2011;
originally announced October 2011.
-
IVOA Recommendation: Resource Metadata for the Virtual Observatory Version 1.12
Authors:
Robert Hanisch,
the IVOA Resource Registry Working Group,
the NVO Metadata Working Group
Abstract:
An essential capability of the Virtual Observatory is a means for describing what data and computational facilities are available where, and once identified, how to use them. The data themselves have associated metadata (e.g., FITS keywords), and similarly we require metadata about data collections and data services so that VO users can easily find information of interest. Furthermore, such metada…
▽ More
An essential capability of the Virtual Observatory is a means for describing what data and computational facilities are available where, and once identified, how to use them. The data themselves have associated metadata (e.g., FITS keywords), and similarly we require metadata about data collections and data services so that VO users can easily find information of interest. Furthermore, such metadata are needed in order to manage distributed queries efficiently; if a user is interested in finding x-ray images there is no point in querying the HST archive, for example. In this document we suggest an architecture for resource and service metadata and describe the relationship of this architecture to emerging Web Services standards. We also define an initial set of metadata concepts.
△ Less
Submitted 3 October, 2011;
originally announced October 2011.
-
IVOA Recommendation: Simple Cone Search Version 1.03
Authors:
Roy Williams,
Robert Hanisch,
Alex Szalay,
Raymond Plante
Abstract:
This specification defines a simple query protocol for retrieving records from a catalog of astronomical sources. The query describes sky position and an angular distance, defining a cone on the sky. The response returns a list of astronomical sources from the catalog whose positions lie within the cone, formatted as a VOTable. This version of the specification is essentially a transcription of th…
▽ More
This specification defines a simple query protocol for retrieving records from a catalog of astronomical sources. The query describes sky position and an angular distance, defining a cone on the sky. The response returns a list of astronomical sources from the catalog whose positions lie within the cone, formatted as a VOTable. This version of the specification is essentially a transcription of the original Cone Search specification in order to move it into the IVOA standardization process.
△ Less
Submitted 3 October, 2011;
originally announced October 2011.
-
Astronomical Data Management
Authors:
Ray Norris,
Heinz Andernach,
Guenther Eichhorn,
Francoise Genova,
Elizabeth Griffin,
Robert Hanisch,
Ajit Kembhavi,
Robert Kennicutt,
Anita Richards
Abstract:
We present a summary of the major contributions to the Special Session on Data Management held at the IAU General Assembly in Prague in 2006. While recent years have seen enormous improvements in access to astronomical data, and the Virtual Observatory aims to provide astronomers with seamless access to on-line resources, more attention needs to be paid to ensuring the quality and completeness o…
▽ More
We present a summary of the major contributions to the Special Session on Data Management held at the IAU General Assembly in Prague in 2006. While recent years have seen enormous improvements in access to astronomical data, and the Virtual Observatory aims to provide astronomers with seamless access to on-line resources, more attention needs to be paid to ensuring the quality and completeness of those resources. For example, data produced by telescopes are not always made available to the astronomical community, and new instruments are sometimes designed and built with insufficient planning for data management, while older but valuable legacy data often remain undigitised. Data and results published in journals do not always appear in the data centres, and astronomers in develo** countries sometimes have inadequate access to on-line resources. To address these issues, an 'Astronomers Data Manifesto' has been formulated with the aim of initiating a discussion that will lead to the development of a 'code of best practice' in astronomical data management.
△ Less
Submitted 1 November, 2006;
originally announced November 2006.
-
SDSS AGNs with X-ray Emission from ROSAT PSPC Pointed Observations
Authors:
A. A. Suchkov,
R. J. Hanisch,
W. Voges,
T. M. Heckman
Abstract:
We present a sample of 1744 type 1 active galactic nuclei (AGNs) from the Sloan Digital Sky Survey (SDSS DR4) spectroscopic catalog with X-ray counterparts in the White-Giommi-Angelini Catalog (WGACAT) of ROSAT PSPC pointed observations. Of 1744 X-ray sources, 1410 (80.9%) are new AGN identifications. Of 4574 SDSS DR4 AGNs for which we found radio matches in the catalog of radio sources from the…
▽ More
We present a sample of 1744 type 1 active galactic nuclei (AGNs) from the Sloan Digital Sky Survey (SDSS DR4) spectroscopic catalog with X-ray counterparts in the White-Giommi-Angelini Catalog (WGACAT) of ROSAT PSPC pointed observations. Of 1744 X-ray sources, 1410 (80.9%) are new AGN identifications. Of 4574 SDSS DR4 AGNs for which we found radio matches in the catalog of radio sources from the FIRST catalog, 224 turned up in our sample of SDSS X-ray AGNs. The sample objects are given in a catalog that contains optical and X-ray parameters along with radio emission parameters where available. We illustrate the content of our catalog and its potential for AGN science by providing statistical relationships for the catalog data. The potential of the morphological information is emphasized by confronting the statistics of optically resolved and unresolved AGNs. The immediate properties of the catalog objects include significant correlation of X-ray and optical fluxes, which is consistent with expectations. Also expected is the decrease of X-ray flux toward higher redshifts. The X-ray to optical flux ratio for the unresolved AGNs exhibits a decline toward higher redshifts, in agreement with previous results. The resolved AGNs, however, display the opposite trend. At a given optical brightness, X-ray fluxes of radio-quiet AGNs by a factor of 2. We caution, however, that because of the variety of selection effects present in both the WGACAT and the SDSS, the interpretation of any relationships based on our sample of X-ray AGNs requires a careful analysis of these effects.
△ Less
Submitted 8 September, 2006;
originally announced September 2006.
-
A Census of Object Types and Redshift Estimates in the SDSS Photometric Catalog from a Trained Decision-Tree Classifier
Authors:
A. A. Suchkov,
R. J. Hanisch,
Bruce Margon
Abstract:
We have applied ClassX, an oblique decision tree classifier optimized for astronomical analysis, to the homogeneous multicolor imaging data base of the Sloan Digital Sky Survey (SDSS), training the software on subsets of SDSS objects whose nature is precisely known via spectroscopy. We find that the software, using photometric data only, correctly classifies a very large fraction of the objects…
▽ More
We have applied ClassX, an oblique decision tree classifier optimized for astronomical analysis, to the homogeneous multicolor imaging data base of the Sloan Digital Sky Survey (SDSS), training the software on subsets of SDSS objects whose nature is precisely known via spectroscopy. We find that the software, using photometric data only, correctly classifies a very large fraction of the objects with existing SDSS spectra, both stellar and extragalactic. ClassX also accurately predicts the redshifts of both normal and active galaxies in SDSS. To illustrate ClassX applications in SDSS research, we (a) derive the object content of the SDSS DR2 photometric catalog and (b) provide a sample catalog of resolved SDSS objects that contains a large number of candidate AGN galaxies, 27,000, along with 63,000 candidate normal galaxies at magnitudes substantially fainter than typical magnitudes of SDSS spectroscopic objects. The surface density of AGN selected by ClassX to i~19 is in agreement with that quoted by SDSS. When ClassX is applied to the photometric data fainter than the SDSS spectroscopic limit, the inferred surface density of AGN rises sharply, as expected. The ability of the classifier to accurately constrain the redshifts of huge numbers (ultimately ~ 10^7) of active galaxies in the photometric data base promises new insights into fundamental issues of AGN research, such as the evolution of the AGN luminosity function with cosmic time, the starburst--AGN connection, and AGN--galactic morphology relationships.
△ Less
Submitted 23 August, 2005;
originally announced August 2005.
-
Automated object classification with ClassX
Authors:
A. A. Suchkov,
T. A. McGlynn,
L. Angelini,
M. F. Corcoran,
S. A. Drake,
W. D. Pence,
N. White,
E. L. Winter,
R. J. Hanisch,
R. L. White,
M. Postman,
M. E. Donahue,
F. Genova,
F. Ochsenbein,
P. Fernique,
S. Derriere
Abstract:
ClassX is a project aimed at creating an automated system to classify X-ray sources and is envisaged as a prototype of the Virtual Observatory. As a system, ClassX integrates into a pipeline a network of classifiers and an engine that searches and retrieves for a given target multi-wavelength counterparts from the worldwide data storage media. It applies machine learning methods to `train' diffe…
▽ More
ClassX is a project aimed at creating an automated system to classify X-ray sources and is envisaged as a prototype of the Virtual Observatory. As a system, ClassX integrates into a pipeline a network of classifiers and an engine that searches and retrieves for a given target multi-wavelength counterparts from the worldwide data storage media. It applies machine learning methods to `train' different classifiers using different `training' data sets. In ClassX, each classifier can make its own class (object type) assignment and is optimized for handling different tasks and/or different object types. A user would generally select a certain classifier to make, for instance, a most complete list of candidate QSOs, but a different classifier would be used to make a most reliable list of candidate QSOs. Still different classifiers would be selected to make similar lists for other object types. Along with the class name assignment, a network classifier outputs the probability for a source to belong to the assigned class as well as probabilities that the source belongs in fact to other classes. We illustrate the current capabilities of ClassX and the concept of a classifiers network with the results obtained with classifiers trained using ROSAT data. ~
△ Less
Submitted 17 October, 2002;
originally announced October 2002.
-
Imaging of z~2 QSO host galaxies with the Hubble Space Telescope
Authors:
J. B. Hutchings,
D. Frenette,
R. Hanisch,
J. Mo,
P. J. Dumont,
D. C. Redding,
S. G. Neff
Abstract:
We report on deep imaging in 2 filters with the PC2 camera of HST, of five QSOs at redshift ~2, with a range of optical and radio luminosity. The observations included a suite of PSF observations which were used to construct new PSF models, described elsewhere by Dumont et al. The new PSF models were used to remove the QSO nucleus from the images. We find that the host galaxies have resolved flu…
▽ More
We report on deep imaging in 2 filters with the PC2 camera of HST, of five QSOs at redshift ~2, with a range of optical and radio luminosity. The observations included a suite of PSF observations which were used to construct new PSF models, described elsewhere by Dumont et al. The new PSF models were used to remove the QSO nucleus from the images. We find that the host galaxies have resolved flux of order 10% of the QSO nuclei, and are generally luminous and blue, indicating active star-formation. While most have clearly irregular morphologies, the bulk of the flux can be modelled approximately by an r**1/4 law. However, all host galaxies also have an additional approximately exponential luminosity profile beyond a radius about 0.8 arcsec, as also seen in ground-based data with larger telescopes. The QSOs all have a number of nearby faint blue companions which may be young galaxies at the QSO redshift. We discuss implications for evolution of the host galaxies, their spheroidal populations, and central black holes.
△ Less
Submitted 21 February, 2002;
originally announced February 2002.
-
Validation of Up-the-Ramp Sampling with Cosmic Ray Rejection on IR Detectors
Authors:
J. D. Offenberg,
D. J. Fixsen,
B. J. Rauscher,
W. J. Forrest,
R. J. Hanisch,
J. C. Mather,
M. E. McKelvey,
R. E. McMurray,
M. A. Nieto-Santisteban,
J. L. Pipher,
R. Sengupta,
H. S. Stockman
Abstract:
We examine cosmic ray rejection methodology on data collected from InSb and Si:As detectors. The application of an Up-the-Ramp sampling technique with cosmic ray identification and mitigation is the focus of this study. This technique is valuable for space-based observatories which are exposed to high-radiation environments. We validate the Up-the-Ramp approach on radiation-test data sets with I…
▽ More
We examine cosmic ray rejection methodology on data collected from InSb and Si:As detectors. The application of an Up-the-Ramp sampling technique with cosmic ray identification and mitigation is the focus of this study. This technique is valuable for space-based observatories which are exposed to high-radiation environments. We validate the Up-the-Ramp approach on radiation-test data sets with InSb and Si:As detectors which were generated for SIRTF. The Up-the-Ramp sampling method studied in this paper is over 99.9% effective at removing cosmic rays and preserves the structure and photometric quality of the image to well within the measurement error.
△ Less
Submitted 25 October, 2000; v1 submitted 17 August, 2000;
originally announced August 2000.
-
Cosmic Ray Rejection and Readout Efficiency for Large-Area Arrays
Authors:
D. J. Fixsen,
J. D. Offenberg,
R. J. Hanisch,
J. C. Mather,
M. A. Nieto-Santisteban,
R. Sengupta,
H. S. Stockman
Abstract:
We present an algorithm to optimally process uniformly sampled array image data obtained with a nondestructive readout. The algorithm discards full wells, removes cosmic ray (particle) hits and other glitches, and makes a nearly optimum estimate of the signal on each pixel. The algorithm also compresses the data. The computer requirements are modest, and the results are robust. The results are s…
▽ More
We present an algorithm to optimally process uniformly sampled array image data obtained with a nondestructive readout. The algorithm discards full wells, removes cosmic ray (particle) hits and other glitches, and makes a nearly optimum estimate of the signal on each pixel. The algorithm also compresses the data. The computer requirements are modest, and the results are robust. The results are shown and compared to results of Fowler sampled and processed data. Non-ideal detector performance may require some additional code, but this is not expected to cost much processing time. Known types of detector faults are addressed.
△ Less
Submitted 24 May, 2000;
originally announced May 2000.
-
Multi-Read Out Data Simulator
Authors:
J. D. Offenberg,
R. J. Hanisch,
D. J. Fixsen,
H. S. Stockman,
M. A. Nieto-Santisteban,
R. Sengupta,
J. C. Mather
Abstract:
We present a data simulation package designed to create a series of simulated data samples for a detector with non-destructive sampling capability. The original intent of this software was to provide a method for generating simulated images for the Next Generation Space Telescope, but it is general enough to apply to almost any non-destructive detector or instrument. MultiDataSim can be used to…
▽ More
We present a data simulation package designed to create a series of simulated data samples for a detector with non-destructive sampling capability. The original intent of this software was to provide a method for generating simulated images for the Next Generation Space Telescope, but it is general enough to apply to almost any non-destructive detector or instrument. MultiDataSim can be used to generate "practice" sampling strategies for an instrument or field-of-view, and thus can be used to identify optimal observation strategies.
△ Less
Submitted 19 May, 2000;
originally announced May 2000.
-
Search and Discovery Tools for Astronomical On-line Resources and Services
Authors:
Daniel Egret,
Robert J. Hanisch,
Fionn Murtagh
Abstract:
A growing number of astronomical resources and data or information services are made available through the Internet. However valuable information is frequently hidden in a deluge of non-pertinent or non up-to-date documents. At a first level, compilations of astronomical resources provide help for selecting relevant sites. Combining yellow-page services and meta-databases of active pointers may…
▽ More
A growing number of astronomical resources and data or information services are made available through the Internet. However valuable information is frequently hidden in a deluge of non-pertinent or non up-to-date documents. At a first level, compilations of astronomical resources provide help for selecting relevant sites. Combining yellow-page services and meta-databases of active pointers may be an efficient solution to the data retrieval problem. Responses generated by submission of queries to a set of heterogeneous resources are difficult to merge or cross-match, because different data providers generally use different data formats: new endeavors are under way to tackle this problem. We review the technical challenges involved in trying to provide general search and discovery tools, and to integrate them through upper level interfaces.
△ Less
Submitted 4 February, 2000;
originally announced February 2000.
-
Cosmic Ray Rejection and Image Processing Aboard The Next Generation Space Telescope
Authors:
H. S. Stockman,
D. Fixsen,
R. Hanisch,
J. C. Mather,
M. Nieto-Santisteban,
J. D. Offenberg,
R. Sengupta,
S. Stallcup
Abstract:
The NASA Yardstick design for the Integrated Science Instrument Module (ISIM) utilizes 64 1k x 1k InSb imagers. Since multiple readouts per image are required to remove cosmic ray events and to reduce the readout noise, the implied downlink rates can approach 0.7 Tbytes per day. These would exceed the downlink capabilities of RF links from L2 or more distant orbits. Some form of on-board data an…
▽ More
The NASA Yardstick design for the Integrated Science Instrument Module (ISIM) utilizes 64 1k x 1k InSb imagers. Since multiple readouts per image are required to remove cosmic ray events and to reduce the readout noise, the implied downlink rates can approach 0.7 Tbytes per day. These would exceed the downlink capabilities of RF links from L2 or more distant orbits. Some form of on-board data analysis and compression is mandatory: a factor of 100 compression for an L2 orbit, factors of 1000-10000 for a 1 AU drift-away or 1 x 3 AU elliptical orbit.
Supported by funding from JPL to study the uses of low-cost, on- board parallel processors, we are studying algorithms and architectures to perform cosmic-ray rejection and lossless compression of the NIR images, while optimizing the resulting signal- to-noise.
△ Less
Submitted 14 August, 1998; v1 submitted 6 August, 1998;
originally announced August 1998.
-
Network Resources for Astronomers
Authors:
H. Andernach,
R. J. Hanisch,
F. Murtagh
Abstract:
The amount of data produced by large observational facilities and space missions has led to the archiving and on-line accessibility of much of this data, available to the entire astronomical community. This allows a much wider multi-frequency approach to astronomical research than previously possible. Here we provide an overview of these services, and give a basic description of their contents a…
▽ More
The amount of data produced by large observational facilities and space missions has led to the archiving and on-line accessibility of much of this data, available to the entire astronomical community. This allows a much wider multi-frequency approach to astronomical research than previously possible. Here we provide an overview of these services, and give a basic description of their contents and possibilities for accessing them. Apart from services providing observational data, many of those providing general information, e.g. on addresses, bibliographies, software etc. are also described. The field is rapidly growing with improved network technology, and our attempt to keep the report as complete and up-to-date as possible will inevitably be outdated shortly. We will endeavor to maintain an updated version of this document on-line.
△ Less
Submitted 7 November, 1994;
originally announced November 1994.
