Showing 1–39 of 39 results for author: Wicenec, A

Supervised Radio Frequency Interference Detection with SNNs

Authors: Nicholas J. Pritchard, Andreas Wicenec, Mohammed Bennamoun, Richard Dodson

Abstract: Radio Frequency Interference (RFI) poses a significant challenge in radio astronomy, arising from terrestrial and celestial sources, disrupting observations conducted by radio telescopes. Addressing RFI involves intricate heuristic algorithms, manual examination, and, increasingly, machine learning methods. Given the dynamic and temporal nature of radio astronomy observations, Spiking Neural Netwo… ▽ More Radio Frequency Interference (RFI) poses a significant challenge in radio astronomy, arising from terrestrial and celestial sources, disrupting observations conducted by radio telescopes. Addressing RFI involves intricate heuristic algorithms, manual examination, and, increasingly, machine learning methods. Given the dynamic and temporal nature of radio astronomy observations, Spiking Neural Networks (SNNs) emerge as a promising approach. In this study, we cast RFI detection as a supervised multi-variate time-series segmentation problem. Notably, our investigation explores the encoding of radio astronomy visibility data for SNN inference, considering six encoding schemes: rate, latency, delta-modulation, and three variations of the step-forward algorithm. We train a small two-layer fully connected SNN on simulated data derived from the Hydrogen Epoch of Reionization Array (HERA) telescope and perform extensive hyper-parameter optimization. Results reveal that latency encoding exhibits superior performance, achieving a per-pixel accuracy of 98.8% and an f1-score of 0.761. Remarkably, these metrics approach those of contemporary RFI detection algorithms, notwithstanding the simplicity and compactness of our proposed network architecture. This study underscores the potential of RFI detection as a benchmark problem for SNN researchers, emphasizing the efficacy of SNNs in addressing complex time-series segmentation tasks in radio astronomy. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: 7 pages, 2 figures, 4 tables. International Conference on Neuromorphic Systems (ICONS) 2024, Accepted

Formal Definition and Implementation of Reproducibility Tenets for Computational Workflows

Authors: Nicholas J. Pritchard, Andreas Wicenec

Abstract: Computational workflow management systems power contemporary data-intensive sciences. The slowly resolving reproducibility crisis presents both a sobering warning and an opportunity to iterate on what science and data processing entails. The Square Kilometre Array (SKA), the world's largest radio telescope, is among the most extensive scientific projects underway and presents grand scientific coll… ▽ More Computational workflow management systems power contemporary data-intensive sciences. The slowly resolving reproducibility crisis presents both a sobering warning and an opportunity to iterate on what science and data processing entails. The Square Kilometre Array (SKA), the world's largest radio telescope, is among the most extensive scientific projects underway and presents grand scientific collaboration and data-processing challenges. This work presents a scale and system-agnostic computational workflow model and extends five well-known reproducibility tenets into seven defined for our workflow model. Subsequent implementation of these definitions, powered by blockchain primitives, into the Data Activated Flow Graph Engine (DALiuGE), a workflow management system for the SKA, demonstrates the possibility of facilitating automatic formal verification of scientific quality in amortized constant time. We validate our approach with a simple yet representative astronomical processing task; filtering a noisy signal with a lowpass filter with both CPU and GPU methods. Our framework illuminates otherwise obscure scientific discrepancies and similarities between principally identical workflow executions. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 15 pages, 3 figures, 5 tables. Submitted to Elsevier

RFI Detection with Spiking Neural Networks

Authors: Nicholas J. Pritchard, Andreas Wicenec, Mohammed Bennamoun, Richard Dodson

Abstract: Detecting and mitigating Radio Frequency Interference (RFI) is critical for enabling and maximising the scientific output of radio telescopes. The emergence of machine learning methods has led to their application in radio astronomy, and in RFI detection. Spiking Neural Networks (SNNs), inspired by biological systems, are well-suited for processing spatio-temporal data. This study introduces the f… ▽ More Detecting and mitigating Radio Frequency Interference (RFI) is critical for enabling and maximising the scientific output of radio telescopes. The emergence of machine learning methods has led to their application in radio astronomy, and in RFI detection. Spiking Neural Networks (SNNs), inspired by biological systems, are well-suited for processing spatio-temporal data. This study introduces the first exploratory application of SNNs to an astronomical data-processing task, specifically RFI detection. We adapt the nearest-latent-neighbours (NLN) algorithm and auto-encoder architecture proposed by previous authors to SNN execution by direct ANN2SNN conversion, enabling simplified downstream RFI detection by sampling the naturally varying latent space from the internal spiking neurons. Our subsequent evaluation aims to determine whether SNNs are viable for future RFI detection schemes. We evaluate detection performance with the simulated HERA telescope and hand-labelled LOFAR observation dataset the original authors provided. We additionally evaluate detection performance with a new MeerKAT-inspired simulation dataset that provides a technical challenge for machine-learnt RFI detection methods. This dataset focuses on satellite-based RFI, an increasingly important class of RFI and is an additional contribution. Our approach remains competitive with existing methods in AUROC, AUPRC and F1 scores for the HERA dataset but exhibits difficulty in the LOFAR and Tabascal datasets. Our method maintains this accuracy while completely removing the compute and memory-intense latent sampling step found in NLN. This work demonstrates the viability of SNNs as a promising avenue for machine-learning-based RFI detection in radio telescopes by establishing a minimal performance baseline on traditional and nascent satellite-based RFI sources and is the first work to our knowledge to apply SNNs in astronomy. △ Less

Submitted 22 March, 2024; v1 submitted 24 November, 2023; originally announced November 2023.

Comments: 11 pages, 5 figures, 5 tables. Accepted for publication in PASA

Detection of Binary Black Hole Mergers from the Signal-to-Noise Ratio Time Series Using Deep Learning

Authors: Damon Beveridge, Linqing Wen, Andreas Wicenec

Abstract: Gravitational wave detection has opened up new avenues for exploring and understanding some of the fundamental principles of the universe. The optimal method for detecting modelled gravitational-wave events involves template-based matched filtering and doing a multi-detector search in the resulting signal-to-noise ratio time series. In recent years, advancements in machine learning and deep learni… ▽ More Gravitational wave detection has opened up new avenues for exploring and understanding some of the fundamental principles of the universe. The optimal method for detecting modelled gravitational-wave events involves template-based matched filtering and doing a multi-detector search in the resulting signal-to-noise ratio time series. In recent years, advancements in machine learning and deep learning have led to a flurry of research into using these techniques to replace matched filtering searches and for efficient and robust parameter estimation. This paper presents a novel approach that utilizes deep learning techniques to detect gravitational waves from the signal-to-noise ratio time series produced from matched filtering. We do this to investigate if an efficient deep-learning model could replace the computationally expensive post-processing in current search pipelines. We present a feasibility study where we look to detect gravitational waves from binary black hole mergers in simulated stationary Gaussian noise from the LIGO detector in Hanford, Washington. We show that our model can match the performance of a single-detector matched filtering search and that the ranking statistic from the output of our model was robust over unseen noise, exhibiting promising results for practical online implementation in the future. We discuss the possible implications of this work and its future applications to gravitational-wave detection. △ Less

Submitted 17 August, 2023; v1 submitted 16 August, 2023; originally announced August 2023.

Comments: 9 pages, 4 figures

A Bibliometric Review of Neuromorphic Computing and Spiking Neural Networks

Authors: Nicholas J. Pritchard, Andreas Wicenec, Mohammed Bennamoun, Richard Dodson

Abstract: Neuromorphic computing and spiking neural networks aim to leverage biological inspiration to achieve greater energy efficiency and computational power beyond traditional von Neumann architectured machines. In particular, spiking neural networks hold the potential to advance artificial intelligence as the basis of third-generation neural networks. Aided by developments in memristive and compute-in-… ▽ More Neuromorphic computing and spiking neural networks aim to leverage biological inspiration to achieve greater energy efficiency and computational power beyond traditional von Neumann architectured machines. In particular, spiking neural networks hold the potential to advance artificial intelligence as the basis of third-generation neural networks. Aided by developments in memristive and compute-in-memory technologies, neuromorphic computing hardware is transitioning from laboratory prototype devices to commercial chipsets; ushering in an era of low-power computing. As a nexus of biological, computing, and material sciences, the literature surrounding these concepts is vast, varied, and somewhat distinct from artificial neural network sources. This article uses bibliometric analysis to survey the last 22 years of literature, seeking to establish trends in publication and citation volumes (III-A); analyze impactful authors, journals and institutions (III-B); generate an introductory reading list (III-C); survey collaborations between countries, institutes and authors (III-D), and to analyze changes in research topics over the years (III-E). We analyze literature data from the Clarivate Web of Science using standard bibliometric methods. By briefly introducing the most impactful literature in this field from the last two decades, we encourage AI practitioners and researchers to look beyond contemporary technologies toward a potentially spiking future of computing. △ Less

Submitted 13 April, 2023; originally announced April 2023.

Comments: 8 pages, 4 figures

ACM Class: A.1

Radio Transient Detection with Closure Products and Machine Learning

Authors: Xia Zhang, Foivos I. Diakogiannis, Richard Dodson, Andreas Wicenec

Abstract: For transient sources with timescales of 1-100 seconds, standardized imaging for all observations at each time step become impossible as large modern interferometers produce significantly large data volumes in this observation time frame. Here we propose a method based on machine learning and using interferometric closure products as input features to detect transient source candidates directly fr… ▽ More For transient sources with timescales of 1-100 seconds, standardized imaging for all observations at each time step become impossible as large modern interferometers produce significantly large data volumes in this observation time frame. Here we propose a method based on machine learning and using interferometric closure products as input features to detect transient source candidates directly from the spatial frequency domain without imaging. We train a simple neural network classifier on a synthetic dataset of Noise/Transient/RFI events, which we construct to tackle the lack of labelled data. We also use the hyper-parameter dropout rate of the model to allow the model to approximate Bayesian inference, and select the optimal dropout rate to match the posterior prediction to the actual underlying probability distribution of the detected events. The overall F1-score of the classifier on the simulated dataset is greater than 85\%, with the signal-to-noise at 7$σ$. The performance of the trained neural network with Monte Carlo dropout is evaluated on semi-real data, which includes a simulated transient source and real noise. This classifier accurately identifies the presence of transient signals in the detectable signal-to-noise levels (above 4$σ$) with the optimal variance. Our findings suggest that a feasible radio transient classifier can be built up with only simulated data for applying to the prediction of real observation, even in the absence of annotated real samples for the purpose of training. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Comments: 16 pages, 8 figures, to appear in AJ

An Empirical Evaluation On the Applicability of the DALiuGE Execution Framework

Authors: Ying Mei, Shoulin Wei, Feng Wang, Chen Wu, Rodrigo Tobar, Mohsim Shaikh, Hui Deng, Wei Dai, Bo Liang, Andreas Wicenec

Abstract: The Square Kilometre Array (SKA) project is an international cooperation project to build the largest radio telescope worldwide. Data processing is one of the biggest challenges of building the SKA telescope. As a distributed execution framework, the Data Activated Liu Graph Engine (DALiuGE) was proposed to be one of the candidates for addressing the massive data of the SKA. DALiuGE has many disti… ▽ More The Square Kilometre Array (SKA) project is an international cooperation project to build the largest radio telescope worldwide. Data processing is one of the biggest challenges of building the SKA telescope. As a distributed execution framework, the Data Activated Liu Graph Engine (DALiuGE) was proposed to be one of the candidates for addressing the massive data of the SKA. DALiuGE has many distinctive features, but its actual ability to handle scientific data is still not evident. In this paper, we perform an objective evaluation of the usability of DALiuGE concerning the execution performance, developer workload, and implementation difficulty of porting the SAGECal to DALiuGE. The evaluation results showed that the DALiuGE enables fast integration of astronomical software, but there are significant differences in the efficiency of different parallel granularities. Even with the deep optimization of the program, there is still a gap between the current DALiuGE and the traditional MPI in execution performance. Therefore, we come to a preliminary conclusion that the DALiuGE has no performance advantage in batch processing of massive data, while it may be more suitable for application scenarios with more customized computational tasks, such as SKA science regional centers. △ Less

Submitted 24 December, 2021; originally announced December 2021.

Comments: 13 pages, 7 figures Accepted by Astronomy And Computing

Enhanced Remote Astronomical Archive System Based on the File-Level Unlimited Sliding-Window Technique

Authors: Cong-Ming Shi, Hui Deng, Feng Wang, Ying Mei, Shao-Guang Guo, Chen Yang, Chen Wu, Shou-Lin Wei, Andreas Wicenec

Abstract: Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-contro… ▽ More Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-control method in TCP protocol. Basing on the USW and the Next Generation Archive System (NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system (ENGAS) using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array (SKA) Science Regional Center. △ Less

Submitted 24 June, 2021; originally announced June 2021.

Comments: 11 pages, 10 figures

SKA shakes hands with Summit

Authors: Ruonan Wang, Andreas Wicenec, Tao An

Abstract: Recently, a full-scale data processing workflow of the Square Kilometre Array (SKA) Phase 1 was successfully executed on the world's fastest supercomputer Summit, proving that scientists have the expertise, software tools and computing resources to process the SKA data. The SKA-Summit experiment shows the importance of multidisciplinary cooperation between astronomy, computer science and others co… ▽ More Recently, a full-scale data processing workflow of the Square Kilometre Array (SKA) Phase 1 was successfully executed on the world's fastest supercomputer Summit, proving that scientists have the expertise, software tools and computing resources to process the SKA data. The SKA-Summit experiment shows the importance of multidisciplinary cooperation between astronomy, computer science and others communities. The SKA science cannot be achieved without the joint efforts of talents from multiple fields. △ Less

Submitted 29 December, 2019; originally announced December 2019.

Comments: Published in Science Bulletin

Journal ref: Science Bulletin Volume 65, Issue 5, Pages 337-339 (2019)

CHILES: HI morphology and galaxy environment at z=0.12 and z=0.17

Authors: Kelley M. Hess, Nicholas M. Luber, Ximena Fernández, Hansung B. Gim, J. H. van Gorkom, Emmanuel Momjian, Julia Gross, Martin Meyer, Attila Pop**, Luke J. M. Davies, Lucas Hunt, Kathryn Kreckel, Danielle Lucero, D. J. Pisano, Monica Sanchez-Barrantes, Min S. Yun, Richard Dodson, Kevin Vinsen, Andreas Wicenec, Chen Wu, Matthew A. Bershady, Aeree Chung, Julie D. Davis, Jennifer Donovan Meyer, Patricia Henning , et al. (5 additional authors not shown)

Abstract: We present a study of 16 HI-detected galaxies found in 178 hours of observations from Epoch 1 of the COSMOS HI Large Extragalactic Survey (CHILES). We focus on two redshift ranges between 0.108 <= z <= 0.127 and 0.162 <= z <= 0.183 which are among the worst affected by radio frequency interference (RFI). While this represents only 10% of the total frequency coverage and 18% of the total expected t… ▽ More We present a study of 16 HI-detected galaxies found in 178 hours of observations from Epoch 1 of the COSMOS HI Large Extragalactic Survey (CHILES). We focus on two redshift ranges between 0.108 <= z <= 0.127 and 0.162 <= z <= 0.183 which are among the worst affected by radio frequency interference (RFI). While this represents only 10% of the total frequency coverage and 18% of the total expected time on source compared to what will be the full CHILES survey, we demonstrate that our data reduction pipeline recovers high quality data even in regions severely impacted by RFI. We report on our in-depth testing of an automated spectral line source finder to produce HI total intensity maps which we present side-by-side with significance maps to evaluate the reliability of the morphology recovered by the source finder. We recommend that this become a common place manner of presenting data from upcoming HI surveys of resolved objects. We use the COSMOS 20k group catalogue, and we extract filamentary structure using the topological DisPerSE algorithm to evaluate the \hi\ morphology in the context of both local and large-scale environments and we discuss the shortcomings of both methods. Many of the detections show disturbed HI morphologies suggesting they have undergone a recent interaction which is not evident from deep optical imaging alone. Overall, the sample showcases the broad range of ways in which galaxies interact with their environment. This is a first look at the population of galaxies and their local and large-scale environments observed in HI by CHILES at redshifts beyond the z=0.1 Universe. △ Less

Submitted 28 November, 2018; originally announced November 2018.

Comments: 23 pages, 12 figures, 1 interactive 3D figure, accepted to MNRAS

Partitioning SKA Dataflows for Optimal Graph Execution

Authors: Chen Wu, Andreas Wicenec, Rodrigo Tobar

Abstract: Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the next few decades. At the core of the SKA Science Data Processor is the graph execution engine, scheduling tens of thousands of algorithmic components to ingest a… ▽ More Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the next few decades. At the core of the SKA Science Data Processor is the graph execution engine, scheduling tens of thousands of algorithmic components to ingest and transform millions of parallel data chunks in order to solve a series of large-scale inverse problems within the power budget. To tackle this challenge, we have developed the Data Activated Liu Graph Engine (DALiuGE) to manage data processing pipelines for several SKA pathfinder projects. In this paper, we discuss the DALiuGE graph scheduling sub-system. By extending previous studies on graph scheduling and partitioning, we lay the foundation on which we can develop polynomial time optimization methods that minimize both workflow execution time and resource footprint while satisfying resource constraints imposed by individual algorithms. We show preliminary results obtained from three radio astronomy data pipelines. △ Less

Submitted 19 May, 2018; originally announced May 2018.

Comments: Accepted in HPDC ScienceCloud 2018 Workshop

AdiosStMan: Parallelizing Casacore Table Data System Using Adaptive IO System

Authors: Ruonan Wang, Christopher Harris, Andreas Wicenec

Abstract: In this paper, we investigate the Casacore Table Data System (CTDS) used in the casacore and CASA libraries, and methods to parallelize it. CTDS provides a storage manager plugin mechanism for third-party devel- opers to design and implement their own CTDS storage managers. Hav- ing this in mind, we looked into various storage backend techniques that can possibly enable parallel I/O for CTDS by im… ▽ More In this paper, we investigate the Casacore Table Data System (CTDS) used in the casacore and CASA libraries, and methods to parallelize it. CTDS provides a storage manager plugin mechanism for third-party devel- opers to design and implement their own CTDS storage managers. Hav- ing this in mind, we looked into various storage backend techniques that can possibly enable parallel I/O for CTDS by implementing new storage managers. After carrying on benchmarks showing the excellent parallel I/O throughput of the Adaptive IO System (ADIOS), we implemented an ADIOS based parallel CTDS storage manager. We then applied the CASA MSTransform frequency split task to verify the ADIOS Storage Manager. We also ran a series of performance tests to examine the I/O throughput in a massively parallel scenario. △ Less

Submitted 27 March, 2017; originally announced March 2017.

Comments: 20 pages, journal article, 2016

Journal ref: Astronomy and Computing, Volume 16, July 2016, Pages 146-154, ISSN 2213-1337

DALiuGE: A Graph Execution Framework for Harnessing the Astronomical Data Deluge

Authors: Chen Wu, Rodrigo Tobar, Kevin Vinsen, Andreas Wicenec, Dave Pallot, Baoqiang Lao, Ruonan Wang, Tao An, Mark Boulton, Ian Cooper, Richard Dodson, Markus Dolensky, Ying Mei, Feng Wang

Abstract: The Data Activated Liu Graph Engine - DALiuGE - is an execution framework for processing large astronomical datasets at a scale required by the Square Kilometre Array Phase 1 (SKA1). It includes an interface for expressing complex data reduction pipelines consisting of both data sets and algorithmic components and an implementation run-time to execute such pipelines on distributed resources. By ma… ▽ More The Data Activated Liu Graph Engine - DALiuGE - is an execution framework for processing large astronomical datasets at a scale required by the Square Kilometre Array Phase 1 (SKA1). It includes an interface for expressing complex data reduction pipelines consisting of both data sets and algorithmic components and an implementation run-time to execute such pipelines on distributed resources. By map** the logical view of a pipeline to its physical realisation, DALiuGE separates the concerns of multiple stakeholders, allowing them to collectively optimise large-scale data processing solutions in a coherent manner. The execution in DALiuGE is data-activated, where each individual data item autonomously triggers the processing on itself. Such decentralisation also makes the execution framework very scalable and flexible, supporting pipeline sizes ranging from less than ten tasks running on a laptop to tens of millions of concurrent tasks on the second fastest supercomputer in the world. DALiuGE has been used in production for reducing interferometry data sets from the Karl E. Jansky Very Large Array and the Mingantu Ultrawide Spectral Radioheliograph; and is being developed as the execution framework prototype for the Science Data Processor (SDP) consortium of the Square Kilometre Array (SKA) telescope. This paper presents a technical overview of DALiuGE and discusses case studies from the CHILES and MUSER projects that use DALiuGE to execute production pipelines. In a companion paper, we provide in-depth analysis of DALiuGE's scalability to very large numbers of tasks on two supercomputing facilities. △ Less

Submitted 24 February, 2017; originally announced February 2017.

Comments: 31 pages, 12 figures, currently under review by Astronomy and Computing

Highest Redshift Image of Neutral Hydrogen in Emission: A CHILES Detection of a Starbursting Galaxy at z=0.376

Authors: Ximena Fernández, Hansung B. Gim, J. H. van Gorkom, Min S. Yun, Emmanuel Momjian, Attila Pop**, Laura Chomiuk, Kelley M. Hess, Lucas Hunt, Kathryn Kreckel, Danielle Lucero, Natasha Maddox, Tom Oosterloo, D. J. Pisano, M. A. W. Verheijen, Christopher A. Hales, Aeree Chung, Richard Dodson, Kumar Golap, Julia Gross, Patricia Henning, John Hibbard, Yara L. Jaffé, Jennifer Donovan Meyer, Martin Meyer , et al. (10 additional authors not shown)

Abstract: Our current understanding of galaxy evolution still has many uncertainties associated with the details of accretion, processing, and removal of gas across cosmic time. The next generation of radio telescopes will image the neutral hydrogen (HI) in galaxies over large volumes at high redshifts, which will provide key insights into these processes. We are conducting the COSMOS HI Large Extragalactic… ▽ More Our current understanding of galaxy evolution still has many uncertainties associated with the details of accretion, processing, and removal of gas across cosmic time. The next generation of radio telescopes will image the neutral hydrogen (HI) in galaxies over large volumes at high redshifts, which will provide key insights into these processes. We are conducting the COSMOS HI Large Extragalactic Survey (CHILES) with the Karl G. Jansky Very Large Array, which is the first survey to simultaneously observe HI from z=0 to z~0.5. Here, we report the highest redshift HI 21-cm detection in emission to date of the luminous infrared galaxy (LIRG) COSMOS J100054.83+023126.2 at z=0.376 with the first 178 hours of CHILES data. The total HI mass is $(2.9\pm1.0)\times10^{10}~M_\odot$, and the spatial distribution is asymmetric and extends beyond the galaxy. While optically the galaxy looks undisturbed, the HI distribution suggests an interaction with candidate a candidate companion. In addition, we present follow-up Large Millimeter Telescope CO observations that show it is rich in molecular hydrogen, with a range of possible masses of $(1.8-9.9)\times10^{10}~M_\odot$. This is the first study of the HI and CO in emission for a single galaxy beyond z~0.2. △ Less

Submitted 31 May, 2016; originally announced June 2016.

Comments: 7 pages, 5 figures, accepted for publication in ApJL

Imaging SKA-Scale data in three different computing environments

Authors: Richard Dodson, Kevin Vinsen, Chen Wu, Attila Pop**, Martin Meyer, Andreas Wicenec, Peter Quinn, Jacqueline van Gorkom, Emmanuel Momjian

Abstract: We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. W… ▽ More We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. We have tested three platforms: a moderately sized cluster, a massive High Performance Computing (HPC) system, and the Amazon Web Services (AWS) cloud computing platform. We have used well-established tools for data reduction and performance measurement to investigate the behaviour of these platforms for the complicated access patterns of real-life Radio Astronomy data reduction. All of these platforms have strengths and weaknesses and the system tools allow us to identify and evaluate them in a quantitative manner. With the insights from these tests we are able to complete the imaging pipeline processing on both the HPC platform and also on the cloud computing platform, which paves the way for meeting big data challenges in the era of SKA in the field of Radio Astronomy. We discuss the implications that all similar projects will have to consider, in both performance and costs, to make recommendations for the planning of Radio Astronomy imaging workflows. △ Less

Submitted 2 November, 2015; originally announced November 2015.

Comments: Accepted Astronomy and Computing

Delivering SKA Science

Authors: Peter Quinn, Tim Axelrod, Ian Bird, Richard Dodson, Alex Szalay, Andreas Wicenec

Abstract: The SKA will be capable of producing a stream of science data products that are Exa-scale in terms of their storage and processing requirements. This Google-scale enterprise is attracting considerable international interest and excitement from within the industrial and academic communities. In this chapter we examine the data flow, storage and processing requirements of a number of key SKA survey… ▽ More The SKA will be capable of producing a stream of science data products that are Exa-scale in terms of their storage and processing requirements. This Google-scale enterprise is attracting considerable international interest and excitement from within the industrial and academic communities. In this chapter we examine the data flow, storage and processing requirements of a number of key SKA survey science projects to be executed on the baseline SKA1 configuration. Based on a set of conservative assumptions about trends for HPC and storage costs, and the data flow process within the SKA Observatory, it is apparent that survey projects of the scale proposed will potentially drive construction and operations costs beyond the current anticipated SKA1 budget. This implies a sharing of the resources and costs to deliver SKA science between the community and what is contained within the SKA Observatory. A similar situation was apparent to the designers of the LHC more than 10 years ago. We propose that it is time for the SKA project and community to consider the effort and process needed to design and implement a distributed SKA science data system that leans on the lessons of other projects and looks to recent developments in Cloud technologies to ensure an affordable, effective and global achievement of SKA science goals. △ Less

Submitted 21 January, 2015; originally announced January 2015.

Comments: 27 pages, 14 figures, Conference: Advancing Astrophysics with the Square Kilometre Array June 8-13, 2014 Giardini Naxos, Italy

Astronomical Imagery: Considerations For a Contemporary Approach with JPEG2000

Authors: Vyacheslav V. Kitaeff, Andrew Cannon, Andreas Wicenec, David Taubman

Abstract: The new wide-field radio telescopes, such as: ASKAP, MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented size -- in the order of hundreds of Petabytes. Servicing such data as images to the end-user in a traditional manner and formats is likely going to encounter significant performance fallbacks. We discuss the requirements for extremely large SIDCs, and in t… ▽ More The new wide-field radio telescopes, such as: ASKAP, MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented size -- in the order of hundreds of Petabytes. Servicing such data as images to the end-user in a traditional manner and formats is likely going to encounter significant performance fallbacks. We discuss the requirements for extremely large SIDCs, and in this light we analyse the applicability of the approach taken in the JPEG2000 (ISO/IEC 15444) standards. We argue the case for the adaptation of contemporary industry standards and technologies vs the modification of legacy astronomy standards or the development new from scratch. △ Less

Submitted 30 June, 2014; v1 submitted 11 March, 2014; originally announced March 2014.

Comments: 14 pages, 12 figures, 3 tables, accepted by Astronomy and Computing

MSC Class: 85-04

Optimising NGAS for the MWA Archive

Authors: Chen Wu, Andreas Wicenec, Dave Pallot, Alessio Checcucci

Abstract: The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software - the Next-Generation Archive System (NGAS) - that was initiall… ▽ More The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software - the Next-Generation Archive System (NGAS) - that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient dataflow management, multi-tiered data storage and processing-aware data staging. △ Less

Submitted 28 August, 2013; originally announced August 2013.

Comments: 15 pages

Extremely Large Images: Considerations for Contemporary Approach

Authors: Slava Kitaeff, Andreas Wicenec, Chen Wu, David Taubman

Abstract: The new widefield radio telescopes, such as: ASKAP,MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volumes in the order of hundreds of Petabytes. Servicing such data as images to the end-user may encounter challenges unforeseen during the development of IVOA SIAP. We discuss the requirements for extremely large SIDC, and in this light we analyse the appli… ▽ More The new widefield radio telescopes, such as: ASKAP,MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volumes in the order of hundreds of Petabytes. Servicing such data as images to the end-user may encounter challenges unforeseen during the development of IVOA SIAP. We discuss the requirements for extremely large SIDC, and in this light we analyse the applicability of approach taken in the ISO/IEC 15444 (JPEG2000) standards. △ Less

Submitted 19 July, 2013; originally announced July 2013.

Comments: IVOA discussion paper

Realisation of a low frequency SKA Precursor: The Murchison Widefield Array

Authors: S. J. Tingay, R. Goeke, J. N. Hewitt, E. Morgan, R. A Remillard, C. L. Williams, J. D. Bowman, D. Emrich, S. M. Ord, T. Booler, B. Crosse, D. Pallot, W. Arcus, T. Colegate, P. J. Hall, D. Herne, M. J. Lynch, F. Schlagenhaufer, S. Tremblay, R. B. Wayth, M. Waterson, D. A. Mitchell, R. J. Sault, R. L. Webster, J. S. B. Wyithe , et al. (34 additional authors not shown)

Abstract: The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) dete… ▽ More The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) detection of fluctuations in the brightness temperature of the diffuse redshifted 21 cm line of neutral hydrogen from the epoch of reionisation; 2) studies of Galactic and extragalactic processes based on deep, confusion-limited surveys of the full sky visible to the array; 3) time domain astrophysics through exploration of the variable radio sky; and 4) solar imaging and characterisation of the heliosphere and ionosphere via propagation effects on background radio source emission. This paper will focus on a brief discussion of the as-built MWA system, highlighting several novel characteristics of the instrument, and a brief progress report (as of June 2012) on the final construction phase. Practical completion of the MWA is expected in November 2012, with commissioning commencing from approximately August 2012 and operations commencing near mid 2013. A brief description of recent science results from the MWA prototype instrument is given. △ Less

Submitted 6 December, 2012; originally announced December 2012.

Comments: 8 pages, Resolving the Sky - Radio Interferometry: Past, Present and Future - RTS2012, April 17-20, 2012, Manchester, UK

Astronomy and Computing: a New Journal for the Astronomical Computing Community

Authors: Alberto Accomazzi, Tamás Budavári, Christopher Fluke, Norman Gray, Robert G Mann, William O'Mullane, Andreas Wicenec, Michael Wise

Abstract: We introduce \emph{Astronomy and Computing}, a new journal for the growing population of people working in the domain where astronomy overlaps with computer science and information technology. The journal aims to provide a new communication channel within that community, which is not well served by current journals, and to help secure recognition of its true importance within modern astronomy. In… ▽ More We introduce \emph{Astronomy and Computing}, a new journal for the growing population of people working in the domain where astronomy overlaps with computer science and information technology. The journal aims to provide a new communication channel within that community, which is not well served by current journals, and to help secure recognition of its true importance within modern astronomy. In this inaugural editorial, we describe the rationale for creating the journal, outline its scope and ambitions, and seek input from the community in defining in detail how the journal should work towards its high-level goals. △ Less

Submitted 30 October, 2012; originally announced October 2012.

Comments: 5 pages, no figures; editorial for first edition of journal

SkuareView: Client-Server Framework for Accessing Extremely Large Radio Astronomy Image Data

Authors: Vyacheslav V. Kitaeff, Chen Wu, Andreas Wicenec, Andrew D. Cannon, Kevin Vinsen

Abstract: The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This requires new approaches to managing and servicing the data to the end-user. We present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard to address the challenges of working with extremely large SIDC. We also present the developed j2… ▽ More The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This requires new approaches to managing and servicing the data to the end-user. We present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard to address the challenges of working with extremely large SIDC. We also present the developed j2k software, that converts and encodes FITS image cubes into JPEG2000 images, paving the way to implementing the pre- sented framework. △ Less

Submitted 10 September, 2012; originally announced September 2012.

Comments: 8 pages, 1 figure, Astro-HPC '12 Proceedings of the 2012 workshop on High-Performance Computing for Astronomy

The Murchison Widefield Array: the Square Kilometre Array Precursor at low radio frequencies

Authors: S. J. Tingay, R. Goeke, J. D. Bowman, D. Emrich, S. M. Ord, D. A. Mitchell, M. F. Morales, T. Booler, B. Crosse, D. Pallot, A. Wicenec, W. Arcus, D. Barnes, G. Bernardi, F. Briggs, S. Burns, J. D. Bunton, R. J. Cappallo, T. Colegate, B. E. Corey, A. Deshpande, L. deSouza, B. M. Gaensler, L. J. Greenhill, J. Hall , et al. (35 additional authors not shown)

Abstract: The Murchison Widefield Array (MWA) is one of three Square Kilometre Array Precursor telescopes and is located at the Murchison Radio-astronomy Observatory in the Murchison Shire of the mid-west of Western Australia, a location chosen for its extremely low levels of radio frequency interference. The MWA operates at low radio frequencies, 80-300 MHz, with a processed bandwidth of 30.72 MHz for both… ▽ More The Murchison Widefield Array (MWA) is one of three Square Kilometre Array Precursor telescopes and is located at the Murchison Radio-astronomy Observatory in the Murchison Shire of the mid-west of Western Australia, a location chosen for its extremely low levels of radio frequency interference. The MWA operates at low radio frequencies, 80-300 MHz, with a processed bandwidth of 30.72 MHz for both linear polarisations, and consists of 128 aperture arrays (known as tiles) distributed over a ~3 km diameter area. Novel hybrid hardware/software correlation and a real-time imaging and calibration systems comprise the MWA signal processing backend. In this paper the as-built MWA is described both at a system and sub-system level, the expected performance of the array is presented, and the science goals of the instrument are summarised. △ Less

Submitted 29 June, 2012; originally announced June 2012.

Comments: Submitted to PASA. 11 figures, 2 tables

IVOA Recommendation: VOTable Format Definition Version 1.3

Authors: François Ochsenbein, Roy Williams, Clive Davenhall, Daniel Durand, Pierre Fernique, David Giaretta, Robert Hanisch, Tom McGlynn, Alex Szalay, Mark B. Taylor, Andreas Wicenec

Abstract: This document describes the structures making up the VOTable standard. The main part of this document describes the adopted part of the VOTable standard; it is followed by appendices presenting extensions which have been proposed and/or discussed, but which are not part of the standard. This document describes the structures making up the VOTable standard. The main part of this document describes the adopted part of the VOTable standard; it is followed by appendices presenting extensions which have been proposed and/or discussed, but which are not part of the standard. △ Less

Submitted 13 September, 2016; v1 submitted 3 October, 2011; originally announced October 2011.

Virtual Observatory studies of Planetary Nebulae

Authors: R. P. Mignani, F. Kerber, R. L. Smart, D. Vande Putte, A. Wicenec, T. Rauch, H. M. Adorf, R. Harrison

Abstract: Starting from the Strasbourg ESO Catalogue (SEC) of Planetary Nebulae (PNe), the largest PNe compilation available with ~ 1500 objects, we undertook a comprehensive study of the whole PN population, never carried out so far, only using on-line catalogues and data from public imaging surveys. The study includes the PN dynamics through their measured proper motions (PMs), the study of their galact… ▽ More Starting from the Strasbourg ESO Catalogue (SEC) of Planetary Nebulae (PNe), the largest PNe compilation available with ~ 1500 objects, we undertook a comprehensive study of the whole PN population, never carried out so far, only using on-line catalogues and data from public imaging surveys. The study includes the PN dynamics through their measured proper motions (PMs), the study of their galactocentric orbits, the study of their interactions with the interstellar medium (ISM), and the study of their UV-to-IR spectral energy distribution (SED). As a preliminary step required to perform cross-correlations with on-line catalogues, we first went through a systematic reassessment of the PN coordinates (Kerber et al. 2003a). △ Less

Submitted 5 February, 2009; originally announced February 2009.

Comments: 2 pages, to be published in the Proceedings of the Conference "Multiwavelength Astronomy and the Virtual Observatory", held at ESAC-Madrid, December 1-3 2008

ESO Imaging Survey: infrared observations of CDF-S and HDF-S

Authors: L. F. Olsen, J. -M. Miralles, L. da Costa, C. Benoist, B. Vandame, R. Rengelink, C. Rite, M. Scodeggio, R. Slijkhuis, A. Wicenec, S. Zaggia

Abstract: This paper presents infrared data obtained from observations carried out at the ESO 3.5m New Technology Telescope (NTT) of the Hubble Deep Field South (HDF-S) and the Chandra Deep Field South (CDF-S). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted by ESO to promote follow-up observations with the VLT. In the HDF-S field the infrared observations… ▽ More This paper presents infrared data obtained from observations carried out at the ESO 3.5m New Technology Telescope (NTT) of the Hubble Deep Field South (HDF-S) and the Chandra Deep Field South (CDF-S). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted by ESO to promote follow-up observations with the VLT. In the HDF-S field the infrared observations cover an area of ~53 square arcmin, encompassing the HST WFPC2 and STIS fields, in the JHKs passbands. The seeing measured in the final stacked images ranges from 0.79" to 1.22" and the median limiting magnitudes (AB system, 2" aperture, 5sigma detection limit) are J_AB~23.0, H_AB~22.8 and K_AB~23.0 mag. Less complete data are also available in JKs for the adjacent HST NICMOS field. For CDF-S, the infrared observations cover a total area of \~100 square arcmin, reaching median limiting magnitudes (as defined above) of J_AB~23.6 and K_AB~22.7 mag. For one CDF-S field H-band data are also available. This paper describes the observations and presents the results of new reductions carried out entirely through the un-supervised, high-throughput EIS Data Reduction System and its associated EIS/MVM C++-based image processing library developed, over the past 5 years, by the EIS project and now publicly available. The paper also presents source catalogs extracted from the final co-added images which are used to evaluate the scientific quality of the survey products, and hence the performance of the software. This is done comparing the results obtained in the present work with those obtained by other authors from independent data and/or reductions carried out with different software packages and techniques. The final science-grade catalogs and co-added images are available at CDS. △ Less

Submitted 23 February, 2006; originally announced February 2006.

Comments: Accepted for publication in A&A, 13 pages, 12 figures; a full resolution version of the paper is available from http://www.astro.ku.dk/~lisbeth/eisdata/papers/4528.pdf ; related catalogs and images are available through http://www.astro.ku.dk/~lisbeth/eisdata/

ESO Imaging Survey. Deep Public Survey: Multi-Color Optical Data for the Chandra Deep Field South

Authors: S. Arnouts, B. Vandame, C. Benoist, M. A. T. Groenewegen, L. da Costa, M. Schirmer, R. P. Mignani, R. Slijkhuis, E. Hatziminaoglou, R. Hook, R. Madejsky, C. Rite', A. Wicenec

Abstract: This paper presents multi-passband optical data obtained from observations of the Chandra Deep Field South (CDF-S), located at alpha ~ 3h 32m, delta ~ -27d 48m. The observations were conducted at the ESO/MPG 2.2m telescope at La Silla using the 8kx8k Wide-Field Imager (WFI). This data set, taken over a period of one year, represents the first field to be completed by the ongoing Deep Public Surv… ▽ More This paper presents multi-passband optical data obtained from observations of the Chandra Deep Field South (CDF-S), located at alpha ~ 3h 32m, delta ~ -27d 48m. The observations were conducted at the ESO/MPG 2.2m telescope at La Silla using the 8kx8k Wide-Field Imager (WFI). This data set, taken over a period of one year, represents the first field to be completed by the ongoing Deep Public Survey (DPS) being carried out by the ESO Imaging Survey (EIS) project. This paper describes the optical observations, the techniques employed for un-supervised pipeline processing and the general characteristics of the final data set. The paper includes data taken in six different filters U'UBVRI. The data cover an area of about 0.25 square degrees reaching 5 sigma limiting magnitudes of U'_AB=26.0, U_AB=25.7, B_AB=26.4$, V_AB=25.4, R_AB=25.5 and I_AB= 24.7 mag, as measured within a 2xFWHM aperture. The optical data covers the area of ~ 0.1 △ Less

Submitted 28 September, 2001; v1 submitted 5 March, 2001; originally announced March 2001.

Comments: 13 pages, 19 postscript figures, Figure 3,4,7,10 are available in jpeg format, use aa.cls style. The full postscript of the paper is available at http://www.eso.org/science/eis/eis_pub/eis_pub.html

Journal ref: Astron.Astrophys.379:740-754,2001

ESO Imaging Survey. Deep Public Survey: Infrared Data for the Chandra Deep Field South

Authors: B. Vandame, L. F. Olsen, H. E. Jorgensen, M. A. T. Groenewegen, M. Schirmer, S. Arnouts, C. Benoist, L. da Costa, R. P. Mignani, C. Rite', R. Slijkhuis, E. Hatziminaoglou, R. Hook, R. Madejsky, A. Wicenec

Abstract: This paper presents new J and Ks near-infrared data obtained from observations of the Chandra Deep Field South (CDF-S) conducted at the ESO 3.5m New Technology Telescope (NTT). These data were taken as part of the ongoing Deep Public Survey (DPS) being carried out by the ESO Imaging Survey (EIS) program, extending the EIS-DEEP survey. Combined these surveys now provide a contiguous coverage over… ▽ More This paper presents new J and Ks near-infrared data obtained from observations of the Chandra Deep Field South (CDF-S) conducted at the ESO 3.5m New Technology Telescope (NTT). These data were taken as part of the ongoing Deep Public Survey (DPS) being carried out by the ESO Imaging Survey (EIS) program, extending the EIS-DEEP survey. Combined these surveys now provide a contiguous coverage over an area of 400 square arcmin in the near-infrared, nearly matching that covered by the deep X-ray observations of Chandra, four times the area of the original EIS-DEEP survey. The paper briefly describes the observations and the new techniques being employed for pipeline processing jittered infrared observations, which include unbiased de-fringing and sky-background subtraction, pixel-based astrometry and stacking and pixel registration based on a multi-resolution decomposition of the images. The astrometric solution is based on a pre-release of the GSC-II catalog and has an accuracy of < 0.15 arcsec. The final images for 12 pointings presented here reach median 5 sigma limiting magnitudes of J_AB~23.4 and K_AB~22.6 as measured within an aperture 2xFWHM. The frame to frame variation of the photometric zero-point is estimated to be <0.09 mag. The data are publicly available in the form of fully calibrated J and Ks pixel maps and source lists extracted for each pointing. These data can be requested through the URL ``http://www.eso.org/eis''. △ Less

Submitted 19 February, 2001; v1 submitted 16 February, 2001; originally announced February 2001.

Comments: 10 pages, 8 postscript figures, Figure 1 and Figures 3 are available in jpeg format, uses updated style aa.cls for Astronomy & Astrophysics. submitted to Astronomy & Astrophysics

ESO Imaging Survey: Past Activities and Future Prospects

Authors: L. da Costa, S. Arnouts, C. Benoist, E. Deul, R. Hook, Y. -S. Kim, M. Nonino, E. Pancino, R. Rengelink, R. Slijkhuis, A. Wicenec, S. Zaggia

Abstract: The ESO Imaging Survey (EIS) is an ongoing project to carry out public imaging surveys to support programs on the ESO Very Large Telescope (VLT). The first phase of the project started in July 1997 and consisted of a moderately deep, large-area survey (EIS-WIDE) and a deep optical/infrared survey (EIS-DEEP) using the ESO New Technology Telescope (NTT). EIS has recently reached another milestone… ▽ More The ESO Imaging Survey (EIS) is an ongoing project to carry out public imaging surveys to support programs on the ESO Very Large Telescope (VLT). The first phase of the project started in July 1997 and consisted of a moderately deep, large-area survey (EIS-WIDE) and a deep optical/infrared survey (EIS-DEEP) using the ESO New Technology Telescope (NTT). EIS has recently reached another milestone with the completion of a Pilot Survey using the Wide-Field Image (WFI), an 8k by 8k mosaic CCD camera mounted on the MPG/ESO 2.2m telescope at La Silla. This paper briefly reviews the results of the original EIS and gives an update of the results obtained from the observations carried out as part of the Pilot Survey. Work in progress on the development of an advanced pipeline for handling data from large CCD mosaics and facilities to make the access to data products easier for external users are also discussed. △ Less

Submitted 10 December, 1999; originally announced December 1999.

Comments: 9 pages, 9 tables and 6 figures (some at reduced resolution) in a single PDF file. To appear in the ESO Messenger

ESO Imaging Survey. AXAF Field: Deep Optical-Infrared Observations, Data Reduction and Photometry

Authors: R. Rengelink, M. Nonino, L. da Costa, S. Zaggia, T. Erben, C. Benoist, A. Wicenec, M. Scodeggio, L. F. Olsen, D. Guarnieri, E. Deul, R. Hook, A. Moorwood, R. Slijkhuis

Abstract: This paper presents ground-based data obtained from deep optical and infrared observations carried out at the ESO 3.5 New Technology Telescope (NTT) of a field selected for its low HI content for deep observations with AXAF. These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted in preparation for the first year of operation of the VLT. Deep CCD images a… ▽ More This paper presents ground-based data obtained from deep optical and infrared observations carried out at the ESO 3.5 New Technology Telescope (NTT) of a field selected for its low HI content for deep observations with AXAF. These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted in preparation for the first year of operation of the VLT. Deep CCD images are available for five optical passbands, reaching 2 sigma limiting magnitudes of U_AB~27.0, B_AB~27, V_AB~26.5, R_AB~26.5 and I_AB~26. An area of ~56 square arcmin is covered by UBVR observations, and ~30 square arcmin also in I. The infrared observations cover a total area of ~83 square arcmin, reaching J_AB~24.5 and K_AB~23.5. This paper describes the observations and data reduction. It also presents images of the surveyed region and lists the optical and infrared photometric parameters of the objects detected on the co-added images of each passband, as well as multicolor optical and infrared catalogs. These catalogs together with the astrometrically and photometrically calibrated co-added images are public and can be retrieved from the URL http://www.eso.org/eis/ . This data set completes the ESO Imaging Survey program sixteen months after it began in July 1997. △ Less

Submitted 9 December, 1998; originally announced December 1998.

Comments: 10 pages, 7 figures, 5 jpg

ESO Imaging Survey. Hubble Deep Field South: Optical-Infrared Observations, Data Reduction and Photometry

Authors: L. da Costa, M. Nonino, R. Rengelink, S. Zaggia, C. Benoist, T. Erben, A. Wicenec, M. Scodeggio, L. F. Olsen, M. D. Guarnieri, E. Deul, S. D'Odorico, R. Hook, A. Moorwood, R. Slijkhuis

Abstract: This paper presents ground-based data obtained from deep optical and infrared observations of the HST Hubble Deep Field South (HDF-S) field carried out at the ESO 3.5 New Technology Telescope (NTT). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey coordinated by ESO and member states, in preparation for the first year of operation of the VLT. Deep CCD images… ▽ More This paper presents ground-based data obtained from deep optical and infrared observations of the HST Hubble Deep Field South (HDF-S) field carried out at the ESO 3.5 New Technology Telescope (NTT). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey coordinated by ESO and member states, in preparation for the first year of operation of the VLT. Deep CCD images are available for five optical passbands, reaching 2 sigma limiting magnitudes of U_AB~27.0, B_AB~26.5, V_AB~26, R_AB~26, I_AB~25, covering a region of ~25 square arcmin, which includes the HST WPFC2 field. The infrared observations cover a total area of ~42 square arcmin and include both the HST WFPC2 and STIS fields. The observations of the WFPC2 region were conducted in JHKs passbands, reaching J_AB~25, and H_AB and K_AB~24.0. Due to time constraints, the adjacent field, covering the STIS field, has been observed only in R, I and JHKs, while no observations were conducted covering the NIC3 field. This paper describes the observations and data reduction. It also presents images of the surveyed region and lists the optical and infrared photometric parameters of the objects detected on the co-added images of each passband, as well as multicolor optical and infrared catalogs. These catalogs together with the astrometrically and photometrically calibrated co-added images are being made public world-wide and can be retrieved from the world-wide web (http://www.eso.org/eis). △ Less

Submitted 4 December, 1998; originally announced December 1998.

Comments: 24 pages, 17 figures (7 available in jpg format), submitted to Astronomy and Astrophysics

ESO Imaging Survey VII. Distant Cluster Candidates over 12 square degrees

Authors: M. Scodeggio, L. F. Olsen, L. da Costa, R. Slijkhuis, C. Benoist, E. Deul, T. Erben, R. Hook, M. Nonino, A. Wicenec, S. Zaggia

Abstract: In this paper the list of candidate clusters identified from the I-band data of the ESO Imaging Survey (EIS) is completed using the images obtained over a total area of about 12 square degrees. Together with the data reported earlier the total I-band coverage of EIS is 17 square degrees, which has yielded a sample of 252 cluster candidates in the redshift range $0.2 \lsim z \lsim 1.3$. This is t… ▽ More In this paper the list of candidate clusters identified from the I-band data of the ESO Imaging Survey (EIS) is completed using the images obtained over a total area of about 12 square degrees. Together with the data reported earlier the total I-band coverage of EIS is 17 square degrees, which has yielded a sample of 252 cluster candidates in the redshift range $0.2 \lsim z \lsim 1.3$. This is the largest optically-selected sample currently available in the Southern Hemisphere. It is also well distributed in the sky thus providing targets for a variety of VLT programs nearly year round. △ Less

Submitted 31 July, 1998; originally announced July 1998.

Comments: 5 pages, 3 figures, submitted to Astronomy & Astrophysics

Report number: ESO-EIS-7

ESO Imaging Survey VI. The last 12 square degrees

Authors: C. Benoist, L. da Costa, L. F. Olsen, E. Deul, T. Erben, M. D. Guarnieri, R. Hook, M. Nonino, I. Prandoni, M. Scodeggio, R. Slijkhuis, A. Wicenec, S. Zaggia

Abstract: This paper presents the I-band data obtained by the ESO Imaging Survey (EIS) over two patches of the sky, 6 square degrees each, centered at $α\sim 5^h40^m$, $δ\sim -24^\circ50^m$, and $α\sim 9^h50^m$, $δ\sim -21^\circ 00^m$. The data are being made public in the form of object catalogs and, photometrically and astrometrically calibrated pixel maps. These products together with other useful info… ▽ More This paper presents the I-band data obtained by the ESO Imaging Survey (EIS) over two patches of the sky, 6 square degrees each, centered at $α\sim 5^h40^m$, $δ\sim -24^\circ50^m$, and $α\sim 9^h50^m$, $δ\sim -21^\circ 00^m$. The data are being made public in the form of object catalogs and, photometrically and astrometrically calibrated pixel maps. These products together with other useful information can be found at "http://www.eso.org/eis". The overall quality of the data in the two fields is significantly better than the other two patches released earlier and cover a much larger contiguous area. The total number of objects in the catalogs extracted from these frames is over 700,000 down to $I\sim23$, where the galaxy catalogs are 80% complete. The star counts are consistent with model predictions computed at the position of the patches considered. The galaxy counts and the angular two-point correlation functions are also consistent with those of the other patches showing that the EIS data set is homogeneous and that the galaxy catalogs are uniform. △ Less

Submitted 31 July, 1998; originally announced July 1998.

Comments: 9 pages, 11 figures, submitted to Astronomy and Astrophysics

Report number: ESO-EIS-6

ESO Imaging Survey V. Cluster Search using Color Data

Authors: L. F. Olsen, M. Scodeggio, L. da Costa, R. Slijkhuis, C. Benoist, E. Bertin, E. Deul, T. Erben, M. D. Guarnieri, R. Hook, M. Nonino, I. Prandoni, A. Wicenec, S. Zaggia

Abstract: This paper presents 19 additional candidate clusters detected using the galaxy catalog extracted from the I-band images taken for the ESO Imaging Survey (EIS). The candidates are found over a region of 1.1 square degrees, located near the South Galactic Pole. Combined with the sample reported earlier, the number of candidates in the Southern Galactic Cap is now 54 over a total area of 3.6 square… ▽ More This paper presents 19 additional candidate clusters detected using the galaxy catalog extracted from the I-band images taken for the ESO Imaging Survey (EIS). The candidates are found over a region of 1.1 square degrees, located near the South Galactic Pole. Combined with the sample reported earlier, the number of candidates in the Southern Galactic Cap is now 54 over a total area of 3.6 square degrees. Images in V band are also available over 2.7 square degrees, and galaxy catalogs extracted from them over a uniform area of 2 square degrees have been used to further explore the reality of the I cluster candidates. Nearly all the I candidates with estimated redshifts <~ 0.5 are also identified in V. At higher redshifts, only rich candidates are detected in both bands. △ Less

Submitted 15 July, 1998; originally announced July 1998.

Comments: 5 pages, 2 figures, submitted to Astronomy and Astrophysics Letters

Report number: eso-eis-5

ESO Imaging Survey III. Multicolor Data near the South Galactic Pole

Authors: I. Prandoni, R. Wichmann, L. da Costa, C. Benoist, R. Mendez, M. Nonino, L. F. Olsen, A. Wicenec, S. Zaggia, E. Bertin, E. Deul, T. Erben, M. D. Guarnieri, I. Hook, R. Hook, M. Scodeggio, R. Slijkhuis

Abstract: This paper presents multicolor data obtained for a 1.7 square degree region near the South Galactic Pole (patch B) as part of the ESO Imaging Survey (EIS). So far the observations have been conducted in B,V and I but are expected to be complemented by observations in the U band later in 1998. Object catalogs extracted from single exposure images are 80% complete down to B~24, V~23.5 and I ~22.5… ▽ More This paper presents multicolor data obtained for a 1.7 square degree region near the South Galactic Pole (patch B) as part of the ESO Imaging Survey (EIS). So far the observations have been conducted in B,V and I but are expected to be complemented by observations in the U band later in 1998. Object catalogs extracted from single exposure images are 80% complete down to B~24, V~23.5 and I ~22.5 and once coadded should reach about 0.5 mag deeper. The data are being made public in the form of catalogs, pixel maps, target lists and image "postage stamps" which can be retrieved from the Web. Counts of stars and galaxies and the angular two-point correlation function of galaxies are computed and compared to other available data to evaluate the depth and uniformity of the extrtacted object catalogs. In addition, color distributions of stellar objects are presented and compared to model predictions to examine the reliability of the colors. The results suggest that the overall quality of the catalogs extracted from the images is good and suitable for the science goals of the survey. △ Less

Submitted 15 July, 1998; originally announced July 1998.

Comments: 12 pages, 17 figures, submitted to Astronomy and Astrophysics

Report number: ESO-EIS-3

ESO Imaging Survey IV. Exploring the EIS Multicolor Data

Authors: S. Zaggia, I. Hook, R. Mendez, L. da Costa, L. F. Olsen, M. Nonino, A. Wicenec, C. Benoist, E. Bertin, E. Deul, T. Erben, M. D. Guarnieri, R. Hook, I. Prandoni, M. Scodeggio, R. Slijkhuis, R. Wichmann

Abstract: This paper presents preliminary lists of potentially interesting point-like sources extracted from multicolor data obtained for a 1.7 square degree region near the South Galactic Pole. The region has been covered by the ESO Imaging Survey (EIS) in B, V,I, and offers a unique combination of area and depth.These lists, containing a total of 330 objects nearly all brighter than I~21.5, over 1.27 sq… ▽ More This paper presents preliminary lists of potentially interesting point-like sources extracted from multicolor data obtained for a 1.7 square degree region near the South Galactic Pole. The region has been covered by the ESO Imaging Survey (EIS) in B, V,I, and offers a unique combination of area and depth.These lists, containing a total of 330 objects nearly all brighter than I~21.5, over 1.27 square degrees (after removing some bad regions), are by-products of the process of verification and quality control of the object catalogs being produced. Among the color selected targets are candidate very low mass stars/brown dwarfs (54), white-dwarfs (32), and quasars (244). In addition, a probable fast moving asteroid was identified. The objects presented here are natural candidates for follow-up spectroscopic observations and illustrate the usefulness of the EIS data for a broad range of science and for providing possible samples for the first year of the VLT. △ Less

Submitted 15 July, 1998; originally announced July 1998.

Comments: 12 pages, 6 figures, submitted to A. and A

Report number: eso-eis-4

ESO Imaging Survey II. Searching for Distant Clusters of Galaxies

Authors: L. F. Olsen, M. Scodeggio, L. da Costa, C. Benoist, E. Bertin, E. Deul, T. Erben, M. D. Guarnieri, R. Hook, M. Nonino, I. Prandoni, R. Slijkhus, A. Wicenec, R. Wichmann

Abstract: Preliminary results of a search for distant clusters of galaxies using the recently released I-band data obtained by the ESO Imaging Survey are presented. In this first installment of the survey, data covering about 3 square degrees in I-band are being used. The matched filter algorithm is applied to two sets of frames that cover the whole patch contiguously and these independent realizations ar… ▽ More Preliminary results of a search for distant clusters of galaxies using the recently released I-band data obtained by the ESO Imaging Survey are presented. In this first installment of the survey, data covering about 3 square degrees in I-band are being used. The matched filter algorithm is applied to two sets of frames that cover the whole patch contiguously and these independent realizations are used to assess the performance of the algorithm and to establish, from the data itself, a robust detection threshold. A preliminary catalog of distant clusters is presented, containing 39 cluster candidates with estimated redshifts 0.3 < z < 1.3 over an area of 2.5 square degrees. △ Less

Submitted 31 March, 1998; originally announced March 1998.

Comments: 13 pages, 10 figures, submitted to Astronomy and Astrophysics

ESO Imagin Survey I. Preliminary Results

Authors: M. Nonino, E. Bertin, L. da Costa, E. Deul, T. Erben, L. Olsen, I. Prandoni, M. Scodeggio, A. Wicenec, R. Wichmann, C. Benoist, W. Freudling, M. D. Guarnieri, I. Hook, R. Hook, R. Mendez, S. Savaglio, D. Silva, R. Slijkhuis

Abstract: This paper presents the preliminary results of the ESO Imaging Survey (EIS), a public survey being carried out by ESO and member states, in preparation for the VLT first-light. The survey goals, organization, strategy and observations are discussed and an overview is given of the survey pipeline developed to handle EIS data and produce object catalogs. A report is presented on moderately deep I-… ▽ More This paper presents the preliminary results of the ESO Imaging Survey (EIS), a public survey being carried out by ESO and member states, in preparation for the VLT first-light. The survey goals, organization, strategy and observations are discussed and an overview is given of the survey pipeline developed to handle EIS data and produce object catalogs. A report is presented on moderately deep I-band observations obtained in the first of four patches surveyed, covering a region of 3.2 square degrees centered at R.A. 22h40m and Dec. -40d. The products available to the community, including pixel maps (with astrometric and photometric calibrations) and the corresponding object catalogs, are also described. In order to evaluate the quality of the data, preliminary estimates are presented for the star and galaxy number counts, and for the angular two-point correlation function obtained from the available data. The present work is meant as a preview of the final release of the EIS data that will become available later this year. △ Less

Submitted 31 March, 1998; originally announced March 1998.

Comments: 25 pages, 30 figures, submitted to Astronomy and Astrophysics

The ESO Imaging Survey: Status Report and Preliminary Results

Authors: L. da Costa, E. Bertin, E. Deul, T. Erben, W. Freudling, M. D. Guarnieri, I. Hook, R. Hook, R. Mendez, M. Nonino, L. Olsen, I. Prandoni, A. Renzini, S. Savaglio, M. Scodeggio, D. Silva, R. Slijkhuis, A. Wicenec, R. Wichmann, C. Benoist

Abstract: The ESO Imaging Survey (EIS) presented in early issues of the Messenger, and with up-to-date information on the ongoing observations available on the Web (http://www.eso.org/eis), is a concerted effort by ESO and the Member State community to provide targets for the first year of operation of the VLT. It consists of two parts: a relatively wide-angle survey (EIS-WIDE) to cover four pre-selected… ▽ More The ESO Imaging Survey (EIS) presented in early issues of the Messenger, and with up-to-date information on the ongoing observations available on the Web (http://www.eso.org/eis), is a concerted effort by ESO and the Member State community to provide targets for the first year of operation of the VLT. It consists of two parts: a relatively wide-angle survey (EIS-WIDE) to cover four pre-selected patches of sky, 6 square degrees each, spread in right ascension to search for distant clusters and quasars and a deep, multicolor survey of four optical (SUSI-2) and two infrared (SOFI) covering the HST/Hubble Deep Field South (HDFS) and its flanking fields (EIS-DEEP). From the start, the main challenge has been to carry out a public survey in a limited amount of time requiring observations, software development and data reduction with the goal of distributing the survey data products before the call for proposal for the VLT. To cope with this one-year timetable, a novel type of collaboration between ESO and the community has been established which has allowed EIS to combine the scientific and technical expertise fo the community with in-house know-how and infrastructure. In spite of the adverse weather conditions in some of the earlier runs, EIS has already proved to be successful experiment achieving most of its scientific and technical goals, thereby laying the ground work for future imaging surveys. △ Less

Submitted 25 February, 1998; originally announced February 1998.

Comments: 11 pages Latex,mprocl.sty included, 2 Postscript figures, 4 jpg figures, to be published in the ESO Messenger

Report number: ESO-EIS-01