Showing 1–5 of 5 results for author: Greenhill, L J

Bifrost: a Python/C++ Framework for High-Throughput Stream Processing in Astronomy

Authors: Miles D. Cranmer, Benjamin R. Barsdell, Danny C. Price, Jayce Dowell, Hugh Garsden, Veronica Dike, Tarraneh Eftekhari, Alexander M. Hegedus, Joseph Malins, Kenneth S. Obenberger, Frank Schinzel, Kevin Stovall, Gregory B. Taylor, Lincoln J. Greenhill

Abstract: Radio astronomy observatories with high throughput back end instruments require real-time data processing. While computing hardware continues to advance rapidly, development of real-time processing pipelines remains difficult and time-consuming, which can limit scientific productivity. Motivated by this, we have developed Bifrost: an open-source software framework for rapid pipeline development. B… ▽ More Radio astronomy observatories with high throughput back end instruments require real-time data processing. While computing hardware continues to advance rapidly, development of real-time processing pipelines remains difficult and time-consuming, which can limit scientific productivity. Motivated by this, we have developed Bifrost: an open-source software framework for rapid pipeline development. Bifrost combines a high-level Python interface with highly efficient reconfigurable data transport and a library of computing blocks for CPU and GPU processing. The framework is generalizable, but initially it emphasizes the needs of high-throughput radio astronomy pipelines, such as the ability to process data buffers as if they were continuous streams, the capacity to partition processing into distinct data sequences (e.g., separate observations), and the ability to extract specific intervals from buffered data. Computing blocks in the library are designed for applications such as interferometry, pulsar dedispersion and timing, and transient search pipelines. We describe the design and implementation of the Bifrost framework and demonstrate its use as the backbone in the correlation and beamforming back end of the Long Wavelength Array station in the Sevilleta National Wildlife Refuge, NM. △ Less

Submitted 2 August, 2017; originally announced August 2017.

Comments: 25 pages, 13 figures, submitted to JAI. For the code, see https://github.com/ledatelescope/bifrost

Power spectrum analysis of ionospheric fluctuations with the Murchison Widefield Array

Authors: Shyeh T**g Loi, Cathryn M. Trott, Tara Murphy, Iver H. Cairns, Martin Bell, Natasha Hurley-Walker, John Morgan, Emil Lenc, A. R. Offringa, L. Feng, P. J. Hancock, D. L. Kaplan, N. Kudryavtseva, G. Bernardi, J. D. Bowman, F. Briggs, R. J. Cappallo, B. E. Corey, A. A. Deshpande, D. Emrich, B. M. Gaensler, R. Goeke, L. J. Greenhill, B. J. Hazelton, M. Johnston-Hollitt , et al. (23 additional authors not shown)

Abstract: Low-frequency, wide field-of-view (FoV) radio telescopes such as the Murchison Widefield Array (MWA) enable the ionosphere to be sampled at high spatial completeness. We present the results of the first power spectrum analysis of ionospheric fluctuations in MWA data, where we examined the position offsets of radio sources appearing in two datasets. The refractive shifts in the positions of celesti… ▽ More Low-frequency, wide field-of-view (FoV) radio telescopes such as the Murchison Widefield Array (MWA) enable the ionosphere to be sampled at high spatial completeness. We present the results of the first power spectrum analysis of ionospheric fluctuations in MWA data, where we examined the position offsets of radio sources appearing in two datasets. The refractive shifts in the positions of celestial sources are proportional to spatial gradients in the electron column density transverse to the line of sight. These can be used to probe plasma structures and waves in the ionosphere. The regional (10-100 km) scales probed by the MWA, determined by the size of its FoV and the spatial density of radio sources (typically thousands in a single FoV), complement the global (100-1000 km) scales of GPS studies and local (0.01-1 km) scales of radar scattering measurements. Our data exhibit a range of complex structures and waves. Some fluctuations have the characteristics of travelling ionospheric disturbances (TIDs), while others take the form of narrow, slowly-drifting bands aligned along the Earth's magnetic field. △ Less

Submitted 5 June, 2015; originally announced June 2015.

Comments: Accepted for publication in Radio Science

Real-time imaging of density ducts between the plasmasphere and ionosphere

Authors: Shyeh T**g Loi, Tara Murphy, Iver H. Cairns, Frederick W. Menk, Colin L. Waters, Philip J. Erickson, Cathryn M. Trott, Natasha Hurley-Walker, John Morgan, Emil Lenc, Andre R. Offringa, Martin E. Bell, Ronald D. Ekers, B. M. Gaensler, Colin J. Lonsdale, Lu Feng, Paul J. Hancock, David L. Kaplan, G. Bernardi, J. D. Bowman, F. Briggs, R. J. Cappallo, A. A. Deshpande, L. J. Greenhill, B. J. Hazelton , et al. (16 additional authors not shown)

Abstract: Ionization of the Earth's atmosphere by sunlight forms a complex, multi-layered plasma environment within the Earth's magnetosphere, the innermost layers being the ionosphere and plasmasphere. The plasmasphere is believed to be embedded with cylindrical density structures (ducts) aligned along the Earth's magnetic field, but direct evidence for these remains scarce. Here we report the first direct… ▽ More Ionization of the Earth's atmosphere by sunlight forms a complex, multi-layered plasma environment within the Earth's magnetosphere, the innermost layers being the ionosphere and plasmasphere. The plasmasphere is believed to be embedded with cylindrical density structures (ducts) aligned along the Earth's magnetic field, but direct evidence for these remains scarce. Here we report the first direct wide-angle observation of an extensive array of field-aligned ducts bridging the upper ionosphere and inner plasmasphere, using a novel ground-based imaging technique. We establish their heights and motions by feature-tracking and parallax analysis. The structures are strikingly organized, appearing as regularly-spaced, alternating tubes of overdensities and underdensities strongly aligned with the Earth's magnetic field. These findings represent the first direct visual evidence for the existence of such structures. △ Less

Submitted 24 April, 2015; originally announced April 2015.

Comments: Accepted for publication in Geophysical Research Letters

Realisation of a low frequency SKA Precursor: The Murchison Widefield Array

Authors: S. J. Tingay, R. Goeke, J. N. Hewitt, E. Morgan, R. A Remillard, C. L. Williams, J. D. Bowman, D. Emrich, S. M. Ord, T. Booler, B. Crosse, D. Pallot, W. Arcus, T. Colegate, P. J. Hall, D. Herne, M. J. Lynch, F. Schlagenhaufer, S. Tremblay, R. B. Wayth, M. Waterson, D. A. Mitchell, R. J. Sault, R. L. Webster, J. S. B. Wyithe , et al. (34 additional authors not shown)

Abstract: The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) dete… ▽ More The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) detection of fluctuations in the brightness temperature of the diffuse redshifted 21 cm line of neutral hydrogen from the epoch of reionisation; 2) studies of Galactic and extragalactic processes based on deep, confusion-limited surveys of the full sky visible to the array; 3) time domain astrophysics through exploration of the variable radio sky; and 4) solar imaging and characterisation of the heliosphere and ionosphere via propagation effects on background radio source emission. This paper will focus on a brief discussion of the as-built MWA system, highlighting several novel characteristics of the instrument, and a brief progress report (as of June 2012) on the final construction phase. Practical completion of the MWA is expected in November 2012, with commissioning commencing from approximately August 2012 and operations commencing near mid 2013. A brief description of recent science results from the MWA prototype instrument is given. △ Less

Submitted 6 December, 2012; originally announced December 2012.

Comments: 8 pages, Resolving the Sky - Radio Interferometry: Past, Present and Future - RTS2012, April 17-20, 2012, Manchester, UK

Enabling a High Throughput Real Time Data Pipeline for a Large Radio Telescope Array with GPUs

Authors: R. G. Edgar, M. A. Clark, K. Dale, D. A. Mitchell, S. M. Ord, R. B. Wayth, H. Pfister, L. J. Greenhill

Abstract: The Murchison Widefield Array (MWA) is a next-generation radio telescope currently under construction in the remote Western Australia Outback. Raw data will be generated continuously at 5GiB/s, grouped into 8s cadences. This high throughput motivates the development of on-site, real time processing and reduction in preference to archiving, transport and off-line processing. Each batch of 8s data m… ▽ More The Murchison Widefield Array (MWA) is a next-generation radio telescope currently under construction in the remote Western Australia Outback. Raw data will be generated continuously at 5GiB/s, grouped into 8s cadences. This high throughput motivates the development of on-site, real time processing and reduction in preference to archiving, transport and off-line processing. Each batch of 8s data must be completely reduced before the next batch arrives. Maintaining real time operation will require a sustained performance of around 2.5TFLOP/s (including convolutions, FFTs, interpolations and matrix multiplications). We describe a scalable heterogeneous computing pipeline implementation, exploiting both the high computing density and FLOP-per-Watt ratio of modern GPUs. The architecture is highly parallel within and across nodes, with all major processing elements performed by GPUs. Necessary scatter-gather operations along the pipeline are loosely synchronized between the nodes hosting the GPUs. The MWA will be a frontier scientific instrument and a pathfinder for planned peta- and exascale facilities. △ Less

Submitted 14 June, 2010; v1 submitted 29 March, 2010; originally announced March 2010.

Comments: Version accepted by Comp. Phys. Comm