-
Investigating Mutual Coupling in the Hydrogen Epoch of Reionization Array and Mitigating its Effects on the 21-cm Power Spectrum
Authors:
E. Rath,
R. Pascua,
A. T. Josaitis,
A. Ewall-Wice,
N. Fagnoni,
E. de Lera Acedo,
Z. E. Martinot,
Z. Abdurashidova,
T. Adams,
J. E. Aguirre,
R. Baartman,
A. P. Beardsley,
L. M. Berkhout,
G. Bernardi,
T. S. Billings,
J. D. Bowman,
P. Bull,
J. Burba,
R. Byrne,
S. Carey,
K. -F. Chen,
S. Choudhuri,
T. Cox,
D. R. DeBoer,
M. Dexter
, et al. (56 additional authors not shown)
Abstract:
Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategi…
▽ More
Interferometric experiments designed to detect the highly redshifted 21-cm signal from neutral hydrogen are producing increasingly stringent constraints on the 21-cm power spectrum, but some k-modes remain systematics-dominated. Mutual coupling is a major systematic that must be overcome in order to detect the 21-cm signal, and simulations that reproduce effects seen in the data can guide strategies for mitigating mutual coupling. In this paper, we analyse 12 nights of data from the Hydrogen Epoch of Reionization Array and compare the data against simulations that include a computationally efficient and physically motivated semi-analytic treatment of mutual coupling. We find that simulated coupling features qualitatively agree with coupling features in the data; however, coupling features in the data are brighter than the simulated features, indicating the presence of additional coupling mechanisms not captured by our model. We explore the use of fringe-rate filters as mutual coupling mitigation tools and use our simulations to investigate the effects of mutual coupling on a simulated cosmological 21-cm power spectrum in a "worst case" scenario where the foregrounds are particularly bright. We find that mutual coupling contaminates a large portion of the "EoR Window", and the contamination is several orders-of-magnitude larger than our simulated cosmic signal across a wide range of cosmological Fourier modes. While our fiducial fringe-rate filtering strategy reduces mutual coupling by roughly a factor of 100 in power, a non-negligible amount of coupling cannot be excised with fringe-rate filters, so more sophisticated mitigation strategies are required.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
High-dimensional inference of radio interferometer beam patterns I: Parametric model of the HERA beams
Authors:
Michael J. Wilensky,
Jacob Burba,
Philip Bull,
Hugh Garsden,
Katrine A. Glasscock,
Nicolas Fagnoni,
Eloy de Lera Acedo,
David R. DeBoer,
Nima Razavi-Ghods
Abstract:
Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity map**, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement an…
▽ More
Accurate modelling of the primary beam is an important but difficult task in radio astronomy. For high dynamic range problems such as 21cm intensity map**, small modelling errors in the sidelobes and spectral structure of the beams can translate into significant systematic errors. Realistic beams exhibit complex spatial and spectral structure, presenting a major challenge for beam measurement and calibration methods. In this paper series, we present a Bayesian framework to infer per-element beam patterns from the interferometric visibilities for large arrays with complex beam structure, assuming a particular (but potentially uncertain) sky model and calibration solution. In this first paper, we develop a compact basis for the beam so that the Bayesian computation is tractable with high-dimensional sampling methods. We use the Hydrogen Epoch of Reionization Array (HERA) as an example, verifying that the basis is capable of describing its single-element E-field beam (i.e. without considering array effects like mutual coupling) with a relatively small number of coefficients. We find that 32 coefficients per feed, incident polarization, and frequency, are sufficient to give percent-level and $\sim$10\% errors in the mainlobe and sidelobes respectively for the current HERA Vivaldi feeds, improving to $\sim 0.1\%$ and $\sim 1\%$ for 128 coefficients.
△ Less
Submitted 20 March, 2024;
originally announced March 2024.
-
A demonstration of the effect of fringe-rate filtering in the Hydrogen Epoch of Reionization Array delay power spectrum pipeline
Authors:
Hugh Garsden,
Philip Bull,
Mike Wilensky,
Zuhra Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Lindsay M. Berkhout,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter
, et al. (72 additional authors not shown)
Abstract:
Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correl…
▽ More
Radio interferometers targeting the 21cm brightness temperature fluctuations at high redshift are subject to systematic effects that operate over a range of different timescales. These can be isolated by designing appropriate Fourier filters that operate in fringe-rate (FR) space, the Fourier pair of local sidereal time (LST). Applications of FR filtering include separating effects that are correlated with the rotating sky vs. those relative to the ground, down-weighting emission in the primary beam sidelobes, and suppressing noise. FR filtering causes the noise contributions to the visibility data to become correlated in time however, making interpretation of subsequent averaging and error estimation steps more subtle. In this paper, we describe fringe rate filters that are implemented using discrete prolate spheroidal sequences, and designed for two different purposes -- beam sidelobe/horizon suppression (the `mainlobe' filter), and ground-locked systematics removal (the `notch' filter). We apply these to simulated data, and study how their properties affect visibilities and power spectra generated from the simulations. Included is an introduction to fringe-rate filtering and a demonstration of fringe-rate filters applied to simple situations to aid understanding.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
Hydrogen Epoch of Reionization Array (HERA) Phase II Deployment and Commissioning
Authors:
Lindsay M. Berkhout,
Daniel C. Jacobs,
Zuhra Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (71 additional authors not shown)
Abstract:
This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system an…
▽ More
This paper presents the design and deployment of the Hydrogen Epoch of Reionization Array (HERA) phase II system. HERA is designed as a staged experiment targeting 21 cm emission measurements of the Epoch of Reionization. First results from the phase I array are published as of early 2022, and deployment of the phase II system is nearing completion. We describe the design of the phase II system and discuss progress on commissioning and future upgrades. As HERA is a designated Square Kilometer Array (SKA) pathfinder instrument, we also show a number of "case studies" that investigate systematics seen while commissioning the phase II system, which may be of use in the design and operation of future arrays. Common pathologies are likely to manifest in similar ways across instruments, and many of these sources of contamination can be mitigated once the source is identified.
△ Less
Submitted 8 January, 2024;
originally announced January 2024.
-
matvis: A matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays
Authors:
Piyanat Kittiwisit,
Steven G. Murray,
Hugh Garsden,
Philip Bull,
Christopher Cain,
Aaron R. Parsons,
Jackson Sipple,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Lindsay M. Berkhout,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Kai-Feng Chen,
Carina Cheng
, et al. (73 additional authors not shown)
Abstract:
Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability…
▽ More
Detection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionisation will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorised outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelisation techniques. We validate the results of this method, implemented in the publicly-available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Bayesian estimation of cross-coupling and reflection systematics in 21cm array visibility data
Authors:
Geoff G. Murphy,
Philip Bull,
Mario G. Santos,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Christopher Cain,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon,
Nico Eksteen
, et al. (54 additional authors not shown)
Abstract:
Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method all…
▽ More
Observations with radio arrays that target the 21-cm signal originating from the early Universe suffer from a variety of systematic effects. An important class of these are reflections and spurious couplings between antennas. We apply a Hamiltonian Monte Carlo sampler to the modelling and mitigation of these systematics in simulated Hydrogen Epoch of Reionisation Array (HERA) data. This method allows us to form statistical uncertainty estimates for both our models and the recovered visibilities, which is an important ingredient in establishing robust upper limits on the Epoch of Reionisation (EoR) power spectrum. In cases where the noise is large compared to the EoR signal, this approach can constrain the systematics well enough to mitigate them down to the noise level for both systematics studied. Where the noise is smaller than the EoR, our modelling can mitigate the majority of the reflections with there being only a minor level of residual systematics, while cross-coupling sees essentially complete mitigation. Our approach performs similarly to existing filtering/fitting techniques used in the HERA pipeline, but with the added benefit of rigorously propagating uncertainties. In all cases it does not significantly attenuate the underlying signal.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
Direct Optimal Map** Image Power Spectrum and its Window Functions
Authors:
Zhilei Xu,
Honggeun Kim,
Jacqueline N. Hewitt,
Kai-Feng Chen,
Nicholas S. Kern,
Eleanor Rath,
Ruby Byrne,
Adélie Gorce,
Robert Pascua,
Zachary E. Martinot,
Joshua S. Dillon,
Bryna J. Hazelton,
Adrian Liu,
Miguel F. Morales,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman
, et al. (57 additional authors not shown)
Abstract:
The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal map** (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based…
▽ More
The key to detecting neutral hydrogen during the epoch of reionization (EoR) is to separate the cosmological signal from the dominating foreground radiation. We developed direct optimal map** (DOM) to map interferometric visibilities; it contains only linear operations, with full knowledge of point spread functions from visibilities to images. Here, we demonstrate a fast Fourier transform-based image power spectrum and its window functions computed from the DOM images. We use noiseless simulation, based on the Hydrogen Epoch of Reionization Array Phase I configuration, to study the image power spectrum properties. The window functions show $<10^{-11}$ of the integrated power leaks from the foreground-dominated region into the EoR window; the 2D and 1D power spectra also verify the separation between the foregrounds and the EoR.
△ Less
Submitted 5 July, 2024; v1 submitted 17 November, 2023;
originally announced November 2023.
-
The Impact of Beam Variations on Power Spectrum Estimation for 21 cm Cosmology II: Mitigation of Foreground Systematics for HERA
Authors:
Honggeun Kim,
Nicholas S. Kern,
Jacqueline N. Hewitt,
Bang D. Nhan,
Joshua S. Dillon,
Eloy de Lera Acedo,
Scott B. C. Dynes,
Nivedita Mahesh,
Nicolas Fagnoni,
David R. DeBoer
Abstract:
One key challenge in detecting 21 cm cosmological signal at z > 6 is to separate the cosmological signal from foreground emission. This can be studied in a power spectrum space where the foreground is confined to low delay modes whereas the cosmological signal can spread out to high delay modes. When there is a calibration error, however, chromaticity of gain errors propagates to the power spectru…
▽ More
One key challenge in detecting 21 cm cosmological signal at z > 6 is to separate the cosmological signal from foreground emission. This can be studied in a power spectrum space where the foreground is confined to low delay modes whereas the cosmological signal can spread out to high delay modes. When there is a calibration error, however, chromaticity of gain errors propagates to the power spectrum estimate and contaminates the modes for cosmological detection. The Hydrogen Epoch of Reionization Array (HERA) employs a high-precision calibration scheme using redundancy in measurements. In this study, we focus on the gain errors induced by nonredundancies arising from feed offset relative to the HERA's 14 meter parabolic dish element, and investigate how to mitigate the chromatic gain errors using three different methods: restricting baseline lengths for calibration, smoothing the antenna gains, and applying a temporal filter prior to calibration. With 2 cm/2 degree perturbations for translation/tilting motions, a level achievable under normal HERA operating conditions, the combination of the baseline cut and temporal filtering indicates that the spurious gain feature due to nonredundancies is significantly reduced, and the power spectrum recovers the clean foreground-free region. We found that the mitigation technique works even for large feed motions but in order to keep a stable calibration process, the feed positions need to be constrained to 2 cm for translation motions and 2 degree for tilting offset relative to the dish's vertex.
△ Less
Submitted 24 July, 2023;
originally announced July 2023.
-
Search for the Epoch of Reionisation with HERA: Upper Limits on the Closure Phase Delay Power Spectrum
Authors:
Pascal M. Keller,
Bojan Nikolic,
Nithyanandan Thyagarajan,
Chris L. Carilli,
Gianni Bernardi,
Ntsikelelo Charles,
Landman Bester,
Oleg M. Smirnov,
Nicholas S. Kern,
Joshua S. Dillon,
Bryna J. Hazelton,
Miguel F. Morales,
Daniel C. Jacobs,
Aaron R. Parsons,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley
, et al. (58 additional authors not shown)
Abstract:
Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standa…
▽ More
Radio interferometers aiming to measure the power spectrum of the redshifted 21 cm line during the Epoch of Reionisation (EoR) need to achieve an unprecedented dynamic range to separate the weak signal from overwhelming foreground emissions. Calibration inaccuracies can compromise the sensitivity of these measurements to the effect that a detection of the EoR is precluded. An alternative to standard analysis techniques makes use of the closure phase, which allows one to bypass antenna-based direction-independent calibration. Similarly to standard approaches, we use a delay spectrum technique to search for the EoR signal. Using 94 nights of data observed with Phase I of the Hydrogen Epoch of Reionization Array (HERA), we place approximate constraints on the 21 cm power spectrum at $z=7.7$. We find at 95% confidence that the 21 cm EoR brightness temperature is $\le$(372)$^2$ "pseudo" mK$^2$ at 1.14 "pseudo" $h$ Mpc$^{-1}$, where the "pseudo" emphasises that these limits are to be interpreted as approximations to the actual distance scales and brightness temperatures. Using a fiducial EoR model, we demonstrate the feasibility of detecting the EoR with the full array. Compared to standard methods, the closure phase processing is relatively simple, thereby providing an important independent check on results derived using visibility intensities, or related.
△ Less
Submitted 15 February, 2023;
originally announced February 2023.
-
On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations
Authors:
Ntsikelelo Charles,
Nicholas Kern,
Gianni Bernardi,
Landman Bester,
Oleg Smirnov,
Nicolas Fagnoni,
Eloy de Lera Acedo
Abstract:
Precision antenna calibration is required for mitigating the impact of foreground contamination in 21 cm cosmological radio surveys. One widely studied source of error is the effect of missing point sources in the calibration sky model; however, poorly understood diffuse galactic emission also creates a calibration bias that can complicate the clean separation of foregrounds from the 21 cm signal.…
▽ More
Precision antenna calibration is required for mitigating the impact of foreground contamination in 21 cm cosmological radio surveys. One widely studied source of error is the effect of missing point sources in the calibration sky model; however, poorly understood diffuse galactic emission also creates a calibration bias that can complicate the clean separation of foregrounds from the 21 cm signal. In this work, we present a technique for suppressing this bias with temporal filtering of radio interferometric visibilities observed in a drift-scan mode. We demonstrate this technique on mock simulations of the Hydrogen Epoch of Reionization Array (HERA) experiment. Inspecting the recovered calibration solutions, we find that our technique reduces spurious errors by over an order of magnitude. This improved accuracy approaches the required accuracy needed to make a fiducial detection of the 21 cm signal with HERA, but is dependent on a number of external factors that we discuss. We also explore different types of temporal filtering techniques and discuss their relative performance and tradeoffs.
△ Less
Submitted 4 April, 2023; v1 submitted 1 February, 2023;
originally announced February 2023.
-
The Impact of Beam Variations on Power Spectrum Estimation for 21-cm Cosmology I: Simulations of Foreground Contamination for HERA
Authors:
Honggeun Kim,
Bang D. Nhan,
Jacqueline N. Hewitt,
Nicholas S. Kern,
Joshua S. Dillon,
Eloy de Lera Acedo,
Scott Dynes,
Nivedita Mahesh,
Nicolas Fagnoni,
David R. DeBoer
Abstract:
Detecting cosmological signals from the Epoch of Reionization (EoR) requires high-precision calibration to isolate the cosmological signals from foreground emission. In radio interferometery, perturbed primary beams of antenna elements can disrupt the precise calibration, which results in contaminating the foreground-free region, or the EoR window, in the cylindrically averaged power spectrum. For…
▽ More
Detecting cosmological signals from the Epoch of Reionization (EoR) requires high-precision calibration to isolate the cosmological signals from foreground emission. In radio interferometery, perturbed primary beams of antenna elements can disrupt the precise calibration, which results in contaminating the foreground-free region, or the EoR window, in the cylindrically averaged power spectrum. For Hydrogen Epoch of Reionization Array (HERA), we simulate and characterize the perturbed primary beams induced by feed motions such as axial, lateral, and tilting motions, above the 14-meter dish. To understand the effect of the perturbed beams, visibility measurements are modeled with two different foreground components, point sources and diffuse sources, and we find different feed motions present a different reaction to each type of sky source. HERA's redundant-baseline calibration in the presence of non-redundant antenna beams due to feed motions introduces chromatic errors in gain solutions, which produces foreground power leakage into the EoR window. The observed leakage from vertical feed motions comes predominately from point sources around zenith. Furthermore, the observed leakage from horizontal and tilting feed motion comes predominately from the diffuse components near the horizon. Mitigation of chromatic gain errors will be necessary for robust detection of the EoR signals with minimal foreground bias, and this will be discussed in the subsequent paper.
△ Less
Submitted 28 October, 2022;
originally announced October 2022.
-
Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
Authors:
Michael Pagano,
**g Liu,
Adrian Liu,
Nicholas S. Kern,
Aaron Ewall-Wice,
Philip Bull,
Robert Pascua,
Siamak Ravanbakhsh,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer
, et al. (53 additional authors not shown)
Abstract:
Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum du…
▽ More
Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.
△ Less
Submitted 20 February, 2023; v1 submitted 26 October, 2022;
originally announced October 2022.
-
Improved Constraints on the 21 cm EoR Power Spectrum and the X-Ray Heating of the IGM with HERA Phase I Observations
Authors:
The HERA Collaboration,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Rennan Barkana,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Daniela Breitman,
Philip Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
Samir Choudhuri,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (70 additional authors not shown)
Abstract:
We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that…
▽ More
We report the most sensitive upper limits to date on the 21 cm epoch of reionization power spectrum using 94 nights of observing with Phase I of the Hydrogen Epoch of Reionization Array (HERA). Using similar analysis techniques as in previously reported limits (HERA Collaboration 2022a), we find at 95% confidence that $Δ^2(k = 0.34$ $h$ Mpc$^{-1}$) $\leq 457$ mK$^2$ at $z = 7.9$ and that $Δ^2 (k = 0.36$ $h$ Mpc$^{-1}) \leq 3,496$ mK$^2$ at $z = 10.4$, an improvement by a factor of 2.1 and 2.6 respectively. These limits are mostly consistent with thermal noise over a wide range of $k$ after our data quality cuts, despite performing a relatively conservative analysis designed to minimize signal loss. Our results are validated with both statistical tests on the data and end-to-end pipeline simulations. We also report updated constraints on the astrophysics of reionization and the cosmic dawn. Using multiple independent modeling and inference techniques previously employed by HERA Collaboration (2022b), we find that the intergalactic medium must have been heated above the adiabatic cooling limit at least as early as $z = 10.4$, ruling out a broad set of so-called "cold reionization" scenarios. If this heating is due to high-mass X-ray binaries during the cosmic dawn, as is generally believed, our result's 99% credible interval excludes the local relationship between soft X-ray luminosity and star formation and thus requires heating driven by evolved low-metallicity stars.
△ Less
Submitted 19 January, 2023; v1 submitted 10 October, 2022;
originally announced October 2022.
-
Impact of instrument and data characteristics in the interferometric reconstruction of the 21 cm power spectrum
Authors:
Adélie Gorce,
Samskruthi Ganjam,
Adrian Liu,
Steven G. Murray,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Joshua S. Dillon
, et al. (53 additional authors not shown)
Abstract:
Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the map** between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand t…
▽ More
Combining the visibilities measured by an interferometer to form a cosmological power spectrum is a complicated process. In a delay-based analysis, the map** between instrumental and cosmological space is not a one-to-one relation. Instead, neighbouring modes contribute to the power measured at one point, with their respective contributions encoded in the window functions. To better understand the power measured by an interferometer, we assess the impact of instrument characteristics and analysis choices on these window functions. Focusing on the Hydrogen Epoch of Reionization Array (HERA) as a case study, we find that long-baseline observations correspond to enhanced low-k tails of the window functions, which facilitate foreground leakage, whilst an informed choice of bandwidth and frequency taper can reduce said tails. With simple test cases and realistic simulations, we show that, apart from tracing mode mixing, the window functions help accurately reconstruct the power spectrum estimator of simulated visibilities. The window functions depend strongly on the beam chromaticity, and less on its spatial structure - a Gaussian approximation, ignoring side lobes, is sufficient. Finally, we investigate the potential of asymmetric window functions, down-weighting the contribution of low-k power to avoid foreground leakage. The window functions presented here correspond to the latest HERA upper limits for the full Phase I data. They allow an accurate reconstruction of the power spectrum measured by the instrument and will be used in future analyses to confront theoretical models and data directly in cylindrical space.
△ Less
Submitted 11 January, 2023; v1 submitted 7 October, 2022;
originally announced October 2022.
-
Direct Optimal Map** for 21cm Cosmology: A Demonstration with the Hydrogen Epoch of Reionization Array
Authors:
Zhilei Xu,
Jacqueline N. Hewitt,
Kai-Feng Chen,
Honggeun Kim,
Joshua S. Dillon,
Nicholas S. Kern,
Miguel F. Morales,
Bryna J. Hazelton,
Ruby Byrne,
Nicolas Fagnoni,
Eloy de Lera Acedo,
Zara Abdurashidova,
Tyrone Adams,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Rushelle Baartman,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba
, et al. (56 additional authors not shown)
Abstract:
Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal map** pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal map** with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipe…
▽ More
Motivated by the desire for wide-field images with well-defined statistical properties for 21cm cosmology, we implement an optimal map** pipeline that computes a maximum likelihood estimator for the sky using the interferometric measurement equation. We demonstrate this direct optimal map** with data from the Hydrogen Epoch of Reionization (HERA) Phase I observations. After validating the pipeline with simulated data, we develop a maximum likelihood figure-of-merit for comparing four sky models at 166MHz with a bandwidth of 100kHz. The HERA data agree with the GLEAM catalogs to <10%. After subtracting the GLEAM point sources, the HERA data discriminate between the different continuum sky models, providing most support for the model of Byrne et al. 2021. We report the computation cost for map** the HERA Phase I data and project the computation for the HERA 320-antenna data; both are feasible with a modern server. The algorithm is broadly applicable to other interferometers and is valid for wide-field and non-coplanar arrays.
△ Less
Submitted 26 October, 2022; v1 submitted 12 April, 2022;
originally announced April 2022.
-
Simulations of primary beam effects on the cosmic bispectrum phase observed with the Hydrogen Epoch of Reionization Array
Authors:
N. Charles,
G. Bernardi,
H. L. Bester,
O. M. Smirnov,
C. Carilli,
P. M. Keller,
N. Kern,
B. Nikolic,
N. Thyagarajan,
E. de Lera Acedo,
N. Fagnoni,
M. G. Santos
Abstract:
The 21~cm transition from neutral Hydrogen promises to be the best observational probe of the Epoch of Reionisation. The main difficulty in measuring the 21 cm signal is the presence of bright foregrounds that require very accurate interferometric calibration. Closure quantities may circumvent the calibration requirements but may be, however, affected by direction dependent effects, particularly a…
▽ More
The 21~cm transition from neutral Hydrogen promises to be the best observational probe of the Epoch of Reionisation. The main difficulty in measuring the 21 cm signal is the presence of bright foregrounds that require very accurate interferometric calibration. Closure quantities may circumvent the calibration requirements but may be, however, affected by direction dependent effects, particularly antenna primary beam responses. This work investigates the impact of antenna primary beams affected by mutual coupling on the closure phase and its power spectrum. Our simulations show that primary beams affected by mutual coupling lead to a leakage of foreground power into the EoR window, which can be up to $\sim4$ orders magnitude higher than the case where no mutual coupling is considered. This leakage is, however, essentially confined at $k < 0.3$~$h$~Mpc$^{-1}$ for triads that include 29~m baselines. The leakage magnitude is more pronounced when bright foregrounds appear in the antenna sidelobes, as expected. Finally, we find that triads that include mutual coupling beams different from each other have power spectra similar to triads that include the same type of mutual coupling beam, indicating that beam-to-beam variation within triads (or visibility pairs) is not the major source of foreground leakage in the EoR window.
△ Less
Submitted 19 May, 2022; v1 submitted 23 December, 2021;
originally announced December 2021.
-
Array Element Coupling in Radio Interferometry I: A Semi-Analytic Approach
Authors:
Alec T. Josaitis,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Eloy de Lera Acedo
Abstract:
We derive a general formalism for interferometric visibilities, which considers first-order antenna-antenna coupling and assumes steady-state, incident radiation. We simulate such coupling features for non-polarized skies on a compact, redundantly-spaced array and present a phenomenological analysis of the coupling features. Contrary to previous studies, we find mutual coupling features manifest t…
▽ More
We derive a general formalism for interferometric visibilities, which considers first-order antenna-antenna coupling and assumes steady-state, incident radiation. We simulate such coupling features for non-polarized skies on a compact, redundantly-spaced array and present a phenomenological analysis of the coupling features. Contrary to previous studies, we find mutual coupling features manifest themselves at nonzero fringe rates. We compare power spectrum results for both coupled and non-coupled (noiseless, simulated) data and find coupling effects to be highly dependent on LST, baseline length, and baseline orientation. For all LSTs, lengths, and orientations, coupling features appear at delays which are outside the foreground 'wedge', which has been studied extensively and contains non-coupled astrophysical foreground features. Further, we find that first-order coupling effects threaten our ability to average data from baselines with identical length and orientation. Two filtering strategies are proposed which may mitigate such coupling systematics. The semi-analytic coupling model herein presented may be used to study mutual coupling systematics as a function of LST, baseline length, and baseline orientation. Such a model is not only helpful to the field of 21cm cosmology, but any study involving interferometric measurements, where coupling effects at the level of at least 1 part in 10^4 could corrupt the scientific result. Our model may be used to mitigate coupling systematics in existing radio interferometers and to design future arrays where the configuration of array elements inherently mitigates coupling effects at desired LSTs and angular resolutions.
△ Less
Submitted 4 April, 2022; v1 submitted 20 October, 2021;
originally announced October 2021.
-
Automated Detection of Antenna Malfunctions in Large-N Interferometers: A Case Study with the Hydrogen Epoch of Reionization Array
Authors:
Dara Storer,
Joshua S. Dillon,
Daniel C. Jacobs,
Miguel F. Morales,
Bryna J. Hazelton,
Aaron Ewall-Wice,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Matt Dexter,
Scott Dynes
, et al. (53 additional authors not shown)
Abstract:
We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for…
▽ More
We present a framework for identifying and flagging malfunctioning antennas in large radio interferometers. We outline two distinct categories of metrics designed to detect outliers along known failure modes of large arrays: cross-correlation metrics, based on all antenna pairs, and auto-correlation metrics, based solely on individual antennas. We define and motivate the statistical framework for all metrics used, and present tailored visualizations that aid us in clearly identifying new and existing systematics. We implement these techniques using data from 105 antennas in the Hydrogen Epoch of Reionization Array (HERA) as a case study. Finally, we provide a detailed algorithm for implementing these metrics as flagging tools on real data sets.
△ Less
Submitted 4 May, 2022; v1 submitted 26 September, 2021;
originally announced September 2021.
-
Radio antenna design for sky-averaged 21 cm cosmology experiments: the REACH case
Authors:
J. Cumner,
E. De Lera Acedo,
D. I. L. de Villiers,
D. Anstey,
C. I. Kolitsidas,
B. Gurdon,
N. Fagnoni,
P. Alexander,
G. Bernardi,
H. T. J. Bevins,
S. Carey,
J. Cavillot,
R. Chiello,
C. Craeye,
W. Croukamp,
J. A. Ely,
A. Fialkov,
T. Gessey-Jones,
Q. Gueuning,
W. Handley,
R. Hills,
A. T. Josaitis,
G. Kulkarni,
A. Magro,
R. Maiolino
, et al. (13 additional authors not shown)
Abstract:
Following the reported detection of an absorption profile associated with the 21~cm sky-averaged signal from the Cosmic Dawn by the EDGES experiment in 2018, a number of experiments have been set up to verify this result. This paper discusses the design process used for global 21~cm experiments, focusing specifically on the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH). This experim…
▽ More
Following the reported detection of an absorption profile associated with the 21~cm sky-averaged signal from the Cosmic Dawn by the EDGES experiment in 2018, a number of experiments have been set up to verify this result. This paper discusses the design process used for global 21~cm experiments, focusing specifically on the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH). This experiment will seek to understand and compensate for systematic errors present using detailed modelling and characterization of the instrumentation. There is detailed the quantitative figures of merit and numerical modelling used to assist the design process of the REACH dipole antenna (one of the 2 antenna designs for REACH Phase I). This design process produced a 2.5:1 frequency bandwidth dipole. The aim of this design was to balance spectral smoothness and low impedance reflections with the ability to describe and understand the antenna response to the sky signal to inform the critically important calibration during observation and data analysis.
△ Less
Submitted 12 January, 2023; v1 submitted 21 September, 2021;
originally announced September 2021.
-
HERA Phase I Limits on the Cosmic 21-cm Signal: Constraints on Astrophysics and Cosmology During the Epoch of Reionization
Authors:
The HERA Collaboration,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki Ali,
Yanga Balfour,
Rennan Barkana,
Adam Beardsley,
Gianni Bernardi,
Tashalee Billings,
Judd Bowman,
Richard Bradley,
Phillip Bull,
Jacob Burba,
Steven Carey,
Christopher Carilli,
Carina Cheng,
David DeBoer,
Matthew Dexter,
Eloy de Lera Acedo,
Joshua Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Anastasia Fialkov
, et al. (59 additional authors not shown)
Abstract:
Recently, the Hydrogen Epoch of Reionization Array (HERA) collaboration has produced the experiment's first upper limits on the power spectrum of 21-cm fluctuations at z~8 and 10. Here, we use several independent theoretical models to infer constraints on the intergalactic medium (IGM) and galaxies during the epoch of reionization (EoR) from these limits. We find that the IGM must have been heated…
▽ More
Recently, the Hydrogen Epoch of Reionization Array (HERA) collaboration has produced the experiment's first upper limits on the power spectrum of 21-cm fluctuations at z~8 and 10. Here, we use several independent theoretical models to infer constraints on the intergalactic medium (IGM) and galaxies during the epoch of reionization (EoR) from these limits. We find that the IGM must have been heated above the adiabatic cooling threshold by z~8, independent of uncertainties about the IGM ionization state and the nature of the radio background. Combining HERA limits with galaxy and EoR observations constrains the spin temperature of the z~8 neutral IGM to 27 K < T_S < 630 K (2.3 K < T_S < 640 K) at 68% (95%) confidence. They therefore also place a lower bound on X-ray heating, a previously unconstrained aspects of early galaxies. For example, if the CMB dominates the z~8 radio background, the new HERA limits imply that the first galaxies produced X-rays more efficiently than local ones (with soft band X-ray luminosities per star formation rate constrained to L_X/SFR = { 10^40.2, 10^41.9 } erg/s/(M_sun/yr) at 68% confidence), consistent with expectations of X-ray binaries in low-metallicity environments. The z~10 limits require even earlier heating if dark-matter interactions (e.g., through millicharges) cool down the hydrogen gas. Using a model in which an extra radio background is produced by galaxies, we rule out (at 95% confidence) the combination of high radio and low X-ray luminosities of L_{r,ν}/SFR > 3.9 x 10^24 W/Hz/(M_sun/yr) and L_X/SFR<10^40 erg/s/(M_sun/yr). The new HERA upper limits neither support nor disfavor a cosmological interpretation of the recent EDGES detection. The analysis framework described here provides a foundation for the interpretation of future HERA results.
△ Less
Submitted 20 December, 2022; v1 submitted 16 August, 2021;
originally announced August 2021.
-
First Results from HERA Phase I: Upper Limits on the Epoch of Reionization 21 cm Power Spectrum
Authors:
The HERA Collaboration,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Taylor Dibblee-Barkman,
Joshua S. Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Randall Fritz
, et al. (52 additional authors not shown)
Abstract:
We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground…
▽ More
We report upper-limits on the Epoch of Reionization (EoR) 21 cm power spectrum at redshifts 7.9 and 10.4 with 18 nights of data ($\sim36$ hours of integration) from Phase I of the Hydrogen Epoch of Reionization Array (HERA). The Phase I data show evidence for systematics that can be largely suppressed with systematic models down to a dynamic range of $\sim10^9$ with respect to the peak foreground power. This yields a 95% confidence upper limit on the 21 cm power spectrum of $Δ^2_{21} \le (30.76)^2\ {\rm mK}^2$ at $k=0.192\ h\ {\rm Mpc}^{-1}$ at $z=7.9$, and also $Δ^2_{21} \le (95.74)^2\ {\rm mK}^2$ at $k=0.256\ h\ {\rm Mpc}^{-1}$ at $z=10.4$. At $z=7.9$, these limits are the most sensitive to-date by over an order of magnitude. While we find evidence for residual systematics at low line-of-sight Fourier $k_\parallel$ modes, at high $k_\parallel$ modes we find our data to be largely consistent with thermal noise, an indicator that the system could benefit from deeper integrations. The observed systematics could be due to radio frequency interference, cable sub-reflections, or residual instrumental cross-coupling, and warrant further study. This analysis emphasizes algorithms that have minimal inherent signal loss, although we do perform a careful accounting in a companion paper of the small forms of loss or bias associated with the pipeline. Overall, these results are a promising first step in the development of a tuned, instrument-specific analysis pipeline for HERA, particularly as Phase II construction is completed en route to reaching the full sensitivity of the experiment.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Effects of model incompleteness on the drift-scan calibration of radio telescopes
Authors:
Bharat K. Gehlot,
Daniel C. Jacobs,
Judd D. Bowman,
Nivedita Mahesh,
Steven G. Murray,
Matthew Kolopanis,
Adam P. Beardsley,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Gianni Bernardi,
Tashalee S. Billings,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
John Ely
, et al. (54 additional authors not shown)
Abstract:
Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less at…
▽ More
Precision calibration poses challenges to experiments probing the redshifted 21-cm signal of neutral hydrogen from the Cosmic Dawn and Epoch of Reionization (z~30-6). In both interferometric and global signal experiments, systematic calibration is the leading source of error. Though many aspects of calibration have been studied, the overlap between the two types of instruments has received less attention. We investigate the sky based calibration of total power measurements with a HERA dish and an EDGES style antenna to understand the role of auto-correlations in the calibration of an interferometer and the role of sky in calibrating a total power instrument. Using simulations we study various scenarios such as time variable gain, incomplete sky calibration model, and primary beam model. We find that temporal gain drifts, sky model incompleteness, and beam inaccuracies cause biases in the receiver gain amplitude and the receiver temperature estimates. In some cases, these biases mix spectral structure between beam and sky resulting in spectrally variable gain errors. Applying the calibration method to the HERA and EDGES data, we find good agreement with calibration via the more standard methods. Although instrumental gains are consistent with beam and sky errors similar in scale to those simulated, the receiver temperatures show significant deviations from expected values. While we show that it is possible to partially mitigate biases due to model inaccuracies by incorporating a time-dependent gain model in calibration, the resulting errors on calibration products are larger and more correlated. Completely addressing these biases will require more accurate sky and primary beam models.
△ Less
Submitted 15 July, 2021; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Validation of the HERA Phase I Epoch of Reionization 21 cm Power Spectrum Software Pipeline
Authors:
James E. Aguirre,
Steven G. Murray,
Robert Pascua,
Zachary E. Martinot,
Jacob Burba,
Joshua S. Dillon,
Daniel C. Jacobs,
Nicholas S. Kern,
Piyanat Kittiwisit,
Matthew Kolopanis,
Adam Lanman,
Adrian Liu,
Lily Whitler,
Zara Abdurashidova,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Steve Carey,
Chris L. Carilli
, et al. (51 additional authors not shown)
Abstract:
We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the…
▽ More
We describe the validation of the HERA Phase I software pipeline by a series of modular tests, building up to an end-to-end simulation. The philosophy of this approach is to validate the software and algorithms used in the Phase I upper limit analysis on wholly synthetic data satisfying the assumptions of that analysis, not addressing whether the actual data meet these assumptions. We discuss the organization of this validation approach, the specific modular tests performed, and the construction of the end-to-end simulations. We explicitly discuss the limitations in scope of the current simulation effort. With mock visibility data generated from a known analytic power spectrum and a wide range of realistic instrumental effects and foregrounds, we demonstrate that the current pipeline produces power spectrum estimates that are consistent with known analytic inputs to within thermal noise levels (at the 2 sigma level) for k > 0.2 h/Mpc for both bands and fields considered. Our input spectrum is intentionally amplified to enable a strong `detection' at k ~0.2 h/Mpc -- at the level of ~25 sigma -- with foregrounds dominating on larger scales, and thermal noise dominating at smaller scales. Our pipeline is able to detect this amplified input signal after suppressing foregrounds with a dynamic range (foreground to noise ratio) of > 10^7. Our validation test suite uncovered several sources of scale-independent signal loss throughout the pipeline, whose amplitude is well-characterized and accounted for in the final estimates. We conclude with a discussion of the steps required for the next round of data analysis.
△ Less
Submitted 19 April, 2021;
originally announced April 2021.
-
A Real Time Processing System for Big Data in Astronomy: Applications to HERA
Authors:
Paul La Plante,
Peter K. G. Williams,
Matthew Kolopanis,
Joshua S. Dillon,
Adam P. Beardsley,
Nicholas S. Kern,
Michael Wilensky,
Zaki S. Ali,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Yanga Balfour,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
John Ely
, et al. (50 additional authors not shown)
Abstract:
As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen…
▽ More
As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data.
△ Less
Submitted 30 September, 2021; v1 submitted 8 April, 2021;
originally announced April 2021.
-
Methods of Error Estimation for Delay Power Spectra in $21\,\textrm{cm}$ Cosmology
Authors:
Jianrong Tan,
Adrian Liu,
Nicholas S. Kern,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Christopher L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni
, et al. (49 additional authors not shown)
Abstract:
Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power…
▽ More
Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power spectrum approach, we have produced a critical examination of different ways that one can estimate error bars on the power spectrum. We do this through a synthesis of analytic work, simulations of toy models, and tests on small amounts of real data. We find that, although computed independently, the different error bar methodologies are in good agreement with each other in the noise-dominated regime of the power spectrum. For our preferred methodology, the predicted probability distribution function is consistent with the empirical noise power distributions from both simulated and real data. This diagnosis is mainly in support of the forthcoming HERA upper limit, and also is expected to be more generally applicable.
△ Less
Submitted 25 May, 2021; v1 submitted 17 March, 2021;
originally announced March 2021.
-
Design of the New Wideband Vivaldi Feed for the HERA Radio-Telescope Phase II
Authors:
Nicolas Fagnoni,
Eloy de Lera Acedo,
Nick Drought,
David R. DeBoer,
Daniel Riley,
Nima Razavi-Ghods,
Steven Carey,
Aaron R. Parsons
Abstract:
This paper presents the design of a new dual-polarised Vivaldi feed for the Hydrogen Epoch of Reionization Array (HERA) radio-telescope. This wideband feed has been developed to replace the Phase I dipole feed, and is used to illuminate a 14-m diameter dish. It aims to improve the science capabilities of HERA, by allowing it to characterise the redshifted 21-cm hydrogen signal from the Cosmic Dawn…
▽ More
This paper presents the design of a new dual-polarised Vivaldi feed for the Hydrogen Epoch of Reionization Array (HERA) radio-telescope. This wideband feed has been developed to replace the Phase I dipole feed, and is used to illuminate a 14-m diameter dish. It aims to improve the science capabilities of HERA, by allowing it to characterise the redshifted 21-cm hydrogen signal from the Cosmic Dawn as well as from the Epoch of Reionization. This is achieved by increasing the bandwidth from 100 -- 200 MHz to 50 -- 250 MHz, optimising the time response of the antenna - receiver system, and improving its sensitivity. This new Vivaldi feed is directly fed by a differential front-end module placed inside the circular cavity and connected to the back-end via cables which pass in the middle of the tapered slot. We show that this particular configuration has minimal effects on the radiation pattern and on the system response.
△ Less
Submitted 9 June, 2021; v1 submitted 16 September, 2020;
originally announced September 2020.
-
Measuring HERA's primary beam in-situ: methodology and first results
Authors:
Chuneeta D. Nunhokee,
Aaron R. Parsons,
Nicholas S. Kern,
Bojan Nikolic,
Jonathan C. Pober,
Gianni Bernardi,
Chris L. Carilli,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de~Lera~Acedo,
Joshua S. Dillon,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Randall Fritz
, et al. (42 additional authors not shown)
Abstract:
The central challenge in 21~cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes such as the Hydrogen Epoch of Reionization Array \citep[HERA, ][]{DeBoer2017} that do not move, primary beam characterization is partic…
▽ More
The central challenge in 21~cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes such as the Hydrogen Epoch of Reionization Array \citep[HERA, ][]{DeBoer2017} that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply \citep{Cornwell2005} and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from \citet{Pober2012} where they use beam symmetries to create a network of overlap** source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20~dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4~Jy at 151~MHz.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Detection of Cosmic Structures using the Bispectrum Phase. II. First Results from Application to Cosmic Reionization Using the Hydrogen Epoch of Reionization Array
Authors:
Nithyanandan Thyagarajan,
Chris L. Carilli,
Bojan Nikolic,
James Kent,
Andrei Mesinger,
Nicholas S. Kern,
Gianni Bernardi,
Siyanda Matika,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Steve Carey,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
John Ely
, et al. (47 additional authors not shown)
Abstract:
Characterizing the epoch of reionization (EoR) at $z\gtrsim 6$ via the redshifted 21 cm line of neutral Hydrogen (HI) is critical to modern astrophysics and cosmology, and thus a key science goal of many current and planned low-frequency radio telescopes. The primary challenge to detecting this signal is the overwhelmingly bright foreground emission at these frequencies, placing stringent requirem…
▽ More
Characterizing the epoch of reionization (EoR) at $z\gtrsim 6$ via the redshifted 21 cm line of neutral Hydrogen (HI) is critical to modern astrophysics and cosmology, and thus a key science goal of many current and planned low-frequency radio telescopes. The primary challenge to detecting this signal is the overwhelmingly bright foreground emission at these frequencies, placing stringent requirements on the knowledge of the instruments and inaccuracies in analyses. Results from these experiments have largely been limited not by thermal sensitivity but by systematics, particularly caused by the inability to calibrate the instrument to high accuracy. The interferometric bispectrum phase is immune to antenna-based calibration and errors therein, and presents an independent alternative to detect the EoR HI fluctuations while largely avoiding calibration systematics. Here, we provide a demonstration of this technique on a subset of data from the Hydrogen Epoch of Reionization Array (HERA) to place approximate constraints on the brightness temperature of the intergalactic medium (IGM). From this limited data, at $z=7.7$ we infer "$1σ$" upper limits on the IGM brightness temperature to be $\le 316$ "pseudo" mK at $κ_\parallel=0.33$ "pseudo" $h$ Mpc$^{-1}$ (data-limited) and $\le 1000$ "pseudo" mK at $κ_\parallel=0.875$ "pseudo" $h$ Mpc$^{-1}$ (noise-limited). The "pseudo" units denote only an approximate and not an exact correspondence to the actual distance scales and brightness temperatures. By propagating models in parallel to the data analysis, we confirm that the dynamic range required to separate the cosmic HI signal from the foregrounds is similar to that in standard approaches, and the power spectrum of the bispectrum phase is still data-limited (at $\gtrsim 10^6$ dynamic range) indicating scope for further improvement in sensitivity as the array build-out continues.
△ Less
Submitted 2 July, 2020; v1 submitted 20 May, 2020;
originally announced May 2020.
-
DAYENU: A Simple Filter of Smooth Foregrounds for Intensity Map** Power Spectra
Authors:
Aaron Ewall-Wice,
Nicholas Kern,
Joshua S. Dillon,
Adrian Liu,
Aaron Parsons,
Saurabh Singh,
Adam Lanman,
Paul La Plante,
Nicolas Fagnoni,
Eloy de Lera Acedo,
David R. DeBoer,
Chuneeta Nunhokee,
Philip Bull,
Tzu-Ching Chang,
T. Joseph Lazio,
James Aguirre,
Sean Weinberg
Abstract:
We introduce DAYENU, a linear, spectral filter for HI intensity map** that achieves the desirable foreground mitigation and error minimization properties of inverse co-variance weighting with minimal modeling of the underlying data. Beyond 21 cm power-spectrum estimation, our filter is suitable for any analysis where high dynamic-range removal of spectrally smooth foregrounds in irregularly (or…
▽ More
We introduce DAYENU, a linear, spectral filter for HI intensity map** that achieves the desirable foreground mitigation and error minimization properties of inverse co-variance weighting with minimal modeling of the underlying data. Beyond 21 cm power-spectrum estimation, our filter is suitable for any analysis where high dynamic-range removal of spectrally smooth foregrounds in irregularly (or regularly) sampled data is required, something required by many other intensity map** techniques. Our filtering matrix is diagonalized by Discrete Prolate Spheroidal Sequences which are an optimal basis to model band-limited foregrounds in 21 cm intensity map** experiments in the sense that they maximally concentrate power within a finite region of Fourier space. We show that DAYENU enables the access of large-scale line-of-sight modes that are inaccessible to tapered DFT estimators. Since these modes have the largest SNRs, DAYENU significantly increases the sensitivity of 21 cm analyses over tapered Fourier transforms. Slight modifications allow us to use DAYENU as a linear replacement for iterative delay CLEANing (DAYENUREST). We refer readers to the Code section at the end of this paper for links to examples and code.
△ Less
Submitted 25 October, 2020; v1 submitted 23 April, 2020;
originally announced April 2020.
-
Foreground modelling via Gaussian process regression: an application to HERA data
Authors:
Abhik Ghosh,
Florent Mertens,
Gianni Bernardi,
Mário G. Santos,
Nicholas S. Kern,
Christopher L. Carilli,
Trienko L. Grobler,
Léon V. E. Koopmans,
Daniel C. Jacobs,
Adrian Liu,
Aaron R. Parsons,
Miguel F. Morales,
James E. Aguirre,
Joshua S. Dillon,
Bryna J. Hazelton,
Oleg M. Smirnov,
Bharat K. Gehlot,
Siyanda Matika,
Paul Alexander,
Zaki S. Ali,
Adam P. Beardsley,
Roshan K. Benefo,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley
, et al. (48 additional authors not shown)
Abstract:
The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize…
▽ More
The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize the measurement of the 21-cm signal. In this paper, we use Gaussian Process Regression to model both foreground emission and instrumental systematics in $\sim 2$ hours of data from the Hydrogen Epoch of Reionization Array. We find that a simple co-variance model with three components matches the data well, giving a residual power spectrum with white noise properties. These consist of an "intrinsic" and instrumentally corrupted component with a coherence-scale of 20 MHz and 2.4 MHz respectively (dominating the line of sight power spectrum over scales $k_{\parallel} \le 0.2$ h cMpc$^{-1}$) and a baseline dependent periodic signal with a period of $\sim 1$ MHz (dominating over $k_{\parallel} \sim 0.4 - 0.8$h cMpc$^{-1}$) which should be distinguishable from the 21-cm EoR signal whose typical coherence-scales is $\sim 0.8$ MHz.
△ Less
Submitted 12 May, 2020; v1 submitted 13 April, 2020;
originally announced April 2020.
-
Antenna design for the SKA1-LOW and HERA super radio telescopes
Authors:
Eloy de Lera Acedo,
Hardie Pienaar,
Nicolas Fagnoni
Abstract:
This paper summarizes the design process and metrics for the latest antenna design for 2 radio telescopes, SKALA4 for the SKA1-LOW instrument and the V-feed for the HERA telescope. In the paper we briefly describe the main features of the antenna element design and the most important figures of merit for both instruments. Finally, we show the response of both designs against some of these figures…
▽ More
This paper summarizes the design process and metrics for the latest antenna design for 2 radio telescopes, SKALA4 for the SKA1-LOW instrument and the V-feed for the HERA telescope. In the paper we briefly describe the main features of the antenna element design and the most important figures of merit for both instruments. Finally, we show the response of both designs against some of these figures of merit.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.
-
Redundant-Baseline Calibration of the Hydrogen Epoch of Reionization Array
Authors:
Joshua S. Dillon,
Max Lee,
Zaki S. Ali,
Aaron R. Parsons,
Naomi Orosz,
Chuneeta Devi Nunhokee,
Paul La Plante,
Adam P. Beardsley,
Nicholas S. Kern,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Yanga Balfour,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Steve Carey,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo
, et al. (54 additional authors not shown)
Abstract:
In 21 cm cosmology, precision calibration is key to the separation of the neutral hydrogen signal from very bright but spectrally-smooth astrophysical foregrounds. The Hydrogen Epoch of Reionization Array (HERA), an interferometer specialized for 21 cm cosmology and now under construction in South Africa, was designed to be largely calibrated using the self-consistency of repeated measurements of…
▽ More
In 21 cm cosmology, precision calibration is key to the separation of the neutral hydrogen signal from very bright but spectrally-smooth astrophysical foregrounds. The Hydrogen Epoch of Reionization Array (HERA), an interferometer specialized for 21 cm cosmology and now under construction in South Africa, was designed to be largely calibrated using the self-consistency of repeated measurements of the same interferometric modes. This technique, known as "redundant-baseline calibration" resolves most of the internal degrees of freedom in the calibration problem. It assumes, however, on antenna elements with identical primary beams placed precisely on a redundant grid. In this work, we review the detailed implementation of the algorithms enabling redundant-baseline calibration and report results with HERA data. We quantify the effects of real-world non-redundancy and how they compare to the idealized scenario in which redundant measurements differ only in their noise realizations. Finally, we study how non-redundancy can produce spurious temporal structure in our calibration solutions--both in data and in simulations--and present strategies for mitigating that structure.
△ Less
Submitted 3 November, 2020; v1 submitted 18 March, 2020;
originally announced March 2020.
-
Absolute Calibration Strategies for the Hydrogen Epoch of Reionization Array and Their Impact on the 21 cm Power Spectrum
Authors:
Nicholas S. Kern,
Joshua S. Dillon,
Aaron R. Parsons,
Christopher L. Carilli,
Gianni Bernardi,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Philip Bull,
Jacob Burba,
Steven Carey,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
John Ely,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Randall Fritz
, et al. (47 additional authors not shown)
Abstract:
We discuss absolute calibration strategies for Phase I of the Hydrogen Epoch of Reionization Array (HERA), which aims to measure the cosmological 21 cm signal from the Epoch of Reionization (EoR). HERA is a drift-scan array with a 10 degree wide field of view, meaning bright, well-characterized point source transits are scarce. This, combined with HERA's redundant sampling of the uv plane and the…
▽ More
We discuss absolute calibration strategies for Phase I of the Hydrogen Epoch of Reionization Array (HERA), which aims to measure the cosmological 21 cm signal from the Epoch of Reionization (EoR). HERA is a drift-scan array with a 10 degree wide field of view, meaning bright, well-characterized point source transits are scarce. This, combined with HERA's redundant sampling of the uv plane and the modest angular resolution of the Phase I instrument, make traditional sky-based and self-calibration techniques difficult to implement with high dynamic range. Nonetheless, in this work we demonstrate calibration for HERA using point source catalogues and electromagnetic simulations of its primary beam. We show that unmodeled diffuse flux and instrumental contaminants can corrupt the gain solutions, and present a gain smoothing approach for mitigating their impact on the 21 cm power spectrum. We also demonstrate a hybrid sky and redundant calibration scheme and compare it to pure sky-based calibration, showing only a marginal improvement to the gain solutions at intermediate delay scales. Our work suggests that the HERA Phase I system can be well-calibrated for a foreground-avoidance power spectrum estimator by applying direction-independent gains with a small set of degrees of freedom across the frequency and time axes.
△ Less
Submitted 4 January, 2020; v1 submitted 28 October, 2019;
originally announced October 2019.
-
Quantifying EoR delay spectrum contamination from diffuse radio emission
Authors:
Adam E. Lanman,
Jonathan C. Pober,
Nicholas S. Kern,
Eloy de Lera Acedo,
David R. DeBoer,
Nicolas Fagnoni
Abstract:
The 21 cm hyperfine transition of neutral hydrogen offers a promising probe of the large scale structure of the universe before and during the Epoch of Reionization, when the first ionizing sources formed. Bright radio emission from foreground sources remains the biggest obstacle to detecting the faint 21 cm signal. However, the expected smoothness of foreground power leaves a clean window in Four…
▽ More
The 21 cm hyperfine transition of neutral hydrogen offers a promising probe of the large scale structure of the universe before and during the Epoch of Reionization, when the first ionizing sources formed. Bright radio emission from foreground sources remains the biggest obstacle to detecting the faint 21 cm signal. However, the expected smoothness of foreground power leaves a clean window in Fourier space where the EoR signal can potentially be seen over thermal noise. Though the boundary of this window is well-defined in principle, spectral structure in foreground sources, instrumental chromaticity, and choice of spectral weighting in analysis all affect how much foreground power spills over into the EoR window. In this paper, we run a suite of numerical simulations of wide-field visibility measurements, with a variety of diffuse foreground models and instrument configurations, and measure the extent of contaminated Fourier modes in the EoR window using a delay-transform approach to estimating power spectra. We also test these effects with a model of the HERA antenna beam generated from electromagnetic simulations, to take into account further chromatic effects in the real instrument. We find that foreground power spillover is dominated by the so-called "pitchfork effect", in which diffuse foreground power is brightened near the horizon due to the shortening of baselines. As a result, the extent of contaminated modes in the EoR window is largely constant over time, except when the galaxy is near the pointing center.
△ Less
Submitted 23 October, 2019;
originally announced October 2019.
-
Mitigating Internal Instrument Coupling II: A Method Demonstration with the Hydrogen Epoch of Reionization Array
Authors:
Nicholas S. Kern,
Aaron R. Parsons,
Joshua S. Dillon,
Adam E. Lanman,
Adrian Liu,
Philip Bull,
Aaron Ewall-Wice,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Nicolas Fagnoni,
Randall Fritz,
Steve R. Furlanetto
, et al. (42 additional authors not shown)
Abstract:
We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. T…
▽ More
We present a study of internal reflection and cross coupling systematics in Phase I of the Hydrogen Epoch of Reionization Array (HERA). In a companion paper, we outlined the mathematical formalism for such systematics and presented algorithms for modeling and removing them from the data. In this work, we apply these techniques to data from HERA's first observing season as a method demonstration. The data show evidence for systematics that, without removal, would hinder a detection of the 21 cm power spectrum for the targeted EoR line-of-sight modes in the range 0.2 < k_parallel < 0.5\ h^-1 Mpc. After systematic removal, we find we can recover these modes in the power spectrum down to the integrated noise-floor of a nightly observation, achieving a dynamic range in the EoR window of 10^-6 in power (mK^2 units) with respect to the bright galactic foreground signal. In the absence of other systematics and assuming the systematic suppression demonstrated here continues to lower noise levels, our results suggest that fully-integrated HERA Phase I may have the capacity to set competitive upper limits on the 21 cm power spectrum. For future observing seasons, HERA will have upgraded analog and digital hardware to better control these systematics in the field.
△ Less
Submitted 29 October, 2019; v1 submitted 25 September, 2019;
originally announced September 2019.
-
Mitigating Internal Instrument Coupling for 21 cm Cosmology I: Temporal and Spectral Modeling in Simulations
Authors:
Nicholas S. Kern,
Aaron R. Parsons,
Joshua S. Dillon,
Adam E. Lanman,
Nicolas Fagnoni,
Eloy de Lera Acedo
Abstract:
We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical i…
▽ More
We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate the EoR window and prohibit a robust detection. We also quantify the signal loss properties of the systematic modeling algorithms, and show that our techniques demonstrate resistance against EoR signal loss. In a companion paper, we demonstrate these methods on data from the Hydrogen Epoch of Reionization Array as a proof-of-concept.
△ Less
Submitted 25 October, 2019; v1 submitted 25 September, 2019;
originally announced September 2019.
-
Understanding the HERA Phase I receiver system with simulations and its impact on the detectability of the EoR delay power spectrum
Authors:
Nicolas Fagnoni,
Eloy de Lera Acedo,
David R. DeBoer,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Tashalee S. Billings,
Judd D. Bowman,
Richard F. Bradley,
Phil Bull,
Jacob Burba,
Chris L. Carilli,
Carina Cheng,
Matt Dexter,
Joshua S. Dillon,
Aaron Ewall-Wice,
Randall Fritz,
Steve R. Furlanetto,
Kingsley Gale-Sides,
Brian Glendenning,
Deepthi Gorthi
, et al. (45 additional authors not shown)
Abstract:
The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines d…
▽ More
The detection of the Epoch of Reionization (EoR) delay power spectrum using a "foreground avoidance method" highly depends on the instrument chromaticity. The systematic effects induced by the radio-telescope spread the foreground signal in the delay domain, which contaminates the EoR window theoretically observable. Applied to the Hydrogen Epoch of Reionization Array (HERA), this paper combines detailed electromagnetic and electrical simulations in order to model the chromatic effects of the instrument, and quantify its frequency and time responses. In particular, the effects of the analogue receiver, transmission cables, and mutual coupling are included. These simulations are able to accurately predict the intensity of the reflections occurring in the 150-m cable which links the antenna to the back-end. They also show that electromagnetic waves can propagate from one dish to another one through large sections of the array due to mutual coupling. The simulated system time response is attenuated by a factor $10^{4}$ after a characteristic delay which depends on the size of the array and on the antenna position. Ultimately, the system response is attenuated by a factor $10^{5}$ after 1400 ns because of the reflections in the cable, which corresponds to characterizable ${k_\parallel}$-modes above 0.7 $h\;\rm{Mpc}^{-1}$ at 150 MHz. Thus, this new study shows that the detection of the EoR signal with HERA Phase I will be more challenging than expected. On the other hand, it improves our understanding of the telescope, which is essential to mitigate the instrument chromaticity.
△ Less
Submitted 25 August, 2020; v1 submitted 6 August, 2019;
originally announced August 2019.
-
Optimizing Sparse RFI Prediction using Deep Learning
Authors:
Joshua Kerrigan,
Paul La Plante,
Saul Kohn,
Jonathan C. Pober,
James Aguirre,
Zara Abdurashidova,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de Lera Acedo,
Joshua S. Dillon,
Julia Estrada,
Aaron Ewall-Wice,
Nicolas Fagnoni,
Randall Fritz,
Steve R. Furlanetto
, et al. (39 additional authors not shown)
Abstract:
Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computa…
▽ More
Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array grow larger in number of receivers. To address this, we present a Deep Fully Convolutional Neural Network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known "ground truth" dataset for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6$\times 10^{5}$ HERA time-ordered 1024 channeled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and Non-RFI. The inclusion of phase when predicting achieves a Recall of 0.81, Precision of 0.58, and $F_{2}$ score of 0.75 as applied to our HERA-67 observations.
△ Less
Submitted 21 February, 2019;
originally announced February 2019.
-
HI 21cm Cosmology and the Bi-spectrum: Closure Diagnostics in Massively Redundant Interferometric Arrays
Authors:
C. L. Carilli,
Bojan Nikolic,
Nithyanandan Thyagarajan,
K. Gale-Sides,
Zara Abdurashidova,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Yanga Balfour,
Adam P. Beardsley,
Gianni Bernardi,
Judd D. Bowman,
Richard F. Bradley,
Jacob Burba,
Carina Cheng,
David R. DeBoer,
Matt Dexter,
Eloy de~Lera~Acedo,
Joshua S. Dillon,
Aaron Ewall-Wice,
Gcobisa Fadana,
Nicolas Fagnoni,
Randall Fritz,
Steve R. Furlanetto,
Abhik Ghosh
, et al. (40 additional authors not shown)
Abstract:
New massively redundant low frequency arrays allow for a novel investigation of closure relations in interferometry. We employ commissioning data from the Hydrogen Epoch of Reionization Array to investigate closure quantities in this densely packed grid array of 14m antennas operating at 100 MHz to 200 MHz. We investigate techniques that utilize closure phase spectra for redundant triads to estima…
▽ More
New massively redundant low frequency arrays allow for a novel investigation of closure relations in interferometry. We employ commissioning data from the Hydrogen Epoch of Reionization Array to investigate closure quantities in this densely packed grid array of 14m antennas operating at 100 MHz to 200 MHz. We investigate techniques that utilize closure phase spectra for redundant triads to estimate departures from redundancy for redundant baseline visibilities. We find a median absolute deviation from redundancy in closure phase across the observed frequency range of about 4.5deg. This value translates into a non-redundancy per visibility phase of about 2.6deg, using prototype electronics. The median absolute deviations from redundancy decrease with longer baselines. We show that closure phase spectra can be used to identify ill-behaved antennas in the array, independent of calibration. We investigate the temporal behavior of closure spectra. The Allan variance increases after a one minute stride time, due to passage of the sky through the primary beam of the transit telescope. However, the closure spectra repeat to well within the noise per measurement at corresponding local sidereal times (LST) from day to day. In future papers in this series we will develop the technique of using closure phase spectra in the search for the HI 21cm signal from cosmic reionization.
△ Less
Submitted 2 May, 2018;
originally announced May 2018.
-
The HERA-19 Commissioning Array: Direction Dependent Effects
Authors:
Saul A. Kohn,
James E. Aguirre,
Paul La Plante,
Tashalee S. Billings,
Paul M. Chichura,
Austin F. Fortino,
Amy S. Igarashi,
Roshan K. Benefo,
Samavarti Gallardo,
Zachary E. Martinot,
Chuneeta D. Nunhokee,
Nicholas S. Kern,
Philip Bull,
Adrian Liu,
Paul Alexander,
Zaki S. Ali,
Adam P. Beardsley,
Gianni Bernardi,
Judd D. Bowman,
Richard F. Bradley,
Chris L. Carilli,
Carina Cheng,
David R. DeBoer,
Eloy de Lera Acedo,
Joshua S. Dillon
, et al. (42 additional authors not shown)
Abstract:
Foreground power dominates the measurements of interferometers that seek a statistical detection of highly-redshifted HI emission from the Epoch of Reionization (EoR). The chromaticity of the instrument creates a boundary in the Fourier transform of frequency (proportional to $k_\parallel$) between spectrally smooth emission, characteristic of the strong synchrotron foreground (the "wedge"), and t…
▽ More
Foreground power dominates the measurements of interferometers that seek a statistical detection of highly-redshifted HI emission from the Epoch of Reionization (EoR). The chromaticity of the instrument creates a boundary in the Fourier transform of frequency (proportional to $k_\parallel$) between spectrally smooth emission, characteristic of the strong synchrotron foreground (the "wedge"), and the spectrally structured emission from HI in the EoR (the "EoR window"). Faraday rotation can inject spectral structure into otherwise smooth polarized foreground emission, which through instrument effects or miscalibration could possibly pollute the EoR window. Using data from the HERA 19-element commissioning array, we investigate the polarization response of this new instrument in the power spectrum domain. We perform a simple image-based calibration based on the unpolarized diffuse emission of the Global Sky Model, and show that it achieves qualitative redundancy between the nominally-redundant baselines of the array and reasonable amplitude accuracy. We construct power spectra of all fully polarized coherencies in all pseudo-Stokes parameters. We compare to simulations based on an unpolarized diffuse sky model and detailed electromagnetic simulations of the dish and feed, confirming that in Stokes I, the calibration does not add significant spectral structure beyond the expected level. Further, this calibration is stable over the 8 days of observations considered. Excess power is seen in the power spectra of the linear polarization Stokes parameters which is not easily attributable to leakage via the primary beam, and results from some combination of residual calibration errors and actual polarized emission. Stokes V is found to be highly discrepant from the expectation of zero power, strongly pointing to the need for more accurate polarized calibration.
△ Less
Submitted 10 June, 2019; v1 submitted 7 February, 2018;
originally announced February 2018.
-
Spectral performance of Square Kilometre Array Antennas II: Calibration performance
Authors:
Cathryn M. Trott,
Eloy de Lera Acedo,
Randall B. Wayth,
Nicolas Fagnoni,
Adrian T. Sutinjo,
Brett Wakley,
Chris Ivan B. Punzalan
Abstract:
We test the bandpass smoothness performance of two prototype Square Kilometre Array (SKA) SKA1-Low log-periodic dipole antennas, the SKALA2 and SKALA3 (`SKA Log-periodic Antenna'), and the current dipole from the Murchison Widefield Array (MWA) precursor telescope. Throughout this paper, we refer to the output complex-valued voltage response of an antenna when connected to a low noise amplifier (L…
▽ More
We test the bandpass smoothness performance of two prototype Square Kilometre Array (SKA) SKA1-Low log-periodic dipole antennas, the SKALA2 and SKALA3 (`SKA Log-periodic Antenna'), and the current dipole from the Murchison Widefield Array (MWA) precursor telescope. Throughout this paper, we refer to the output complex-valued voltage response of an antenna when connected to a low noise amplifier (LNA), as the dipole bandpass. In Paper I (de Lera Acedo et al. 2017), the bandpass spectral response of the log-periodic antenna being developed for the SKA1-Low was estimated using numerical electromagnetic simulations and analyzed using low-order polynomial fittings and it was compared with the HERA antenna against the delay spectrum metric. In this work, realistic simulations of the SKA1-Low instrument, including frequency-dependent primary beams and array configuration, are used with a weighted least-squares polynomial estimator to assess the ability of prototype antennas to perform the SKA Epoch of Reionisation (EoR) statistical experiments. This work complements the ideal estimator tolerances computed for the proposed EoR science experiments in Trott & Wayth (2016), with the realised performance of an optimal and standard estimation (calibration) procedure. With a sufficient sky calibration model at higher frequencies, all antennas have bandpasses that are sufficiently smooth to meet the tolerances described in Trott & Wayth (2016) to perform the EoR statistical experiments, and these are primarily limited by an adequate sky calibration model, and the thermal noise level in the calibration data. At frequencies of the Cosmic Dawn (CD), which is of principal interest to SKA as one of the first next-generation telescopes capable of accessing higher redshifts, the MWA dipole and SKALA3 antenna have adequate performance, while the SKALA2 design will impede the ability to explore this era.
△ Less
Submitted 8 May, 2017;
originally announced May 2017.
-
Spectral performance of SKA Log-periodic Antennas I: Mitigating spectral artefacts in SKA1-LOW 21-cm cosmology experiments
Authors:
Eloy de Lera Acedo,
Cathryn M. Trott,
Randall B. Wayth,
Nicolas Fagnoni,
Gianni Bernardi,
Brett Wakley,
Leon V. E. Koopmans,
Andrew J. Faulkner,
Jan Geralt bij de Vaate
Abstract:
This paper is the first in a series of papers describing the impact of antenna instrumental artefacts on the 21-cm cosmology experiments to be carried out by the low frequency instrument (SKA1-LOW) of the Square Kilometre Array telescope (SKA), i.e., the Cosmic Dawn (CD) and the Epoch of Reionization (EoR). The smoothness of the passband response of the current log-periodic antenna being developed…
▽ More
This paper is the first in a series of papers describing the impact of antenna instrumental artefacts on the 21-cm cosmology experiments to be carried out by the low frequency instrument (SKA1-LOW) of the Square Kilometre Array telescope (SKA), i.e., the Cosmic Dawn (CD) and the Epoch of Reionization (EoR). The smoothness of the passband response of the current log-periodic antenna being developed for the SKA1-LOW is analyzed using numerical electromagnetic simulations. The amplitude variations over the frequency range are characterized using low-order polynomials defined locally, in order to study the impact of the passband smoothness in the instrument calibration and CD/EoR Science. A solution is offered to correct a fast ripple found at 60~MHz during a test campaign at the SKA site at the Murchison Radio-astronomy Observatory, Western Australia in September 2015 with a minor impact on the telescope's performance and design. A comparison with the Hydrogen Epoch of Reionization Array antenna is also shown demonstrating the potential use of the SKA1-LOW antenna for the Delay Spectrum technique to detect the EoR.
△ Less
Submitted 10 April, 2017; v1 submitted 16 February, 2017;
originally announced February 2017.
-
The Hydrogen Epoch of Reionization Array Dish III: Measuring Chromaticity of Prototype Element with Reflectometry
Authors:
Nipanjana Patra,
Aaron R. Parsons,
David R. DeBoer,
Nithyanandan Thyagarajan,
Aaron Ewall-Wice,
Gilbert Hsyu,
Tsz Kuk Leung,
Cherie K. Day,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Adam P. Beardsley,
Judd D. Bowman,
Richard F. Bradley,
Chris L. Carilli,
Carina Cheng,
Eloy de Lera Acedo,
Joshua S. Dillon,
Gcobisa Fadana,
Nicolas Fagnoni,
Randall Fritz,
Steve R. Furlanetto,
Brian Glendenning,
Bradley Greig,
Jasper Grobbelaar
, et al. (32 additional authors not shown)
Abstract:
The experimental efforts to detect the redshifted 21 cm signal from the Epoch of Reionization (EoR) are limited predominantly by the chromatic instrumental systematic effect. The delay spectrum methodology for 21 cm power spectrum measurements brought new attention to the critical impact of an antenna's chromaticity on the viability of making this measurement. This methodology established a straig…
▽ More
The experimental efforts to detect the redshifted 21 cm signal from the Epoch of Reionization (EoR) are limited predominantly by the chromatic instrumental systematic effect. The delay spectrum methodology for 21 cm power spectrum measurements brought new attention to the critical impact of an antenna's chromaticity on the viability of making this measurement. This methodology established a straightforward relationship between time-domain response of an instrument and the power spectrum modes accessible to a 21 cm EoR experiment. We examine the performance of a prototype of the Hydrogen Epoch of Reionization Array (HERA) array element that is currently observing in Karoo desert, South Africa. We present a mathematical framework to derive the beam integrated frequency response of a HERA prototype element in reception from the return loss measurements between 100-200 MHz and determined the extent of additional foreground contamination in the delay space. The measurement reveals excess spectral structures in comparison to the simulation studies of the HERA element. Combined with the HERA data analysis pipeline that incorporates inverse covariance weighting in optimal quadratic estimation of power spectrum, we find that in spite of its departure from the simulated response, HERA prototype element satisfies the necessary criteria posed by the foreground attenuation limits and potentially can measure the power spectrum at spatial modes as low as $k_{\parallel} > 0.1h$~Mpc$^{-1}$. The work highlights a straightforward method for directly measuring an instrument response and assessing its impact on 21 cm EoR power spectrum measurements for future experiments that will use reflector-type antenna.
△ Less
Submitted 14 March, 2017; v1 submitted 11 January, 2017;
originally announced January 2017.
-
The Hydrogen Epoch of Reionization Array (HERA). Improvement of the antenna response with a matching network and scientific impacts
Authors:
Nicolas Fagnoni,
Eloy de Lera Acedo
Abstract:
The Hydrogen Epoch of Reionization Array (HERA) is a new powerful radio-telescope, dedicated to the study of the early universe. Its main goal is to characterise the period of the universe where the first galaxies and stars started to form, by studying the evolution of the 21-cm emission signal from neutral hydrogen, during the Epoch of Reionization. In this article, we present an electromagnetic…
▽ More
The Hydrogen Epoch of Reionization Array (HERA) is a new powerful radio-telescope, dedicated to the study of the early universe. Its main goal is to characterise the period of the universe where the first galaxies and stars started to form, by studying the evolution of the 21-cm emission signal from neutral hydrogen, during the Epoch of Reionization. In this article, we present an electromagnetic and electrical co-simulation of the antenna performed with CST. We focus our analysis on the characterisation of the chromatic effects caused by the antenna, in particular multiple reflections of the received signal between the feed and the dish. These reflections can have an important impact on the scientific results, and it is crucial to keep them as low as possible. Therefore, we are currently develo** a matching circuit which aims to improve the impedance matching between the feed and the front end.
△ Less
Submitted 28 June, 2016;
originally announced June 2016.
-
Hydrogen Epoch of Reionization Array (HERA)
Authors:
David R. DeBoer,
Aaron R. Parsons,
James E. Aguirre,
Paul Alexander,
Zaki S. Ali,
Adam P. Beardsley,
Gianni Bernardi,
Judd D. Bowman,
Richard F. Bradley,
Chris L. Carilli,
Carina Cheng,
Eloy de Lera Acedo,
Joshua S. Dillon,
Aaron Ewall-Wice,
Gcobisa Fadana,
Nicolas Fagnoni,
Randall Fritz,
Steve R. Furlanetto,
Brian Glendenning,
Bradley Greig,
Jasper Grobbelaar,
Bryna J. Hazelton,
Jacqueline N. Hewitt,
Jack Hickish,
Daniel C. Jacobs
, et al. (29 additional authors not shown)
Abstract:
The Hydrogen Epoch of Reionization Array (HERA) is a staged experiment to measure 21 cm emission from the primordial intergalactic medium (IGM) throughout cosmic reionization ($z=6-12$), and to explore earlier epochs of our Cosmic Dawn ($z\sim30$). During these epochs, early stars and black holes heated and ionized the IGM, introducing fluctuations in 21 cm emission. HERA is designed to characteri…
▽ More
The Hydrogen Epoch of Reionization Array (HERA) is a staged experiment to measure 21 cm emission from the primordial intergalactic medium (IGM) throughout cosmic reionization ($z=6-12$), and to explore earlier epochs of our Cosmic Dawn ($z\sim30$). During these epochs, early stars and black holes heated and ionized the IGM, introducing fluctuations in 21 cm emission. HERA is designed to characterize the evolution of the 21 cm power spectrum to constrain the timing and morphology of reionization, the properties of the first galaxies, the evolution of large-scale structure, and the early sources of heating. The full HERA instrument will be a 350-element interferometer in South Africa consisting of 14-m parabolic dishes observing from 50 to 250 MHz. Currently, 19 dishes have been deployed on site and the next 18 are under construction. HERA has been designated as an SKA Precursor instrument.
In this paper, we summarize HERA's scientific context and provide forecasts for its key science results. After reviewing the current state of the art in foreground mitigation, we use the delay-spectrum technique to motivate high-level performance requirements for the HERA instrument. Next, we present the HERA instrument design, along with the subsystem specifications that ensure that HERA meets its performance requirements. Finally, we summarize the schedule and status of the project. We conclude by suggesting that, given the realities of foreground contamination, current-generation 21 cm instruments are approaching their sensitivity limits. HERA is designed to bring both the sensitivity and the precision to deliver its primary science on the basis of proven foreground filtering techniques, while develo** new subtraction techniques to unlock new capabilities. The result will be a major step toward realizing the widely recognized scientific potential of 21 cm cosmology.
△ Less
Submitted 12 September, 2016; v1 submitted 23 June, 2016;
originally announced June 2016.