-
BeyondPlanck IV. On end-to-end simulations in CMB analysis -- Bayesian versus frequentist statistics
Authors:
M. Brilenkov,
K. S. F. Fornazier,
L. T. Hergt,
G. A. Hoerning,
A. Marins,
T. Murokoshi,
F. Rahman,
N. -O. Stutzer,
Y. Zhou,
F. B. Abdalla,
K. J. Andersen,
R. Aurlien,
R. Banerji,
A. Basyrov,
A. Battista,
M. Bersanelli,
S. Bertocco,
S. Bollanos,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta
, et al. (26 additional authors not shown)
Abstract:
End-to-end simulations play a key role in the analysis of any high-sensitivity CMB experiment, providing high-fidelity systematic error propagation capabilities unmatched by any other means. In this paper, we address an important issue regarding such simulations, namely how to define the inputs in terms of sky model and instrument parameters. These may either be taken as a constrained realization…
▽ More
End-to-end simulations play a key role in the analysis of any high-sensitivity CMB experiment, providing high-fidelity systematic error propagation capabilities unmatched by any other means. In this paper, we address an important issue regarding such simulations, namely how to define the inputs in terms of sky model and instrument parameters. These may either be taken as a constrained realization derived from the data, or as a random realization independent from the data. We refer to these as Bayesian and frequentist simulations, respectively. We show that the two options lead to significantly different correlation structures, as frequentist simulations, contrary to Bayesian simulations, effectively include cosmic variance, but exclude realization-specific correlations from non-linear degeneracies. Consequently, they quantify fundamentally different types of uncertainties, and we argue that they therefore also have different and complementary scientific uses, even if this dichotomy is not absolute. Before BeyondPlanck, most pipelines have used a mix of constrained and random inputs, and used the same hybrid simulations for all applications, even though the statistical justification for this is not always evident. BeyondPlanck represents the first end-to-end CMB simulation framework that is able to generate both types of simulations, and these new capabilities have brought this topic to the forefront. The Bayesian BeyondPlanck simulations and their uses are described extensively in a suite of companion papers. In this paper we consider one important applications of the corresponding frequentist simulations, namely code validation. That is, we generate a set of 1-year LFI 30 GHz frequentist simulations with known inputs, and use these to validate the core low-level BeyondPlanck algorithms; gain estimation, correlated noise estimation, and mapmaking.
△ Less
Submitted 9 September, 2022;
originally announced September 2022.
-
BeyondPlanck X. Planck LFI frequency maps with sample-based error propagation
Authors:
A. Basyrov,
A. -S. Suur-Uski,
L. P. L. Colombo,
J. R. Eskilt,
S. Paradiso,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle
, et al. (15 additional authors not shown)
Abstract:
We present Planck LFI frequency sky maps derived within the BeyondPlanck framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncer…
▽ More
We present Planck LFI frequency sky maps derived within the BeyondPlanck framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncertainties into higher-level science products. We show that the two dominant sources of LFI instrumental systematic uncertainties are correlated noise and gain fluctuations, and the products presented here support - for the first time - full Bayesian error propagation for these effects at full angular resolution. We compare our posterior mean maps with traditional frequency maps delivered by the Planck collaboration, and find generally good agreement. The most important quality improvement is due to significantly lower calibration uncertainties in the new processing, as we find a fractional absolute calibration uncertainty at 70 GHz of $δg_{0}/g_{0} =5 \cdot 10^{-5}$, which is nominally 40 times smaller than that reported by Planck 2018. However, the original Planck 2018 estimate has a non-trivial statistical interpretation, and this further illustrates the advantage of the new framework in terms of producing self-consistent and well-defined error estimates of all involved quantities without the need of ad hoc uncertainty contributions. We describe how low-resolution data products, including dense pixel-pixel covariance matrices, may be produced directly from the posterior samples without the need for computationally expensive analytic calculations or simulations. We conclude that posterior-based frequency map sampling provides unique capabilities in terms of low-level systematics modelling and error propagation, and may play an important role for future CMB B-mode experiments. (Abridged.)
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
BeyondPlanck XI. Bayesian CMB analysis with sample-based end-to-end error propagation
Authors:
L. P. L. Colombo,
J. R. Eskilt,
S. Paradiso,
H. Thommesen,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell
, et al. (14 additional authors not shown)
Abstract:
We present posterior sample-based cosmic microwave background (CMB) constraints from Planck LFI and WMAP observations derived through global end-to-end Bayesian processing. We use these samples to study correlations between CMB, foreground, and instrumental parameters, and we identify a particularly strong degeneracy between CMB temperature fluctuations and free-free emission on intermediate angul…
▽ More
We present posterior sample-based cosmic microwave background (CMB) constraints from Planck LFI and WMAP observations derived through global end-to-end Bayesian processing. We use these samples to study correlations between CMB, foreground, and instrumental parameters, and we identify a particularly strong degeneracy between CMB temperature fluctuations and free-free emission on intermediate angular scales, which is mitigated through model reduction, masking, and resampling. We compare our posterior-based CMB results with previous Planck products, and find generally good agreement, but with higher noise due to exclusion of HFI data. We find a best-fit CMB dipole amplitude of $3362.7\pm1.4μK$, in excellent agreement with previous Planck results. The quoted uncertainty is derived directly from the sampled posterior distribution, and does not involve any ad hoc contribution for systematic effects. Similarly, we find a temperature quadrupole amplitude of $σ^{TT}_2=229\pm97μK^2$, in good agreement with previous results in terms of the amplitude, but the uncertainty is an order of magnitude larger than the diagonal Fisher uncertainty. Relatedly, we find lower evidence for a possible alignment between $\ell = 2$ and $\ell = 3$ than previously reported due to a much larger scatter in the individual quadrupole coefficients, caused both by marginalizing over a more complete set of systematic effects, and by our more conservative analysis mask. For higher multipoles, we find that the angular temperature power spectrum is generally in good agreement with both Planck and WMAP. This is the first time the sample-based asymptotically exact Blackwell-Rao estimator has been successfully established for multipoles up to $\ell\le600$, and it now accounts for the majority of the cosmologically important information. Cosmological parameter constraints are presented in a companion paper. (Abriged)
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
From BeyondPlanck to Cosmoglobe: Open Science, Reproducibility, and Data Longevity
Authors:
S. Gerakakis,
M. Brilenkov,
M. Ieronymaki,
M. San,
D. J. Watts,
K. J. Andersen,
R. Aurlien,
R. Banerji,
A. Basyrov,
M. Bersanelli,
S. Bertocco,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
H. T. Ihle
, et al. (17 additional authors not shown)
Abstract:
The BeyondPlanck and Cosmoglobe collaborations have implemented the first integrated Bayesian end-to-end analysis pipeline for CMB experiments. The primary long-term motivation for this work is to develop a common analysis platform that supports efficient global joint analysis of complementary radio, microwave, and sub-millimeter experiments. A strict prerequisite for this to succeed is broad part…
▽ More
The BeyondPlanck and Cosmoglobe collaborations have implemented the first integrated Bayesian end-to-end analysis pipeline for CMB experiments. The primary long-term motivation for this work is to develop a common analysis platform that supports efficient global joint analysis of complementary radio, microwave, and sub-millimeter experiments. A strict prerequisite for this to succeed is broad participation from the CMB community, and two foundational aspects of the program are therefore reproducibility and Open Science. In this paper, we discuss our efforts toward this aim. We also discuss measures toward facilitating easy code and data distribution, community-based code documentation, user-friendly compilation procedures, etc. This work represents the first publicly released end-to-end CMB analysis pipeline that includes raw data, source code, parameter files, and documentation. We argue that such a complete pipeline release should be a requirement for all major future and publicly-funded CMB experiments, noting that a full public release significantly increases data longevity by ensuring that the data quality can be improved whenever better processing techniques, complementary datasets, or more computing power become available, and thereby also taxpayers' value for money; providing only raw data and final products is not sufficient to guarantee full reproducibility in the future.
△ Less
Submitted 14 March, 2023; v1 submitted 20 May, 2022;
originally announced May 2022.
-
BeyondPlanck XII. Cosmological parameter constraints with end-to-end error propagation
Authors:
S. Paradiso,
L. P. L. Colombo,
K. J. Andersen,
R. Aurlien,
R. Banerji,
A. Basyrov,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell
, et al. (16 additional authors not shown)
Abstract:
We present cosmological parameter constraints as estimated using the Bayesian BeyondPlanck (BP) analysis framework. This method supports seamless end-to-end error propagation from raw time-ordered data to final cosmological parameters. As a first demonstration of the method, we analyze time-ordered Planck LFI observations, combined with selected external data (WMAP 33-61GHz, Planck HFI DR4 353 and…
▽ More
We present cosmological parameter constraints as estimated using the Bayesian BeyondPlanck (BP) analysis framework. This method supports seamless end-to-end error propagation from raw time-ordered data to final cosmological parameters. As a first demonstration of the method, we analyze time-ordered Planck LFI observations, combined with selected external data (WMAP 33-61GHz, Planck HFI DR4 353 and 857GHz, and Haslam 408MHz) in the form of pixelized maps which are used to break critical astrophysical degeneracies. Overall, all results are generally in good agreement with previously reported values from Planck 2018 and WMAP, with the largest relative difference for any parameter of about 1 sigma when considering only temperature multipoles between 29<l<601. In cases where there are differences, we note that the BP results are generally slightly closer to the high-l HFI-dominated Planck 2018 results than previous analyses, suggesting slightly less tension between low and high multipoles. Using low-l polarization information from LFI and WMAP, we find a best-fit value of tau=0.066 +/- 0.013, which is higher than the low value of tau=0.051 +/- 0.006 derived from Planck 2018 and slightly lower than the value of 0.069 +/- 0.011 derived from joint analysis of official LFI and WMAP products. Most importantly, however, we find that the uncertainty derived in the BP processing is about 30% larger than when analyzing the official products, after taking into account the different sky coverage. We argue that this is due to marginalizing over a more complete model of instrumental and astrophysical parameters, and this results in both more reliable and more rigorously defined uncertainties. We find that about 2000 Monte Carlo samples are required to achieve robust convergence for low-resolution CMB covariance matrix with 225 independent modes.
△ Less
Submitted 20 May, 2022;
originally announced May 2022.
-
BeyondPlanck V. Minimal ADC Corrections for Planck LFI
Authors:
D. Herman,
R. A. Watson,
K. J. Andersen,
R. Aurlien,
R. Banjeri,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen
, et al. (14 additional authors not shown)
Abstract:
We describe the correction procedure for Analog-to-Digital Converter (ADC) differential non-linearities (DNL) adopted in the Bayesian end-to-end BeyondPlanck analysis framework. This method is nearly identical to that developed for the official LFI Data Processing Center (DPC) analysis, and relies on the binned rms noise profile of each detector data stream. However, rather than building the corre…
▽ More
We describe the correction procedure for Analog-to-Digital Converter (ADC) differential non-linearities (DNL) adopted in the Bayesian end-to-end BeyondPlanck analysis framework. This method is nearly identical to that developed for the official LFI Data Processing Center (DPC) analysis, and relies on the binned rms noise profile of each detector data stream. However, rather than building the correction profile directly from the raw rms profile, we first fit a Gaussian to each significant ADC-induced rms decrement, and then derive the corresponding correction model from this smooth model. The main advange of this approach is that only samples which are significantly affected by ADC DNLs are corrected. The new corrections are only applied to data for which there is a clear detection of the non-linearities, and for which they perform at least comparably with the DPC corrections. Out of a total of 88 LFI data streams (sky and reference load for each of the 44 detectors) we apply the new minimal ADC corrections in 25 cases, and maintain the DPC corrections in 8 cases. All these correctsion are applited to 44 or 70 GHz channels, while, as in previous analyses, none of the 30 GHz ADCs show significant evidence of non-linearity. By comparing the BeyondPlanck and DPC ADC correction methods, we estimate that the residual ADC uncertainty is about two orders of magnitude below the total noise of both the 44 and 70 GHz channels, and their impact on current cosmological parameter estimation is small. However, we also show that non-idealities in the ADC corrections can generate sharp stripes in the final frequency maps, and these could be important for future joint analyses with HFI, WMAP, or other datasets. We therefore conclude that, although the existing corrections are adequate for LFI-based cosmological parameter analysis, further work on LFI ADC corrections is still warranted.
△ Less
Submitted 6 April, 2022; v1 submitted 25 March, 2022;
originally announced March 2022.
-
From BeyondPlanck to Cosmoglobe: Preliminary $\mathit{WMAP}$ $\mathit Q$-band analysis
Authors:
D. J. Watts,
M. Galloway,
H. T. Ihle,
K. J. Andersen,
R. Aurlien,
R. Banerji,
A. Basyrov,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
J. B. Jewell
, et al. (18 additional authors not shown)
Abstract:
We present the first application of the Cosmoglobe analysis framework by analyzing 9-year $\mathit{WMAP}$ time-ordered observations using similar machinery as BeyondPlanck utilizes for $\mathit{Planck}$ LFI. We analyze only the $\mathit Q$-band (41 GHz) data and report on the low-level analysis process from uncalibrated time-ordered data to calibrated maps. Most of the existing BeyondPlanck pipeli…
▽ More
We present the first application of the Cosmoglobe analysis framework by analyzing 9-year $\mathit{WMAP}$ time-ordered observations using similar machinery as BeyondPlanck utilizes for $\mathit{Planck}$ LFI. We analyze only the $\mathit Q$-band (41 GHz) data and report on the low-level analysis process from uncalibrated time-ordered data to calibrated maps. Most of the existing BeyondPlanck pipeline may be reused for $\mathit{WMAP}$ analysis with minimal changes to the existing codebase. The main modification is the implementation of the same preconditioned biconjugate gradient mapmaker used by the $\mathit{WMAP}$ team. Producing a single $\mathit{WMAP}$ $\mathit Q$1-band sample requires 22 CPU-hrs, which is slightly more than the cost of a $\mathit{Planck}$ 44 GHz sample of 17 CPU-hrs; this demonstrates that full end-to-end Bayesian processing of the $\mathit{WMAP}$ data is computationally feasible. In general, our recovered maps are very similar to the maps released by the $\mathit{WMAP}$ team, although with two notable differences. In temperature we find a $\sim2\,\mathrm{μK}$ quadrupole difference that most likely is caused by different gain modeling, while in polarization we find a distinct $2.5\,\mathrm{μK}$ signal that has been previously called poorly-measured modes by the $\mathit{WMAP}$ team. In the Cosmoglobe processing, this pattern arises from temperature-to-polarization leakage from the coupling between the CMB Solar dipole, transmission imbalance, and sidelobes. No traces of this pattern are found in either the frequency map or TOD residual map, suggesting that the current processing has succeeded in modelling these poorly measured modes within the assumed parametric model by using $\mathit{Planck}$ information to break the sky-synchronous degeneracies inherent in the $\mathit{WMAP}$ scanning strategy.
△ Less
Submitted 23 May, 2022; v1 submitted 24 February, 2022;
originally announced February 2022.
-
BeyondPlanck XIII. Intensity foreground sampling, degeneracies, and priors
Authors:
K. J. Andersen,
D. Herman,
R. Aurlien,
R. Banerji,
A. Basyrov,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci
, et al. (19 additional authors not shown)
Abstract:
We present the intensity foreground algorithms and model employed within the BeyondPlanck analysis framework. The BeyondPlanck analysis is aimed at integrating component separation and instrumental parameter sampling within a global framework, leading to complete end-to-end error propagation in the $Planck$ Low Frequency Instrument (LFI) data analysis. Given the scope of the BeyondPlanck analysis,…
▽ More
We present the intensity foreground algorithms and model employed within the BeyondPlanck analysis framework. The BeyondPlanck analysis is aimed at integrating component separation and instrumental parameter sampling within a global framework, leading to complete end-to-end error propagation in the $Planck$ Low Frequency Instrument (LFI) data analysis. Given the scope of the BeyondPlanck analysis, a limited set of data is included in the component separation process, leading to foreground parameter degeneracies. In order to properly constrain the Galactic foreground parameters, we improve upon the previous $\texttt{Commander}$ component separation implementation by adding a suite of algorithmic techniques. These algorithms are designed to improve the stability and computational efficiency for weakly constrained posterior distributions. These are: 1) joint foreground spectral parameter and amplitude sampling, building on ideas from Miramare; 2) component-based monopole determination; 3) joint spectral parameter and monopole sampling; and 4) application of informative spatial priors for component amplitude maps. We find that the only spectral parameter with a significant signal-to-noise ratio using the current BeyondPlanck data set is the peak frequency of the anomalous microwave emission component, for which we find $ν_{\mathrm{p}}=25.3\pm0.5$ GHz; all others must be constrained through external priors. Future works will be aimed at integrating many more data sets into this analysis, both map and time-ordered based, thereby gradually eliminating the currently observed degeneracies in a controlled manner with respect to both instrumental systematic effects and astrophysical degeneracies. When this happens, the simple LFI-oriented data model employed in the current work will need to be generalized to account for both a richer astrophysical model and additional instrumental effects.
△ Less
Submitted 1 October, 2022; v1 submitted 20 January, 2022;
originally announced January 2022.
-
BeyondPlanck XVI. Limits on Large-Scale Polarized Anomalous Microwave Emission from Planck LFI and WMAP
Authors:
D. Herman,
B. Hensley,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen,
R. Keskitalo
, et al. (13 additional authors not shown)
Abstract:
We constrain the level of polarized anomalous microwave emission (AME) on large angular scales using $\textit{Planck}$ LFI and $\textit{WMAP}$ polarization data within a Bayesian CMB analysis framework. We model synchrotron emission with a power-law spectral energy distribution, and the sum of AME and thermal dust emission through linear regression with the $\textit{Planck}$ HFI 353 GHz data. This…
▽ More
We constrain the level of polarized anomalous microwave emission (AME) on large angular scales using $\textit{Planck}$ LFI and $\textit{WMAP}$ polarization data within a Bayesian CMB analysis framework. We model synchrotron emission with a power-law spectral energy distribution, and the sum of AME and thermal dust emission through linear regression with the $\textit{Planck}$ HFI 353 GHz data. This template-based dust emission model allows us to constrain the level of polarized AME while making minimal assumptions on its frequency dependence. We neglect cosmic microwave background fluctuations, but show through simulations that these have a minor impact on the results. We find that the resulting AME polarization fraction confidence limit is sensitive to the polarized synchrotron spectral index prior, and for priors steeper than $β_{\mathrm{s}} = -3.1\pm0.1$ we find an upper limit of $p_{\mathrm{AME}}^{\rm max}\lesssim 0.6\,\%$ ($95\,\%$ confidence). In contrast, for $β_{\mathrm{s}}=-3.0\pm0.1$, we find a nominal detection of $p_{\mathrm{AME}}=2.5\pm1.0\,\%$ ($95\,\%$ confidence). These data are thus not strong enough to simultaneously and robustly constrain both polarized synchrotron emission and AME, and our main result is therefore a constraint on the AME polarization fraction explicitly as a function of $β_\mathrm{s}$. Combining the current $\textit{Planck}$ and $\textit{WMAP}$ observations with measurements from high-sensitivity low-frequency experiments such as C-BASS and QUIJOTE will be critical to improve these limits further.
△ Less
Submitted 26 April, 2022; v1 submitted 10 January, 2022;
originally announced January 2022.
-
BeyondPlanck III. Commander3
Authors:
M. Galloway,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen,
R. Keskitalo
, et al. (13 additional authors not shown)
Abstract:
We describe the computational infrastructure for end-to-end Bayesian CMB analysis implemented by the BeyondPlanck collaboration. This code is called commander3, and provides a statistically consistent framework for global analysis of CMB and microwave observations, and may be useful for a wide range of legacy, current, and future experiments. The paper has three main goals. Firstly, we provide a h…
▽ More
We describe the computational infrastructure for end-to-end Bayesian CMB analysis implemented by the BeyondPlanck collaboration. This code is called commander3, and provides a statistically consistent framework for global analysis of CMB and microwave observations, and may be useful for a wide range of legacy, current, and future experiments. The paper has three main goals. Firstly, we provide a high-level overview of the existing code base, aiming to guide readers who wish to extend and adapt the code according to their own needs, or to reimplement it from scratch in a different programming language. Secondly, we discuss some critical computational challenges that arise within any global CMB analysis framework, for instance in-memory compression of time-ordered data, FFT optimization, and parallelization and load-balancing. Thirdly, we quantify the CPU and RAM requirements for the current BeyondPlanck analysis, and find that a total of 1.5 TB of RAM is required for efficient analysis, and the total cost of a full Gibbs sample is 170 CPU-hrs, including both low-level processing and high-level component separation, which is well within the capabilities of current low-cost computing facilities. The existing code base is made publicly available under a GNU General Public Library (GPL) license.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
BeyondPlanck VIII. Efficient Sidelobe Convolution and Correction through Spin Harmonics
Authors:
M. Galloway,
M. Reinecke,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen
, et al. (13 additional authors not shown)
Abstract:
We introduce a new formulation of the Conviqt convolution algorithm in terms of spin harmonics, and apply this to the problem of sidelobe correction for BeyondPlanck, the first end-to-end Bayesian Gibbs sampling framework for CMB analysis. We compare our implementation to the previous Planck LevelS implementation, and find good agreement between the two codes in terms of accuracy, but with a speed…
▽ More
We introduce a new formulation of the Conviqt convolution algorithm in terms of spin harmonics, and apply this to the problem of sidelobe correction for BeyondPlanck, the first end-to-end Bayesian Gibbs sampling framework for CMB analysis. We compare our implementation to the previous Planck LevelS implementation, and find good agreement between the two codes in terms of accuracy, but with a speed-up reaching a factor of 3--10, depending on the frequency bandlimits, $l_{\textrm{max}}$ and $m_{\textrm{max}}$. The new algorithm is significantly simpler to implement and maintain, since all low-level calculations are handled through an external spherical harmonic transform library. We find that our mean sidelobe estimates for Planck LFI agree well with previous efforts. Additionally, we present novel sidelobe rms maps that quantify the uncertainty in the sidelobe corrections due to variations in the sky model.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
BeyondPlanck X. Bandpass and beam leakage corrections
Authors:
T. L. Svalheim,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen
, et al. (14 additional authors not shown)
Abstract:
We discuss the treatment of bandpass and beam leakage corrections in the Bayesian BeyondPlanck CMB analysis pipeline as applied to the Planck LFI measurements. As a preparatory step, we first apply three corrections to the nominal LFI bandpass profiles including removal of a known systematic effect in the ground measuring equipment at 61 GHz; smoothing of standing wave ripples; and edge regulariza…
▽ More
We discuss the treatment of bandpass and beam leakage corrections in the Bayesian BeyondPlanck CMB analysis pipeline as applied to the Planck LFI measurements. As a preparatory step, we first apply three corrections to the nominal LFI bandpass profiles including removal of a known systematic effect in the ground measuring equipment at 61 GHz; smoothing of standing wave ripples; and edge regularization. The main net impact of these modifications is an overall shift in the 70 GHz bandpass of +0.6 GHz; we argue that any analysis of LFI data products, either from Planck or BeyondPlanck, should use these new bandpasses. In addition, we fit a single free bandpass parameter for each radiometer of the form $Δ_i = Δ_0 + δ_i$, where $Δ_0$ represents an absolute frequency shift per frequency band and $δ_i$ is a relative shift per detector. The absolute correction is only fitted at 30 GHz with a full $χ^2$-based likelihood, resulting in a correction of $Δ_{30}=0.24\pm0.03\,$GHz. The relative corrections are fitted using a spurious map approach, fundamentally similar to the method pioneered by the WMAP team, but without introducing many additional degrees of freedom. All bandpass parameters are sampled using a standard Metropolis sampler within the main BeyondPlanck Gibbs chain, and bandpass uncertainties are thus propagated to all other data products in the analysis. In total, we find that our bandpass model significantly reduces leakage effects. For beam leakage corrections, we adopt the official Planck LFI beam estimates without additional degrees of freedom, and only marginalize over the underlying sky model. We note that this is the first time leakage from beam mismatch has been included for Planck LFI maps.
△ Less
Submitted 10 January, 2022;
originally announced January 2022.
-
COMAP Early Science: VII. Prospects for CO Intensity Map** at Reionization
Authors:
Patrick C. Breysse,
Dongwoo T. Chung,
Kieran A. Cleary,
Håvard T. Ihle,
Hamsa Padmanabhan,
Marta B. Silva,
J. Richard Bond,
Jowita Borowska,
Morgan Catha,
Sarah E. Church,
Delaney A. Dunne,
Hans Kristian Eriksen,
Marie Kristine Foss,
Todd Gaier,
Joshua Ott Gundersen,
Andrew I. Harris,
Richard Hobbs,
Laura Keating,
James W. Lamb,
Charles R. Lawrence,
Jonas G. S. Lunde,
Norman Murray,
Timothy J. Pearson,
Liju Philip,
Maren Rasmussen
, et al. (7 additional authors not shown)
Abstract:
We introduce COMAP-EoR, the next generation of the Carbon Monoxide Map** Array Project aimed at extending CO intensity map** to the Epoch of Reionization. COMAP-EoR supplements the existing 30 GHz COMAP Pathfinder with two additional 30 GHz instruments and a new 16 GHz receiver. This combination of frequencies will be able to simultaneously map CO(1--0) and CO(2--1) at reionization redshifts (…
▽ More
We introduce COMAP-EoR, the next generation of the Carbon Monoxide Map** Array Project aimed at extending CO intensity map** to the Epoch of Reionization. COMAP-EoR supplements the existing 30 GHz COMAP Pathfinder with two additional 30 GHz instruments and a new 16 GHz receiver. This combination of frequencies will be able to simultaneously map CO(1--0) and CO(2--1) at reionization redshifts ($z\sim5-8$) in addition to providing a significant boost to the $z\sim3$ sensitivity of the Pathfinder. We examine a set of existing models of the EoR CO signal, and find power spectra spanning several orders of magnitude, highlighting our extreme ignorance about this period of cosmic history and the value of the COMAP-EoR measurement. We carry out the most detailed forecast to date of an intensity map** cross-correlation, and find that five out of the six models we consider yield signal to noise ratios (S/N) $\gtrsim20$ for COMAP-EoR, with the brightest reaching a S/N above 400. We show that, for these models, COMAP-EoR can make a detailed measurement of the cosmic molecular gas history from $z\sim2-8$, as well as probe the population of faint, star-forming galaxies predicted by these models to be undetectable by traditional surveys. We show that, for the single model that does not predict numerous faint emitters, a COMAP-EoR-type measurement is required to rule out their existence. We briefly explore prospects for a third-generation Expanded Reionization Array (COMAP-ERA) capable of detecting the faintest models and characterizing the brightest signals in extreme detail.
△ Less
Submitted 12 November, 2021; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: VI. A First Look at the COMAP Galactic Plane Survey
Authors:
Thomas J. Rennie,
Stuart E. Harper,
Clive Dickinson,
Liju Philip,
Kieran A. Cleary,
Richard J. Bond,
Jowita Borowska,
Patrick C. Breysse,
Morgan Catha,
Roke Cepeda-Arroita,
Dongwoo T. Chung,
Sarah E. Church,
Delaney A. Dunne,
Hans Kristian Eriksen,
Marie Kristine Foss,
Todd Gaier,
Joshua Ott Gunderson,
Andrew I. Harris,
Brandon Hensley,
Richard Hobbs,
Håvard T. Ihle,
James W. Lamb,
Charles R. Lawrence,
Jonas G. S. Lunde,
Roberta Paladini
, et al. (7 additional authors not shown)
Abstract:
We present early results from the COMAP Galactic Plane Survey conducted between June 2019 and April 2021, spanning $20^\circ<\ell<40^\circ$ in Galactic longitude and $|b|<1.\!\!^{\circ}5$ in Galactic latitude with an angular resolution of $4.5^{\prime}$. The full survey will span $\ell \sim 20^{\circ}$- $220^{\circ}$ and will be the first large-scale radio continuum survey at $30$ GHz with sub-deg…
▽ More
We present early results from the COMAP Galactic Plane Survey conducted between June 2019 and April 2021, spanning $20^\circ<\ell<40^\circ$ in Galactic longitude and $|b|<1.\!\!^{\circ}5$ in Galactic latitude with an angular resolution of $4.5^{\prime}$. The full survey will span $\ell \sim 20^{\circ}$- $220^{\circ}$ and will be the first large-scale radio continuum survey at $30$ GHz with sub-degree resolution. We present initial results from the first part of the survey, including diffuse emission and spectral energy distributions (SEDs) of HII regions and supernova remnants. Using low and high frequency surveys to constrain free-free and thermal dust emission contributions, we find evidence of excess flux density at $30\,$GHz in six regions that we interpret as anomalous microwave emission. Furthermore we model UCHII contributions using data from the $5\,$GHz CORNISH catalogue and reject this as the cause of the $30\,$GHz excess. Six known supernova remnants (SNR) are detected at $30\,$GHz, and we measure spectral indices consistent with the literature or show evidence of steepening. The flux density of the SNR W44 at $30\,$GHz is consistent with a power-law extrapolation from lower frequencies with no indication of spectral steepening in contrast with recent results from the Sardinia Radio Telescope. We also extract five hydrogen radio recombination lines to map the warm ionized gas, which can be used to estimate electron temperatures or to constrain continuum free-free emission. The full COMAP Galactic plane survey, to be released in 2023/2024, will be an invaluable resource for Galactic astrophysics.
△ Less
Submitted 21 March, 2022; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: V. Constraints and Forecasts at $z \sim 3$
Authors:
Dongwoo T. Chung,
Patrick C. Breysse,
Kieran A. Cleary,
Håvard T. Ihle,
Hamsa Padmanabhan,
Marta B. Silva,
J. Richard Bond,
Jowita Borowska,
Morgan Catha,
Sarah E. Church,
Delaney A. Dunne,
Hans Kristian Eriksen,
Marie Kristine Foss,
Todd Gaier,
Joshua Ott Gundersen,
Stuart E. Harper,
Andrew I. Harris,
Brandon Hensley,
Richard Hobbs,
Laura C. Keating,
Junhan Kim,
James W. Lamb,
Charles R. Lawrence,
Jonas Gahr Sturtzel Lunde,
Norman Murray
, et al. (12 additional authors not shown)
Abstract:
We present the current state of models for the $z\sim3$ carbon monoxide (CO) line-intensity signal targeted by the CO Map** Array Project (COMAP) Pathfinder in the context of its early science results. Our fiducial model, relating dark matter halo properties to CO luminosities, informs parameter priors with empirical models of the galaxy-halo connection and previous CO(1-0) observations. The Pat…
▽ More
We present the current state of models for the $z\sim3$ carbon monoxide (CO) line-intensity signal targeted by the CO Map** Array Project (COMAP) Pathfinder in the context of its early science results. Our fiducial model, relating dark matter halo properties to CO luminosities, informs parameter priors with empirical models of the galaxy-halo connection and previous CO(1-0) observations. The Pathfinder early science data spanning wavenumbers $k=0.051$-$0.62\,$Mpc$^{-1}$ represent the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum. Our 95% upper limit on the redshift-space clustering amplitude $A_{\rm clust}\lesssim70\,μ$K$^2$ greatly improves on the indirect upper limit of $420\,μ$K$^2$ reported from the CO Power Spectrum Survey (COPSS) measurement at $k\sim1\,$Mpc$^{-1}$. The COMAP limit excludes a subset of models from previous literature, and constrains interpretation of the COPSS results, demonstrating the complementary nature of COMAP and interferometric CO surveys. Using line bias expectations from our priors, we also constrain the squared mean line intensity-bias product, $\langle{Tb}\rangle^2\lesssim50\,μ$K$^2$, and the cosmic molecular gas density, $ρ_\text{H2}<2.5\times10^8\,M_\odot\,$Mpc$^{-3}$ (95% upper limits). Based on early instrument performance and our current CO signal estimates, we forecast that the five-year Pathfinder campaign will detect the CO power spectrum with overall signal-to-noise of 9-17. Between then and now, we also expect to detect the CO-galaxy cross-spectrum using overlap** galaxy survey data, enabling enhanced inferences of cosmic star-formation and galaxy-evolution history.
△ Less
Submitted 4 March, 2022; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: IV. Power Spectrum Methodology and Results
Authors:
Håvard T. Ihle,
Jowita Borowska,
Kieran A. Cleary,
Hans Kristian Eriksen,
Marie K. Foss,
Stuart E. Harper,
Junhan Kim,
Jonas G. S. Lunde,
Liju Philip,
Maren Rasmussen,
Nils-Ole Stutzer,
Bade D. Uzgil,
Duncan J. Watts,
Ingunn Kathrine Wehus,
J. Richard Bond,
Patrick C. Breysse,
Morgan Catha,
Sarah E. Church,
Dongwoo T. Chung,
Clive Dickinson,
Delaney A. Dunne,
Todd Gaier,
Joshua Ott Gundersen,
Andrew I. Harris,
Richard Hobbs
, et al. (8 additional authors not shown)
Abstract:
We present the power spectrum methodology used for the first-season COMAP analysis, and assess the quality of the current data set. The main results are derived through the Feed-feed Pseudo-Cross-Spectrum (FPXS) method, which is a robust estimator with respect to both noise modeling errors and experimental systematics. We use effective transfer functions to take into account the effects of instrum…
▽ More
We present the power spectrum methodology used for the first-season COMAP analysis, and assess the quality of the current data set. The main results are derived through the Feed-feed Pseudo-Cross-Spectrum (FPXS) method, which is a robust estimator with respect to both noise modeling errors and experimental systematics. We use effective transfer functions to take into account the effects of instrumental beam smoothing and various filter operations applied during the low-level data processing. The power spectra estimated in this way have allowed us to identify a systematic error associated with one of our two scanning strategies, believed to be due to residual ground or atmospheric contamination. We omit these data from our analysis and no longer use this scanning technique for observations. We present the power spectra from our first season of observing and demonstrate that the uncertainties are integrating as expected for uncorrelated noise, with any residual systematics suppressed to a level below the noise. Using the FPXS method, and combining data on scales $k=0.051-0.62 \,\mathrm{Mpc}^{-1}$ we estimate $P_\mathrm{CO}(k) = -2.7 \pm 1.7 \times 10^4μ\textrm{K}^2\mathrm{Mpc}^3$, the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum in the literature.
△ Less
Submitted 6 April, 2022; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: III. CO Data Processing
Authors:
Marie K. Foss,
Håvard T. Ihle,
Jowita Borowska,
Kieran A. Cleary,
Hans Kristian Eriksen,
Stuart E. Harper,
Junhan Kim,
James W. Lamb,
Jonas G. S. Lunde,
Liju Philip,
Maren Rasmussen,
Nils-Ole Stutzer,
Bade D. Uzgil,
Duncan J. Watts,
Ingunn K. Wehus,
David P. Woody,
J. Richard Bond,
Patrick C. Breysse,
Morgan Catha,
Sarah E. Church,
Dongwoo T. Chung,
Clive Dickinson,
Delaney A. Dunne,
Todd Gaier,
Joshua Ott Gundersen
, et al. (8 additional authors not shown)
Abstract:
We describe the first season COMAP analysis pipeline that converts raw detector readouts to calibrated sky maps. This pipeline implements four main steps: gain calibration, filtering, data selection, and map-making. Absolute gain calibration relies on a combination of instrumental and astrophysical sources, while relative gain calibration exploits real-time total-power variations. High efficiency…
▽ More
We describe the first season COMAP analysis pipeline that converts raw detector readouts to calibrated sky maps. This pipeline implements four main steps: gain calibration, filtering, data selection, and map-making. Absolute gain calibration relies on a combination of instrumental and astrophysical sources, while relative gain calibration exploits real-time total-power variations. High efficiency filtering is achieved through spectroscopic common-mode rejection within and across receivers, resulting in nearly uncorrelated white noise within single-frequency channels. Consequently, near-optimal but biased maps are produced by binning the filtered time stream into pixelized maps; the corresponding signal bias transfer function is estimated through simulations. Data selection is performed automatically through a series of goodness-of-fit statistics, including $χ^2$ and multi-scale correlation tests. Applying this pipeline to the first-season COMAP data, we produce a dataset with very low levels of correlated noise. We find that one of our two scanning strategies (the Lissajous type) is sensitive to residual instrumental systematics. As a result, we no longer use this type of scan and exclude data taken this way from our Season 1 power spectrum estimates. We perform a careful analysis of our data processing and observing efficiencies and take account of planned improvements to estimate our future performance. Power spectrum results derived from the first-season COMAP maps are presented and discussed in companion papers.
△ Less
Submitted 30 November, 2021; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: II. Pathfinder Instrument
Authors:
James W. Lamb,
Kieran A. Cleary,
David P. Woody,
Morgan Catha,
Dongwoo T. Chung,
Joshua Ott Gundersen,
Stuart E. Harper,
Andrew I. Harris,
Richard Hobbs,
Håvard T. Ihle,
Jonathon Kocz,
Timothy J. Pearson,
Liju Philip,
Travis W. Powell,
Lilian Basoalto,
J. Richard Bond,
Jowita Borowska,
Patrick C. Breysse,
Sarah E. Church,
Clive Dickinson,
Delaney A. Dunne,
Hans Kristian Eriksen,
Marie Kristine Foss,
Todd Gaier,
Junhan Kim
, et al. (10 additional authors not shown)
Abstract:
Line intensity map** (LIM) is a new technique for tracing the global properties of galaxies over cosmic time. Detection of the very faint signals from redshifted carbon monoxide (CO), a tracer of star formation, pushes the limits of what is feasible with a total-power instrument. The CO Map** Project (COMAP) Pathfinder is a first-generation instrument aiming to prove the concept and develop th…
▽ More
Line intensity map** (LIM) is a new technique for tracing the global properties of galaxies over cosmic time. Detection of the very faint signals from redshifted carbon monoxide (CO), a tracer of star formation, pushes the limits of what is feasible with a total-power instrument. The CO Map** Project (COMAP) Pathfinder is a first-generation instrument aiming to prove the concept and develop the technology for future experiments, as well as delivering early science products. With 19 receiver channels in a hexagonal focal plane arrangement on a 10.4 m antenna, and an instantaneous 26-34 GHz frequency range with 2 MHz resolution, it is ideally suited to measuring CO($J$=1-0) from $z\sim3$. In this paper we discuss strategies for designing and building the Pathfinder and the challenges that were encountered. The design of the instrument prioritized LIM requirements over those of ancillary science. After a couple of years of operation, the instrument is well understood, and the first year of data is already yielding useful science results. Experience with this Pathfinder will drive the design of the next generations of experiments.
△ Less
Submitted 29 November, 2021; v1 submitted 10 November, 2021;
originally announced November 2021.
-
COMAP Early Science: I. Overview
Authors:
Kieran A. Cleary,
Jowita Borowska,
Patrick C. Breysse,
Morgan Catha,
Dongwoo T. Chung,
Sarah E. Church,
Clive Dickinson,
Hans Kristian Eriksen,
Marie Kristine Foss,
Joshua Ott Gundersen,
Stuart E. Harper,
Andrew I. Harris,
Richard Hobbs,
Håvard,
T. Ihle,
Junhan Kim,
Jonathon Kocz,
James W. Lamb,
Jonas G. S. Lunde,
Hamsa Padmanabhan,
Timothy J. Pearson,
Liju Philip,
Travis W. Powell,
Maren Rasmussen,
Anthony C. S. Readhead
, et al. (18 additional authors not shown)
Abstract:
The CO Map** Array Project (COMAP) aims to use line intensity map** of carbon monoxide (CO) to trace the distribution and global properties of galaxies over cosmic time, back to the Epoch of Reionization (EoR). To validate the technologies and techniques needed for this goal, a Pathfinder instrument has been constructed and fielded. Sensitive to CO(1-0) emission from $z=2.4$-$3.4$ and a fainte…
▽ More
The CO Map** Array Project (COMAP) aims to use line intensity map** of carbon monoxide (CO) to trace the distribution and global properties of galaxies over cosmic time, back to the Epoch of Reionization (EoR). To validate the technologies and techniques needed for this goal, a Pathfinder instrument has been constructed and fielded. Sensitive to CO(1-0) emission from $z=2.4$-$3.4$ and a fainter contribution from CO(2-1) at $z=6$-8, the Pathfinder is surveying $12$ deg$^2$ in a 5-year observing campaign to detect the CO signal from $z\sim3$. Using data from the first 13 months of observing, we estimate $P_\mathrm{CO}(k) = -2.7 \pm 1.7 \times 10^4μ\mathrm{K}^2 \mathrm{Mpc}^3$ on scales $k=0.051-0.62 \mathrm{Mpc}^{-1}$ - the first direct 3D constraint on the clustering component of the CO(1-0) power spectrum. Based on these observations alone, we obtain a constraint on the amplitude of the clustering component (the squared mean CO line temperature-bias product) of $\langle Tb\rangle^2<49$ $μ$K$^2$ - nearly an order-of-magnitude improvement on the previous best measurement. These constraints allow us to rule out two models from the literature. We forecast a detection of the power spectrum after 5 years with signal-to-noise ratio (S/N) 9-17. Cross-correlation with an overlap** galaxy survey will yield a detection of the CO-galaxy power spectrum with S/N of 19. We are also conducting a 30 GHz survey of the Galactic plane and present a preliminary map. Looking to the future of COMAP, we examine the prospects for future phases of the experiment to detect and characterize the CO signal from the EoR.
△ Less
Submitted 29 November, 2021; v1 submitted 10 November, 2021;
originally announced November 2021.
-
A model of spectral line broadening in signal forecasts for line-intensity map** experiments
Authors:
Dongwoo T. Chung,
Patrick C. Breysse,
Håvard Tveit Ihle,
Hamsa Padmanabhan,
Marta B. Silva,
J. Richard Bond,
Jowita Borowska,
Kieran A. Cleary,
Hans Kristian Eriksen,
Marie Kristine Foss,
Joshua Ott Gundersen,
Laura C. Keating,
Jonas Gahr Sturtzel Lunde,
Liju Philip,
Nils-Ole Stutzer,
Marco P. Viero,
Duncan J. Watts,
Ingunn Kathrine Wehus
Abstract:
Line-intensity map** observations will find fluctuations of integrated line emission are attenuated by varying degrees at small scales due to the width of the line emission profiles. This attenuation may significantly impact estimates of astrophysical or cosmological quantities derived from measurements. We consider a theoretical treatment of the effect of line broadening on both the clustering…
▽ More
Line-intensity map** observations will find fluctuations of integrated line emission are attenuated by varying degrees at small scales due to the width of the line emission profiles. This attenuation may significantly impact estimates of astrophysical or cosmological quantities derived from measurements. We consider a theoretical treatment of the effect of line broadening on both the clustering and shot-noise components of the power spectrum of a generic line-intensity power spectrum using a halo model. We then consider possible simplifications to allow easier application in analysis, particularly in the context of inferences that require numerous, repeated, fast computations of model line-intensity signals across a large parameter space. For the CO Map** Array Project (COMAP) and the CO(1-0) line-intensity field at $z\sim3$ serving as our primary case study, we expect a $\sim10\%$ attenuation of the spherically averaged power spectrum on average at relevant scales of $k\approx0.2$-$0.3$ Mpc$^{-1}$, compared to $\sim25\%$ for the interferometric Millimetre-wave Intensity Map** Experiment (mmIME) targeting shot noise from CO lines at $z\sim1$-$5$ at scales of $k\gtrsim1$ Mpc$^{-1}$. We also consider the nature and amplitude of errors introduced by simplified treatments of line broadening, and find that while an approximation using a single effective velocity scale is sufficient for spherically-averaged power spectra, a more careful treatment is necessary when considering other statistics such as higher multipoles of the anisotropic power spectrum or the voxel intensity distribution.
△ Less
Submitted 24 September, 2021; v1 submitted 22 April, 2021;
originally announced April 2021.
-
BeyondPlanck XV. Polarized foreground emission between 30 and 70 GHz
Authors:
T. L. Svalheim,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci,
E. Keihänen
, et al. (13 additional authors not shown)
Abstract:
We constrain polarized foreground emission between 30 and 70 GHz with the Planck Low Frequency Instrument (LFI) and WMAP data within the global Bayesian BeyondPlanck framework. We combine for the first time full-resolution Planck LFI time-ordered data with low-resolution WMAP sky maps at 33, 40 and 61 GHz. Spectral parameters are fit with a likelihood defined at the native resolution of each frequ…
▽ More
We constrain polarized foreground emission between 30 and 70 GHz with the Planck Low Frequency Instrument (LFI) and WMAP data within the global Bayesian BeyondPlanck framework. We combine for the first time full-resolution Planck LFI time-ordered data with low-resolution WMAP sky maps at 33, 40 and 61 GHz. Spectral parameters are fit with a likelihood defined at the native resolution of each frequency channel. This analysis represents the first implementation of true multi-resolution component separation applied to CMB observations for both amplitude and spectral energy distribution (SED) parameters. For synchrotron emission, we approximate the SED as a power-law in frequency and find that the low signal-to-noise ratio of the current data strongly limits the number of free parameters that may be robustly constrained. We partition the sky into four large disjoint regions (High Latitude; Galactic Spur; Galactic Plane; and Galactic Center), each associated with its own power-law index. We find that the High Latitude region is prior-dominated, while the Galactic Center region is contaminated by residual instrumental systematics. The two remaining regions appear to be signal-dominated, and for these we derive spectral indices of $β_{\mathrm s}^{\mathrm{Spur}}=-3.17\pm0.06$ and $β_{\mathrm s}^{\mathrm{Plane}}=-3.03\pm0.07$, in good agreement with previous results. For thermal dust emission we assume a modified blackbody model and we fit a single power-law index across the full sky. We find $β_{\mathrm{d}}=1.64\pm0.03$, which is slightly steeper than reported from Planck HFI data, but still statistically consistent at the 2$σ$ confidence level.
△ Less
Submitted 18 January, 2022; v1 submitted 17 November, 2020;
originally announced November 2020.
-
BeyondPlanck VII. Bayesian estimation of gain and absolute calibration for CMB experiments
Authors:
E. Gjerløw,
H. T. Ihle,
S. Galeotta,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
M. Galloway,
S. Gerakakis,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
J. B. Jewell,
A. Karakci,
E. Keihänen,
R. Keskitalo
, et al. (13 additional authors not shown)
Abstract:
We present a Bayesian calibration algorithm for CMB observations as implemented within the global end-to-end BeyondPlanck (BP) framework, and apply this to the Planck Low Frequency Instrument (LFI) data. Following the most recent Planck analysis, we decompose the full time-dependent gain into a sum of three orthogonal components: One absolute calibration term, common to all detectors; one time-ind…
▽ More
We present a Bayesian calibration algorithm for CMB observations as implemented within the global end-to-end BeyondPlanck (BP) framework, and apply this to the Planck Low Frequency Instrument (LFI) data. Following the most recent Planck analysis, we decompose the full time-dependent gain into a sum of three orthogonal components: One absolute calibration term, common to all detectors; one time-independent term that can vary between detectors; and one time-dependent component that is allowed to vary between one-hour pointing periods. Each term is then sampled conditionally on all other parameters in the global signal model through Gibbs sampling. The absolute calibration is sampled using only the orbital dipole as a reference source, while the two relative gain components are sampled using the full sky signal, including the orbital and Solar CMB dipoles, CMB fluctuations, and foreground contributions. We discuss various aspects of the data that influence gain estimation, including the dipole/polarization quadrupole degeneracy and anomalous jumps in the instrumental gain. Comparing our solution to previous pipelines, we find good agreement in general, with relative deviations of -0.67% (-0.84%) for 30 GHz, 0.12% (-0.04%) for 44 GHz and -0.03% (-0.64%) for 70 GHz, compared to Planck DR4 (Planck 2018). The deviations we find are within expected error bounds, and we attribute them to differences in data usage and general approach between the pipelines. In particular, the BP calibration is performed globally, resulting in better inter-frequency consistency. Additionally, WMAP observations are used actively in the BP analysis, which breaks degeneracies in the Planck data set and results in better agreement with WMAP. Although our presentation and algorithm are currently oriented toward LFI processing, the procedure is fully generalizable to other experiments.
△ Less
Submitted 20 May, 2022; v1 submitted 16 November, 2020;
originally announced November 2020.
-
BeyondPlanck VI. Noise characterization and modelling
Authors:
H. T. Ihle,
M. Bersanelli,
C. Franceschet,
E. Gjerløw,
K. J. Andersen,
R. Aurlien,
R. Banerji,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
J. B. Jewell,
A. Karakci,
E. Keihänen
, et al. (16 additional authors not shown)
Abstract:
We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a $1/f$ model for the noise power spectral density (PSD), but find the need for an additional lognormal comp…
▽ More
We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a $1/f$ model for the noise power spectral density (PSD), but find the need for an additional lognormal component in the noise model for the 30 and 44\,GHz bands. We implement an optimal Wiener-filter (or constrained realization) gap-filling procedure to account for masked data. We then use this procedure to both estimate the gapless correlated noise in the time-domain, $n_\mathrm{corr}$, and to sample the noise PSD parameters, $ξ^n = \{σ_0, f_\mathrm{knee}, α, A_\mathrm{p}\}$. In contrast to previous \textit{Planck} analyses, we assume piecewise stationary noise only within each pointing period (PID), not throughout the full mission, but we adopt the LFI Data Processing Center (DPC) results as priors on $α$ and $f_\mathrm{knee}$. On average, we find best-fit correlated noise parameters that are mostly consistent with previous results, with a few notable exceptions. However, a detailed inspection of the time-dependent results reveals many important findings. First and foremost, we find strong evidence for statistically significant temporal variations in all noise PSD parameters, many of which are directly correlated with satellite housekee** data. Second, while the simple $1/f$ model appears to be an excellent fit for the LFI 70 GHz channel, there is evidence for additional correlated noise not described by a $1/f$ model in the 30 and 44 GHz channels, including within the primary science frequency range of 0.1--1 Hz. (Abridged)
△ Less
Submitted 19 July, 2022; v1 submitted 12 November, 2020;
originally announced November 2020.
-
BeyondPlanck II. CMB map-making through Gibbs sampling
Authors:
E. Keihänen,
A. -S. Suur-Uski,
K. J. Andersen,
R. Aurlien,
R. Banerji,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell,
A. Karakci
, et al. (15 additional authors not shown)
Abstract:
We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destri** methodology. Gibbs sampling breaks the computationally heavy destri** problem into two separate steps; noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benef…
▽ More
We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destri** methodology. Gibbs sampling breaks the computationally heavy destri** problem into two separate steps; noise filtering and map binning. Considered as two separate steps, both are computationally much cheaper than solving the combined problem. This provides a huge performance benefit as compared to traditional methods, and allows us for the first time to bring the destri** baseline length to a single sample. We apply the Gibbs procedure to simulated Planck 30 GHz data. We find that gaps in the time-ordered data are handled efficiently by filling them with simulated noise as part of the Gibbs process. The Gibbs procedure yields a chain of map samples, from which we may compute the posterior mean as a best-estimate map. The variation in the chain provides information on the correlated residual noise, without need to construct a full noise covariance matrix. However, if only a single maximum-likelihood frequency map estimate is required, we find that traditional conjugate gradient solvers converge much faster than a Gibbs sampler in terms of total number of iterations. The conceptual advantages of the Gibbs sampling approach lies in statistically well-defined error propagation and systematic error correction, and this methodology forms the conceptual basis for the map-making algorithm employed in the BeyondPlanck framework, which implements the first end-to-end Bayesian analysis pipeline for CMB observations.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
-
BeyondPlanck I. Global Bayesian analysis of the Planck Low Frequency Instrument data
Authors:
BeyondPlanck Collaboration,
K. J. Andersen,
R. Aurlien,
R. Banerji,
A. Basyrov,
M. Bersanelli,
S. Bertocco,
M. Brilenkov,
M. Carbone,
L. P. L. Colombo,
H. K. Eriksen,
J. R. Eskilt,
M. K. Foss,
C. Franceschet,
U. Fuskeland,
S. Galeotta,
M. Galloway,
S. Gerakakis,
E. Gjerløw,
B. Hensley,
D. Herman,
M. Iacobellis,
M. Ieronymaki,
H. T. Ihle,
J. B. Jewell
, et al. (20 additional authors not shown)
Abstract:
We describe the BeyondPlanck project in terms of motivation, methodology and main products, and provide a guide to a set of companion papers that describe each result in fuller detail. We implement a complete end-to-end Bayesian analysis framework for the Planck LFI observations. The primary product is a full joint posterior distribution $P(ω|d)$, where $ω$ represents the set of all free instrumen…
▽ More
We describe the BeyondPlanck project in terms of motivation, methodology and main products, and provide a guide to a set of companion papers that describe each result in fuller detail. We implement a complete end-to-end Bayesian analysis framework for the Planck LFI observations. The primary product is a full joint posterior distribution $P(ω|d)$, where $ω$ represents the set of all free instrumental, astrophysical, and cosmological parameters. Notable advantages of this approach are seamless end-to-end propagation of uncertainties; accurate modeling of both astrophysical and instrumental effects in the most natural basis for each uncertain quantity; optimized computational costs with little or no need for intermediate human interaction between various analysis steps; and a complete overview of the entire analysis process within one single framework. We focus in particular on low-$\ell$ CMB polarization reconstruction with Planck LFI. We identify several important new effects that have not been accounted for in previous pipelines, including gain over-smoothing and time-variable and non-$1/f$ correlated noise in the 30 and 44 GHz channels. We find that all results are consistent with the $Λ$CDM model, and we constrain the reionization optical depth to $τ=0.066\pm0.013$, with a low-resolution $χ^2$ probability-to-exceed of 32%. This uncertainty is about 30% larger than the official pipelines, arising from taking into account a more complete instrumental model. The marginal CMB Solar dipole amplitude is $3362.7\pm1.4μ\mathrm{K}$, where the error bar is derived directly from the posterior distribution without the need of any ad-hoc instrumental corrections. We are currently not aware of any significant unmodelled systematic effects remaining in the Planck LFI data, and, for the first time, the 44 GHz channel is fully exploited. (Abridged.)
△ Less
Submitted 12 September, 2022; v1 submitted 11 November, 2020;
originally announced November 2020.
-
Cross-correlating Carbon Monoxide Line-intensity Maps with Spectroscopic and Photometric Galaxy Surveys
Authors:
Dongwoo T. Chung,
Marco P. Viero,
Sarah E. Church,
Risa H. Wechsler,
Marcelo A. Alvarez,
J. Richard Bond,
Patrick C. Breysse,
Kieran A. Cleary,
Hans K. Eriksen,
Marie K. Foss,
Joshua O. Gundersen,
Stuart E. Harper,
Håvard T. Ihle,
Laura C. Keating,
Norman Murray,
Hamsa Padmanabhan,
George F. Stein,
Ingunn K. Wehus
Abstract:
Line-intensity map** (LIM or IM) is an emerging field of observational work, with strong potential to fit into a larger effort to probe large-scale structure and small-scale astrophysical phenomena using multiple complementary tracers. Taking full advantage of such complementarity means, in part, undertaking line-intensity surveys with galaxy surveys in mind. We consider the potential for detect…
▽ More
Line-intensity map** (LIM or IM) is an emerging field of observational work, with strong potential to fit into a larger effort to probe large-scale structure and small-scale astrophysical phenomena using multiple complementary tracers. Taking full advantage of such complementarity means, in part, undertaking line-intensity surveys with galaxy surveys in mind. We consider the potential for detection of a cross-correlation signal between COMAP and blind surveys based on photometric redshifts (as in COSMOS) or based on spectroscopic data (as with the HETDEX survey of Lyman-$α$ emitters). We find that obtaining $σ_z/(1+z)\lesssim0.003$ accuracy in redshifts and $\gtrsim10^{-4}$ sources per Mpc$^3$ with spectroscopic redshift determination should enable a CO-galaxy cross spectrum detection significance at least twice that of the CO auto spectrum. Either a future targeted spectroscopic survey or a blind survey like HETDEX may be able to meet both of these requirements.
△ Less
Submitted 17 January, 2019; v1 submitted 12 September, 2018;
originally announced September 2018.
-
Joint power spectrum and voxel intensity distribution forecast on the CO luminosity function with COMAP
Authors:
Håvard Tveit Ihle,
Dongwoo Chung,
George Stein,
Marcelo Alvarez,
J. Richard Bond,
Patrick C. Breysse,
Kieran A. Cleary,
Hans Kristian Eriksen,
Marie Kristine Foss,
Joshua Ott Gundersen,
Stuart Harper,
Norman Murray,
Hamsa Padmanabhan,
Marco P. Viero,
Ingunn Katerine Wehus
Abstract:
We develop a framework for joint constraints on the CO luminosity function based on power spectra (PS) and voxel intensity distributions (VID), and apply this to simulations of COMAP, a CO intensity map** experiment. This Bayesian framework is based on a Markov chain Monte Carlo (MCMC) sampler coupled to a Gaussian likelihood with a joint PS + VID covariance matrix computed from a large number o…
▽ More
We develop a framework for joint constraints on the CO luminosity function based on power spectra (PS) and voxel intensity distributions (VID), and apply this to simulations of COMAP, a CO intensity map** experiment. This Bayesian framework is based on a Markov chain Monte Carlo (MCMC) sampler coupled to a Gaussian likelihood with a joint PS + VID covariance matrix computed from a large number of fiducial simulations, and re-calibrated with a small number of simulations per MCMC step. The simulations are based on dark matter halos from fast peak patch simulations combined with the $L_\text{CO}(M_\text{halo})$ model of Li et al. (2016). We find that the relative power to constrain the CO luminosity function depends on the luminosity range of interest. In particular, the VID is more sensitive at both small and large luminosities, while the PS is more sensitive at intermediate luminosities. The joint analysis is superior to using either observable separately. When averaging over CO luminosities ranging between $L_\text{CO} = 10^4-10^7L_\odot$, and over 10 cosmological realizations of COMAP Phase 2, the uncertainties (in dex) are larger by 58 % and 30 % for the PS and VID, respectively, when compared to the joint analysis (PS + VID). This method is generally applicable to any other random field, with a complicated likelihood, as long a fast simulation procedure is available.
△ Less
Submitted 20 March, 2019; v1 submitted 22 August, 2018;
originally announced August 2018.