-
Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows
Authors:
Doris Xin,
Eva Yiwei Wu,
Doris Jung-Lin Lee,
Niloufar Salehi,
Aditya Parameswaran
Abstract:
Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today, we performed a qualitative study with participants ranging from novice hobbyists to industry researchers who use Auto-ML tools. We present insights into the bene…
▽ More
Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today, we performed a qualitative study with participants ranging from novice hobbyists to industry researchers who use Auto-ML tools. We present insights into the benefits and deficiencies of existing tools, as well as the respective roles of the human and automation in ML workflows. Finally, we discuss design implications for the future of Auto-ML tool development. We argue that instead of full automation being the ultimate goal of Auto-ML, designers of these tools should focus on supporting a partnership between the user and the Auto-ML tool. This means that a range of Auto-ML tools will need to be developed to support varying user goals such as simplicity, reproducibility, and reliability.
△ Less
Submitted 12 January, 2021;
originally announced January 2021.
-
The QUaD Galactic Plane Survey II: A Compact Source Catalog
Authors:
T. Culverhouse,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
R. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. Pryke,
R. Schwarz,
C. O'Sullivan,
L. Piccirillo,
N. Rajguru
, et al. (6 additional authors not shown)
Abstract:
We present a catalog of compact sources derived from the QUaD Galactic Plane Survey. The survey covers ~800 square degrees of the inner galaxy (|b|<4 degrees) in Stokes I, Q and U parameters at 100 and 150 GHz, with angular resolution 5 and 3.5 arcminutes. 505 unique sources are identified in I, of which 239 are spatially matched between frequency bands, with 50 (216) detected at 100 (150) GHz alo…
▽ More
We present a catalog of compact sources derived from the QUaD Galactic Plane Survey. The survey covers ~800 square degrees of the inner galaxy (|b|<4 degrees) in Stokes I, Q and U parameters at 100 and 150 GHz, with angular resolution 5 and 3.5 arcminutes. 505 unique sources are identified in I, of which 239 are spatially matched between frequency bands, with 50 (216) detected at 100 (150) GHz alone; 182 sources are identified as ultracompact HII (UCHII) regions. Approximating the distribution of total intensity source fluxes as a power-law, we find a slope of $γ_{S,100}=-1.8\pm0.4$ at 100 GHz, and $γ_{S,150}=-2.2\pm0.4$ at 150 GHz. Similarly, the power-law index of the source two-point angular correlation function is $γ_{θ,100}=-1.21\pm0.04$ and $γ_{θ,150}=-1.25\pm0.04$. The total intensity spectral index distribution peaks at $α_{I}\sim0.25$, indicating that dust emission is not the only source of radiation produced by these objects between 100 and 150 GHz; free-free radiation is likely significant in the 100 GHz band. Four sources are detected in polarized intensity P, of which three have matching counterparts in I. Three of the polarized sources lie close to the galactic center, Sagittarius A*, Sagittarius B2 and the Galactic Radio Arc, while the fourth is RCW 49, a bright HII region. An extended polarized source, undetected by the source extraction algorithm on account of its $\sim0.5^{\circ}$ size, is identified visually, and is an isolated example of large-scale polarized emission oriented distinctly from the bulk galactic dust polarization.
△ Less
Submitted 18 December, 2010;
originally announced December 2010.
-
The QUaD Galactic Plane Survey 1: Maps And Analysis of Diffuse Emission
Authors:
T. Culverhouse,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
R. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
R. Schwarz,
C. O' Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (6 additional authors not shown)
Abstract:
We present a survey of ~800 square degrees of the galactic plane observed with the QUaD telescope. The primary product of the survey are maps of Stokes I, Q and U parameters at 100 and 150 GHz, with spatial resolution 5 and 3.5 arcminutes respectively. Two regions are covered, spanning approximately 245-295 and 315-5 degrees in galactic longitude l, and -4<b<+4 degrees in galactic latitude b. At 0…
▽ More
We present a survey of ~800 square degrees of the galactic plane observed with the QUaD telescope. The primary product of the survey are maps of Stokes I, Q and U parameters at 100 and 150 GHz, with spatial resolution 5 and 3.5 arcminutes respectively. Two regions are covered, spanning approximately 245-295 and 315-5 degrees in galactic longitude l, and -4<b<+4 degrees in galactic latitude b. At 0.02 degree square pixel size, the median sensitivity is 74 and 107 kJy/sr at 100 GHz and 150 GHz respectively in I, and 98 and 120 kJy/sr for Q and U. In total intensity, we find an average spectral index of 2.35+/-0.01 (stat) +/- 0.02 (sys) for |b|<1 degree, indicative of emission components other than thermal dust. A comparison to published dust, synchrotron and free-free models implies an excess of emission in the 100 GHz QUaD band, while better agreement is found at 150 GHz. A smaller excess is observed when comparing QUaD 100 GHz data to WMAP 5-year W band; in this case the excess is likely due to the wider bandwidth of QUaD. Combining the QUaD and WMAP data, a two-component spectral fit to the inner galactic plane (|b|<1 degree) yields mean spectral indices of -0.32 +/- 0.03 and 2.84 +/- 0.03; the former is interpreted as a combination of the spectral indices of synchrotron, free-free and dust, while the second is attributed largely to the thermal dust continuum. In the same galactic latitude range, the polarization data show a high degree of alignment perpendicular to the expected galactic magnetic field direction, and exhibit mean polarization fraction 1.38+/-0.08 (stat) +/-0.1 (sys) % at 100 GHz and 1.70 +/- 0.06 (stat) +/- 0.1 (sys) % at 150GHz. We find agreement in polarization fraction between QUaD 100 GHz and WMAP W band, the latter giving 1.1 +/- 0.4 %.
△ Less
Submitted 18 December, 2010; v1 submitted 8 January, 2010;
originally announced January 2010.
-
Parameter Estimation from Improved Measurements of the CMB from QUaD
Authors:
QUaD collaboration,
S. Gupta,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
R. B. Friedman,
K. Ganga,
W. K. Gear,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. O'Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (7 additional authors not shown)
Abstract:
We evaluate the contribution of cosmic microwave background (CMB) polarization spectra to cosmological parameter constraints. We produce cosmological parameters using high-quality CMB polarization data from the ground-based QUaD experiment and demonstrate for the majority of parameters that there is significant improvement on the constraints obtained from satellite CMB polarization data. We split…
▽ More
We evaluate the contribution of cosmic microwave background (CMB) polarization spectra to cosmological parameter constraints. We produce cosmological parameters using high-quality CMB polarization data from the ground-based QUaD experiment and demonstrate for the majority of parameters that there is significant improvement on the constraints obtained from satellite CMB polarization data. We split a multi-experiment CMB dataset into temperature and polarization subsets and show that the best-fit confidence regions for the LCDM 6-parameter cosmological model are consistent with each other, and that polarization data reduces the confidence regions on all parameters. We provide the best limits on parameters from QUaD EE/BB polarization data and we find best-fit parameters from the multi-experiment CMB dataset using the optimal pivot scale of k_p=0.013 Mpc-1 to be {omch2, ombh2, H_0, A_s, n_s, tau}= {0.113, 0.0224, 70.6, 2.29 times 10^-9, 0.960, 0.086}.
△ Less
Submitted 27 May, 2010; v1 submitted 9 September, 2009;
originally announced September 2009.
-
Characterization of the Millimeter-Wave Polarization of Centaurus A with QUaD
Authors:
M. Zemcov,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
R. B. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. O'Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (6 additional authors not shown)
Abstract:
Centaurus (Cen) A represents one of the best candidates for an isolated, compact, highly polarized source that is bright at typical cosmic microwave background (CMB) experiment frequencies. We present measurements of the 4 degree by 2 degree region centered on Cen A with QUaD, a CMB polarimeter whose absolute polarization angle is known to 0.5 degrees. Simulations are performed to assess the effec…
▽ More
Centaurus (Cen) A represents one of the best candidates for an isolated, compact, highly polarized source that is bright at typical cosmic microwave background (CMB) experiment frequencies. We present measurements of the 4 degree by 2 degree region centered on Cen A with QUaD, a CMB polarimeter whose absolute polarization angle is known to 0.5 degrees. Simulations are performed to assess the effect of misestimation of the instrumental parameters on the final measurement and systematic errors due to the field's background structure and temporal variability from Cen A's nuclear region are determined. The total (Q, U) of the inner lobe region is (1.00 +/- 0.07 (stat.) +/- 0.04 (sys.), -1.72 +/- 0.06 +/- 0.05) Jy at 100 GHz and (0.80 +/- 0.06 +/- 0.06, -1.40 +/- 0.07 +/- 0.08) Jy at 150 GHz, leading to polarization angles and total errors of -30.0 +/- 1.1 degrees and -29.1 +/- 1.7 degrees. These measurements will allow the use of Cen A as a polarized calibration source for future millimeter experiments.
△ Less
Submitted 29 July, 2010; v1 submitted 17 August, 2009;
originally announced August 2009.
-
Improved measurements of the temperature and polarization of the CMB from QUaD
Authors:
The QUaD collaboration,
M. L. Brown,
P. Ade,
J. Bock,
M. Bowden,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
R. B. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. O'Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (7 additional authors not shown)
Abstract:
We present an improved analysis of the final dataset from the QUaD experiment. Using an improved technique to remove ground contamination, we double the effective sky area and hence increase the precision of our CMB power spectrum measurements by ~30% versus that previously reported. In addition, we have improved our modeling of the instrument beams and have reduced our absolute calibration unce…
▽ More
We present an improved analysis of the final dataset from the QUaD experiment. Using an improved technique to remove ground contamination, we double the effective sky area and hence increase the precision of our CMB power spectrum measurements by ~30% versus that previously reported. In addition, we have improved our modeling of the instrument beams and have reduced our absolute calibration uncertainty from 5% to 3.5% in temperature. The robustness of our results is confirmed through extensive jackknife tests and by way of the agreement we find between our two fully independent analysis pipelines. For the standard 6-parameter LCDM model, the addition of QUaD data marginally improves the constraints on a number of cosmological parameters over those obtained from the WMAP experiment alone. The impact of QUaD data is significantly greater for a model extended to include either a running in the scalar spectral index, or a possible tensor component, or both. Adding both the QUaD data and the results from the ACBAR experiment, the uncertainty in the spectral index running is reduced by ~25% compared to WMAP alone, while the upper limit on the tensor-to-scalar ratio is reduced from r < 0.48 to r < 0.33 (95% c.l). This is the strongest limit on tensors to date from the CMB alone. We also use our polarization measurements to place constraints on parity violating interactions to the surface of last scattering, constraining the energy scale of Lorentz violating interactions to < 1.5 x 10^{-43} GeV (68% c.l.). Finally, we place a robust upper limit on the strength of the lensing B-mode signal. Assuming a single flat band power between l = 200 and l = 2000, we constrain the amplitude of B-modes to be < 0.57 micro-K^2 (95% c.l.).
△ Less
Submitted 29 October, 2009; v1 submitted 5 June, 2009;
originally announced June 2009.
-
Small Angular Scale Measurements of the CMB Temperature Power Spectrum from QUaD
Authors:
QUaD collaboration,
R. B. Friedman,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. O' Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (7 additional authors not shown)
Abstract:
We present measurements of the cosmic microwave background (CMB) radiation temperature anisotropy in the multipole range 2000<ell<3000 from the QUaD telescope's second and third observing seasons. After masking the brightest point sources our results are consistent with the primary LCDM expectation alone. We estimate the contribution of residual (un-masked) radio point sources using a model cali…
▽ More
We present measurements of the cosmic microwave background (CMB) radiation temperature anisotropy in the multipole range 2000<ell<3000 from the QUaD telescope's second and third observing seasons. After masking the brightest point sources our results are consistent with the primary LCDM expectation alone. We estimate the contribution of residual (un-masked) radio point sources using a model calibrated to our own bright source observations, and a full simulation of the source finding and masking procedure. Including this contribution slightly improves the chi^2. We also fit a standard SZ template to the bandpowers and see no strong evidence of an SZ contribution, which is as expected for sigma_8 approx 0.8.
△ Less
Submitted 30 June, 2009; v1 submitted 27 January, 2009;
originally announced January 2009.
-
Cosmological Parameters from the QUaD CMB polarization experiment
Authors:
QUaD collaboration,
P. G. Castro,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
S. Church,
T. Culverhouse,
R. B. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
C. Pryke,
R. Schwarz,
C. O'Sullivan,
L. Piccirillo
, et al. (7 additional authors not shown)
Abstract:
In this paper we present a parameter estimation analysis of the polarization and temperature power spectra from the second and third season of observations with the QUaD experiment. QUaD has for the first time detected multiple acoustic peaks in the E-mode polarization spectrum with high significance. Although QUaD-only parameter constraints are not competitive with previous results for the stan…
▽ More
In this paper we present a parameter estimation analysis of the polarization and temperature power spectra from the second and third season of observations with the QUaD experiment. QUaD has for the first time detected multiple acoustic peaks in the E-mode polarization spectrum with high significance. Although QUaD-only parameter constraints are not competitive with previous results for the standard 6-parameter LCDM cosmology, they do allow meaningful polarization-only parameter analyses for the first time. In a standard 6-parameter LCDM analysis we find the QUaD TT power spectrum to be in good agreement with previous results. However, the QUaD polarization data shows some tension with LCDM. The origin of this 1 to 2 sigma tension remains unclear, and may point to new physics, residual systematics or simple random chance. We also combine QUaD with the five-year WMAP data set and the SDSS Luminous Red Galaxies 4th data release power spectrum, and extend our analysis to constrain individual isocurvature mode fractions, constraining cold dark matter density, alpha(cdmi)<0.11 (95 % CL), neutrino density, alpha(ndi)<0.26 (95 % CL), and neutrino velocity, alpha(nvi)<0.23 (95 % CL), modes. Our analysis sets a benchmark for future polarization experiments.
△ Less
Submitted 7 January, 2009;
originally announced January 2009.
-
Parity violation constraints using 2006-2007 QUaD CMB polarization spectra
Authors:
QUaD Collaboration,
E. Y. S. Wu,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
R. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (7 additional authors not shown)
Abstract:
We constrain parity-violating interactions to the surface of last scattering using spectra from the QUaD experiment's second and third seasons of observations by searching for a possible systematic rotation of the polarization directions of CMB photons. We measure the rotation angle due to such a possible "cosmological birefringence" to be 0.55 deg. +/- 0.82 deg. (random) +/- 0.5 deg. (systemati…
▽ More
We constrain parity-violating interactions to the surface of last scattering using spectra from the QUaD experiment's second and third seasons of observations by searching for a possible systematic rotation of the polarization directions of CMB photons. We measure the rotation angle due to such a possible "cosmological birefringence" to be 0.55 deg. +/- 0.82 deg. (random) +/- 0.5 deg. (systematic) using QUaD's 100 and 150 GHz TB and EB spectra over the multipole range 200 < l < 2000, consistent with null, and constrain Lorentz violating interactions to < 2^-43 GeV (68% confidence limit). This is the best constraint to date on electrodynamic parity violation on cosmological scales.
△ Less
Submitted 1 April, 2009; v1 submitted 4 November, 2008;
originally announced November 2008.
-
QUaD: A High-Resolution Cosmic Microwave Background Polarimeter
Authors:
QUaD collaboration,
J. R. Hinderks,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
J. E. Carlstrom,
P. G. Castro,
S. Church,
T. Culverhouse,
R. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Harris,
V. Haynes,
B. G. Keating,
J. Kovac,
E. Kirby,
A. E. Lange,
E. Leitch,
O. E. Mallie,
S. Melhuish,
Y. Memari
, et al. (14 additional authors not shown)
Abstract:
We describe the QUaD experiment, a millimeter-wavelength polarimeter designed to observe the Cosmic Microwave Background (CMB) from a site at the South Pole. The experiment comprises a 2.64 m Cassegrain telescope equipped with a cryogenically cooled receiver containing an array of 62 polarization-sensitive bolometers. The focal plane contains pixels at two different frequency bands, 100 GHz and…
▽ More
We describe the QUaD experiment, a millimeter-wavelength polarimeter designed to observe the Cosmic Microwave Background (CMB) from a site at the South Pole. The experiment comprises a 2.64 m Cassegrain telescope equipped with a cryogenically cooled receiver containing an array of 62 polarization-sensitive bolometers. The focal plane contains pixels at two different frequency bands, 100 GHz and 150 GHz, with angular resolutions of 5 arcmin and 3.5 arcmin, respectively. The high angular resolution allows observation of CMB temperature and polarization anisotropies over a wide range of scales. The instrument commenced operation in early 2005 and collected science data during three successive Austral winter seasons of observation.
△ Less
Submitted 29 April, 2009; v1 submitted 14 May, 2008;
originally announced May 2008.
-
Second and third season QUaD CMB temperature and polarization power spectra
Authors:
QUaD collaboration,
C. Pryke,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
P. G. Castro,
S. Church,
T. Culverhouse,
R. Friedman,
K. Ganga,
W. K. Gear,
S. Gupta,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
Y. Memari,
J. A. Murphy,
A. Orlando,
R. Schwarz,
C. O'Sullivan,
L. Piccirillo
, et al. (7 additional authors not shown)
Abstract:
We report results from the second and third seasons of observation with the QUaD experiment. Angular power spectra of the Cosmic Microwave Background are derived for both temperature and polarization at both 100 GHz and 150 GHz, and as cross frequency spectra. All spectra are subjected to an extensive set of jackknife tests to probe for possible systematic contamination. For the implemented data…
▽ More
We report results from the second and third seasons of observation with the QUaD experiment. Angular power spectra of the Cosmic Microwave Background are derived for both temperature and polarization at both 100 GHz and 150 GHz, and as cross frequency spectra. All spectra are subjected to an extensive set of jackknife tests to probe for possible systematic contamination. For the implemented data cuts and processing technique such contamination is undetectable. We analyze the difference map formed between the 100 and 150 GHz bands and find no evidence of foreground contamination in polarization. The spectra are then combined to form a single set of results which are shown to be consistent with the prevailing LCDM model. The sensitivity of the polarization results is considerably better than that of any previous experiment -- for the first time multiple acoustic peaks are detected in the E-mode power spectrum at high significance.
△ Less
Submitted 24 February, 2009; v1 submitted 14 May, 2008;
originally announced May 2008.
-
First season QUaD CMB temperature and polarization power spectra
Authors:
QUaD Collaboration,
P. Ade,
J. Bock,
M. Bowden,
M. L. Brown,
G. Cahill,
J. E. Carlstrom,
P. G. Castro,
S. Church,
T. Culverhouse,
R. Friedman,
K. Ganga,
W. K. Gear,
J. Hinderks,
J. Kovac,
A. E. Lange,
E. Leitch,
S. J. Melhuish,
J. A. Murphy,
A. Orlando,
R. Schwarz,
C. O'Sullivan,
L. Piccirillo,
C. Pryke,
N. Rajguru
, et al. (5 additional authors not shown)
Abstract:
QUaD is a bolometric CMB polarimeter sited at the South Pole, operating at frequencies of 100 and 150 GHz. In this paper we report preliminary results from the first season of operation (austral winter 2005). All six CMB power spectra are presented derived as cross spectra between the 100 and 150 GHz maps using 67 days of observation in a low foreground region of approximately 60 square degrees.…
▽ More
QUaD is a bolometric CMB polarimeter sited at the South Pole, operating at frequencies of 100 and 150 GHz. In this paper we report preliminary results from the first season of operation (austral winter 2005). All six CMB power spectra are presented derived as cross spectra between the 100 and 150 GHz maps using 67 days of observation in a low foreground region of approximately 60 square degrees. This data is a small fraction of the data acquired to date. The measured spectra are consistent with the LCDM cosmological model. We perform jackknife tests which indicate that the observed signal has negligible contamination from instrumental systematics. In addition by using a frequency jackknife we find no evidence for foreground contamination.
△ Less
Submitted 16 May, 2007;
originally announced May 2007.
