-
A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics
Authors:
M. Baak,
R. Koopman,
H. Snoek,
S. Klous
Abstract:
A prescription is presented for a new and practical correlation coefficient, $φ_K$, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of $φ_K$ form an advantage over existing coefficients. First, it works consistently between categorical, ordinal and interval variables. Second, it captures non-linear dependency. Third, it reverts to t…
▽ More
A prescription is presented for a new and practical correlation coefficient, $φ_K$, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of $φ_K$ form an advantage over existing coefficients. First, it works consistently between categorical, ordinal and interval variables. Second, it captures non-linear dependency. Third, it reverts to the Pearson correlation coefficient in case of a bi-variate normal input distribution. These are useful features when studying the correlation between variables with mixed types. Particular emphasis is paid to the proper evaluation of statistical significance of correlations and to the interpretation of variable relationships in a contingency table, in particular in case of low statistics samples and significant dependencies. Three practical applications are discussed. The presented algorithms are easy to use and available through a public Python library.
△ Less
Submitted 9 March, 2019; v1 submitted 28 November, 2018;
originally announced November 2018.
-
Power-aware applications for scientific cluster and distributed computing
Authors:
David Abdurachmanov,
Peter Elmer,
Giulio Eulisse,
Paola Grosso,
Curtis Hillegas,
Burt Holzman,
Ruben L. Janssen,
Sander Klous,
Robert Knight,
Shahzad Muzaffar
Abstract:
The aggregate power use of computing hardware is an important cost factor in scientific cluster and distributed computing systems. The Worldwide LHC Computing Grid (WLCG) is a major example of such a distributed computing system, used primarily for high throughput computing (HTC) applications. It has a computing capacity and power consumption rivaling that of the largest supercomputers. The comput…
▽ More
The aggregate power use of computing hardware is an important cost factor in scientific cluster and distributed computing systems. The Worldwide LHC Computing Grid (WLCG) is a major example of such a distributed computing system, used primarily for high throughput computing (HTC) applications. It has a computing capacity and power consumption rivaling that of the largest supercomputers. The computing capacity required from this system is also expected to grow over the next decade. Optimizing the power utilization and cost of such systems is thus of great interest.
A number of trends currently underway will provide new opportunities for power-aware optimizations. We discuss how power-aware software applications and scheduling might be used to reduce power consumption, both as autonomous entities and as part of a (globally) distributed system. As concrete examples of computing centers we provide information on the large HEP-focused Tier-1 at FNAL, and the Tigress High Performance Computing Center at Princeton University, which provides HPC resources in a university context.
△ Less
Submitted 22 October, 2014; v1 submitted 28 April, 2014;
originally announced April 2014.
-
Expected Performance of the ATLAS Experiment - Detector, Trigger and Physics
Authors:
The ATLAS Collaboration,
G. Aad,
E. Abat,
B. Abbott,
J. Abdallah,
A. A. Abdelalim,
A. Abdesselam,
O. Abdinov,
B. Abi,
M. Abolins,
H. Abramowicz,
B. S. Acharya,
D. L. Adams,
T. N. Addy,
C. Adorisio,
P. Adragna,
T. Adye,
J. A. Aguilar-Saavedra,
M. Aharrouche,
S. P. Ahlen,
F. Ahles,
A. Ahmad,
H. Ahmed,
G. Aielli,
T. Akdogan
, et al. (2587 additional authors not shown)
Abstract:
A detailed study is presented of the expected performance of the ATLAS detector. The reconstruction of tracks, leptons, photons, missing energy and jets is investigated, together with the performance of b-tagging and the trigger. The physics potential for a variety of interesting physics processes, within the Standard Model and beyond, is examined. The study comprises a series of notes based on…
▽ More
A detailed study is presented of the expected performance of the ATLAS detector. The reconstruction of tracks, leptons, photons, missing energy and jets is investigated, together with the performance of b-tagging and the trigger. The physics potential for a variety of interesting physics processes, within the Standard Model and beyond, is examined. The study comprises a series of notes based on simulations of the detector and physics processes, with particular emphasis given to the data expected from the first years of operation of the LHC at CERN.
△ Less
Submitted 14 August, 2009; v1 submitted 28 December, 2008;
originally announced January 2009.
-
DIRAC - Distributed Infrastructure with Remote Agent Control
Authors:
N. Brook,
A. Bogdanchikov,
A. Buckley,
J. Closier,
U. Egede,
M. Frank,
D. Galli,
M. Gandelman,
V. Garonne,
C. Gaspar,
R. Graciani Diaz,
K. Harrison,
E. van Herwijnen,
A. Khan,
S. Klous,
I. Korolko,
G. Kuznetsov,
F. Loverre,
U. Marconi,
J. P. Palacios,
G. N. Patrick,
A. Pickford,
S. Ponce,
V. Romanovski,
J. J. Saborido
, et al. (5 additional authors not shown)
Abstract:
This paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes; Databases for production management, bookkee** (the metadata catalogue) and software configuration; Monitoring and cataloguing services for updating and accessing the databases. Locally installed software agents im…
▽ More
This paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes; Databases for production management, bookkee** (the metadata catalogue) and software configuration; Monitoring and cataloguing services for updating and accessing the databases. Locally installed software agents implemented in Python monitor the local batch queue, interrogate the production database for any outstanding production requests using the XML-RPC protocol and initiate the job submission. The agent checks and, if necessary, installs any required software automatically. After the job has processed the events, the agent transfers the output data and updates the metadata catalogue. DIRAC has been successfully installed at 18 collaborating institutes, including the DataGRID, and has been used in recent Physics Data Challenges. In the near to medium term future we must use a mixed environment with different types of grid middleware or no middleware. We describe how this flexibility has been achieved and how ubiquitously available grid middleware would improve DIRAC.
△ Less
Submitted 12 June, 2003;
originally announced June 2003.
-
Spin-Momentum Correlations in Quasi-Elastic Electron Scattering from Deuterium
Authors:
I. Passchier,
L. D. van Buuren,
D. Szczerba,
R. Alarcon,
Th. S. Bauer,
D. Boersma,
J. F. J. van den Brand,
H. J. Bulten,
R. Ent,
M. Ferro-Luzzi,
M. Harvey,
P. Heimberg,
D. W. Higinbotham,
S. Klous,
H. Kolster,
J. Lang,
B. L. Militsyn,
D. Nikolenko,
G. J. L. Nooren,
B. E. Norum,
H. R. Poolman,
I. Rachek,
M. C. Simani,
E. Six,
H. de Vries
, et al. (2 additional authors not shown)
Abstract:
We report on a measurement of spin-momentum correlations in quasi-elastic scattering of longitudinally polarized electrons with an energy of 720 MeV from vector-polarized deuterium. The spin correlation parameter $A^V_{ed}$ was measured for the $^2 \vec{\rm H}(\vec e,e^\prime p)n$ reaction for missing momenta up to 350 MeV/$c$ at a four-momentum transfer squared of 0.21 (GeV/c)$^2$. The data giv…
▽ More
We report on a measurement of spin-momentum correlations in quasi-elastic scattering of longitudinally polarized electrons with an energy of 720 MeV from vector-polarized deuterium. The spin correlation parameter $A^V_{ed}$ was measured for the $^2 \vec{\rm H}(\vec e,e^\prime p)n$ reaction for missing momenta up to 350 MeV/$c$ at a four-momentum transfer squared of 0.21 (GeV/c)$^2$. The data give detailed information about the spin structure of the deuteron, and are in good agreement with the predictions of microscopic calculations based on realistic nucleon-nucleon potentials and including various spin-dependent reaction mechanism effects. The experiment demonstrates in a most direct manner the effects of the D-state in the deuteron ground-state wave function and shows the importance of isobar configurations for this reaction.
△ Less
Submitted 21 September, 2001;
originally announced September 2001.
-
The Charge Form Factor of the Neutron from the reaction 2H(pol)(e(pol)e'n)p
Authors:
I. Passchier,
L. D. van Buuren,
D. Szczerba,
R. Alarcon,
Th. S. Bauer,
D. Boersma,
J. F. J. van den Brand,
H. J. Bulten,
M. Ferro-Luzzi,
D. W. Higinbotham,
C. W. de Jager,
S. Klous,
H. Kolster,
J. Lang,
D. Nikolenko,
G. J. Nooren,
B. E. Norum,
H. R. Poolman,
I. Rachek,
M. C. Simani,
E. Six,
H. de Vries,
K. Wang,
Z. -L. Zhou
Abstract:
We report on the first measurement of spin-correlation parameters in quasifree electron scattering from vector-polarized deuterium. Polarized electrons were injected into an electron storage ring at a beam energy of 720 MeV. A Siberian snake was employed to preserve longitudinal polarization at the interaction point. Vector-polarized deuterium was produced by an atomic beam source and injected i…
▽ More
We report on the first measurement of spin-correlation parameters in quasifree electron scattering from vector-polarized deuterium. Polarized electrons were injected into an electron storage ring at a beam energy of 720 MeV. A Siberian snake was employed to preserve longitudinal polarization at the interaction point. Vector-polarized deuterium was produced by an atomic beam source and injected into an open-ended cylindrical cell, internal to the electron storage ring. The spin correlation parameter $A^V_{ed}$ was measured for the reaction $^2 \vec{\rm H}(\vec e,e^\prime n)p$ at a four-momentum transfer squared of 0.21~(GeV/$c$)$^2$ from which a value for the charge form factor of the neutron was extracted.
△ Less
Submitted 9 August, 1999;
originally announced August 1999.
-
The Charge Form Factor of the Neutron from the Reaction \pol{2H}(\pol{e},e'n)p
Authors:
I. Passchier,
R. Alarcon,
Th. S. Bauer,
D. Boersma,
J. F. J. van den Brand,
L. D. van Buuren,
H. J. Bulten,
M. Ferro-Luzzi,
P. Heimberg,
D. W. Higinbotham,
C. W. de Jager,
S. Klous,
H. Kolster,
J. Lang,
B. L. Militsyn,
D. Nikolenko,
G. J. L. Nooren,
B. E. Norum,
H. R. Poolman,
I. Rachek,
M. C. Simani,
E. Six,
D. Szczerba,
H. de Vries,
K. Wang
Abstract:
We report on the first measurement of spin-correlation parameters in quasifree electron scattering from vector-polarized deuterium. Polarized electrons were injected into an electron storage ring at a beam energy of 720~MeV. A Siberian snake was employed to preserve longitudinal polarization at the interaction point. Vector-polarized deuterium was produced by an atomic beam source and injected i…
▽ More
We report on the first measurement of spin-correlation parameters in quasifree electron scattering from vector-polarized deuterium. Polarized electrons were injected into an electron storage ring at a beam energy of 720~MeV. A Siberian snake was employed to preserve longitudinal polarization at the interaction point. Vector-polarized deuterium was produced by an atomic beam source and injected into an open-ended cylindrical cell, internal to the electron storage ring. The spin correlation parameter A^V_{ed} was measured for the reaction \pol{2H}(\pol{e},e'n)p at a four-momentum transfer squared of 0.21 (GeV/c)^2 from which a value for the charge form factor of the neutron was extracted.
△ Less
Submitted 19 July, 1999;
originally announced July 1999.
