Showing 1–50 of 116 results for author: Wittich, P

Improving tracking algorithms with machine learning: a case for line-segment tracking at the High Luminosity LHC

Authors: Jonathan Guiang, Slava Krutelyov, Manos Vourliotis, Yanxi Gu, Avi Yagil, Balaji Venkat Sathia Narayanan, Matevz Tadel, Philip Chang, Mayra Silva, Gavin Niendorf, Peter Wittich, Tres Reid, Peter Elmer

Abstract: In this work, we present a study on ways that tracking algorithms can be improved with machine learning (ML). We base this study on the line segment tracking (LST) algorithm that we have designed to be naturally parallelized and vectorized in order to efficiently run on modern processors. LST has been developed specifically for the CMS Experiment at the LHC, towards the High Luminosity LHC (HL-LHC… ▽ More In this work, we present a study on ways that tracking algorithms can be improved with machine learning (ML). We base this study on the line segment tracking (LST) algorithm that we have designed to be naturally parallelized and vectorized in order to efficiently run on modern processors. LST has been developed specifically for the CMS Experiment at the LHC, towards the High Luminosity LHC (HL-LHC) upgrade. Moreover, we have already shown excellent efficiency and performance results as we iteratively improve LST, leveraging a full simulation of the CMS detector. At the same time, promising deep-learning-based tracking algorithms, such as Graph Neural Networks (GNNs), are being pioneered on the simplified TrackML dataset. These results suggest that parts of LST could be improved or replaced by ML. Thus, a thorough, step-by-step investigation of exactly how and where ML can be utilized, while still meeting realistic HL-LHC performance and efficiency constraints, is implemented as follows. First, a lightweight neural network is used to replace and improve upon explicitly defined track quality selections. This neural network is shown to be highly efficient and robust to displaced tracks while having little-to-no impact on the runtime of LST. These results clearly establish that ML can be used to improve LST without penalty. Next, exploratory studies of GNN track-building algorithms are described. In particular, low-level track objects from LST are considered as nodes in a graph, where edges represent higher-level objects or even entire track candidates. Then, an edge-classifier GNN is trained, and the efficiency of the resultant edge scores is compared with that of the existing LST track quality selections. These GNN studies provide insights into the practicality and performance of using more ambitious and complex ML algorithms for HL-LHC tracking at the CMS Experiment. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Comments: Connecting the Dots Workshop (CTD 2023)

Generalizing mkFit and its Application to HL-LHC

Authors: Giuseppe Cerati, Peter Elmer, Patrick Gartung, Leonardo Giannini, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Mario Masciovecchio, Tres Reid, Allison Reinsvold Hall, Daniel Riley, Matevz Tadel, Emmanouil Vourliotis, Peter Wittich, Avi Yagil

Abstract: mkFit is an implementation of the Kalman filter-based track reconstruction algorithm that exploits both thread- and data-level parallelism. In the past few years the project transitioned from the R&D phase to deployment in the Run-3 offline workflow of the CMS experiment. The CMS tracking performs a series of iterations, targeting reconstruction of tracks of increasing difficulty after removing hi… ▽ More mkFit is an implementation of the Kalman filter-based track reconstruction algorithm that exploits both thread- and data-level parallelism. In the past few years the project transitioned from the R&D phase to deployment in the Run-3 offline workflow of the CMS experiment. The CMS tracking performs a series of iterations, targeting reconstruction of tracks of increasing difficulty after removing hits associated to tracks found in previous iterations. mkFit has been adopted for several of the tracking iterations, which contribute to the majority of reconstructed tracks. When tested in the standard conditions for production jobs, speedups in track pattern recognition are on average of the order of 3.5x for the iterations where it is used (3-7x depending on the iteration). Multiple factors contribute to the observed speedups, including vectorization and a lightweight geometry description, as well as improved memory management and single precision. Efficient vectorization is achieved with both the icc and the gcc (default in CMSSW) compilers and relies on a dedicated library for small matrix operations, Matriplex, which has recently been released in a public repository. While the mkFit geometry description already featured levels of abstraction from the actual Phase-1 CMS tracker, several components of the implementations were still tied to that specific geometry. We have further generalized the geometry description and the configuration of the run-time parameters, in order to enable support for the Phase-2 upgraded tracker geometry for the HL-LHC and potentially other detector configurations. The implementation strategy and high-level code changes required for the HL-LHC geometry are presented. Speedups in track building from mkFit imply that track fitting becomes a comparably time consuming step of the tracking chain. △ Less

Submitted 18 December, 2023; originally announced December 2023.

Speeding up the CMS track reconstruction with a parallelized and vectorized Kalman-filter-based algorithm during the LHC Run 3

Authors: Sophie Berkman, Giuseppe Cerati, Peter Elmer, Patrick Gartung, Leonardo Giannini, Brian Gravelle, Allison R. Hall, Matti Kortelainen, Vyacheslav Krutelyov, Steve R. Lantz, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Michael Reid, Daniel S. Riley, Matevž Tadel, Emmanouil Vourliotis, Bei Wang, Peter Wittich, Avraham Yagil

Abstract: One of the most challenging computational problems in the Run 3 of the Large Hadron Collider (LHC) and more so in the High-Luminosity LHC (HL-LHC) is expected to be finding and fitting charged-particle tracks during event reconstruction. The methods used so far at the LHC and in particular at the CMS experiment are based on the Kalman filter technique. Such methods have shown to be robust and to p… ▽ More One of the most challenging computational problems in the Run 3 of the Large Hadron Collider (LHC) and more so in the High-Luminosity LHC (HL-LHC) is expected to be finding and fitting charged-particle tracks during event reconstruction. The methods used so far at the LHC and in particular at the CMS experiment are based on the Kalman filter technique. Such methods have shown to be robust and to provide good physics performance, both in the trigger and offline. In order to improve computational performance, we explored Kalman-filter-based methods for track finding and fitting, adapted for many-core SIMD architectures. This adapted Kalman-filter-based software, called "mkFit", was shown to provide a significant speedup compared to the traditional algorithm, thanks to its parallelized and vectorized implementation. The mkFit software was recently integrated into the offline CMS software framework, in view of its exploitation during the Run 3 of the LHC. At the start of the LHC Run 3, mkFit will be used for track finding in a subset of the CMS offline track reconstruction iterations, allowing for significant improvements over the existing framework in terms of computational performance, while retaining comparable physics performance. The performance of the CMS track reconstruction using mkFit at the start of the LHC Run 3 is presented, together with prospects of further improvement in the upcoming years of data taking. △ Less

Submitted 12 April, 2023; originally announced April 2023.

Comments: Contribution to the ACAT 2022

Segment Linking: A Highly Parallelizable Track Reconstruction Algorithm for HL-LHC

Authors: Philip Chang, Peter Elmer, Yanxi Gu, Vyacheslav Krutelyov, Gavin Niendorf, Michael Reid, Balaji Venkat Sathia Narayanan, Matevž Tadel, Emmanouil Vourliotis, Bei Wang, Peter Wittich, Avraham Yagil

Abstract: The High Luminosity upgrade of the Large Hadron Collider (HL-LHC) will produce particle collisions with up to 200 simultaneous proton-proton interactions. These unprecedented conditions will create a combinatorial complexity for charged-particle track reconstruction that demands a computational cost that is expected to surpass the projected computing budget using conventional CPUs. Motivated by th… ▽ More The High Luminosity upgrade of the Large Hadron Collider (HL-LHC) will produce particle collisions with up to 200 simultaneous proton-proton interactions. These unprecedented conditions will create a combinatorial complexity for charged-particle track reconstruction that demands a computational cost that is expected to surpass the projected computing budget using conventional CPUs. Motivated by this and taking into account the prevalence of heterogeneous computing in cutting-edge High Performance Computing centers, we propose an efficient, fast and highly parallelizable bottom-up approach to track reconstruction for the HL-LHC, along with an associated implementation on GPUs, in the context of the Phase 2 CMS outer tracker. Our algorithm, called Segment Linking (or Line Segment Tracking), takes advantage of localized track stub creation, combining individual stubs to progressively form higher level objects that are subject to kinematical and geometrical requirements compatible with genuine physics tracks. The local nature of the algorithm makes it ideal for parallelization under the Single Instruction, Multiple Data paradigm, as hundreds of objects can be built simultaneously. The computing and physics performance of the algorithm has been tested on an NVIDIA Tesla V100 GPU, already yielding efficiency and timing measurements that are on par with the latest, multi-CPU versions of existing CMS tracking algorithms. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Comments: Contribution to the HEP 2022 - 39th Conference on Recent Developments in High Energy Physics and Cosmology, 15-18 June 2022, Thessaloniki, Greece

Journal ref: 2022 J. Phys.: Conf. Ser. 2375 012005

Line Segment Tracking in the HL-LHC

Authors: Gavin Niendorf, Tres Reid, Peter Wittich, Peter Elmer, Bei Wang, Philip Chang, Yanxi Gu, Vyacheslav Krutelyov, Balaji Venkat Sathia Narayanan, Matevz Tadel, Emmanouil Vourliotis, Avi Yagil

Abstract: The major challenge posed by the high instantaneous luminosity in the High Luminosity LHC (HL-LHC) motivates efficient and fast reconstruction of charged particle tracks in a high pile-up environment. While there have been efforts to use modern techniques like vectorization to improve the existing classic Kalman Filter based reconstruction algorithms, Line Segment Tracking takes a fundamentally di… ▽ More The major challenge posed by the high instantaneous luminosity in the High Luminosity LHC (HL-LHC) motivates efficient and fast reconstruction of charged particle tracks in a high pile-up environment. While there have been efforts to use modern techniques like vectorization to improve the existing classic Kalman Filter based reconstruction algorithms, Line Segment Tracking takes a fundamentally different approach by doing a bottom-up reconstruction of tracks. Small track stubs from adjoining detector regions are constructed, and then these track stubs that are consistent with typical track trajectories are successively linked. Since the production of these track stubs is localized, they can be made in parallel, which lends way into using architectures like GPUs and multi-CPUs to take advantage of the parallelism. The algorithm is implemented in the context of the CMS Phase-2 Tracker and runs on NVIDIA Tesla V100 GPUs. Good physics and timing performance has been obtained, and step** stones for the future are elaborated. △ Less

Submitted 28 September, 2022; v1 submitted 17 July, 2022; originally announced July 2022.

Comments: Connecting the Dots Workshop (CTD 2022) v2 : Implemented referee comments from internal review

A Call to Arms Control: Synergies between Nonproliferation Applications of Neutrino Detectors and Large-Scale Fundamental Neutrino Physics Experiments

Authors: T. Akindele, T. Anderson, E. Anderssen, M. Askins, M. Bohles, A. J. Bacon, Z. Bagdasarian, A. Baldoni, A. Barna, N. Barros, L. Bartoszek, A. Bat, E. W. Beier, T. Benson, M. Bergevin, A. Bernstein, B. Birrittella, E. Blucher, J. Boissevain, R. Bonventre, J. Borusinki, E. Bourret, D. Brown, E. J. Callaghan, J. Caravaca , et al. (140 additional authors not shown)

Abstract: The High Energy Physics community can benefit from a natural synergy in research activities into next-generation large-scale water and scintillator neutrino detectors, now being studied for remote reactor monitoring, discovery and exclusion applications in cooperative nonproliferation contexts. Since approximately 2010, US nonproliferation researchers, supported by the National Nuclear Security… ▽ More The High Energy Physics community can benefit from a natural synergy in research activities into next-generation large-scale water and scintillator neutrino detectors, now being studied for remote reactor monitoring, discovery and exclusion applications in cooperative nonproliferation contexts. Since approximately 2010, US nonproliferation researchers, supported by the National Nuclear Security Administration (NNSA), have been studying a range of possible applications of relatively large (100 ton) to very large (hundreds of kiloton) water and scintillator neutrino detectors. In parallel, the fundamental physics community has been develo** detectors at similar scales and with similar design features for a range of high-priority physics topics, primarily in fundamental neutrino physics. These topics include neutrino oscillation studies at beams and reactors, solar, and geological neutrino measurements, supernova studies, and others. Examples of ongoing synergistic work at U.S. national laboratories and universities include prototype gadolinium-doped water and water-based and opaque scintillator test-beds and demonstrators, extensive testing and industry partnerships related to large area fast position-sensitive photomultiplier tubes, and the development of concepts for a possible underground kiloton-scale water-based detector for reactor monitoring and technology demonstrations. Some opportunities for engagement between the two communities include bi-annual Applied Antineutrino Physics conferences, collaboration with U.S. National Laboratories engaging in this research, and occasional NNSA funding opportunities supporting a blend of nonproliferation and basic science R&D, directed at the U.S. academic community. △ Less

Submitted 20 April, 2022; v1 submitted 28 February, 2022; originally announced March 2022.

Comments: contribution to Snowmass 2021

Report number: LLNL-MI-831404

Theia: Summary of physics program. Snowmass White Paper Submission

Authors: M. Askins, Z. Bagdasarian, N. Barros, E. W. Beier, A. Bernstein, E. Blucher, R. Bonventre, E. Bourret, E. J. Callaghan, J. Caravaca, M. Diwan, S. T. Dye, J. Eisch, A. Elagin, T. Enqvist, U. Fahrendholz, V. Fischer, K. Frankiewicz, C. Grant, D. Guffanti, C. Hagner, A. Hallin, C. M. Jackson, R. Jiang, T. Kaptanoglu , et al. (62 additional authors not shown)

Abstract: Theia would be a novel, "hybrid" optical neutrino detector, with a rich physics program. This paper is intended to provide a brief overview of the concepts and physics reach of Theia. Full details can be found in the Theia white paper [1]. Theia would be a novel, "hybrid" optical neutrino detector, with a rich physics program. This paper is intended to provide a brief overview of the concepts and physics reach of Theia. Full details can be found in the Theia white paper [1]. △ Less

Submitted 25 February, 2022; originally announced February 2022.

Comments: Contribution to Snowmass 2021

The Apollo ATCA Design for the CMS Track Finder and the Pixel Readout at the HL-LHC

Authors: A. Albert, Z. Demiragli, D. Gastler, K. Hahn, E. Hazen, P. Kotamnives, S. Noorudhin, A. Peck, J. Rohlf, C. Strohman, P. Wittich, R. Zou

Abstract: The challenging conditions of the High-Luminosity LHC require tailored hardware designs for the trigger and data acquisition systems. The Apollo platform features a "Service Module" with a powerful system-on-module computer that provides standard ATCA communications and application-specific "Command Module"s with large FPGAs and high-speed optical fiber links. The CMS version of Apollo will be use… ▽ More The challenging conditions of the High-Luminosity LHC require tailored hardware designs for the trigger and data acquisition systems. The Apollo platform features a "Service Module" with a powerful system-on-module computer that provides standard ATCA communications and application-specific "Command Module"s with large FPGAs and high-speed optical fiber links. The CMS version of Apollo will be used for the track finder and the pixel readout. It features up to two large FPGAs and more than 100 optical links with speeds up to 25\,Gb/s. We study carefully the design and performance of the board by using customized firmware to test power consumption, heat dissipation, and optical link integrity. This paper presents the results of these performance tests, design updates, and future plans. △ Less

Submitted 3 February, 2022; v1 submitted 29 November, 2021; originally announced December 2021.

Comments: Submitted to JINST Proceedings for TWEPP 2021

A novel measurement of initial-state gluon radiation in hadron collisions using Drell-Yan events

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (375 additional authors not shown)

Abstract: A study of initial-state gluon radiation (ISR) in hadron collisions is presented using Drell-Yan (DY) events produced in proton-antiproton collisions by the Tevatron collider at a center-of-mass energy of 1.96 TeV. This paper adopts a novel approach which uses the mean value of the Z/$γ^*$ transverse momentum $<p_T^{DY}>$ in DY events as a powerful observable to characterize the effect of ISR. In… ▽ More A study of initial-state gluon radiation (ISR) in hadron collisions is presented using Drell-Yan (DY) events produced in proton-antiproton collisions by the Tevatron collider at a center-of-mass energy of 1.96 TeV. This paper adopts a novel approach which uses the mean value of the Z/$γ^*$ transverse momentum $<p_T^{DY}>$ in DY events as a powerful observable to characterize the effect of ISR. In a data sample corresponding to an integrated luminosity of 9.4 fb$^{-1}$ collected with the CDF Run II detector, $<p_T^{DY}>$ is measured as a function of the Z/$γ^*$ invariant mass. It is found that these two observables have a dependence, $<p_T^{DY}> = -8 + 2.2 \ln m_{DY}^2$ [GeV/c], where $m_{DY}$ is the value of the Z/$γ^*$ mass measured in units of GeV/$c^2$. This linear dependence is observed for the first time in this analysis. It may be exploited to model the effect of ISR and constrain its impact in other processes. △ Less

Submitted 28 October, 2021; v1 submitted 28 October, 2021; originally announced October 2021.

Comments: 14 pages, 14 figures

Measurement of the charge asymmetry of electrons from the decays of $W$ bosons produced in $p\bar{p}$ collisions at $\sqrt{s}=1.96$ TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (376 additional authors not shown)

Abstract: At the Fermilab Tevatron proton-antiproton ($p\bar{p}$) collider, high-mass electron-neutrino ($eν$) pairs are produced predominantly in the process $p \bar{p} \rightarrow W(\rightarrow eν) + X$. The asymmetry of the electron and positron yield as a function of their pseudorapidity constrain the slope of the ratio of the $u$- to $d$-quark parton distributions versus the fraction of the proton mome… ▽ More At the Fermilab Tevatron proton-antiproton ($p\bar{p}$) collider, high-mass electron-neutrino ($eν$) pairs are produced predominantly in the process $p \bar{p} \rightarrow W(\rightarrow eν) + X$. The asymmetry of the electron and positron yield as a function of their pseudorapidity constrain the slope of the ratio of the $u$- to $d$-quark parton distributions versus the fraction of the proton momentum carried by the quarks. This paper reports on the measurement of the electron-charge asymmetry using the full data set recorded by the Collider Detector at Fermilab in 2001--2011 and corresponding to 9.1~fb$^{-1}$ of integrated luminosity. The measurement significantly improves the precision of the Tevatron constraints on the parton-distribution functions of the proton. Numerical tables of the measurement are provided. △ Less

Submitted 2 November, 2021; v1 submitted 9 July, 2021; originally announced July 2021.

Comments: 27 pages, 25 figures. To be published in PRD

Report number: FERMILAB-PUB-21-293-E

Parallelizing the Unpacking and Clustering of Detector Data for Reconstruction of Charged Particle Tracks on Multi-core CPUs and Many-core GPUs

Authors: Giuseppe Cerati, Peter Elmer, Brian Gravelle, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Allison Reinsvold Hall, Micheal Reid, Daniel Riley, Matevž Tadel, Peter Wittich, Bei Wang, Frank Würthwein, Avraham Yagil

Abstract: We present results from parallelizing the unpacking and clustering steps of the raw data from the silicon strip modules for reconstruction of charged particle tracks. Throughput is further improved by concurrently processing multiple events using nested OpenMP parallelism on CPU or CUDA streams on GPU. The new implementation along with earlier work in develo** a parallelized and vectorized imple… ▽ More We present results from parallelizing the unpacking and clustering steps of the raw data from the silicon strip modules for reconstruction of charged particle tracks. Throughput is further improved by concurrently processing multiple events using nested OpenMP parallelism on CPU or CUDA streams on GPU. The new implementation along with earlier work in develo** a parallelized and vectorized implementation of the combinatoric Kalman filter algorithm has enabled efficient global reconstruction of the entire event on modern computer architectures. We demonstrate the performance of the new implementation on Intel Xeon and NVIDIA GPU architectures. △ Less

Submitted 27 January, 2021; originally announced January 2021.

Speeding up Particle Track Reconstruction using a Parallel Kalman Filter Algorithm

Authors: Steven Lantz, Kevin McDermott, Michael Reid, Daniel Riley, Peter Wittich, Sophie Berkman, Giuseppe Cerati, Matti Kortelainen, Allison Reinsvold Hall, Peter Elmer, Bei Wang, Leonardo Giannini, Vyacheslav Krutelyov, Mario Masciovecchio, Matevž Tadel, Frank Würthwein, Avraham Yagil, Brian Gravelle, Boyana Norris

Abstract: One of the most computationally challenging problems expected for the High-Luminosity Large Hadron Collider (HL-LHC) is determining the trajectory of charged particles during event reconstruction. Algorithms used at the LHC today rely on Kalman filtering, which builds physical trajectories incrementally while incorporating material effects and error estimation. Recognizing the need for faster comp… ▽ More One of the most computationally challenging problems expected for the High-Luminosity Large Hadron Collider (HL-LHC) is determining the trajectory of charged particles during event reconstruction. Algorithms used at the LHC today rely on Kalman filtering, which builds physical trajectories incrementally while incorporating material effects and error estimation. Recognizing the need for faster computational throughput, we have adapted Kalman-filter-based methods for highly parallel, many-core SIMD architectures that are now prevalent in high-performance hardware. In this paper, we discuss the design and performance of the improved tracking algorithm, referred to as mkFit. A key piece of the algorithm is the Matriplex library, containing dedicated code to optimally vectorize operations on small matrices. The physics performance of the mkFit algorithm is comparable to the nominal CMS tracking algorithm when reconstructing tracks from simulated proton-proton collisions within the CMS detector. We study the scaling of the algorithm as a function of the parallel resources utilized and find large speedups both from vectorization and multi-threading. mkFit achieves a speedup of a factor of 6 compared to the nominal algorithm when run in a single-threaded application within the CMS software framework. △ Less

Submitted 10 July, 2020; v1 submitted 29 May, 2020; originally announced June 2020.

Reconstruction of Charged Particle Tracks in Realistic Detector Geometry Using a Vectorized and Parallelized Kalman Filter Algorithm

Authors: Giuseppe Cerati, Peter Elmer, Brian Gravelle, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Allison Reinsvold Hall, Michael Reid, Daniel Riley, Matevž Tadel, Peter Wittich, Bei Wang, Frank Würthwein, Avraham Yagil

Abstract: One of the most computationally challenging problems expected for the High-Luminosity Large Hadron Collider (HL-LHC) is finding and fitting particle tracks during event reconstruction. Algorithms used at the LHC today rely on Kalman filtering, which builds physical trajectories incrementally while incorporating material effects and error estimation. Recognizing the need for faster computational th… ▽ More One of the most computationally challenging problems expected for the High-Luminosity Large Hadron Collider (HL-LHC) is finding and fitting particle tracks during event reconstruction. Algorithms used at the LHC today rely on Kalman filtering, which builds physical trajectories incrementally while incorporating material effects and error estimation. Recognizing the need for faster computational throughput, we have adapted Kalman-filter-based methods for highly parallel, many-core SIMD and SIMT architectures that are now prevalent in high-performance hardware. Previously we observed significant parallel speedups, with physics performance comparable to CMS standard tracking, on Intel Xeon, Intel Xeon Phi, and (to a limited extent) NVIDIA GPUs. While early tests were based on artificial events occurring inside an idealized barrel detector, we showed subsequently that our mkFit software builds tracks successfully from complex simulated events (including detector pileup) occurring inside a geometrically accurate representation of the CMS-2017 tracker. Here, we report on advances in both the computational and physics performance of mkFit, as well as progress toward integration with CMS production software. Recently we have improved the overall efficiency of the algorithm by preserving short track candidates at a relatively early stage rather than attempting to extend them over many layers. Moreover, mkFit formerly produced an excess of duplicate tracks; these are now explicitly removed in an additional processing step. We demonstrate that with these enhancements, mkFit becomes a suitable choice for the first iteration of CMS tracking, and eventually for later iterations as well. We plan to test this capability in the CMS High Level Trigger during Run 3 of the LHC, with an ultimate goal of using it in both the CMS HLT and offline reconstruction for the HL-LHC CMS tracker. △ Less

Submitted 9 July, 2020; v1 submitted 14 February, 2020; originally announced February 2020.

Report number: FERMILAB-CONF-20-075-SCD

The Apollo ATCA Platform

Authors: A. Albert, J. Butler, Z. Demiragli, K. Finelli, D. Gastler, E. Hazen, J. Rohlf, S. Yuan, T. Costa de Paiva, V. Martinez Outschoorn, S. Willocq, C. Strohman, P. Wittich, R. Glein, K. Ulmer

Abstract: We have developed a novel and generic open-source platform - Apollo - which simplifies the design of custom Advanced Telecommunications Computing Architecture (ATCA) blades by factoring the design into generic infrastructure and application-specific parts. The Apollo "Service Module" provides the required ATCA Intelligent Platform Management Controller, power entry and conditioning, a powerful sys… ▽ More We have developed a novel and generic open-source platform - Apollo - which simplifies the design of custom Advanced Telecommunications Computing Architecture (ATCA) blades by factoring the design into generic infrastructure and application-specific parts. The Apollo "Service Module" provides the required ATCA Intelligent Platform Management Controller, power entry and conditioning, a powerful system-on-module (SoM) computer, and flexible clock and communications infrastructure. The Apollo "Command Module" is customized for each application and typically includes two large field-programmable gate arrays, several hundred optical fiber interfaces operating at speeds up to 28 Gbps, memories, and other supporting infrastructure. The command and service module boards can be operated together or independently on the bench without need for an ATCA shelf. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Comments: Submitted to the Proceedings for TWEPP 2019

Journal ref: PoS(TWEPP2019) 120

Theia: An advanced optical neutrino detector

Authors: M. Askins, Z. Bagdasarian, N. Barros, E. W. Beier, E. Blucher, R. Bonventre, E. Callaghan, J. Caravaca, M. Diwan, S. T. Dye, J. Eisch, A. Elagin, T. Enqvist, V. Fischer, K. Frankiewicz, C. Grant, D. Guffanti, C. Hagner, A. Hallin, C. M. Jackson, R. Jiang, T. Kaptanoglu, J. R. Klein, Yu. G. Kolomensky, C. Kraus , et al. (53 additional authors not shown)

Abstract: New developments in liquid scintillators, high-efficiency, fast photon detectors, and chromatic photon sorting have opened up the possibility for building a large-scale detector that can discriminate between Cherenkov and scintillation signals. Such a detector could exploit these two distinct signals to observe particle direction and species using Cherenkov light while also having the excellent en… ▽ More New developments in liquid scintillators, high-efficiency, fast photon detectors, and chromatic photon sorting have opened up the possibility for building a large-scale detector that can discriminate between Cherenkov and scintillation signals. Such a detector could exploit these two distinct signals to observe particle direction and species using Cherenkov light while also having the excellent energy resolution and low threshold of a scintillator detector. Situated in a deep underground laboratory, and utilizing new techniques in computing and reconstruction techniques, such a detector could achieve unprecedented levels of background rejection, thus enabling a rich physics program that would span topics in nuclear, high-energy, and astrophysics, and across a dynamic range from hundreds of keV to many GeV. The scientific program would include observations of low- and high-energy solar neutrinos, determination of neutrino mass ordering and measurement of the neutrino CP violating phase, observations of diffuse supernova neutrinos and neutrinos from a supernova burst, sensitive searches for nucleon decay and, ultimately, a search for NeutrinoLess Double Beta Decay (NLDBD) with sensitivity reaching the normal ordering regime of neutrino mass phase space. This paper describes Theia, a detector design that incorporates these new technologies in a practical and affordable way to accomplish the science goals described above. We consider two scenarios, one in which Theia would reside in a cavern the size and shape of the caverns intended to be excavated for the Deep Underground Neutrino Experiment (DUNE) which we call Theia 25, and a larger 100 ktonne version (Theia 100) that could achieve an even broader and more sensitive scientific program. △ Less

Submitted 22 February, 2021; v1 submitted 8 November, 2019; originally announced November 2019.

Journal ref: The European Physical Journal C volume 80, Article number: 416 (2020)

FPGA-based tracking for the CMS Level-1 trigger using the tracklet algorithm

Authors: E. Bartz, G. Boudoul, R. Bucci, J. Chaves, E. Clement, D. Cranshaw, S. Dutta, Y. Gershtein, R. Glein, K. Hahn, E. Halkiadakis, M. Hildreth, S. Kyriacou, K. Lannon, A. Lefeld, Y. Liu, E. MacDonald, N. Pozzobon, A. Ryd, K. Salyer, P. Shields, L. Skinnari, K. Stenson, R. Stone, C. Strohman , et al. (9 additional authors not shown)

Abstract: The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many cha… ▽ More The high instantaneous luminosities expected following the upgrade of the Large Hadron Collider (LHC) to the High Luminosity LHC (HL-LHC) pose major experimental challenges for the CMS experiment. A central component to allow efficient operation under these conditions is the reconstruction of charged particle trajectories and their inclusion in the hardware-based trigger system. There are many challenges involved in achieving this: a large input data rate of about 20--40 Tb/s; processing a new batch of input data every 25 ns, each consisting of about 15,000 precise position measurements and rough transverse momentum measurements of particles ("stubs''); performing the pattern recognition on these stubs to find the trajectories; and producing the list of trajectory parameters within 4 $μ\,$s. This paper describes a proposed solution to this problem, specifically, it presents a novel approach to pattern recognition and charged particle trajectory reconstruction using an all-FPGA solution. The results of an end-to-end demonstrator system, based on Xilinx Virtex-7 FPGAs, that meets timing and performance requirements are presented along with a further improved, optimized version of the algorithm together with its corresponding expected performance. △ Less

Submitted 6 July, 2020; v1 submitted 22 October, 2019; originally announced October 2019.

Comments: As published in JINST

Report number: CMS NOTE -2019/005

Journal ref: JINST 15 P06024 (2020)

Speeding up Particle Track Reconstruction in the CMS Detector using a Vectorized and Parallelized Kalman Filter Algorithm

Authors: Giuseppe Cerati, Peter Elmer, Brian Gravelle, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Michael Reid, Allison Reinsvold Hall, Daniel Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: Building particle tracks is the most computationally intense step of event reconstruction at the LHC. With the increased instantaneous luminosity and associated increase in pileup expected from the High-Luminosity LHC, the computational challenge of track finding and fitting requires novel solutions. The current track reconstruction algorithms used at the LHC are based on Kalman filter methods tha… ▽ More Building particle tracks is the most computationally intense step of event reconstruction at the LHC. With the increased instantaneous luminosity and associated increase in pileup expected from the High-Luminosity LHC, the computational challenge of track finding and fitting requires novel solutions. The current track reconstruction algorithms used at the LHC are based on Kalman filter methods that achieve good physics performance. By adapting the Kalman filter techniques for use on many-core SIMD architectures such as the Intel Xeon and Intel Xeon Phi and (to a limited degree) NVIDIA GPUs, we are able to obtain significant speedups and comparable physics performance. New optimizations, including a dedicated post-processing step to remove duplicate tracks, have improved the algorithm's performance even further. Here we report on the current structure and performance of the code and future plans for the algorithm. △ Less

Submitted 6 November, 2019; v1 submitted 27 June, 2019; originally announced June 2019.

Comments: Submitted to proceedings of the 2019 Connecting the Dots and Workshop on Intelligent Trackers (CTD/WIT 2019); 6 pages, 4 figures

Parallelized Kalman-Filter-Based Reconstruction of Particle Tracks on Many-Core Architectures with the CMS Detector

Authors: Giuseppe Cerati, Peter Elmer, Brian Gravelle, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Allison Reinsvold Hall, Daniel Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: In the High-Luminosity Large Hadron Collider (HL-LHC), one of the most challenging computational problems is expected to be finding and fitting charged-particle tracks during event reconstruction. The methods currently in use at the LHC are based on the Kalman filter. Such methods have shown to be robust and to provide good physics performance, both in the trigger and offline. In order to improve… ▽ More In the High-Luminosity Large Hadron Collider (HL-LHC), one of the most challenging computational problems is expected to be finding and fitting charged-particle tracks during event reconstruction. The methods currently in use at the LHC are based on the Kalman filter. Such methods have shown to be robust and to provide good physics performance, both in the trigger and offline. In order to improve computational performance, we explored Kalman-filter-based methods for track finding and fitting, adapted for many-core SIMD and SIMT architectures. Our adapted Kalman-filter-based software has obtained significant parallel speedups using such processors, e.g., Intel Xeon Phi, Intel Xeon SP (Scalable Processors) and (to a limited degree) NVIDIA GPUs. Recently, an effort has started towards the integration of our software into the CMS software framework, in view of its exploitation for the Run III of the LHC. Prior reports have shown that our software allows in fact for some significant improvements over the existing framework in terms of computational performance with comparable physics performance, even when applied to realistic detector configurations and event complexity. Here, we demonstrate that in such conditions physics performance can be further improved with respect to our prior reports, while retaining the improvements in computational performance, by making use of the knowledge of the detector and its geometry. △ Less

Submitted 5 June, 2019; originally announced June 2019.

Comments: Submitted to proceedings of 19th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2019); 6 pages, 5 figures

Search for Higgs-like particles produced in association with bottom quarks in proton-antiproton collisions

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (374 additional authors not shown)

Abstract: We report on a search for a spin-zero non-standard-model particle in proton-antiproton collisions collected by the Collider Detector at Fermilab at a center-of-mass-energy of 1.96 TeV. This particle, the $φ$ boson, is expected to decay into a bottom-antibottom quark pair and to be produced in association with at least one bottom quark. The data sample consists of events with three jets identified… ▽ More We report on a search for a spin-zero non-standard-model particle in proton-antiproton collisions collected by the Collider Detector at Fermilab at a center-of-mass-energy of 1.96 TeV. This particle, the $φ$ boson, is expected to decay into a bottom-antibottom quark pair and to be produced in association with at least one bottom quark. The data sample consists of events with three jets identified as initiated by bottom quarks and corresponds to $5.4~\text{fb}^{-1}$ of integrated luminosity. In each event, the invariant mass of the two most energetic jets is studied by looking for deviations from the multijet background, which is modeled using data. No evidence is found for such particle. Exclusion upper limits ranging from 20 to 2 pb are set for the product of production cross sections times branching fraction for hypothetical $φ$ boson with mass between 100 and 300 GeV/$c^2$. These are the most stringent constraints to date. △ Less

Submitted 12 February, 2019; originally announced February 2019.

Comments: submitted to PRD

Report number: FERMILAB-PUB-19-067-PPD

Journal ref: Phys. Rev. D 99, 052001 (2019)

Parallelized and Vectorized Tracking Using Kalman Filters with CMS Detector Geometry and Events

Authors: Giuseppe Cerati, Peter Elmer, Brian Gravelle, Matti Kortelainen, Vyacheslav Krutelyov, Steven Lantz, Matthieu Lefebvre, Mario Masciovecchio, Kevin McDermott, Boyana Norris, Allison Reinsvold Hall, Daniel Riley, Matevz Tadel, Peter Wittich, Frank Wuerthwein, Avi Yagil

Abstract: The High-Luminosity Large Hadron Collider at CERN will be characterized by greater pileup of events and higher occupancy, making the track reconstruction even more computationally demanding. Existing algorithms at the LHC are based on Kalman filter techniques with proven excellent physics performance under a variety of conditions. Starting in 2014, we have been develo** Kalman-filter-based metho… ▽ More The High-Luminosity Large Hadron Collider at CERN will be characterized by greater pileup of events and higher occupancy, making the track reconstruction even more computationally demanding. Existing algorithms at the LHC are based on Kalman filter techniques with proven excellent physics performance under a variety of conditions. Starting in 2014, we have been develo** Kalman-filter-based methods for track finding and fitting adapted for many-core SIMD processors that are becoming dominant in high-performance systems. This paper summarizes the latest extensions to our software that allow it to run on the realistic CMS-2017 tracker geometry using CMSSW-generated events, including pileup. The reconstructed tracks can be validated against either the CMSSW simulation that generated the hits, or the CMSSW reconstruction of the tracks. In general, the code's computational performance has continued to improve while the above capabilities were being added. We demonstrate that the present Kalman filter implementation is able to reconstruct events with comparable physics performance to CMSSW, while providing generally better computational performance. Further plans for advancing the software are discussed. △ Less

Submitted 9 July, 2019; v1 submitted 9 November, 2018; originally announced November 2018.

Measurement of the differential cross sections for $W$-boson production in association with jets in $p\bar{p}$ collisions at $\sqrt{s}=1.96$ TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (374 additional authors not shown)

Abstract: This paper presents a study of the production of a single $W$ boson in association with one or more jets in proton-antiproton collisions at $\sqrt{s}=1.96$ TeV, using the entire data set collected in 2001-2011 by the Collider Detector at Fermilab at the Tevatron, which corresponds to an integrated luminosity of $9.0$ fb$^{-1}$. The $W$ boson is identified through its leptonic decays into electron… ▽ More This paper presents a study of the production of a single $W$ boson in association with one or more jets in proton-antiproton collisions at $\sqrt{s}=1.96$ TeV, using the entire data set collected in 2001-2011 by the Collider Detector at Fermilab at the Tevatron, which corresponds to an integrated luminosity of $9.0$ fb$^{-1}$. The $W$ boson is identified through its leptonic decays into electron and muon. The production cross sections are measured for each leptonic decay mode and combined after testing that the ratio of the $W(\rightarrow μν)+$jets cross section to the $W(\rightarrow eν)+$jets cross section agrees with the hypothesis of $e$-$μ$ lepton universality. The combination of measured cross sections, differential in the inclusive jet multiplicity ($W+\geqslant N$ jets with $N=1,\,2,\,3, \textrm{or }4$) and in the transverse energy of the leading jet, are compared with theoretical predictions. △ Less

Submitted 7 August, 2018; originally announced August 2018.

Comments: submitted to Phys. Rev. D

Report number: FERMILAB-PUB-18-371-E

Journal ref: Phys. Rev. D 98, 112005 (2018)

The DUNE Far Detector Interim Design Report, Volume 3: Dual-Phase Module

Authors: DUNE Collaboration, B. Abi, R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, D. Adams, P. Adamson, M. Adinolfi, Z. Ahmad, C. H. Albright, L. Aliaga Soplin, T. Alion, S. Alonso Monsalve, M. Alrashed, C. Alt, J. Anderson, K. Anderson, C. Andreopoulos, M. P. Andrews, R. A. Andrews, A. Ankowski, J. Anthony, M. Antonello, M. Antonova , et al. (1076 additional authors not shown)

Abstract: The DUNE IDR describes the proposed physics program and technical designs of the DUNE far detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable… ▽ More The DUNE IDR describes the proposed physics program and technical designs of the DUNE far detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable the DUNE experiment to make the ground-breaking discoveries that will help to answer fundamental physics questions. Volume 3 describes the dual-phase module's subsystems, the technical coordination required for its design, construction, installation, and integration, and its organizational structure. △ Less

Submitted 26 July, 2018; originally announced July 2018.

Comments: 280 pages, 109 figures. arXiv admin note: text overlap with arXiv:1807.10327

Report number: Fermilab-Design-2018-04

The DUNE Far Detector Interim Design Report Volume 1: Physics, Technology and Strategies

Authors: DUNE Collaboration, B. Abi, R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, D. Adams, P. Adamson, M. Adinolfi, Z. Ahmad, C. H. Albright, L. Aliaga Soplin, T. Alion, S. Alonso Monsalve, M. Alrashed, C. Alt, J. Anderson, K. Anderson, C. Andreopoulos, M. P. Andrews, R. A. Andrews, A. Ankowski, J. Anthony, M. Antonello, M. Antonova , et al. (1076 additional authors not shown)

Abstract: The DUNE IDR describes the proposed physics program and technical designs of the DUNE Far Detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable… ▽ More The DUNE IDR describes the proposed physics program and technical designs of the DUNE Far Detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable the DUNE experiment to make the ground-breaking discoveries that will help to answer fundamental physics questions. Volume 1 contains an executive summary that describes the general aims of this document. The remainder of this first volume provides a more detailed description of the DUNE physics program that drives the choice of detector technologies. It also includes concise outlines of two overarching systems that have not yet evolved to consortium structures: computing and calibration. Volumes 2 and 3 of this IDR describe, for the single-phase and dual-phase technologies, respectively, each detector module's subsystems, the technical coordination required for its design, construction, installation, and integration, and its organizational structure. △ Less

Submitted 26 July, 2018; originally announced July 2018.

Comments: 83 pages, 11 figures

Report number: Fermilab-Design-2018-02

The DUNE Far Detector Interim Design Report, Volume 2: Single-Phase Module

Authors: DUNE Collaboration, B. Abi, R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, D. Adams, P. Adamson, M. Adinolfi, Z. Ahmad, C. H. Albright, L. Aliaga Soplin, T. Alion, S. Alonso Monsalve, M. Alrashed, C. Alt, J. Anderson, K. Anderson, C. Andreopoulos, M. P. Andrews, R. A. Andrews, A. Ankowski, J. Anthony, M. Antonello, M. Antonova , et al. (1076 additional authors not shown)

Abstract: The DUNE IDR describes the proposed physics program and technical designs of the DUNE far detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable… ▽ More The DUNE IDR describes the proposed physics program and technical designs of the DUNE far detector modules in preparation for the full TDR to be published in 2019. It is intended as an intermediate milestone on the path to a full TDR, justifying the technical choices that flow down from the high-level physics goals through requirements at all levels of the Project. These design choices will enable the DUNE experiment to make the ground-breaking discoveries that will help to answer fundamental physics questions. Volume 2 describes the single-phase module's subsystems, the technical coordination required for its design, construction, installation, and integration, and its organizational structure. △ Less

Submitted 26 July, 2018; originally announced July 2018.

Comments: 324 pages, 130 figures. arXiv admin note: text overlap with arXiv:1807.10340

Report number: Fermilab-Design-2018-03

Search for standard-model Z and Higgs bosons decaying into a bottom-antibottom quark pair in proton-antiproton collisions at 1.96 TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (374 additional authors not shown)

Abstract: The Collider Detector at Fermilab collected a unique sample of jets originating from bottom-quark fragmentation ($b$-jets) by selecting online proton-antiproton ($p\bar{p}$) collisions with a vertex displaced from the $p\bar{p}$ interaction point, consistent with the decay of a bottom-quark hadron. This data set, collected at a center-of-mass energy of $\sqrt{s}=$1.96 TeV, and corresponding to an… ▽ More The Collider Detector at Fermilab collected a unique sample of jets originating from bottom-quark fragmentation ($b$-jets) by selecting online proton-antiproton ($p\bar{p}$) collisions with a vertex displaced from the $p\bar{p}$ interaction point, consistent with the decay of a bottom-quark hadron. This data set, collected at a center-of-mass energy of $\sqrt{s}=$1.96 TeV, and corresponding to an integrated luminosity of $5.4~\rm{fb}^{-1}$, is used to measure the $Z$-boson production cross section times branching ratio into $b\bar{b}$. The number of $Z\rightarrow b\bar{b}$ events is determined by fitting the dijet-mass distribution while constraining the dominant $b$-jet background, originating from QCD multijet events, with data. The result, $σ(p\bar{p} \rightarrow Z) \times \mathcal{B}(Z \rightarrow b\bar{b})= 1.11\pm 0.08(\text{stat}) \pm 0.14(\text{syst})~\text{nb}$, is the most precise measurement of this process, and is consistent with the standard-model prediction. The data set is also used to search for Higgs-boson production. No significant signal is expected in our data and the first upper limit on the cross section for the inclusive $p\bar p \rightarrow H\rightarrow b\bar b$ process at $\sqrt{s}=$1.96 TeV is set, corresponding to 33 times the expected standard-model cross section, or $σ= 40.6$ pb, at the 95\% confidence level. △ Less

Submitted 18 October, 2018; v1 submitted 3 July, 2018; originally announced July 2018.

Report number: FERMILAB-PUB-18-307-E-PPD

Journal ref: Phys. Rev. D 98, 072002 (2018)

A search for the exotic meson $X(5568)$ with the Collider Detector at Fermilab

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (373 additional authors not shown)

Abstract: A search for the exotic meson $X(5568)$ decaying into the $B^0_s π^{\pm}$ final state is performed using data corresponding to $9.6 \textrm{fb}^{-1}$ from $p{\bar p}$ collisions at $\sqrt{s} = 1960$ GeV recorded by the Collider Detector at Fermilab. No evidence for this state is found and an upper limit of 6.7\% at the 95\% confidence level is set on the fraction of $B^0_s$ produced through the… ▽ More A search for the exotic meson $X(5568)$ decaying into the $B^0_s π^{\pm}$ final state is performed using data corresponding to $9.6 \textrm{fb}^{-1}$ from $p{\bar p}$ collisions at $\sqrt{s} = 1960$ GeV recorded by the Collider Detector at Fermilab. No evidence for this state is found and an upper limit of 6.7\% at the 95\% confidence level is set on the fraction of $B^0_s$ produced through the $X(5568) \rightarrow B^0_s \, π^{\pm}$ process. △ Less

Submitted 27 December, 2017; originally announced December 2017.

Comments: 13 pages, 3 figures

Report number: FERMILAB-FN-1048-E

Journal ref: Phys. Rev. Lett. 120, 202006 (2018)

Parallelized Kalman-Filter-Based Reconstruction of Particle Tracks on Many-Core Architectures

Authors: Giuseppe Cerati, Peter Elmer, Slava Krutelyov, Steven Lantz, Matthieu Lefebvre, Mario Masciovecchio, Kevin McDermott, Daniel Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: Faced with physical and energy density limitations on clock speed, contemporary microprocessor designers have increasingly turned to on-chip parallelism for performance gains. Algorithms should accordingly be designed with ample amounts of fine-grained parallelism if they are to realize the full performance of the hardware. This requirement can be challenging for algorithms that are naturally expr… ▽ More Faced with physical and energy density limitations on clock speed, contemporary microprocessor designers have increasingly turned to on-chip parallelism for performance gains. Algorithms should accordingly be designed with ample amounts of fine-grained parallelism if they are to realize the full performance of the hardware. This requirement can be challenging for algorithms that are naturally expressed as a sequence of small-matrix operations, such as the Kalman filter methods widely in use in high-energy physics experiments. In the High-Luminosity Large Hadron Collider (HL-LHC), for example, one of the dominant computational problems is expected to be finding and fitting charged-particle tracks during event reconstruction; today, the most common track-finding methods are those based on the Kalman filter. Experience at the LHC, both in the trigger and offline, has shown that these methods are robust and provide high physics performance. Previously we reported the significant parallel speedups that resulted from our efforts to adapt Kalman-filter-based tracking to many-core architectures such as Intel Xeon Phi. Here we report on how effectively those techniques can be applied to more realistic detector configurations and event complexity. △ Less

Submitted 27 March, 2018; v1 submitted 16 November, 2017; originally announced November 2017.

Comments: Accepted to the Proceedings of the 18th International Workshop on Advanced Computing and Analysis Techniques in Physics Research; 6 pages, 5 figures. arXiv admin note: text overlap with arXiv:1702.06359

FPGA-Based Tracklet Approach to Level-1 Track Finding at CMS for the HL-LHC

Authors: Edward Bartz, Jorge Chaves, Yuri Gershtein, Eva Halkiadakis, Michael Hildreth, Savvas Kyriacou, Kevin Lannon, Anthony Lefeld, Anders Ryd, Louise Skinnari, Robert Stone, Charles Strohman, Zhengcheng Tao, Brian Winer, Peter Wittich, Margaret Zientek

Abstract: During the High Luminosity LHC, the CMS detector will need charged particle tracking at the hardware trigger level to maintain a manageable trigger rate and achieve its physics goals. The tracklet approach is a track-finding algorithm based on a road-search algorithm that has been implemented on commercially available FPGA technology. The tracklet algorithm has achieved high performance in track-f… ▽ More During the High Luminosity LHC, the CMS detector will need charged particle tracking at the hardware trigger level to maintain a manageable trigger rate and achieve its physics goals. The tracklet approach is a track-finding algorithm based on a road-search algorithm that has been implemented on commercially available FPGA technology. The tracklet algorithm has achieved high performance in track-finding and completes tracking within 3.4 $μ$s on a Xilinx Virtex-7 FPGA. An overview of the algorithm and its implementation on an FPGA is given, results are shown from a demonstrator test stand and system performance studies are presented. △ Less

Submitted 28 June, 2017; originally announced June 2017.

Comments: Submitted to proceedings of Connecting The Dots/Intelligent Trackers 2017, Orsay, France

The Single-Phase ProtoDUNE Technical Design Report

Authors: B. Abi, R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, D. L. Adams, P. Adamson, M. Adinolfi, Z. Ahmad, C. H. Albright, T. Alion, J. Anderson, K. Anderson, C. Andreopoulos, M. P. Andrews, R. A. Andrews, J. dos Anjos, A. Ankowski, J. Anthony, M. Antonello, A. Aranda Fernandez, A. Ariga, T. Ariga, E. Arrieta Diaz, J. Asaadi , et al. (806 additional authors not shown)

Abstract: ProtoDUNE-SP is the single-phase DUNE Far Detector prototype that is under construction and will be operated at the CERN Neutrino Platform (NP) starting in 2018. ProtoDUNE-SP, a crucial part of the DUNE effort towards the construction of the first DUNE 10-kt fiducial mass far detector module (17 kt total LAr mass), is a significant experiment in its own right. With a total liquid argon (LAr) mass… ▽ More ProtoDUNE-SP is the single-phase DUNE Far Detector prototype that is under construction and will be operated at the CERN Neutrino Platform (NP) starting in 2018. ProtoDUNE-SP, a crucial part of the DUNE effort towards the construction of the first DUNE 10-kt fiducial mass far detector module (17 kt total LAr mass), is a significant experiment in its own right. With a total liquid argon (LAr) mass of 0.77 kt, it represents the largest monolithic single-phase LArTPC detector to be built to date. It's technical design is given in this report. △ Less

Submitted 27 July, 2017; v1 submitted 21 June, 2017; originally announced June 2017.

Comments: 165 pages, fix references, author list and minor numbers

Parallelized Kalman-Filter-Based Reconstruction of Particle Tracks on Many-Core Processors and GPUs

Authors: Giuseppe Cerati, Peter Elmer, Slava Krutelyov, Steven Lantz, Matthieu Lefebvre, Mario Masciovecchio, Kevin McDermott, Daniel Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: For over a decade now, physical and energy constraints have limited clock speed improvements in commodity microprocessors. Instead, chipmakers have been pushed into producing lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. Broad-based efforts from manufacturers and developers have been devoted to making these processors user-friendly enough to perform general computations. How… ▽ More For over a decade now, physical and energy constraints have limited clock speed improvements in commodity microprocessors. Instead, chipmakers have been pushed into producing lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. Broad-based efforts from manufacturers and developers have been devoted to making these processors user-friendly enough to perform general computations. However, extracting performance from a larger number of cores, as well as specialized vector or SIMD units, requires special care in algorithm design and code optimization. One of the most computationally challenging problems in high-energy particle experiments is finding and fitting the charged-particle tracks during event reconstruction. This is expected to become by far the dominant problem in the High-Luminosity Large Hadron Collider (HL-LHC), for example. Today the most common track finding methods are those based on the Kalman filter. Experience with Kalman techniques on real tracking detector systems has shown that they are robust and provide high physics performance. This is why they are currently in use at the LHC, both in the trigger and offline. Previously we reported on the significant parallel speedups that resulted from our investigations to adapt Kalman filters to track fitting and track building on Intel Xeon and Xeon Phi. Here, we discuss our progresses toward the understanding of these processors and the new developments to port Kalman filter to NVIDIA GPUs. △ Less

Submitted 19 June, 2017; v1 submitted 8 May, 2017; originally announced May 2017.

Comments: Submitted to proceedings of Connecting The Dots 2017 (CTD2017), Orsay. arXiv admin note: substantial text overlap with arXiv:1605.05508

Measurement of the inclusive-isolated prompt-photon cross section in $p\bar{p}$ collisions using the full CDF data set

Authors: CDF Collaboration, T. Aaltonen, M. G. Albrow, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce , et al. (374 additional authors not shown)

Abstract: A measurement of the inclusive production cross section of isolated prompt photons in proton-antiproton collisions at center-of-mass energy $\sqrt{s}$=1.96TeV is presented. The results are obtained using the full Run II data sample collected with the Collider Detector at the Fermilab Tevatron, which corresponds to an integrated luminosity of 9.5fb$^{-1}$. The cross section is measured as a functio… ▽ More A measurement of the inclusive production cross section of isolated prompt photons in proton-antiproton collisions at center-of-mass energy $\sqrt{s}$=1.96TeV is presented. The results are obtained using the full Run II data sample collected with the Collider Detector at the Fermilab Tevatron, which corresponds to an integrated luminosity of 9.5fb$^{-1}$. The cross section is measured as a function of photon transverse energy, $E_T^γ$, in the range 30$ < E_T^γ <$500GeV and in the pseudorapidity region $|η^γ|<$1.0. The results are compared with predictions from parton-shower Monte Carlo models at leading order in quantum chromodynamics (QCD) and from next-to-leading order perturbative QCD calculations. The latter show good agreement with the measured cross section. △ Less

Submitted 1 March, 2017; originally announced March 2017.

Comments: submitted to Phys. Rev. D - RC

Report number: FERMILAB-PUB-17-053-PPD

Journal ref: Phys. Rev. D 96, 092003 (2017)

Kalman filter tracking on parallel architectures

Authors: Giuseppe Cerati, Peter Elmer, Slava Krutelyov, Steven Lantz, Matthieu Lefebvre, Kevin McDermott, Daniel Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: Limits on power dissipation have pushed CPUs to grow in parallel processing capabilities rather than clock rate, leading to the rise of "manycore" or GPU-like processors. In order to achieve the best performance, applications must be able to take full advantage of vector units across multiple cores, or some analogous arrangement on an accelerator card. Such parallel performance is becoming a criti… ▽ More Limits on power dissipation have pushed CPUs to grow in parallel processing capabilities rather than clock rate, leading to the rise of "manycore" or GPU-like processors. In order to achieve the best performance, applications must be able to take full advantage of vector units across multiple cores, or some analogous arrangement on an accelerator card. Such parallel performance is becoming a critical requirement for methods to reconstruct the tracks of charged particles at the Large Hadron Collider and, in the future, at the High Luminosity LHC. This is because the steady increase in luminosity is causing an exponential growth in the overall event reconstruction time, and tracking is by far the most demanding task for both online and offline processing. Many past and present collider experiments adopted Kalman filter-based algorithms for tracking because of their robustness and their excellent physics performance, especially for solid state detectors where material interactions play a significant role. We report on the progress of our studies towards a Kalman filter track reconstruction algorithm with optimal performance on manycore architectures. The combinatorial structure of these algorithms is not immediately compatible with an efficient SIMD (or SIMT) implementation; the challenge for us is to recast the existing software so it can readily generate hundreds of shared-memory threads that exploit the underlying instruction set of modern processors. We show how the data and associated tasks can be organized in a way that is conducive to both multithreading and vectorization. We demonstrate very good performance on Intel Xeon and Xeon Phi architectures, as well as promising first results on Nvidia GPUs. △ Less

Submitted 21 November, 2017; v1 submitted 21 February, 2017; originally announced February 2017.

Comments: Proceedings of the 22nd International Conference on Computing in High Energy and Nuclear Physics, CHEP 2016; 8 pages, 9 figures

Journal ref: G Cerati et al 2017 J. Phys.: Conf. Ser. 898 042051

Measurement of the $D^+$-meson production cross section at low transverse momentum in $p\bar{p}$ collisions at $\sqrt{s}=1.96$ TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (372 additional authors not shown)

Abstract: We report on a measurement of the $D^{+}$-meson production cross section as a function of transverse momentum ($p_T$) in proton-antiproton ($p\bar{p}$) collisions at 1.96 TeV center-of-mass energy, using the full data set collected by the Collider Detector at Fermilab in Tevatron Run II and corresponding to 10 fb$^{-1}$ of integrated luminosity. We use $D^{+} \to K^-π^+π^+$ decays fully reconstruc… ▽ More We report on a measurement of the $D^{+}$-meson production cross section as a function of transverse momentum ($p_T$) in proton-antiproton ($p\bar{p}$) collisions at 1.96 TeV center-of-mass energy, using the full data set collected by the Collider Detector at Fermilab in Tevatron Run II and corresponding to 10 fb$^{-1}$ of integrated luminosity. We use $D^{+} \to K^-π^+π^+$ decays fully reconstructed in the central rapidity region $|y|<1$ with transverse momentum down to 1.5 GeV/$c$, a range previously unexplored in $p\bar{p}$ collisions. Inelastic $p\bar{p}$-scattering events are selected online using minimally-biasing requirements followed by an optimized offline selection. The $K^-π^+π^+$ mass distribution is used to identify the $D^+$ signal, and the $D^+$ transverse impact-parameter distribution is used to separate prompt production, occurring directly in the hard scattering process, from secondary production from $b$-hadron decays. We obtain a prompt $D^+$ signal of 2950 candidates corresponding to a total cross section $σ(D^+, 1.5 < p_T < 14.5~\mbox{GeV/}c, |y|<1) = 71.9 \pm 6.8 (\mbox{stat}) \pm 9.3 (\mbox{syst})~μ$b. While the measured cross sections are consistent with theoretical estimates in each $p_T$ bin, the shape of the observed $p_T$ spectrum is softer than the expectation from quantum chromodynamics. The results are unique in $p\bar{p}$ collisions and can improve the shape and uncertainties of future predictions. △ Less

Submitted 27 October, 2016; originally announced October 2016.

Comments: 8 pages, 3 figures

Journal ref: Phys. Rev. D 95, 092006 (2017)

Dark Sectors 2016 Workshop: Community Report

Authors: Jim Alexander, Marco Battaglieri, Bertrand Echenard, Rouven Essig, Matthew Graham, Eder Izaguirre, John Jaros, Gordan Krnjaic, Jeremy Mardon, David Morrissey, Tim Nelson, Maxim Perelstein, Matt Pyle, Adam Ritz, Philip Schuster, Brian Shuve, Natalia Toro, Richard G Van De Water, Daniel Akerib, Haipeng An, Konrad Aniol, Isaac J. Arnquist, David M. Asner, Henning O. Back, Keith Baker , et al. (179 additional authors not shown)

Abstract: This report, based on the Dark Sectors workshop at SLAC in April 2016, summarizes the scientific importance of searches for dark sector dark matter and forces at masses beneath the weak-scale, the status of this broad international field, the important milestones motivating future exploration, and promising experimental opportunities to reach these milestones over the next 5-10 years. This report, based on the Dark Sectors workshop at SLAC in April 2016, summarizes the scientific importance of searches for dark sector dark matter and forces at masses beneath the weak-scale, the status of this broad international field, the important milestones motivating future exploration, and promising experimental opportunities to reach these milestones over the next 5-10 years. △ Less

Submitted 30 August, 2016; originally announced August 2016.

Comments: 66 pages, 15 figures, 3 tables. Workshop website and agenda: http://www-conf.slac.stanford.edu/darksectors2016/ https://indico.cern.ch/event/507783/ Editors: J. Alexander, M. Battaglieri, B. Echenard, R. Essig, M. Graham, E. Izaguirre, J. Jaros, G. Krnjaic, J. Mardon, D. Morrissey, T. Nelson, M. Perelstein, M. Pyle, A. Ritz, P. Schuster, B. Shuve, N. Toro, R. Van De Water

Measurement of the $WW$ and $WZ$ production cross section using final states with a charged lepton and heavy-flavor jets in the full CDF Run II data set

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (374 additional authors not shown)

Abstract: We present a measurement of the total {\it WW} and {\it WZ} production cross sections in $p\bar{p}$ collision at $\sqrt{s}=1.96$ TeV, in a final state consistent with leptonic $W$ boson decay and jets originating from heavy-flavor quarks from either a $W$ or a $Z$ boson decay. This analysis uses the full data set collected with the CDF II detector during Run II of the Tevatron collider, correspond… ▽ More We present a measurement of the total {\it WW} and {\it WZ} production cross sections in $p\bar{p}$ collision at $\sqrt{s}=1.96$ TeV, in a final state consistent with leptonic $W$ boson decay and jets originating from heavy-flavor quarks from either a $W$ or a $Z$ boson decay. This analysis uses the full data set collected with the CDF II detector during Run II of the Tevatron collider, corresponding to an integrated luminosity of 9.4 fb$^{-1}$. An analysis of the dijet mass spectrum provides $3.7σ$ evidence of the summed production processes of either {\it WW} or {\it WZ} bosons with a measured total cross section of $σ_{WW+WZ} = 13.7\pm 3.9$~pb. Independent measurements of the {\it WW} and {\it WZ} production cross sections are allowed by the different heavy-flavor decay-patterns of the $W$ and $Z$ bosons and by the analysis of secondary-decay vertices reconstructed within heavy-flavor jets. The productions of {\it WW} and of {\it WZ} dibosons are independently seen with significances of $2.9σ$ and $2.1σ$, respectively, with total cross sections of $σ_{WW}= 9.4\pm 4.2$~pb and $σ_{WZ}=3.7^{+2.5}_{-2.2}$~pb. The measurements are consistent with standard-model predictions. △ Less

Submitted 31 July, 2016; v1 submitted 22 June, 2016; originally announced June 2016.

Comments: 19 pages, 11 figures, accepted for publication on Physical Review D

Report number: FERMILAB-PUB-16-229-E

Journal ref: Phys. Rev. D 94, 032008 (2016)

Kalman Filter Tracking on Parallel Architectures

Authors: Giuseppe Cerati, Peter Elmer, Slava Krutelyov, Steven Lantz, Matthieu Lefebvre, Kevin McDermott, Daniel Riley, Matevz Tadel, Peter Wittich, Frank Wuerthwein, Avi Yagil

Abstract: Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. To stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweight cores and specia… ▽ More Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. To stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweight cores and specialized functions like large vector units. Track finding and fitting is one of the most computationally challenging problems for event reconstruction in particle physics. At the High-Luminosity Large Hadron Collider (HL-LHC), for example, this will be by far the dominant problem. The need for greater parallelism has driven investigations of very different track finding techniques such as Cellular Automata or Hough Transforms. The most common track finding techniques in use today, however, are those based on the Kalman Filter. Significant experience has been accumulated with these techniques on real tracking detector systems, both in the trigger and offline. They are known to provide high physics performance, are robust, and are in use today at the LHC. We report on porting these algorithms to new parallel architectures. Our previous investigations showed that, using optimized data structures, track fitting with a Kalman Filter can achieve large speedups both with Intel Xeon and Xeon Phi. Additionally, we have previously shown first attempts at track building with some speedup. We report here our progress towards an end-to-end track reconstruction algorithm fully exploiting vectorization and parallelization techniques in a simplified experimental environment. △ Less

Submitted 18 May, 2016; originally announced May 2016.

Comments: Submitted to proceedings of Connecting The Dots 2016 (CTD2016), Vienna. arXiv admin note: text overlap with arXiv:1601.08245

Measurement of $\sin^2θ^{\rm lept}_{\rm eff}$ using $e^+e^-$ pairs from $γ^*/Z$ bosons produced in $p\bar{p}$ collisions at a center-of-momentum energy of 1.96 TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (372 additional authors not shown)

Abstract: At the Fermilab Tevatron proton-antiproton ($p\bar{p}$) collider, Drell-Yan lepton pairs are produced in the process $p \bar{p} \rightarrow e^+e^- + X$ through an intermediate $γ^*/Z$ boson. The forward-backward asymmetry in the polar-angle distribution of the $e^-$ as a function of the $e^+e^-$-pair mass is used to obtain $\sin^2θ^{\rm lept}_{\rm eff}$, the effective leptonic determination of the… ▽ More At the Fermilab Tevatron proton-antiproton ($p\bar{p}$) collider, Drell-Yan lepton pairs are produced in the process $p \bar{p} \rightarrow e^+e^- + X$ through an intermediate $γ^*/Z$ boson. The forward-backward asymmetry in the polar-angle distribution of the $e^-$ as a function of the $e^+e^-$-pair mass is used to obtain $\sin^2θ^{\rm lept}_{\rm eff}$, the effective leptonic determination of the electroweak-mixing parameter $\sin^2θ_W$. The measurement sample, recorded by the Collider Detector at Fermilab (CDF), corresponds to 9.4~fb$^{-1}$ of integrated luminosity from $p\bar{p}$ collisions at a center-of-momentum energy of 1.96 TeV, and is the full CDF Run II data set. The value of $\sin^2θ^{\rm lept}_{\rm eff}$ is found to be $0.23248 \pm 0.00053$. The combination with the previous CDF measurement based on $μ^+μ^-$ pairs yields $\sin^2θ^{\rm lept}_{\rm eff} = 0.23221 \pm 0.00046$. This result, when interpreted within the specified context of the standard model assuming $\sin^2 θ_W = 1 - M_W^2/M_Z^2$ and that the $W$- and $Z$-boson masses are on-shell, yields $\sin^2θ_W = 0.22400 \pm 0.00045$, or equivalently a $W$-boson mass of $80.328 \pm 0.024 \;{\rm GeV}/c^2$. △ Less

Submitted 10 June, 2016; v1 submitted 9 May, 2016; originally announced May 2016.

Report number: FERMILAB-PUB-16-165-E

Journal ref: Phys. Rev. D 93, 112016 (2016)

Measurement of the forward-backward asymmetry of top-quark and antiquark pairs using the full CDF Run II data set

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (372 additional authors not shown)

Abstract: We measure the forward--backward asymmetry of the production of top quark and antiquark pairs in proton-antiproton collisions at center-of-mass energy $\sqrt{s} = 1.96~\mathrm{TeV}$ using the full data set collected by the Collider Detector at Fermilab (CDF) in Tevatron Run II corresponding to an integrated luminosity of $9.1~\rm{fb}^{-1}$. The asymmetry is characterized by the rapidity difference… ▽ More We measure the forward--backward asymmetry of the production of top quark and antiquark pairs in proton-antiproton collisions at center-of-mass energy $\sqrt{s} = 1.96~\mathrm{TeV}$ using the full data set collected by the Collider Detector at Fermilab (CDF) in Tevatron Run II corresponding to an integrated luminosity of $9.1~\rm{fb}^{-1}$. The asymmetry is characterized by the rapidity difference between top quarks and antiquarks ($Δy$), and measured in the final state with two charged leptons (electrons and muons). The inclusive asymmetry, corrected to the entire phase space at parton level, is measured to be $A_{\text{FB}}^{t\bar{t}} = 0.12 \pm 0.13$, consistent with the expectations from the standard-model (SM) and previous CDF results in the final state with a single charged lepton. The combination of the CDF measurements of the inclusive $A_{\text{FB}}^{t\bar{t}}$ in both final states yields $A_{\text{FB}}^{t\bar{t}}=0.160\pm0.045$, which is consistent with the SM predictions. We also measure the differential asymmetry as a function of $Δy$. A linear fit to $A_{\text{FB}}^{t\bar{t}}(|Δy|)$, assuming zero asymmetry at $Δy=0$, yields a slope of $α=0.14\pm0.15$, consistent with the SM prediction and the previous CDF determination in the final state with a single charged lepton. The combined slope of $A_{\text{FB}}^{t\bar{t}}(|Δy|)$ in the two final states is $α=0.227\pm0.057$, which is $2.0σ$ larger than the SM prediction. △ Less

Submitted 29 February, 2016; originally announced February 2016.

Comments: To be submitted to Phys. Rev. D

Report number: FERMILAB-PUB-16-045-E

Journal ref: Phys. Rev. D 93, 112005 (2016)

Kalman-Filter-Based Particle Tracking on Parallel Architectures at Hadron Colliders

Authors: Giuseppe Cerati, Peter Elmer, Steven Lantz, Kevin McDermott, Dan Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. To stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweight cores and specia… ▽ More Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors such as GPGPU, ARM and Intel MIC. To stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweight cores and specialized functions like large vector units. Track finding and fitting is one of the most computationally challenging problems for event reconstruction in particle physics. At the High-Luminosity Large Hadron Collider (HL-LHC), for example, this will be by far the dominant problem. The need for greater parallelism has driven investigations of very different track finding techniques such as Cellular Automata or Hough Transforms. The most common track finding techniques in use today, however, are those based on the Kalman Filter. Significant experience has been accumulated with these techniques on real tracking detector systems, both in the trigger and offline. They are known to provide high physics performance, are robust, and are in use today at the LHC. We report on porting these algorithms to new parallel architectures. Our previous investigations showed that, using optimized data structures, track fitting with Kalman Filter can achieve large speedups both with Intel Xeon and Xeon Phi. We report here our progress towards an end-to-end track reconstruction algorithm fully exploiting vectorization and parallelization techniques in a realistic experimental environment. △ Less

Submitted 29 January, 2016; originally announced January 2016.

Comments: Proceedings of the 2015 IEEE NSS/MIC Conference, San Diego, CA

Measurement of the forward-backward asymmetry in low-mass bottom-quark pairs produced in proton-antiproton collisions

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (373 additional authors not shown)

Abstract: We report a measurement of the forward-backward asymmetry, $A_{FB}$, in $b\bar{b}$ pairs produced in proton-antiproton collisions and identified by muons from semileptonic $b$-hadron decays. The event sample was collected at a center-of-mass energy of $\sqrt{s}=1.96$ TeV with the CDF II detector and corresponds to 6.9 fb$^{-1}$ of integrated luminosity. We obtain an integrated asymmetry of… ▽ More We report a measurement of the forward-backward asymmetry, $A_{FB}$, in $b\bar{b}$ pairs produced in proton-antiproton collisions and identified by muons from semileptonic $b$-hadron decays. The event sample was collected at a center-of-mass energy of $\sqrt{s}=1.96$ TeV with the CDF II detector and corresponds to 6.9 fb$^{-1}$ of integrated luminosity. We obtain an integrated asymmetry of $A_{FB}(b\bar{b})=(1.2 \pm 0.7)$\% at the particle level for $b$-quark pairs with invariant mass, $m_{b\bar{b}}$, down to $40$ GeV/$c^2$ and measure the dependence of $A_{FB}(b\bar{b})$ on $m_{b\bar{b}}$. The results are compatible with expectations from the standard model. △ Less

Submitted 25 January, 2016; originally announced January 2016.

Comments: submitted to Phys. Rev. D

Report number: FERMILAB-PUB-16-017-E

Long-Baseline Neutrino Facility (LBNF) and Deep Underground Neutrino Experiment (DUNE) Conceptual Design Report Volume 1: The LBNF and DUNE Projects

Authors: R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, P. Adamson, S. Adhikari, Z. Ahmad, C. H. Albright, T. Alion, E. Amador, J. Anderson, K. Anderson, C. Andreopoulos, M. Andrews, R. Andrews, I. Anghel, J. d. Anjos, A. Ankowski, M. Antonello, A. ArandaFernandez, A. Ariga, T. Ariga, D. Aristizabal, E. Arrieta-Diaz, K. Aryal , et al. (780 additional authors not shown)

Abstract: This document presents the Conceptual Design Report (CDR) put forward by an international neutrino community to pursue the Deep Underground Neutrino Experiment at the Long-Baseline Neutrino Facility (LBNF/DUNE), a groundbreaking science experiment for long-baseline neutrino oscillation studies and for neutrino astrophysics and nucleon decay searches. The DUNE far detector will be a very large modu… ▽ More This document presents the Conceptual Design Report (CDR) put forward by an international neutrino community to pursue the Deep Underground Neutrino Experiment at the Long-Baseline Neutrino Facility (LBNF/DUNE), a groundbreaking science experiment for long-baseline neutrino oscillation studies and for neutrino astrophysics and nucleon decay searches. The DUNE far detector will be a very large modular liquid argon time-projection chamber (LArTPC) located deep underground, coupled to the LBNF multi-megawatt wide-band neutrino beam. DUNE will also have a high-resolution and high-precision near detector. △ Less

Submitted 20 January, 2016; originally announced January 2016.

Measurement of the $B_c^{\pm}$ production cross section in $p\bar{p}$ collisions at $\sqrt{s}=1.96$ TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (374 additional authors not shown)

Abstract: We describe a measurement of the ratio of the cross sections times branching fractions of the $B_c^+$ meson in the decay mode $B_c^+ \rightarrow J/ψμν$ to the $B^+$ meson in the decay mode $B^+ \rightarrow J/ψK^+$ in proton-antiproton collisions at center-of-mass energy $\sqrt{s}=1.96$ TeV. The measurement is based on the complete CDF Run II data set, which comes from an integrated luminosity of… ▽ More We describe a measurement of the ratio of the cross sections times branching fractions of the $B_c^+$ meson in the decay mode $B_c^+ \rightarrow J/ψμν$ to the $B^+$ meson in the decay mode $B^+ \rightarrow J/ψK^+$ in proton-antiproton collisions at center-of-mass energy $\sqrt{s}=1.96$ TeV. The measurement is based on the complete CDF Run II data set, which comes from an integrated luminosity of $8.7\,{\rm fb}^{-1}$. The ratio of the production cross sections times branching fractions for $B_c^+$ and $B_c^+$ mesons with momentum transverse to the beam greater than $6~\textrm{GeV}/c$ and rapidity magnitude smaller than 0.6 is $0.211\pm 0.012~\mbox{(stat)}^{+0.021}_{-0.020}~\mbox{(syst)}$. Using the known $B^+ \rightarrow J/ψK^+$ branching fraction, the known $B^+$ production cross section, and a selection of the predicted $B_c^+ \rightarrow J/ψμν$ branching fractions, the range for the total $B_c^+$ production cross section is estimated. △ Less

Submitted 26 March, 2016; v1 submitted 15 January, 2016; originally announced January 2016.

Comments: 28 pages, 25 figures, and 20 tables. This version is consistent with paper published in Phys. Rev. D on March 1, 2016

Report number: FERMILAB-PUB-16-008-E-PPD

Journal ref: Phys. Rev. D 93, 052001 (2016)

Long-Baseline Neutrino Facility (LBNF) and Deep Underground Neutrino Experiment (DUNE) Conceptual Design Report, Volume 4 The DUNE Detectors at LBNF

Authors: R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, P. Adamson, S. Adhikari, Z. Ahmad, C. H. Albright, T. Alion, E. Amador, J. Anderson, K. Anderson, C. Andreopoulos, M. Andrews, R. Andrews, I. Anghel, J. d. Anjos, A. Ankowski, M. Antonello, A. ArandaFernandez, A. Ariga, T. Ariga, D. Aristizabal, E. Arrieta-Diaz, K. Aryal , et al. (779 additional authors not shown)

Abstract: A description of the proposed detector(s) for DUNE at LBNF A description of the proposed detector(s) for DUNE at LBNF △ Less

Submitted 12 January, 2016; originally announced January 2016.

Search for a Low-Mass Neutral Higgs Boson with Suppressed Couplings to Fermions Using Events with Multiphoton Final States

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (373 additional authors not shown)

Abstract: A search for a Higgs boson with suppressed couplings to fermions, $h_f$, assumed to be the neutral, lower-mass partner of the Higgs boson discovered at the Large Hadron Collider, is reported. Such a Higgs boson could exist in extensions of the standard model with two Higgs doublets, and could be produced via $p\bar{p} \to H^\pm h_f \to W^* h_f h_f \to 4γ+ X$, where $H^\pm$ is a charged Higgs boson… ▽ More A search for a Higgs boson with suppressed couplings to fermions, $h_f$, assumed to be the neutral, lower-mass partner of the Higgs boson discovered at the Large Hadron Collider, is reported. Such a Higgs boson could exist in extensions of the standard model with two Higgs doublets, and could be produced via $p\bar{p} \to H^\pm h_f \to W^* h_f h_f \to 4γ+ X$, where $H^\pm$ is a charged Higgs boson. This analysis uses all events with at least three photons in the final state from proton-antiproton collisions at a center-of-mass energy of 1.96~TeV collected by the Collider Detector at Fermilab, corresponding to an integrated luminosity of 9.2~${\rm fb}^{-1}$. No evidence of a signal is observed in the data. Values of Higgs-boson masses between 10 and 100 GeV/$c^2$ are excluded at 95\% Bayesian credibility. △ Less

Submitted 4 January, 2016; originally announced January 2016.

Comments: Submitted to Phys. Rev. Lett

Report number: FERMILAB-PUB-15-578-E

Journal ref: Phys. Rev. D 93, 112010 (2016)

Long-Baseline Neutrino Facility (LBNF) and Deep Underground Neutrino Experiment (DUNE) Conceptual Design Report Volume 2: The Physics Program for DUNE at LBNF

Authors: DUNE Collaboration, R. Acciarri, M. A. Acero, M. Adamowski, C. Adams, P. Adamson, S. Adhikari, Z. Ahmad, C. H. Albright, T. Alion, E. Amador, J. Anderson, K. Anderson, C. Andreopoulos, M. Andrews, R. Andrews, I. Anghel, J. d. Anjos, A. Ankowski, M. Antonello, A. ArandaFernandez, A. Ariga, T. Ariga, D. Aristizabal, E. Arrieta-Diaz , et al. (780 additional authors not shown)

Abstract: The Physics Program for the Deep Underground Neutrino Experiment (DUNE) at the Fermilab Long-Baseline Neutrino Facility (LBNF) is described. The Physics Program for the Deep Underground Neutrino Experiment (DUNE) at the Fermilab Long-Baseline Neutrino Facility (LBNF) is described. △ Less

Submitted 22 January, 2016; v1 submitted 18 December, 2015; originally announced December 2015.

Measurement of vector boson plus $D^{*}(2010)^+$ meson production in $\bar{p}p$ collisions at $\sqrt{s}=1.96\, {\rm TeV}$

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (378 additional authors not shown)

Abstract: A measurement of vector boson ($V$) production in conjunction with a $D^{*}(2010)^+$ meson is presented. Using a data sample corresponding to $9.7\, {\rm fb}^{-1}$ of ^Mproton-antiproton collisions at center-of-mass energy $\sqrt{s}=1.96\rm~ TeV$ produced by the Fermilab Tevatron, we reconstruct $V+D^{*+}$ samples with the CDF~II detector. The $D^{*+}$ is fully reconstructed in the… ▽ More A measurement of vector boson ($V$) production in conjunction with a $D^{*}(2010)^+$ meson is presented. Using a data sample corresponding to $9.7\, {\rm fb}^{-1}$ of ^Mproton-antiproton collisions at center-of-mass energy $\sqrt{s}=1.96\rm~ TeV$ produced by the Fermilab Tevatron, we reconstruct $V+D^{*+}$ samples with the CDF~II detector. The $D^{*+}$ is fully reconstructed in the $D^{*}(2010)^+ \rightarrow D^{0}(\to K^-π^+)π^+$ decay mode. This technique is sensitive to the associated production of vector boson plus charm or bottom mesons. We measure the ratio of production cross sections $σ(W+D^{*})/σ(W)$ = $[1.75\pm 0.13 {\rm (stat)}\pm 0.09 {\rm (syst)}]\% $ and $σ(Z+D^{*})/σ(Z)$ = $[1.5\pm 0.4 {\rm (stat)} \pm 0.2 {\rm (syst)}]\% $ and perform a differential measurement of $dσ(W+D^{*})/dp_T(D^{*})$. Event properties are utilized to determine the fraction of $V+D^{*}(2010)^+$ events originating from different production processes. The results are in agreement with the predictions obtained with the {\sc pythia} program, limiting possible contribution from non-standard-model physics processes. △ Less

Submitted 22 March, 2016; v1 submitted 27 August, 2015; originally announced August 2015.

Report number: FERMILAB-PUB-15-368

Journal ref: Phys. Rev. D 93, 052012 (2016)

A Study of the Energy Dependence of the Underlying Event in Proton-Antiproton Collisions

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, M. Albrow, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce , et al. (379 additional authors not shown)

Abstract: We study charged particle production in proton-antiproton collisions at 300 GeV, 900 GeV, and 1.96 TeV. We use the direction of the charged particle with the largest transverse momentum in each event to define three regions of eta-phi space; toward, away, and transverse. The average number and the average scalar pT sum of charged particles in the transverse region are sensitive to the modeling of… ▽ More We study charged particle production in proton-antiproton collisions at 300 GeV, 900 GeV, and 1.96 TeV. We use the direction of the charged particle with the largest transverse momentum in each event to define three regions of eta-phi space; toward, away, and transverse. The average number and the average scalar pT sum of charged particles in the transverse region are sensitive to the modeling of the underlying event. The transverse region is divided into a MAX and MIN transverse region, which helps separate the hard component (initial and final-state radiation) from the beam-beam remnant and multiple parton interaction components of the scattering. The center-of-mass energy dependence of the various components of the event are studied in detail. The data presented here can be used to constrain and improve QCD Monte Carlo models, resulting in more precise predictions at the LHC energies of 13 and 14 TeV. △ Less

Submitted 27 August, 2015; v1 submitted 21 August, 2015; originally announced August 2015.

Comments: 24 pages, 19 figures, to be submitted to Phys. Rev. D

Report number: FERMILAB-PUB-15-361-E

Journal ref: Phys. Rev. D 92, 092009 (2015)

Kalman Filter Tracking on Parallel Architectures

Authors: Giuseppe Cerati, Peter Elmer, Steven Lantz, Kevin McDermott, Dan Riley, Matevž Tadel, Peter Wittich, Frank Würthwein, Avi Yagil

Abstract: Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors, but the future will be even more exciting. In order to stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweig… ▽ More Power density constraints are limiting the performance improvements of modern CPUs. To address this we have seen the introduction of lower-power, multi-core processors, but the future will be even more exciting. In order to stay within the power density limits but still obtain Moore's Law performance/price gains, it will be necessary to parallelize algorithms to exploit larger numbers of lightweight cores and specialized functions like large vector units. Example technologies today include Intel's Xeon Phi and GPGPUs. Track finding and fitting is one of the most computationally challenging problems for event reconstruction in particle physics. At the High Luminosity LHC, for example, this will be by far the dominant problem. The need for greater parallelism has driven investigations of very different track finding techniques including Cellular Automata or returning to Hough Transform. The most common track finding techniques in use today are however those based on the Kalman Filter. Significant experience has been accumulated with these techniques on real tracking detector systems, both in the trigger and offline. They are known to provide high physics performance, are robust and are exactly those being used today for the design of the tracking system for HL-LHC. Our previous investigations showed that, using optimized data structures, track fitting with Kalman Filter can achieve large speedup both with Intel Xeon and Xeon Phi. We report here our further progress towards an end-to-end track reconstruction algorithm fully exploiting vectorization and parallelization techniques in a realistic simulation setup. △ Less

Submitted 18 May, 2015; originally announced May 2015.

Measurement of the production and differential cross sections of $W^{+}W^{-}$ bosons in association with jets in $p\bar{p}$ collisions at $\sqrt{s}=1.96$ TeV

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (378 additional authors not shown)

Abstract: We present a measurement of the $W$-boson-pair production cross section in $p\bar{p}$ collisions at 1.96 TeV center-of-mass energy and the first measurement of the differential cross section as a function of jet multiplicity and leading-jet energy. The $W^{+}W^{-}$ cross section is measured in the final state comprising two charged leptons and neutrinos, where either charged lepton can be an elect… ▽ More We present a measurement of the $W$-boson-pair production cross section in $p\bar{p}$ collisions at 1.96 TeV center-of-mass energy and the first measurement of the differential cross section as a function of jet multiplicity and leading-jet energy. The $W^{+}W^{-}$ cross section is measured in the final state comprising two charged leptons and neutrinos, where either charged lepton can be an electron or a muon. Using data collected by the CDF experiment corresponding to $9.7~\rm{fb}^{-1}$ of integrated luminosity, a total of $3027$ collision events consistent with $W^{+}W^{-}$ production are observed with an estimated background contribution of $1790\pm190$ events. The measured total cross section is $σ(p\bar{p} \rightarrow W^{+}W^{-}) = 14.0 \pm 0.6~(\rm{stat})^{+1.2}_{-1.0}~(\rm{syst})\pm0.8~(\rm{lumi})$ pb, consistent with the standard model prediction. △ Less

Submitted 23 June, 2015; v1 submitted 4 May, 2015; originally announced May 2015.

Report number: FERMILAB-PUB-15-191-PPD

Journal ref: Phys. Rev. D 91, 111101 (2015)

Measurement of the top-quark mass in the ${t\bar{t}}$ dilepton channel using the full CDF Run II data set

Authors: CDF Collaboration, T. Aaltonen, S. Amerio, D. Amidei, A. Anastassov, A. Annovi, J. Antos, G. Apollinari, J. A. Appel, T. Arisawa, A. Artikov, J. Asaadi, W. Ashmanskas, B. Auerbach, A. Aurisano, F. Azfar, W. Badgett, T. Bae, A. Barbaro-Galtieri, V. E. Barnes, B. A. Barnett, P. Barria, P. Bartos, M. Bauce, F. Bedeschi , et al. (378 additional authors not shown)

Abstract: We present a measurement of the top-quark mass in events containing two leptons (electrons or muons) with a large transverse momentum, two or more energetic jets, and a transverse-momentum imbalance. We use the full proton-antiproton collision data set collected by the CDF experiment during the Fermilab Tevatron Run~II at center-of-mass energy $\sqrt{s} = 1.96$ TeV, corresponding to an integrated… ▽ More We present a measurement of the top-quark mass in events containing two leptons (electrons or muons) with a large transverse momentum, two or more energetic jets, and a transverse-momentum imbalance. We use the full proton-antiproton collision data set collected by the CDF experiment during the Fermilab Tevatron Run~II at center-of-mass energy $\sqrt{s} = 1.96$ TeV, corresponding to an integrated luminosity of 9.1 fb$^{-1}$. A special observable is exploited for an optimal reduction of the dominant systematic uncertainty, associated with the knowledge of the absolute energy of the hadronic jets. The distribution of this observable in the selected events is compared to simulated distributions of ${t\bar{t}}$ dilepton signal and background.We measure a value for the top-quark mass of $171.5\pm 1.9~{\rm (stat)}\pm 2.5~{\rm (syst)}$ GeV/$c^2$. △ Less

Submitted 20 June, 2015; v1 submitted 3 May, 2015; originally announced May 2015.

Comments: Submitted to Phys. Rev. D, 11 pages, 5 figures and 2 tables

Report number: FERMILAB-PUB-15-190-E

Journal ref: Phys. Rev. D 92, 032003 (2015)