Showing 51–100 of 103 results for author: Duarte, J

Autoencoders on FPGAs for real-time, unsupervised new physics detection at 40 MHz at the Large Hadron Collider

Authors: Ekaterina Govorkova, Ema Puljak, Thea Aarrestad, Thomas James, Vladimir Loncar, Maurizio Pierini, Adrian Alan Pol, Nicolò Ghielmetti, Maksymilian Graczyk, Sioni Summers, Jennifer Ngadiuba, Thong Q. Nguyen, Javier Duarte, Zhenbin Wu

Abstract: In this paper, we show how to adapt and deploy anomaly detection algorithms based on deep autoencoders, for the unsupervised detection of new physics signatures in the extremely challenging environment of a real-time event selection system at the Large Hadron Collider (LHC). We demonstrate that new physics signatures can be enhanced by three orders of magnitude, while staying within the strict lat… ▽ More In this paper, we show how to adapt and deploy anomaly detection algorithms based on deep autoencoders, for the unsupervised detection of new physics signatures in the extremely challenging environment of a real-time event selection system at the Large Hadron Collider (LHC). We demonstrate that new physics signatures can be enhanced by three orders of magnitude, while staying within the strict latency and resource constraints of a typical LHC event filtering system. This would allow for collecting datasets potentially enriched with high-purity contributions from new physics processes. Through per-layer, highly parallel implementations of network layers, support for autoencoder-specific losses on FPGAs and latent space based inference, we demonstrate that anomaly detection can be performed in as little as $80\,$ns using less than 3% of the logic resources in the Xilinx Virtex VU9P FPGA. Opening the way to real-life applications of this idea during the next data-taking campaign of the LHC. △ Less

Submitted 12 August, 2021; v1 submitted 9 August, 2021; originally announced August 2021.

Report number: FERMILAB-PUB-21-487-CMS

Journal ref: Nature Machine Intelligence 4, 154 (2022)

A FAIR and AI-ready Higgs boson decay dataset

Authors: Yifan Chen, E. A. Huerta, Javier Duarte, Philip Harris, Daniel S. Katz, Mark S. Neubauer, Daniel Diaz, Farouk Mokhtar, Raghav Kansal, Sang Eon Park, Volodymyr V. Kindratenko, Zhizhen Zhao, Roger Rusack

Abstract: To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate… ▽ More To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate how to use this guide to evaluate the FAIRness of an open simulated dataset produced by the CMS Collaboration at the CERN Large Hadron Collider. This dataset consists of Higgs boson decays and quark and gluon background, and is available through the CERN Open Data Portal. We use additional available tools to assess the FAIRness of this dataset, and incorporate feedback from members of the FAIR community to validate our results. This article is accompanied by a Jupyter notebook to visualize and explore this dataset. This study marks the first in a planned series of articles that will guide scientists in the creation of FAIR AI models and datasets in high energy particle physics. △ Less

Submitted 16 February, 2022; v1 submitted 4 August, 2021; originally announced August 2021.

Comments: 13 pages, 3 figures. v2: Accepted to Nature Scientific Data. Learn about the FAIR4HEP project at https://fair4hep.github.io. See our invited Behind the Paper Blog in Springer Nature Research Data Community at https://go.nature.com/3oMVYxo

ACM Class: I.2; J.2

Journal ref: Scientific Data volume 9, Article number: 31 (2022)

Particle Cloud Generation with Message Passing Generative Adversarial Networks

Authors: Raghav Kansal, Javier Duarte, Hao Su, Breno Orzari, Thiago Tomei, Maurizio Pierini, Mary Touranakou, Jean-Roch Vlimant, Dimitrios Gunopulos

Abstract: In high energy physics (HEP), jets are collections of correlated particles produced ubiquitously in particle collisions such as those at the CERN Large Hadron Collider (LHC). Machine learning (ML)-based generative models, such as generative adversarial networks (GANs), have the potential to significantly accelerate LHC jet simulations. However, despite jets having a natural representation as a set… ▽ More In high energy physics (HEP), jets are collections of correlated particles produced ubiquitously in particle collisions such as those at the CERN Large Hadron Collider (LHC). Machine learning (ML)-based generative models, such as generative adversarial networks (GANs), have the potential to significantly accelerate LHC jet simulations. However, despite jets having a natural representation as a set of particles in momentum-space, a.k.a. a particle cloud, there exist no generative models applied to such a dataset. In this work, we introduce a new particle cloud dataset (JetNet), and apply to it existing point cloud GANs. Results are evaluated using (1) 1-Wasserstein distances between high- and low-level feature distributions, (2) a newly developed Fréchet ParticleNet Distance, and (3) the coverage and (4) minimum matching distance metrics. Existing GANs are found to be inadequate for physics applications, hence we develop a new message passing GAN (MPGAN), which outperforms existing point cloud GANs on virtually every metric and shows promise for use in HEP. We propose JetNet as a novel point-cloud-style dataset for the ML community to experiment with, and set MPGAN as a benchmark to improve upon for future generative models. Additionally, to facilitate research and improve accessibility and reproducibility in this area, we release the open-source JetNet Python package with interfaces for particle cloud datasets, implementations for evaluation and loss metrics, and more tools for ML in HEP development. △ Less

Submitted 21 January, 2022; v1 submitted 22 June, 2021; originally announced June 2021.

Comments: 14 pages, 4 figures, 2 tables, and an 8 page appendix. Accepted to the Thirty-fifth Conference on Neural Information Processing Systems

MLPerf Tiny Benchmark

Authors: Colby Banbury, Vijay Janapa Reddi, Peter Torelli, Jeremy Holleman, Nat Jeffries, Csaba Kiraly, Pietro Montino, David Kanter, Sebastian Ahmed, Danilo Pau, Urmish Thakker, Antonio Torrini, Peter Warden, Jay Cordaro, Giuseppe Di Guglielmo, Javier Duarte, Stephen Gibellini, Videet Parekh, Honson Tran, Nhan Tran, Niu Wenxu, Xu Xuesong

Abstract: Advancements in ultra-low-power tiny machine learning (TinyML) systems promise to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted and easily reproducible benchmark for these systems. To meet this need, we present MLPerf Tiny, the first industry-standard benchmark suite for ultra-low-power tiny machine learning systems. The… ▽ More Advancements in ultra-low-power tiny machine learning (TinyML) systems promise to unlock an entirely new class of smart applications. However, continued progress is limited by the lack of a widely accepted and easily reproducible benchmark for these systems. To meet this need, we present MLPerf Tiny, the first industry-standard benchmark suite for ultra-low-power tiny machine learning systems. The benchmark suite is the collaborative effort of more than 50 organizations from industry and academia and reflects the needs of the community. MLPerf Tiny measures the accuracy, latency, and energy of machine learning inference to properly evaluate the tradeoffs between systems. Additionally, MLPerf Tiny implements a modular design that enables benchmark submitters to show the benefits of their product, regardless of where it falls on the ML deployment stack, in a fair and reproducible manner. The suite features four benchmarks: keyword spotting, visual wake words, image classification, and anomaly detection. △ Less

Submitted 24 August, 2021; v1 submitted 14 June, 2021; originally announced June 2021.

Comments: TinyML Benchmark

Detecting Fetal Alcohol Spectrum Disorder in children using Artificial Neural Network

Authors: Vannessa de J. Duarte, Paul Leger, Sergio Contreras, Hiroaki Fukuda

Abstract: Fetal alcohol spectrum disorder (FASD) is a syndrome whose only difference compared to other children's conditions is the mother's alcohol consumption during pregnancy. An earlier diagnosis of FASD improving the quality of life of children and adolescents. For this reason, this study focus on evaluating the use of the artificial neural network (ANN) to classify children with FASD and explore how a… ▽ More Fetal alcohol spectrum disorder (FASD) is a syndrome whose only difference compared to other children's conditions is the mother's alcohol consumption during pregnancy. An earlier diagnosis of FASD improving the quality of life of children and adolescents. For this reason, this study focus on evaluating the use of the artificial neural network (ANN) to classify children with FASD and explore how accurate it is. ANN has been used to diagnose cancer, diabetes, and other diseases in the medical area, being a tool that presents good results. The data used is from a battery of tests from children for 5-18 years old (include tests of psychometric, saccade eye movement, and diffusion tensor imaging (DTI)). We study the different configurations of ANN with dense layers. The first one predicts 75\% of the outcome correctly for psychometric data. The others models include a feature layer, and we used it to predict FASD using every test individually. The models accurately predict over 70\% of the cases, and psychometric and memory guides predict over 88\% accuracy. The results suggest that the ANN approach is a competitive and efficient methodology to detect FASD. However, we could be careful in used as a diagnostic technique. △ Less

Submitted 31 May, 2021; originally announced May 2021.

The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

Authors: T. Aarrestad, M. van Beekveld, M. Bona, A. Boveia, S. Caron, J. Davies, A. De Simone, C. Doglioni, J. M. Duarte, A. Farbin, H. Gupta, L. Hendriks, L. Heinrich, J. Howarth, P. Jawahar, A. Jueid, J. Lastow, A. Leinweber, J. Mamuzic, E. Merényi, A. Morandini, P. Moskvitina, C. Nellist, J. Ngadiuba, B. Ostdiek , et al. (14 additional authors not shown)

Abstract: We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We defin… ▽ More We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 Billion simulated LHC events corresponding to $10~\rm{fb}^{-1}$ of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge. △ Less

Submitted 9 December, 2021; v1 submitted 28 May, 2021; originally announced May 2021.

Comments: v1: 54 pages, 24 figures. v2: 56 pages, citations added, extend discussion of look-elsewhere-effect, results unchanged; v3. minor typos and updated references

Journal ref: SciPost Phys. 12, 043 (2022)

A reconfigurable neural network ASIC for detector front-end data compression at the HL-LHC

Authors: Giuseppe Di Guglielmo, Farah Fahim, Christian Herwig, Manuel Blanco Valentin, Javier Duarte, Cristian Gingu, Philip Harris, James Hirschauer, Martin Kwok, Vladimir Loncar, Yingyi Luo, Llovizna Miranda, Jennifer Ngadiuba, Daniel Noonan, Seda Ogrenci-Memik, Maurizio Pierini, Sioni Summers, Nhan Tran

Abstract: Despite advances in the programmable logic capabilities of modern trigger systems, a significant bottleneck remains in the amount of data to be transported from the detector to off-detector logic where trigger decisions are made. We demonstrate that a neural network autoencoder model can be implemented in a radiation tolerant ASIC to perform lossy data compression alleviating the data transmission… ▽ More Despite advances in the programmable logic capabilities of modern trigger systems, a significant bottleneck remains in the amount of data to be transported from the detector to off-detector logic where trigger decisions are made. We demonstrate that a neural network autoencoder model can be implemented in a radiation tolerant ASIC to perform lossy data compression alleviating the data transmission problem while preserving critical information of the detector energy profile. For our application, we consider the high-granularity calorimeter from the CMS experiment at the CERN Large Hadron Collider. The advantage of the machine learning approach is in the flexibility and configurability of the algorithm. By changing the neural network weights, a unique data compression algorithm can be deployed for each sensor in different detector regions, and changing detector or collider conditions. To meet area, performance, and power constraints, we perform a quantization-aware training to create an optimized neural network hardware implementation. The design is achieved through the use of high-level synthesis tools and the hls4ml framework, and was processed through synthesis and physical layout flows based on a LP CMOS 65 nm technology node. The flow anticipates 200 Mrad of ionizing radiation to select gates, and reports a total area of 3.6 mm^2 and consumes 95 mW of power. The simulated energy consumption per inference is 2.4 nJ. This is the first radiation tolerant on-detector ASIC implementation of a neural network that has been designed for particle physics applications. △ Less

Submitted 4 May, 2021; originally announced May 2021.

Comments: 9 pages, 8 figures, 3 tables

Report number: FERMILAB-PUB-21-217-CMS-E-SCD

Journal ref: IEEE Trans. Nucl. Sci. 68, 2179 (2021)

Charged particle tracking via edge-classifying interaction networks

Authors: Gage DeZoort, Savannah Thais, Javier Duarte, Vesal Razavimaleki, Markus Atkinson, Isobel Ojalvo, Mark Neubauer, Peter Elmer

Abstract: Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high energy particle physics. In particular, particle tracking data is naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges; given a set of hypothesized edges, edge-class… ▽ More Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high energy particle physics. In particular, particle tracking data is naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges; given a set of hypothesized edges, edge-classifying GNNs identify those corresponding to real particle trajectories. In this work, we adapt the physics-motivated interaction network (IN) GNN toward the problem of particle tracking in pileup conditions similar to those expected at the high-luminosity Large Hadron Collider. Assuming idealized hit filtering at various particle momenta thresholds, we demonstrate the IN's excellent edge-classification accuracy and tracking efficiency through a suite of measurements at each stage of GNN-based tracking: graph construction, edge classification, and track building. The proposed IN architecture is substantially smaller than previously studied GNN tracking architectures; this is particularly promising as a reduction in size is critical for enabling GNN-based tracking in constrained computing environments. Furthermore, the IN may be represented as either a set of explicit matrix operations or a message passing GNN. Efforts are underway to accelerate each representation via heterogeneous computing resources towards both high-level and low-latency triggering applications. △ Less

Submitted 18 November, 2021; v1 submitted 30 March, 2021; originally announced March 2021.

Comments: This is a post-peer-review, pre-copyedit version of this article. The final authenticated version is available online at: https://doi.org/10.1007/s41781-021-00073-z

Journal ref: Comput. Softw. Big Sci. 5, 26 (2021)

hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices

Authors: Farah Fahim, Benjamin Hawks, Christian Herwig, James Hirschauer, Sergo **dariani, Nhan Tran, Luca P. Carloni, Giuseppe Di Guglielmo, Philip Harris, Jeffrey Krupa, Dylan Rankin, Manuel Blanco Valentin, Josiah Hester, Yingyi Luo, John Mamish, Seda Orgrenci-Memik, Thea Aarrestad, Hamza Javed, Vladimir Loncar, Maurizio Pierini, Adrian Alan Pol, Sioni Summers, Javier Duarte, Scott Hauck, Shih-Chieh Hsu , et al. (5 additional authors not shown)

Abstract: Accessible machine learning algorithms, software, and diagnostic tools for energy-efficient devices and systems are extremely valuable across a broad range of application domains. In scientific domains, real-time near-sensor processing can drastically improve experimental design and accelerate scientific discoveries. To support domain scientists, we have developed hls4ml, an open-source software-h… ▽ More Accessible machine learning algorithms, software, and diagnostic tools for energy-efficient devices and systems are extremely valuable across a broad range of application domains. In scientific domains, real-time near-sensor processing can drastically improve experimental design and accelerate scientific discoveries. To support domain scientists, we have developed hls4ml, an open-source software-hardware codesign workflow to interpret and translate machine learning algorithms for implementation with both FPGA and ASIC technologies. We expand on previous hls4ml work by extending capabilities and techniques towards low-power implementations and increased usability: new Python APIs, quantization-aware pruning, end-to-end FPGA workflows, long pipeline kernels for low power, and new device backends include an ASIC workflow. Taken together, these and continued efforts in hls4ml will arm a new generation of domain scientists with accessible, efficient, and powerful tools for machine-learning-accelerated discovery. △ Less

Submitted 23 March, 2021; v1 submitted 9 March, 2021; originally announced March 2021.

Comments: 10 pages, 8 figures, TinyML Research Symposium 2021

Report number: FERMILAB-CONF-21-080-SCD

Ps and Qs: Quantization-aware pruning for efficient low latency neural network inference

Authors: Benjamin Hawks, Javier Duarte, Nicholas J. Fraser, Alessandro Pappalardo, Nhan Tran, Yaman Umuroglu

Abstract: Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. I… ▽ More Efficient machine learning implementations optimized for inference in hardware have wide-ranging benefits, depending on the application, from lower inference latency to higher data throughput and reduced energy consumption. Two popular techniques for reducing computation in neural networks are pruning, removing insignificant synapses, and quantization, reducing the precision of the calculations. In this work, we explore the interplay between pruning and quantization during the training of neural networks for ultra low latency applications targeting high energy physics use cases. Techniques developed for this study have potential applications across many other domains. We study various configurations of pruning during quantization-aware training, which we term quantization-aware pruning, and the effect of techniques like regularization, batch normalization, and different pruning schemes on performance, computational complexity, and information content metrics. We find that quantization-aware pruning yields more computationally efficient models than either pruning or quantization alone for our task. Further, quantization-aware pruning typically performs similar to or better in terms of computational efficiency compared to other neural architecture search techniques like Bayesian optimization. Surprisingly, while networks with different training configurations can have similar performance for the benchmark application, the information content in the network can vary significantly, affecting its generalizability. △ Less

Submitted 19 July, 2021; v1 submitted 22 February, 2021; originally announced February 2021.

Comments: 22 pages, 7 Figures, 1 Table

Report number: FERMILAB-PUB-21-056-SCD

Journal ref: Front. AI 4, 94 (2021)

Controlling infectious diseases: the decisive phase effect on a seasonal vaccination strategy

Authors: Jorge Duarte, Cristina Januário, Nuno Martins, Jesús Seoane, Miguel AF Sanjuán

Abstract: The study of epidemiological systems has generated deep interest in exploring the dynamical complexity of common infectious diseases driven by seasonally varying contact rates. Mathematical modeling and field observations have shown that, under seasonal variation, the incidence rates of some endemic infectious diseases fluctuate dramatically and the dynamics is often characterized by chaotic oscil… ▽ More The study of epidemiological systems has generated deep interest in exploring the dynamical complexity of common infectious diseases driven by seasonally varying contact rates. Mathematical modeling and field observations have shown that, under seasonal variation, the incidence rates of some endemic infectious diseases fluctuate dramatically and the dynamics is often characterized by chaotic oscillations in the absence of specific vaccination programs. In fact, the existence of chaotic behavior has been precisely stated in the literature as a noticeable feature in the dynamics of the classical Susceptible-Infected-Recovered (SIR) seasonally forced epidemic model. However, in the context of epidemiology, chaos is often regarded as an undesirable phenomenon associated with the unpredictability of infectious diseases. As a consequence, the problem of converting chaotic motions into regular motions becomes particularly relevant. In this article, we consider the phase control technique applied to the seasonally forced SIR epidemic model to suppress chaos. Interestingly, this method of controlling chaos takes on a clear meaning as a weak perturbation on a seasonal vaccination strategy. Numerical simulations show that the phase difference between the two periodic forces - contact rate and vaccination - plays a very important role in controlling chaos. △ Less

Submitted 14 February, 2021; originally announced February 2021.

Comments: 18 pages, 14 figures

MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networks

Authors: Joosep Pata, Javier Duarte, Jean-Roch Vlimant, Maurizio Pierini, Maria Spiropulu

Abstract: In general-purpose particle detectors, the particle-flow algorithm may be used to reconstruct a comprehensive particle-level view of the event by combining information from the calorimeters and the trackers, significantly improving the detector resolution for jets and the missing transverse momentum. In view of the planned high-luminosity upgrade of the CERN Large Hadron Collider (LHC), it is nece… ▽ More In general-purpose particle detectors, the particle-flow algorithm may be used to reconstruct a comprehensive particle-level view of the event by combining information from the calorimeters and the trackers, significantly improving the detector resolution for jets and the missing transverse momentum. In view of the planned high-luminosity upgrade of the CERN Large Hadron Collider (LHC), it is necessary to revisit existing reconstruction algorithms and ensure that both the physics and computational performance are sufficient in an environment with many simultaneous proton-proton interactions (pileup). Machine learning may offer a prospect for computationally efficient event reconstruction that is well-suited to heterogeneous computing platforms, while significantly improving the reconstruction quality over rule-based algorithms for granular detectors. We introduce MLPF, a novel, end-to-end trainable, machine-learned particle-flow algorithm based on parallelizable, computationally efficient, and scalable graph neural networks optimized using a multi-task objective on simulated events. We report the physics and computational performance of the MLPF algorithm on a Monte Carlo dataset of top quark-antiquark pairs produced in proton-proton collisions in conditions similar to those expected for the high-luminosity LHC. The MLPF algorithm improves the physics response with respect to a rule-based benchmark algorithm and demonstrates computationally scalable particle-flow reconstruction in a high-pileup environment. △ Less

Submitted 9 June, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Comments: 15 pages, 10 figures

Journal ref: Eur. Phys. J. C (2021) 81: 381

The LHC Olympics 2020: A Community Challenge for Anomaly Detection in High Energy Physics

Authors: Gregor Kasieczka, Benjamin Nachman, David Shih, Oz Amram, Anders Andreassen, Kees Benkendorfer, Blaz Bortolato, Gustaaf Brooijmans, Florencia Canelli, Jack H. Collins, Biwei Dai, Felipe F. De Freitas, Barry M. Dillon, Ioan-Mihail Dinu, Zhongtian Dong, Julien Donini, Javier Duarte, D. A. Faroughy, Julia Gonski, Philip Harris, Alan Kahn, Jernej F. Kamenik, Charanjit K. Khosa, Patrick Komiske, Luc Le Pottier , et al. (22 additional authors not shown)

Abstract: A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a… ▽ More A new paradigm for data-driven, model-agnostic new physics searches at colliders is emerging, and aims to leverage recent breakthroughs in anomaly detection and machine learning. In order to develop and benchmark new anomaly detection methods within this framework, it is essential to have standard datasets. To this end, we have created the LHC Olympics 2020, a community challenge accompanied by a set of simulated collider events. Participants in these Olympics have developed their methods using an R&D dataset and then tested them on black boxes: datasets with an unknown anomaly (or not). This paper will review the LHC Olympics 2020 challenge, including an overview of the competition, a description of methods deployed in the competition, lessons learned from the experience, and implications for data analyses with future datasets as well as future colliders. △ Less

Submitted 20 January, 2021; originally announced January 2021.

Comments: 108 pages, 53 figures, 3 tables

Fast convolutional neural networks on FPGAs with hls4ml

Authors: Thea Aarrestad, Vladimir Loncar, Nicolò Ghielmetti, Maurizio Pierini, Sioni Summers, Jennifer Ngadiuba, Christoffer Petersson, Hampus Linander, Yutaro Iiyama, Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Dylan Rankin, Sergo **dariani, Kevin Pedro, Nhan Tran, Mia Liu, Edward Kreinar, Zhenbin Wu, Duc Hoang

Abstract: We introduce an automated tool for deploying ultra low-latency, low-power deep neural networks with convolutional layers on FPGAs. By extending the hls4ml library, we demonstrate an inference latency of $5\,μ$s using convolutional architectures, targeting microsecond latency applications like those at the CERN Large Hadron Collider. Considering benchmark models trained on the Street View House Num… ▽ More We introduce an automated tool for deploying ultra low-latency, low-power deep neural networks with convolutional layers on FPGAs. By extending the hls4ml library, we demonstrate an inference latency of $5\,μ$s using convolutional architectures, targeting microsecond latency applications like those at the CERN Large Hadron Collider. Considering benchmark models trained on the Street View House Numbers Dataset, we demonstrate various methods for model compression in order to fit the computational constraints of a typical FPGA device used in trigger and data acquisition systems of particle detectors. In particular, we discuss pruning and quantization-aware training, and demonstrate how resource utilization can be significantly reduced with little to no loss in model accuracy. We show that the FPGA critical resource consumption can be reduced by 97% with zero loss in model accuracy, and by 99% when tolerating a 6% accuracy degradation. △ Less

Submitted 29 April, 2021; v1 submitted 13 January, 2021; originally announced January 2021.

Comments: 18 pages, 18 figures, 4 tables

Journal ref: Mach. Learn.: Sci. Technol. 2 045015 (2021)

Accelerated Charged Particle Tracking with Graph Neural Networks on FPGAs

Authors: Aneesh Heintz, Vesal Razavimaleki, Javier Duarte, Gage DeZoort, Isobel Ojalvo, Savannah Thais, Markus Atkinson, Mark Neubauer, Lindsey Gray, Sergo **dariani, Nhan Tran, Philip Harris, Dylan Rankin, Thea Aarrestad, Vladimir Loncar, Maurizio Pierini, Sioni Summers, Jennifer Ngadiuba, Mia Liu, Edward Kreinar, Zhenbin Wu

Abstract: We develop and study FPGA implementations of algorithms for charged particle tracking based on graph neural networks. The two complementary FPGA designs are based on OpenCL, a framework for writing programs that execute across heterogeneous platforms, and hls4ml, a high-level-synthesis-based compiler for neural network to firmware conversion. We evaluate and compare the resource usage, latency, an… ▽ More We develop and study FPGA implementations of algorithms for charged particle tracking based on graph neural networks. The two complementary FPGA designs are based on OpenCL, a framework for writing programs that execute across heterogeneous platforms, and hls4ml, a high-level-synthesis-based compiler for neural network to firmware conversion. We evaluate and compare the resource usage, latency, and tracking performance of our implementations based on a benchmark dataset. We find a considerable speedup over CPU-based execution is possible, potentially enabling such algorithms to be used effectively in future computing workflows and the FPGA-based Level-1 trigger at the CERN Large Hadron Collider. △ Less

Submitted 30 November, 2020; originally announced December 2020.

Comments: 8 pages, 4 figures, To appear in Third Workshop on Machine Learning and the Physical Sciences (NeurIPS 2020)

Report number: FERMILAB-CONF-20-622-CMS-SCD

Graph Neural Networks for Particle Tracking and Reconstruction

Authors: Javier Duarte, Jean-Roch Vlimant

Abstract: Machine learning methods have a long history of applications in high energy physics (HEP). Recently, there is a growing interest in exploiting these methods to reconstruct particle signatures from raw detector data. In order to benefit from modern deep learning algorithms that were initially designed for computer vision or natural language processing tasks, it is common practice to transform HEP d… ▽ More Machine learning methods have a long history of applications in high energy physics (HEP). Recently, there is a growing interest in exploiting these methods to reconstruct particle signatures from raw detector data. In order to benefit from modern deep learning algorithms that were initially designed for computer vision or natural language processing tasks, it is common practice to transform HEP data into images or sequences. Conversely, graph neural networks (GNNs), which operate on graph data composed of elements with a set of features and their pairwise connections, provide an alternative way of incorporating weight sharing, local connectivity, and specialized domain knowledge. Particle physics data, such as the hits in a tracking detector, can generally be represented as graphs, making the use of GNNs natural. In this chapter, we recapitulate the mathematical formalism of GNNs and highlight aspects to consider when designing these networks for HEP data, including graph construction, model architectures, learning objectives, and graph pooling. We also review promising applications of GNNs for particle tracking and reconstruction in HEP and summarize the outlook for their deployment in current and future experiments. △ Less

Submitted 7 December, 2020; v1 submitted 2 December, 2020; originally announced December 2020.

Comments: 44 pages, 20 figures. Submitted for review. To appear in "Artificial Intelligence for Particle Physics", World Scientific Publishing

Journal ref: Artificial Intelligence for High Energy Physics, Chapter 12, pp. 387-436 (2022)

Graph Generative Adversarial Networks for Sparse Data Generation in High Energy Physics

Authors: Raghav Kansal, Javier Duarte, Breno Orzari, Thiago Tomei, Maurizio Pierini, Mary Touranakou, Jean-Roch Vlimant, Dimitrios Gunopulos

Abstract: We develop a graph generative adversarial network to generate sparse data sets like those produced at the CERN Large Hadron Collider (LHC). We demonstrate this approach by training on and generating sparse representations of MNIST handwritten digit images and jets of particles in proton-proton collisions like those at the LHC. We find the model successfully generates sparse MNIST digits and partic… ▽ More We develop a graph generative adversarial network to generate sparse data sets like those produced at the CERN Large Hadron Collider (LHC). We demonstrate this approach by training on and generating sparse representations of MNIST handwritten digit images and jets of particles in proton-proton collisions like those at the LHC. We find the model successfully generates sparse MNIST digits and particle jet data. We quantify agreement between real and generated data with a graph-based Fréchet Inception distance, and the particle and jet feature-level 1-Wasserstein distance for the MNIST and jet datasets respectively. △ Less

Submitted 30 January, 2021; v1 submitted 30 November, 2020; originally announced December 2020.

Comments: 9 pages, 4 figures, 4 tables, To appear in Third Workshop on Machine Learning and the Physical Sciences (NeurIPS 2020)

Real-time Artificial Intelligence for Accelerator Control: A Study at the Fermilab Booster

Authors: Jason St. John, Christian Herwig, Diana Kafkes, Jovan Mitrevski, William A. Pellico, Gabriel N. Perdue, Andres Quintero-Parra, Brian A. Schupbach, Kiyomi Seiya, Nhan Tran, Malachi Schram, Javier M. Duarte, Yunzhi Huang, Rachael Keller

Abstract: We describe a method for precisely regulating the gradient magnet power supply at the Fermilab Booster accelerator complex using a neural network trained via reinforcement learning. We demonstrate preliminary results by training a surrogate machine-learning model on real accelerator data to emulate the Booster environment, and using this surrogate model in turn to train the neural network for its… ▽ More We describe a method for precisely regulating the gradient magnet power supply at the Fermilab Booster accelerator complex using a neural network trained via reinforcement learning. We demonstrate preliminary results by training a surrogate machine-learning model on real accelerator data to emulate the Booster environment, and using this surrogate model in turn to train the neural network for its regulation task. We additionally show how the neural networks to be deployed for control purposes may be compiled to execute on field-programmable gate arrays. This capability is important for operational stability in complicated environments such as an accelerator facility. △ Less

Submitted 20 October, 2021; v1 submitted 14 November, 2020; originally announced November 2020.

Comments: 16 pages, 10 figures. Phys. Rev. Accel. Beams vol 24, issue 10. Published 18 October 2021. For associated dataset and data sheet see http://doi.org/10.5281/zenodo.4088982

Report number: FERMILAB-PUB-20-565-AD-E-QIS-SCD

FPGAs-as-a-Service Toolkit (FaaST)

Authors: Dylan Sheldon Rankin, Jeffrey Krupa, Philip Harris, Maria Acosta Flechas, Burt Holzman, Thomas Klijnsma, Kevin Pedro, Nhan Tran, Scott Hauck, Shih-Chieh Hsu, Matthew Trahms, Kelvin Lin, Yu Lou, Ta-Wei Ho, Javier Duarte, Mia Liu

Abstract: Computing needs for high energy physics are already intensive and are expected to increase drastically in the coming years. In this context, heterogeneous computing, specifically as-a-service computing, has the potential for significant gains over traditional computing models. Although previous studies and packages in the field of heterogeneous computing have focused on GPUs as accelerators, FPGAs… ▽ More Computing needs for high energy physics are already intensive and are expected to increase drastically in the coming years. In this context, heterogeneous computing, specifically as-a-service computing, has the potential for significant gains over traditional computing models. Although previous studies and packages in the field of heterogeneous computing have focused on GPUs as accelerators, FPGAs are an extremely promising option as well. A series of workflows are developed to establish the performance capabilities of FPGAs as a service. Multiple different devices and a range of algorithms for use in high energy physics are studied. For a small, dense network, the throughput can be improved by an order of magnitude with respect to GPUs as a service. For large convolutional networks, the throughput is found to be comparable to GPUs as a service. This work represents the first open-source FPGAs-as-a-service toolkit. △ Less

Submitted 16 October, 2020; originally announced October 2020.

Comments: 10 pages, 7 figures, to appear in proceedings of the 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing

Report number: FERMILAB-CONF-20-426-SCD

Journal ref: 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing (H2RC), 2020, pp. 38-47

Faceting diagram for Ag segregation induced nanofaceting at an asymmetric Cu tilt grain boundary

Authors: Nicolas J. Peter, Maria J. Duarte, Christoph Kirchlechner, Christian H. Liebscher, Gerhard Dehm

Abstract: In this work, we experimentally establish the isothermal nanofacet evolution at an asymmetric tilt grain boundary in the Cu-Ag system using a diffusion couple approach. We investigate the nanofacet formation along the grain boundary in dependence of the Ag solute excess concentration. The initial grain boundary dissociates into asymmetric Ag-lean segments and Ag-rich symmetric (210) segments. Incr… ▽ More In this work, we experimentally establish the isothermal nanofacet evolution at an asymmetric tilt grain boundary in the Cu-Ag system using a diffusion couple approach. We investigate the nanofacet formation along the grain boundary in dependence of the Ag solute excess concentration. The initial grain boundary dissociates into asymmetric Ag-lean segments and Ag-rich symmetric (210) segments. Increasing Ag excess leads to an increase in Ag-rich facet segment length, while the length of the asymmetric facets remains constant. From this, we construct a grain boundary nanofaceting diagram deduced from our experiments relating local atomic structure, overall inclination and Ag solute excess. △ Less

Submitted 1 September, 2020; originally announced September 2020.

HL-LHC Computing Review: Common Tools and Community Software

Authors: HEP Software Foundation, :, Thea Aarrestad, Simone Amoroso, Markus Julian Atkinson, Joshua Bendavid, Tommaso Boccali, Andrea Bocci, Andy Buckley, Matteo Cacciari, Paolo Calafiura, Philippe Canal, Federico Carminati, Taylor Childers, Vitaliano Ciulli, Gloria Corti, Davide Costanzo, Justin Gage Dezoort, Caterina Doglioni, Javier Mauricio Duarte, Agnieszka Dziurda, Peter Elmer, Markus Elsing, V. Daniel Elvira, Giulio Eulisse , et al. (85 additional authors not shown)

Abstract: Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this doc… ▽ More Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this document we address the issues for software that is used in multiple experiments (usually even more widely than ATLAS and CMS) and maintained by teams of developers who are either not linked to a particular experiment or who contribute to common software within the context of their experiment activity. We also give space to general considerations for future software and projects that tackle upcoming challenges, no matter who writes it, which is an area where community convergence on best practice is extremely useful. △ Less

Submitted 31 August, 2020; originally announced August 2020.

Comments: 40 pages contribution to Snowmass 2021

Report number: HSF-DOC-2020-01

Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics

Authors: Yutaro Iiyama, Gianluca Cerminara, Abhijay Gupta, Jan Kieseler, Vladimir Loncar, Maurizio Pierini, Shah Rukh Qasim, Marcel Rieger, Sioni Summers, Gerrit Van Onsem, Kinga Wozniak, Jennifer Ngadiuba, Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Dylan Rankin, Sergo **dariani, Mia Liu, Kevin Pedro, Nhan Tran, Edward Kreinar, Zhenbin Wu

Abstract: Graph neural networks have been shown to achieve excellent performance for several crucial tasks in particle physics, such as charged particle tracking, jet tagging, and clustering. An important domain for the application of these networks is the FGPA-based first layer of real-time data filtering at the CERN Large Hadron Collider, which has strict latency and resource constraints. We discuss how t… ▽ More Graph neural networks have been shown to achieve excellent performance for several crucial tasks in particle physics, such as charged particle tracking, jet tagging, and clustering. An important domain for the application of these networks is the FGPA-based first layer of real-time data filtering at the CERN Large Hadron Collider, which has strict latency and resource constraints. We discuss how to design distance-weighted graph networks that can be executed with a latency of less than 1$μ\mathrm{s}$ on an FPGA. To do so, we consider a representative task associated to particle reconstruction and identification in a next-generation calorimeter operating at a particle collider. We use a graph network architecture developed for such purposes, and apply additional simplifications to match the computing constraints of Level-1 trigger systems, including weight quantization. Using the $\mathtt{hls4ml}$ library, we convert the compressed models into firmware to be implemented on an FPGA. Performance of the synthesized models is presented both in terms of inference accuracy and resource usage. △ Less

Submitted 3 February, 2021; v1 submitted 8 August, 2020; originally announced August 2020.

Comments: 15 pages, 4 figures

Report number: FERMILAB-PUB-20-405-E-SCD

Journal ref: Frontiers in Big Data 3 (2021) 44

GPU coprocessors as a service for deep learning inference in high energy physics

Authors: Jeffrey Krupa, Kelvin Lin, Maria Acosta Flechas, Jack Dinsmore, Javier Duarte, Philip Harris, Scott Hauck, Burt Holzman, Shih-Chieh Hsu, Thomas Klijnsma, Mia Liu, Kevin Pedro, Dylan Rankin, Natchanon Suaysom, Matt Trahms, Nhan Tran

Abstract: In the next decade, the demands for computing in large scientific experiments are expected to grow tremendously. During the same time period, CPU performance increases will be limited. At the CERN Large Hadron Collider (LHC), these two issues will confront one another as the collider is upgraded for high luminosity running. Alternative processors such as graphics processing units (GPUs) can resolv… ▽ More In the next decade, the demands for computing in large scientific experiments are expected to grow tremendously. During the same time period, CPU performance increases will be limited. At the CERN Large Hadron Collider (LHC), these two issues will confront one another as the collider is upgraded for high luminosity running. Alternative processors such as graphics processing units (GPUs) can resolve this confrontation provided that algorithms can be sufficiently accelerated. In many cases, algorithmic speedups are found to be largest through the adoption of deep learning algorithms. We present a comprehensive exploration of the use of GPU-based hardware acceleration for deep learning inference within the data reconstruction workflow of high energy physics. We present several realistic examples and discuss a strategy for the seamless integration of coprocessors so that the LHC can maintain, if not exceed, its current performance throughout its running. △ Less

Submitted 23 April, 2021; v1 submitted 20 July, 2020; originally announced July 2020.

Comments: 26 pages, 7 figures, 2 tables

Report number: FERMILAB-PUB-20-338-E-SCD

Journal ref: Mach. Learn.: Sci. Technol. 2 (2021) 035005

Early stage phase separation of AlCoCr0.75Cu0.5FeNi high-entropy powder at the nanoscale

Authors: Nicolas J. Peter, Maria J. Duarte, Christian H. Liebscher, Vikas C. Srivastava, Volker Uhlenwinkel, Eric A. Jägle, Gerhard Dehm

Abstract: High entropy alloys are generally considered to be single phase material. This state is, however, typically a non-equilibrium state after fabrication at high cooling rates. Phase constitution after fabrication or heat treatment is mostly known for isothermal annealing only and for casts as well as rapidly quenched alloys. Knowledge on early phase separation stages of high entropy alloys and their… ▽ More High entropy alloys are generally considered to be single phase material. This state is, however, typically a non-equilibrium state after fabrication at high cooling rates. Phase constitution after fabrication or heat treatment is mostly known for isothermal annealing only and for casts as well as rapidly quenched alloys. Knowledge on early phase separation stages of high entropy alloys and their mechanisms are missing so far. Here, we present results on phase separation at intermediate cooling rates, by characterization of gas atomized powder of the AlCoCr0.75Cu0.5FeNi alloy. Although investigation by X-ray diffraction and Electron Backscatter Diffraction indicates a single-phase nature of the powder particles, aberration-corrected scanning transmission electron microscopy and atom probe tomography reveal a nanoscale phase separation into Ni-Al-rich B2 and Fe-Cr-rich A2 regions as well as a high number density of 3.1x1024 Cu-rich clusters per m3 in the B2 matrix. The observed phase separation and cluster formation are linked to spinodal decomposition and nucleation processes, respectively. The study highlights that adequate characterization techniques need to be chosen when making statements about phase stability and structural evolution in compositionally complex alloys. △ Less

Submitted 8 May, 2020; originally announced May 2020.

Comments: 33 pages, 12 figures

Journal ref: Journal of Alloys and Compounds, Volume 820, 2020, 153149

pexm: a JAGS module for applications involving the piecewise exponential distribution

Authors: Vinícius D. Mayrink, João Daniel N. Duarte, Fábio N. Demarqui

Abstract: In this study, we present a new module built for users interested in a programming language similar to BUGS to fit a Bayesian model based on the piecewise exponential (PE) distribution. The module is an extension to the open-source program JAGS by which a Gibbs sampler can be applied without requiring the derivation of complete conditionals and the subsequent implementation of strategies to draw s… ▽ More In this study, we present a new module built for users interested in a programming language similar to BUGS to fit a Bayesian model based on the piecewise exponential (PE) distribution. The module is an extension to the open-source program JAGS by which a Gibbs sampler can be applied without requiring the derivation of complete conditionals and the subsequent implementation of strategies to draw samples from unknown distributions. The PE distribution is widely used in the fields of survival analysis and reliability. Currently, it can only be implemented in JAGS through methods to indirectly specify the likelihood based on the Poisson or Bernoulli probabilities. Our module provides a more straightforward implementation and is thus more attractive to the researchers aiming to spend more time exploring the results from the Bayesian inference rather than implementing the Markov Chain Monte Carlo (MCMC) algorithm. For those interested in extending JAGS, this work can be seen as a tutorial including important information not well investigated or organized in other materials. Here, we describe how to use the module taking advantage of the interface between R and JAGS. A short simulation study is developed to ensure that the module behaves well and a real illustration, involving two PE models, exhibits a context where the module can be used in practice. △ Less

Submitted 26 April, 2020; originally announced April 2020.

Comments: 19 pages, 5 figures, 2 tables

MSC Class: 62-XX; 62-04 ACM Class: G.3

Compressing deep neural networks on FPGAs to binary and ternary precision with HLS4ML

Authors: Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Duc Hoang, Sergo **dariani, Edward Kreinar, Mia Liu, Vladimir Loncar, Jennifer Ngadiuba, Kevin Pedro, Maurizio Pierini, Dylan Rankin, Sheila Sagear, Sioni Summers, Nhan Tran, Zhenbin Wu

Abstract: We present the implementation of binary and ternary neural networks in the hls4ml library, designed to automatically convert deep neural network models to digital circuits with FPGA firmware. Starting from benchmark models trained with floating point precision, we investigate different strategies to reduce the network's resource consumption by reducing the numerical precision of the network parame… ▽ More We present the implementation of binary and ternary neural networks in the hls4ml library, designed to automatically convert deep neural network models to digital circuits with FPGA firmware. Starting from benchmark models trained with floating point precision, we investigate different strategies to reduce the network's resource consumption by reducing the numerical precision of the network parameters to binary or ternary. We discuss the trade-off between model accuracy and resource consumption. In addition, we show how to balance between latency and accuracy by retaining full precision on a selected subset of network components. As an example, we consider two multiclass classification tasks: handwritten digit recognition with the MNIST data set and jet identification with simulated proton-proton collisions at the CERN Large Hadron Collider. The binary and ternary implementation has similar performance to the higher precision implementation while using drastically fewer FPGA resources. △ Less

Submitted 29 June, 2020; v1 submitted 11 March, 2020; originally announced March 2020.

Comments: Update to MLST journal version

Report number: FERMILAB-PUB-20-167-PPD-SCD

Journal ref: Mach. Learn.: Sci. Technol. 2, 015001 (2020)

Fast inference of Boosted Decision Trees in FPGAs for particle physics

Authors: Sioni Summers, Giuseppe Di Guglielmo, Javier Duarte, Philip Harris, Duc Hoang, Sergo **dariani, Edward Kreinar, Vladimir Loncar, Jennifer Ngadiuba, Maurizio Pierini, Dylan Rankin, Nhan Tran, Zhenbin Wu

Abstract: We describe the implementation of Boosted Decision Trees in the hls4ml library, which allows the translation of a trained model into FPGA firmware through an automated conversion process. Thanks to its fully on-chip implementation, hls4ml performs inference of Boosted Decision Tree models with extremely low latency. With a typical latency less than 100 ns, this solution is suitable for FPGA-based… ▽ More We describe the implementation of Boosted Decision Trees in the hls4ml library, which allows the translation of a trained model into FPGA firmware through an automated conversion process. Thanks to its fully on-chip implementation, hls4ml performs inference of Boosted Decision Tree models with extremely low latency. With a typical latency less than 100 ns, this solution is suitable for FPGA-based real-time processing, such as in the Level-1 Trigger system of a collider experiment. These developments open up prospects for physicists to deploy BDTs in FPGAs for identifying the origin of jets, better reconstructing the energies of muons, and enabling better selection of rare signal processes. △ Less

Submitted 19 February, 2020; v1 submitted 5 February, 2020; originally announced February 2020.

Journal ref: JINST 15 P05026 (2020)

Interaction networks for the identification of boosted $H\to b\overline{b}$ decays

Authors: Eric A. Moreno, Thong Q. Nguyen, Jean-Roch Vlimant, Olmo Cerri, Harvey B. Newman, Avikar Periwal, Maria Spiropulu, Javier M. Duarte, Maurizio Pierini

Abstract: We develop an algorithm based on an interaction network to identify high-transverse-momentum Higgs bosons decaying to bottom quark-antiquark pairs and distinguish them from ordinary jets that reflect the configurations of quarks and gluons at short distances. The algorithm's inputs are features of the reconstructed charged particles in a jet and the secondary vertices associated with them. Describ… ▽ More We develop an algorithm based on an interaction network to identify high-transverse-momentum Higgs bosons decaying to bottom quark-antiquark pairs and distinguish them from ordinary jets that reflect the configurations of quarks and gluons at short distances. The algorithm's inputs are features of the reconstructed charged particles in a jet and the secondary vertices associated with them. Describing the jet shower as a combination of particle-to-particle and particle-to-vertex interactions, the model is trained to learn a jet representation on which the classification problem is optimized. The algorithm is trained on simulated samples of realistic LHC collisions, released by the CMS Collaboration on the CERN Open Data Portal. The interaction network achieves a drastic improvement in the identification performance with respect to state-of-the-art algorithms. △ Less

Submitted 28 July, 2020; v1 submitted 26 September, 2019; originally announced September 2019.

Comments: 20 pages, 8 figures, 6 tables, version published in PRD

Report number: FERMILAB-PUB-19-492-CMS-E

Journal ref: Phys. Rev. D 102, 012010 (2020)

Computed stereo lensless X-ray imaging

Authors: J. Duarte, R. Cassin, J. Huijts, M. Kholodtsova, B. Iwan, M. Kovacev, M. Fajardo, F. Fortuna, L. Delbecq, W. Boutu, H. Merdji

Abstract: The ability to gain insights into the 3D properties of artificial or biological systems is often critical. However, 3D structures are difficult to retrieve at low dose and with extremely fast processing, as most techniques are based on acquiring and computing hundreds of 2D angular projections. This is even more challenging with ultrashort X-rays which allow realizing nanometre scale studies and u… ▽ More The ability to gain insights into the 3D properties of artificial or biological systems is often critical. However, 3D structures are difficult to retrieve at low dose and with extremely fast processing, as most techniques are based on acquiring and computing hundreds of 2D angular projections. This is even more challenging with ultrashort X-rays which allow realizing nanometre scale studies and ultrafast time resolved 2D movies. Here we show that computer stereo vision concepts can be transposed to X-rays. We demonstrate nanoscale three-dimensional reconstruction from a single ultrafast acquisition. Two diffraction patterns are recorded simultaneously on a single CCD camera and after phase retrieval two stereo images are reconstructed. A 3D representation of the sample is then computed from quantitative disparity maps with about 130x130x380nm3 voxel resolution in a snapshot of 20 femtoseconds. We extend our demonstration to phase contrast X-ray stereo imaging and reveal hidden 3D features of a sample. Computed phase stereo imaging will find scientific applications at X-ray free electron lasers, synchrotrons and laser-based sources, but also in fast industrial and medical 3D diagnostics. △ Less

Submitted 9 September, 2019; originally announced September 2019.

Journal ref: Nature Photonics 2019

Assessment of protein assembly prediction in CASP13

Authors: Dmytro Guzenko, Aleix Lafita, Bohdan Monastyrskyy, Andriy Kryshtafovych, Jose M. Duarte

Abstract: We present the assembly category assessment in the 13th edition of the CASP community-wide experiment. For the second time, protein assemblies constitute an independent assessment category. Compared to the last edition we see a clear uptake in participation, more oligomeric targets released, and consistent, albeit modest, improvement of the predictions quality. Looking at the tertiary structure pr… ▽ More We present the assembly category assessment in the 13th edition of the CASP community-wide experiment. For the second time, protein assemblies constitute an independent assessment category. Compared to the last edition we see a clear uptake in participation, more oligomeric targets released, and consistent, albeit modest, improvement of the predictions quality. Looking at the tertiary structure predictions we observe that ignoring the oligomeric state of the targets hinders modelling success. We also note that some contact prediction groups successfully predicted homomeric interfacial contacts, though it appears that these predictions were not used for assembly modelling. Homology modelling with sizeable human intervention appears to form the basis of the assembly prediction techniques in this round of CASP. Future developments should see more integrated approaches to modelling where multiple subunits are a natural part of the modelling process, which would benefit the structure prediction field as a whole. △ Less

Submitted 20 August, 2019; originally announced August 2019.

JEDI-net: a jet identification algorithm based on interaction networks

Authors: Eric A. Moreno, Olmo Cerri, Javier M. Duarte, Harvey B. Newman, Thong Q. Nguyen, Avikar Periwal, Maurizio Pierini, Aidana Serikova, Maria Spiropulu, Jean-Roch Vlimant

Abstract: We investigate the performance of a jet identification algorithm based on interaction networks (JEDI-net) to identify all-hadronic decays of high-momentum heavy particles produced at the LHC and distinguish them from ordinary jets originating from the hadronization of quarks and gluons. The jet dynamics are described as a set of one-to-one interactions between the jet constituents. Based on a repr… ▽ More We investigate the performance of a jet identification algorithm based on interaction networks (JEDI-net) to identify all-hadronic decays of high-momentum heavy particles produced at the LHC and distinguish them from ordinary jets originating from the hadronization of quarks and gluons. The jet dynamics are described as a set of one-to-one interactions between the jet constituents. Based on a representation learned from these interactions, the jet is associated to one of the considered categories. Unlike other architectures, the JEDI-net models achieve their performance without special handling of the sparse input jet representation, extensive pre-processing, particle ordering, or specific assumptions regarding the underlying detector geometry. The presented models give better results with less model parameters, offering interesting prospects for LHC applications. △ Less

Submitted 27 January, 2020; v1 submitted 14 August, 2019; originally announced August 2019.

Comments: 16 pages, 9 figures, 7 tables

Report number: FERMILAB-PUB-19-360-PPD

Journal ref: Eur. Phys. J. C 80, 58 (2020)

Charged particle tracking with quantum annealing-inspired optimization

Authors: Alexander Zlokapa, Abhishek Anand, Jean-Roch Vlimant, Javier M. Duarte, Joshua Job, Daniel Lidar, Maria Spiropulu

Abstract: At the High Luminosity Large Hadron Collider (HL-LHC), traditional track reconstruction techniques that are critical for analysis are expected to face challenges due to scaling with track density. Quantum annealing has shown promise in its ability to solve combinatorial optimization problems amidst an ongoing effort to establish evidence of a quantum speedup. As a step towards exploiting such pote… ▽ More At the High Luminosity Large Hadron Collider (HL-LHC), traditional track reconstruction techniques that are critical for analysis are expected to face challenges due to scaling with track density. Quantum annealing has shown promise in its ability to solve combinatorial optimization problems amidst an ongoing effort to establish evidence of a quantum speedup. As a step towards exploiting such potential speedup, we investigate a track reconstruction approach by adapting the existing geometric Denby-Peterson (Hopfield) network method to the quantum annealing framework and to HL-LHC conditions. Furthermore, we develop additional techniques to embed the problem onto existing and near-term quantum annealing hardware. Results using simulated annealing and quantum annealing with the D-Wave 2X system on the TrackML dataset are presented, demonstrating the successful application of a quantum annealing-inspired algorithm to the track reconstruction challenge. We find that combinatorial optimization problems can effectively reconstruct tracks, suggesting possible applications for fast hardware-specific implementations at the LHC while leaving open the possibility of a quantum speedup for tracking. △ Less

Submitted 12 August, 2019; originally announced August 2019.

Comments: 18 pages, 21 figures

Journal ref: Quantum Mach. Intell. 3, 27 (2021)

FPGA-accelerated machine learning inference as a service for particle physics computing

Authors: Javier Duarte, Philip Harris, Scott Hauck, Burt Holzman, Shih-Chieh Hsu, Sergo **dariani, Suffian Khan, Benjamin Kreis, Brian Lee, Mia Liu, Vladimir Lončar, Jennifer Ngadiuba, Kevin Pedro, Brandon Perez, Maurizio Pierini, Dylan Rankin, Nhan Tran, Matthew Trahms, Aristeidis Tsaris, Colin Versteeg, Ted W. Way, Dustin Werran, Zhenbin Wu

Abstract: New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains. The growing applications of machine learning algorithms in particle physics for simulation, reconstruction, and analysis are naturally deployed on such platforms. We demonstrate that the acceleration of mach… ▽ More New heterogeneous computing paradigms on dedicated hardware with increased parallelization, such as Field Programmable Gate Arrays (FPGAs), offer exciting solutions with large potential gains. The growing applications of machine learning algorithms in particle physics for simulation, reconstruction, and analysis are naturally deployed on such platforms. We demonstrate that the acceleration of machine learning inference as a web service represents a heterogeneous computing solution for particle physics experiments that potentially requires minimal modification to the current computing model. As examples, we retrain the ResNet-50 convolutional neural network to demonstrate state-of-the-art performance for top quark jet tagging at the LHC and apply a ResNet-50 model with transfer learning for neutrino event classification. Using Project Brainwave by Microsoft to accelerate the ResNet-50 image classification model, we achieve average inference times of 60 (10) milliseconds with our experimental physics software framework using Brainwave as a cloud (edge or on-premises) service, representing an improvement by a factor of approximately 30 (175) in model inference latency over traditional CPU inference in current experimental hardware. A single FPGA service accessed by many CPUs achieves a throughput of 600--700 inferences per second using an image batch of one, comparable to large batch-size GPU throughput and significantly better than small batch-size GPU throughput. Deployed as an edge or cloud service for the particle physics computing model, coprocessor accelerators can have a higher duty cycle and are potentially much more cost-effective. △ Less

Submitted 16 October, 2019; v1 submitted 18 April, 2019; originally announced April 2019.

Comments: 16 pages, 14 figures, 2 tables

Report number: FERMILAB-PUB-19-170-CD-CMS-E-ND

Journal ref: Comput Softw Big Sci (2019) 3: 13

First Results on 3D Pixel Sensors Interconnected to the RD53A Readout Chip after Irradiation to $1\times$$10^{16}$neq cm$^{-2}$

Authors: M. Meschini, R. Ceccarelli, M. Dinardo, S. Gennai, L. Moroni, D. Zuolo, L. Demaria, E. Monteil, L. Gaioni, A. Messineo, E. Curras, J. Duarte, M. Fernandez, G. Gomez, A. Garcia, J. Gonzalez, E. Silva, I. Vila, G. F. Dalla Betta, R. Mendicino, M. Boscardin

Abstract: Results obtained with 3D columnar pixel sensors bump-bonded to the RD53A prototype readout chip are reported. The interconnected modules have been tested in a hadron beam before and after irradiation to a fluence of about $1\times$$10^{16}$neq cm$^{-2}$ (1MeV equivalent neutrons). All presented results are part of the CMS R&D activities in view of the pixel detector upgrade for the High Luminosity… ▽ More Results obtained with 3D columnar pixel sensors bump-bonded to the RD53A prototype readout chip are reported. The interconnected modules have been tested in a hadron beam before and after irradiation to a fluence of about $1\times$$10^{16}$neq cm$^{-2}$ (1MeV equivalent neutrons). All presented results are part of the CMS R&D activities in view of the pixel detector upgrade for the High Luminosity phase of the LHC at CERN (HL-LHC). A preliminary analysis of the collected data shows hit detection efficiencies around 97% measured after proton irradiation. △ Less

Submitted 5 March, 2019; originally announced March 2019.

Comments: Conference Proceedings of PIXEL2018, 9$^{\text{th}}$ International Workshop on Semiconductor Pixel Detectors for Particles and Imaging, December 10-14, 2018, Academia Sinica, Taipei

Fast Reconstruction and Data Scouting

Authors: Javier Duarte

Abstract: Data scouting, introduced by CMS in 2011, is the use of specialized data streams based on reduced event content, enabling LHC experiments to record unprecedented numbers of proton-proton collision events that would otherwise be rejected by the usual filters. These streams were created to maintain sensitivity to new light resonances decaying to jets or muons, while requiring minimal online and offl… ▽ More Data scouting, introduced by CMS in 2011, is the use of specialized data streams based on reduced event content, enabling LHC experiments to record unprecedented numbers of proton-proton collision events that would otherwise be rejected by the usual filters. These streams were created to maintain sensitivity to new light resonances decaying to jets or muons, while requiring minimal online and offline resources, and taking advantage of the fast and accurate online reconstruction algorithms of the high-level trigger. The viability of this technique was demonstrated by CMS in 2012, when 18.8 fb$^{-1}$ of collision data at $\sqrt{s} = 8$ TeV were collected and analyzed. For LHC Run 2, CMS, ATLAS, and LHCb implemented or expanded similar reduced-content data streams, promoting the concept to an essential and flexible discovery tool for the LHC. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Comments: 8 pages, 5 figures; submitted to proceedings of Connecting the Dots 2018

Report number: FERMILAB-CONF-18-370-CMS-E-PPD

Machine Learning in High Energy Physics Community White Paper

Authors: Kim Albertsson, Piero Altoe, Dustin Anderson, John Anderson, Michael Andrews, Juan Pedro Araque Espinosa, Adam Aurisano, Laurent Basara, Adrian Bevan, Wahid Bhimji, Daniele Bonacorsi, Bjorn Burkle, Paolo Calafiura, Mario Campanelli, Louis Capps, Federico Carminati, Stefano Carrazza, Yi-fan Chen, Taylor Childers, Yann Coadou, Elias Coniavitis, Kyle Cranmer, Claire David, Douglas Davis, Andrea De Simone , et al. (103 additional authors not shown)

Abstract: Machine learning has been applied to several problems in particle physics research, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas for machine learning in particle physics. We d… ▽ More Machine learning has been applied to several problems in particle physics research, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas for machine learning in particle physics. We detail a roadmap for their implementation, software and hardware resource requirements, collaborative initiatives with the data science community, academia and industry, and training the particle physics community in data science. The main objective of the document is to connect and motivate these areas of research and development with the physics drivers of the High-Luminosity Large Hadron Collider and future neutrino experiments and identify the resource needs for their implementation. Additionally we identify areas where collaboration with external communities will be of great benefit. △ Less

Submitted 16 May, 2019; v1 submitted 8 July, 2018; originally announced July 2018.

Comments: Editors: Sergei Gleyzer, Paul Seyfert and Steven Schramm

Fast inference of deep neural networks in FPGAs for particle physics

Authors: Javier Duarte, Song Han, Philip Harris, Sergo **dariani, Edward Kreinar, Benjamin Kreis, Jennifer Ngadiuba, Maurizio Pierini, Ryan Rivera, Nhan Tran, Zhenbin Wu

Abstract: Recent results at the Large Hadron Collider (LHC) have pointed to enhanced physics capabilities through the improvement of the real-time event processing techniques. Machine learning methods are ubiquitous and have proven to be very powerful in LHC physics, and particle physics as a whole. However, exploration of the use of such techniques in low-latency, low-power FPGA hardware has only just begu… ▽ More Recent results at the Large Hadron Collider (LHC) have pointed to enhanced physics capabilities through the improvement of the real-time event processing techniques. Machine learning methods are ubiquitous and have proven to be very powerful in LHC physics, and particle physics as a whole. However, exploration of the use of such techniques in low-latency, low-power FPGA hardware has only just begun. FPGA-based trigger and data acquisition (DAQ) systems have extremely low, sub-microsecond latency requirements that are unique to particle physics. We present a case study for neural network inference in FPGAs focusing on a classifier for jet substructure which would enable, among many other physics scenarios, searches for new dark sector particles and novel measurements of the Higgs boson. While we focus on a specific example, the lessons are far-reaching. We develop a package based on High-Level Synthesis (HLS) called hls4ml to build machine learning models in FPGAs. The use of HLS increases accessibility across a broad user community and allows for a drastic decrease in firmware development time. We map out FPGA resource usage and latency versus neural network hyperparameters to identify the problems in particle physics that would benefit from performing neural network inference with FPGAs. For our example jet substructure model, we fit well within the available resources of modern FPGAs with a latency on the scale of 100 ns. △ Less

Submitted 28 June, 2018; v1 submitted 16 April, 2018; originally announced April 2018.

Comments: 22 pages, 17 figures, 2 tables, JINST revision

Report number: FERMILAB-PUB-18-089-E

Journal ref: JINST 13 P07027 (2018)

Measurement of 1323 and 1487 keV resonances in 15N(α, γ)19F with the recoil separator ERNA

Authors: A. Di Leva, G. Imbriani, R. Buompane, L. Gialanella, A. Best, S. Cristallo, M. De Cesare, A. D'Onofrio, J. G. Duarte, L. R. Gasques, L. Morales-Gallegos, A. Pezzella, G. Porzio, D. Rapagnani, V. Roca, M. Romoli, D. Schürmann, O. Straniero, F. Terrasi

Abstract: The origin of fluorine is a widely debated issue. Nevertheless, the ^{15}N(α,γ)^{19}F reaction is a common feature among the various production channels so far proposed. Its reaction rate at relevant temperatures is determined by a number of narrow resonances together with the DC component and the tails of the two broad resonances at E_{c.m.} = 1323 and 1487 keV. Measurement through the direct det… ▽ More The origin of fluorine is a widely debated issue. Nevertheless, the ^{15}N(α,γ)^{19}F reaction is a common feature among the various production channels so far proposed. Its reaction rate at relevant temperatures is determined by a number of narrow resonances together with the DC component and the tails of the two broad resonances at E_{c.m.} = 1323 and 1487 keV. Measurement through the direct detection of the 19F recoil ions with the European Recoil separator for Nuclear Astrophysics (ERNA) were performed. The reaction was initiated by a 15N beam im**ing onto a 4He windowless gas target. The observed yield of the resonances at Ec.m. = 1323 and 1487 keV is used to determine their widths in the α and γ channels. We show that a direct measurement of the cross section of the ^{15}N(α,γ)^{19}F reaction can be successfully obtained with the Recoil Separator ERNA, and the widths Γ_γ and Γ_α of the two broad resonances have been determined. While a fair agreement is found with earlier determination of the widths of the 1487 keV resonance, a significant difference is found for the 1323 keV resonance Γ_α . The revision of the widths of the two more relevant broad resonances in the 15N(α,γ)19F reaction presented in this work is the first step toward a more firm determination of the reaction rate. At present, the residual uncertainty at the temperatures of the ^{19}F stellar nucleosynthesis is dominated by the uncertainties affecting the Direct Capture component and the 364 keV narrow resonance, both so far investigated only through indirect experiments. △ Less

Submitted 10 April, 2017; originally announced April 2017.

Comments: 8 pages, 11 figures. Accepted for publication in PRC

Dynamic Modeling and Simulation of a Rotational Inverted Pendulum

Authors: J. L. Duarte, B. Montero, P. A. Ospina-Henao, E. Gonzalez

Abstract: This paper presents an alternative way to the dynamic modeling of a rotational inverted pendulum using the classic mechanics known as Euler-Lagrange allows to find motion equations that describe our model. It also has a design of the basic model of the system in SolidWorks software, which based on the material and dimensions of the model provides some physical variables necessary for modeling. In… ▽ More This paper presents an alternative way to the dynamic modeling of a rotational inverted pendulum using the classic mechanics known as Euler-Lagrange allows to find motion equations that describe our model. It also has a design of the basic model of the system in SolidWorks software, which based on the material and dimensions of the model provides some physical variables necessary for modeling. In order to verify the theoretical results, It was made a contrast between the solutions obtained by simulation SimMechanics-Matlab and the system of equations Euler-Lagrange, solved through ODE23tb method included in Matlab bookstores for solving equations systems of the type and order obtained. This article comprises a pendulum trajectory analysis by a phase space diagram that allows the identification of stable and unstable regions of the system. △ Less

Submitted 8 April, 2017; originally announced April 2017.

Journal ref: VIII International Congress of Engineering Physics IOP Conf. Series: Journal of Physics: Conf. Series 792 (2017) 012081

Squark-mediated Higgs+jets production at the LHC

Authors: J. Duarte, C. Peña, A. Wang, M. Pierini, M. Spiropulu

Abstract: We investigate possible scenarios of light-squark production at the LHC as a new mechanism to produce Higgs bosons in association with jets. The study is motivated by the SUSY search for H+jets events, performed by the CMS collaboration on 8 and 13 TeV data using the razor variables. Two simplified models are proposed to interpret the observations in this search. The constraint from Run I and the… ▽ More We investigate possible scenarios of light-squark production at the LHC as a new mechanism to produce Higgs bosons in association with jets. The study is motivated by the SUSY search for H+jets events, performed by the CMS collaboration on 8 and 13 TeV data using the razor variables. Two simplified models are proposed to interpret the observations in this search. The constraint from Run I and the implications for Run II and beyond are discussed. △ Less

Submitted 19 March, 2017; originally announced March 2017.

Rheology of fractal networks

Authors: Pedro Patricio, Catarina R. Leal, Jorge Duarte, Cristina Januario

Abstract: We model the cytoskeleton as a fractal network by identifying each segment with a simple Kelvin-Voigt element, with a well defined equilibrium length. The final structure retains the elastic characteristics of a solid or a gel, which may support stress, without relaxing. By considering a very simple regular self-similar structure of segments in series and in parallel, in 1, 2 or 3 dimensions, we a… ▽ More We model the cytoskeleton as a fractal network by identifying each segment with a simple Kelvin-Voigt element, with a well defined equilibrium length. The final structure retains the elastic characteristics of a solid or a gel, which may support stress, without relaxing. By considering a very simple regular self-similar structure of segments in series and in parallel, in 1, 2 or 3 dimensions, we are able to express the viscoelasticity of the network as an effective generalised Kelvin-Voigt model with a power law spectrum of retardation times, $\cal L\simτ^α$. We relate the parameter $α$ with the fractal dimension of the gel. In some regimes ($0<α<1$), we recover the weak power law behaviours of the elastic and viscous moduli with the angular frequencies, $G'\sim G''\sim w^α$, that occur in a variety of soft materials, including living cells. In other regimes, we find different power laws for $G'$ and $G''$. △ Less

Submitted 3 August, 2015; v1 submitted 5 June, 2015; originally announced June 2015.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. E 92, 040702 (2015)

Activation of effector immune cells promotes tumor stochastic extinction: A homotopy analysis approach

Authors: Josep Sardanyés, Carla Rodrigues, Cristina Januário, Nuno Martins, Gabriel Gil-Gómez, Jorge Duarte

Abstract: In this article we provide homotopy solutions of a cancer nonlinear model describing the dynamics of tumor cells in interaction with healthy and effector immune cells. We apply a semi-analytic technique for solving strongly nonlinear systems - the Step Homotopy Analysis Method (SHAM). This algorithm, based on a modification of the standard homotopy analysis method (HAM), allows to obtain a one-par… ▽ More In this article we provide homotopy solutions of a cancer nonlinear model describing the dynamics of tumor cells in interaction with healthy and effector immune cells. We apply a semi-analytic technique for solving strongly nonlinear systems - the Step Homotopy Analysis Method (SHAM). This algorithm, based on a modification of the standard homotopy analysis method (HAM), allows to obtain a one-parameter family of explicit series solutions. By using the homotopy solutions, we first investigate the dynamical effect of the activation of the effector immune cells in the deterministic dynamics, showing that an increased activation makes the system to enter into chaotic dynamics via a period-doubling bifurcation scenario. Then, by adding demographic stochasticity into the homotopy solutions, we show, as a difference from the deterministic dynamics, that an increased activation of the immune cells facilitates cancer clearance involving tumor cells extinction and healthy cells persistence. Our results highlight the importance of therapies activating the effector immune cells at early stages of cancer progression. △ Less

Submitted 28 November, 2014; originally announced November 2014.

Low-cost educational robotics applied to physics teaching in Brazil

Authors: Marcos A. M. Souza, José R. R. Duarte

Abstract: In this paper we propose strategies and methodologies of teaching topics in high school physics, through a show of Educational Robotics. The Exhibition was part of a set of actions promoted by a brazilian government program of incentive for teaching activities (PIBID) and whose primary focus is the training of teachers, improvement of teaching in public schools, dissemination of science and format… ▽ More In this paper we propose strategies and methodologies of teaching topics in high school physics, through a show of Educational Robotics. The Exhibition was part of a set of actions promoted by a brazilian government program of incentive for teaching activities (PIBID) and whose primary focus is the training of teachers, improvement of teaching in public schools, dissemination of science and formation of new scientists and researchers. By means of workshops, banners and prototy** of robotics, we are able to create a connection between the study areas and their surrounding, making learning meaningful and accessible for the students involved and contributing to their cognitive development. △ Less

Submitted 19 June, 2015; v1 submitted 19 November, 2014; originally announced November 2014.

Comments: 5 pages and 10 figures

Journal ref: Phys. Educ. 50 (2015) 482-488

Observation of the rare $B^0_s\toμ^+μ^-$ decay from the combined analysis of CMS and LHCb data

Authors: The CMS, LHCb Collaborations, :, V. Khachatryan, A. M. Sirunyan, A. Tumasyan, W. Adam, T. Bergauer, M. Dragicevic, J. Erö, M. Friedl, R. Frühwirth, V. M. Ghete, C. Hartl, N. Hörmann, J. Hrubec, M. Jeitler, W. Kiesenhofer, V. Knünz, M. Krammer, I. Krätschmer, D. Liko, I. Mikulec, D. Rabady, B. Rahbaran , et al. (2807 additional authors not shown)

Abstract: A joint measurement is presented of the branching fractions $B^0_s\toμ^+μ^-$ and $B^0\toμ^+μ^-$ in proton-proton collisions at the LHC by the CMS and LHCb experiments. The data samples were collected in 2011 at a centre-of-mass energy of 7 TeV, and in 2012 at 8 TeV. The combined analysis produces the first observation of the $B^0_s\toμ^+μ^-$ decay, with a statistical significance exceeding six sta… ▽ More A joint measurement is presented of the branching fractions $B^0_s\toμ^+μ^-$ and $B^0\toμ^+μ^-$ in proton-proton collisions at the LHC by the CMS and LHCb experiments. The data samples were collected in 2011 at a centre-of-mass energy of 7 TeV, and in 2012 at 8 TeV. The combined analysis produces the first observation of the $B^0_s\toμ^+μ^-$ decay, with a statistical significance exceeding six standard deviations, and the best measurement of its branching fraction so far. Furthermore, evidence for the $B^0\toμ^+μ^-$ decay is obtained with a statistical significance of three standard deviations. The branching fraction measurements are statistically compatible with SM predictions and impose stringent constraints on several theories beyond the SM. △ Less

Submitted 17 August, 2015; v1 submitted 17 November, 2014; originally announced November 2014.

Comments: Correspondence should be addressed to [email protected]

Report number: CERN-PH-EP-2014-220, CMS-BPH-13-007, LHCb-PAPER-2014-049

Journal ref: Nature 522, 68-72 (04 June 2015)

Search for natural Supersymmetry in events with 1 b-tagged jet using razor variables at 8 TeV

Authors: Javier Duarte

Abstract: We discuss a search for natural Supersymmetry in events with at least one bottom-quark jet using razor variables in proton-proton collisions at 8 TeV with the CMS detector. The event distribution in the plane defined by the razor variables $R^2$ and $M_R$ is studied, searching for a peaking signal on top of a smoothly falling standard model background. The data are consistent with the expected bac… ▽ More We discuss a search for natural Supersymmetry in events with at least one bottom-quark jet using razor variables in proton-proton collisions at 8 TeV with the CMS detector. The event distribution in the plane defined by the razor variables $R^2$ and $M_R$ is studied, searching for a peaking signal on top of a smoothly falling standard model background. The data are consistent with the expected background, modeled by a template function. The 95% C.L. exclusion limit on the masses of the gluino and lightest supersymmetric particle in a benchmark simplified model is presented. For a lightest supersymmetric particle mass of 100 GeV, the pair production of gluinos in a multi-bottom final state is excluded for gluino masses up to 1375 GeV. △ Less

Submitted 15 September, 2014; originally announced September 2014.

Comments: LHCP Conference 2014

Element-Resolved Corrosion Analysis of Stainless-Type Glass-Forming Steels

Authors: M. J. Duarte, J. Klemm, S. O. Klemm, K. J. J. Mayrhofer, M. Stratmann, S. Borodin, A. H. Romero, M. Madinehe, D. Crespo, J. Serrano, S. S. A. Gerstl, P. P. Choi, D. Raabe, F. U. Renner

Abstract: Ultrathin passive films effectively prevent the chemical attack of stainless steel grades in corrosive environments; their stability critically depends on the interplay between structure and chemistry of the constituents Fe-Cr-Mo. In particular, nanoscale inhomogeneities along the surface can have a tremendous impact on material failure, but are yet barely understood. Addressing a stainless-type g… ▽ More Ultrathin passive films effectively prevent the chemical attack of stainless steel grades in corrosive environments; their stability critically depends on the interplay between structure and chemistry of the constituents Fe-Cr-Mo. In particular, nanoscale inhomogeneities along the surface can have a tremendous impact on material failure, but are yet barely understood. Addressing a stainless-type glass-forming Fe50Cr15Mo14C15B6 alloy and utilizing a combination of complementary high-resolution analytical techniques, we relate near-atomistic insight into different gradual nanostructures with time- and element-resolved dissolution behavior. The progressive elemental segregation on the nanoscale is followed in its influence on the concomitant degree of passivity. A detrimental transition from Cr-controlled passivity to Mo-controlled breakdown is dissected atom-by-atom demonstrating the importance of nanoscale knowledge for understanding corrosion. △ Less

Submitted 13 February, 2014; originally announced February 2014.

Journal ref: Science volume 341, 372 (2013)

Charged lepton mixing processes in 331 Models

Authors: J. M. Cabarcas, J. Duarte, J. -Alexis Rodriguez

Abstract: Processes $τ\rightarrow lγ$, $τ\rightarrow lll$ with $l= e,μ$ and $μ(τ) \to e (μ) γ$ are evaluated in the framework of a model based on the extended symmetry gauge $SU(3)_c \otimes SU(3)_L \otimes U(1)_Y$ with a leptonic sector consistent of five triplets. Lepton flavor violating processes are allowed at tree level in this model through the new $Z'$ gauge boson. We obtained bounds for the mixing a… ▽ More Processes $τ\rightarrow lγ$, $τ\rightarrow lll$ with $l= e,μ$ and $μ(τ) \to e (μ) γ$ are evaluated in the framework of a model based on the extended symmetry gauge $SU(3)_c \otimes SU(3)_L \otimes U(1)_Y$ with a leptonic sector consistent of five triplets. Lepton flavor violating processes are allowed at tree level in this model through the new $Z'$ gauge boson. We obtained bounds for the mixing angles in the leptonic sector of the model, considering the experimental measurements of the processes from the BELLE and the BABAR collaborations. △ Less

Submitted 6 December, 2013; v1 submitted 4 October, 2013; originally announced October 2013.

Comments: arXiv admin note: substantial text overlap with arXiv:1212.3586

Journal ref: International Journal of Modern Physics A, February 2014, Vol. 29, No. 03n04

Forward tracking at the next \boldmath{$e^+e^-$} collider Part II: experimental challenges and detector design

Authors: Steve Aplin, Marça Boronat, Dominik Dannheim, Jordi Duarte, F. Gaede, Alberto Ruiz-Jimeno, Andre Sailer, Manfred Valentan, Ivan Vila, Marcel Vos

Abstract: We present the second in a series of studies into the forward tracking system for a future linear $ e^+ e^- $ collider with a center-of-mass energy in the range from 250 GeV to 3 TeV. In this note a number of specific challenges are investigated, that have caused a degradation of the tracking and vertexing performance in the forward region in previous experiments. We perform a quantitative analysi… ▽ More We present the second in a series of studies into the forward tracking system for a future linear $ e^+ e^- $ collider with a center-of-mass energy in the range from 250 GeV to 3 TeV. In this note a number of specific challenges are investigated, that have caused a degradation of the tracking and vertexing performance in the forward region in previous experiments. We perform a quantitative analysis of the dependence of the tracking performance on detector design parameters and identify several ways to mitigate the performance loss for charged particles emitted at shallow angle. △ Less

Submitted 26 March, 2013; v1 submitted 13 March, 2013; originally announced March 2013.

Lepton Flavor Violation processes in 331 Models

Authors: J. M. Cabarcas, J. Duarte, J. -Alexis Rodriguez

Abstract: Models based on the extended symmetry gauge $SU(3)_c \otimes SU(3)_L \otimes U(1)_Y$ can be build up with a leptonic sector consistent of five triplets in different $SU(3)_L$ representations where additional heavy fermions are included. Some of these models present flavor changing neutral currents in the leptonic sector which are mediated through the $Z'$ boson. One of these models is studied usin… ▽ More Models based on the extended symmetry gauge $SU(3)_c \otimes SU(3)_L \otimes U(1)_Y$ can be build up with a leptonic sector consistent of five triplets in different $SU(3)_L$ representations where additional heavy fermions are included. Some of these models present flavor changing neutral currents in the leptonic sector which are mediated through the $Z'$ boson. One of these models is studied using the measurements of lepton flavor violation processes such as $τ\rightarrow lll$ with $l= e,μ$ and $μ(τ) \to e (μ) γ$. △ Less

Submitted 30 September, 2013; v1 submitted 14 December, 2012; originally announced December 2012.

Comments: Proceedings, The XIth International Conference on Heavy Quarks and Leptons, 11-15 June, 2012. Prague,The Czech Republic

Sources of FCNC in $SU(3)_C \otimes SU(3)_L \otimes U(1)_X$ models

Authors: J. M. Cabarcas, J. Duarte, J-Alexis Rodriguez

Abstract: There are different models based on the gauge symmetry $SU(3)_C \otimes SU(3)_L \otimes U(1)_X$ (331) some of them includes exotic particles and others are constructed without any exotic charges assigned to the fermionic spectrum. Each model build up on 331 symmetry has its own interesting properties according to the representations of the gauge group used for the fermionic spectrum; that is the m… ▽ More There are different models based on the gauge symmetry $SU(3)_C \otimes SU(3)_L \otimes U(1)_X$ (331) some of them includes exotic particles and others are constructed without any exotic charges assigned to the fermionic spectrum. Each model build up on 331 symmetry has its own interesting properties according to the representations of the gauge group used for the fermionic spectrum; that is the main reason to explore and identify the possible sources of flavor changing neutral currents and lepton flavor violation at tree level. △ Less

Submitted 1 November, 2011; originally announced November 2011.

Comments: 14 pages, Prepared for the special issue "Non-Abelian Gauge Symmetries beyond the Standard Model" of Advances in High Energy Physics