-
Controls at the Fermilab PIP-II Superconducting Linac
Authors:
Dennis J. Nicklaus,
Pierrick Hanlet,
Charles King,
Daniel McArthur,
Richard Neswold
Abstract:
PIP-II is an 800 MeV superconducting RF linear accelerator under development at Fermilab. As the new first stage in our accelerator chain, it will deliver high-power beam to multiple experiments simultaneously and thus drive Fermilab's particle physics program for years to come. In a pivot for Fermilab, controls for PIP-II are based on EPICS instead of ACNET, the legacy control system for accelera…
▽ More
PIP-II is an 800 MeV superconducting RF linear accelerator under development at Fermilab. As the new first stage in our accelerator chain, it will deliver high-power beam to multiple experiments simultaneously and thus drive Fermilab's particle physics program for years to come. In a pivot for Fermilab, controls for PIP-II are based on EPICS instead of ACNET, the legacy control system for accelerators at the lab. This paper discusses the status of the EPICS controls work for PIP-II. We describe the EPICS tools selected for our system and the experience of operators new to EPICS. We introduce our continuous integration / continuous development environment. We also describe some efforts at cooperation between EPICS and ACNET, or efforts to move towards a unified interface that can apply to both control systems.
△ Less
Submitted 26 January, 2024;
originally announced January 2024.
-
ML-based Real-Time Control at the Edge: An Approach Using hls4ml
Authors:
R. Shi,
S. Ogrenci,
J. M. Arnold,
J. R. Berlioz,
P. Hanlet,
K. J. Hazelwood,
M. A. Ibrahim,
H. Liu,
V. P. Nagaslaev,
A. Narayanan 1,
D. J. Nicklaus,
J. Mitrevski,
G. Pradhan,
A. L. Saewert,
B. A. Schupbach,
K. Seiya,
M. Thieme,
R. M. Thurman-Keup,
N. V. Tran
Abstract:
This study focuses on implementing a real-time control system for a particle accelerator facility that performs high energy physics experiments. A critical operating parameter in this facility is beam loss, which is the fraction of particles deviating from the accelerated proton beam into a cascade of secondary particles. Accelerators employ a large number of sensors to monitor beam loss. The data…
▽ More
This study focuses on implementing a real-time control system for a particle accelerator facility that performs high energy physics experiments. A critical operating parameter in this facility is beam loss, which is the fraction of particles deviating from the accelerated proton beam into a cascade of secondary particles. Accelerators employ a large number of sensors to monitor beam loss. The data from these sensors is monitored by human operators who predict the relative contribution of different sub-systems to the beam loss. Using this information, they engage control interventions. In this paper, we present a controller to track this phenomenon in real-time using edge-Machine Learning (ML) and support control with low latency and high accuracy. We implemented this system on an Intel Arria 10 SoC. Optimizations at the algorithm, high-level synthesis, and interface levels to improve latency and resource usage are presented. Our design implements a neural network, which can predict the main source of beam loss (between two possible causes) at speeds up to 575 frames per second (fps) (average latency of 1.74 ms). The practical deployed system is required to operate at 320 fps, with a 3ms latency requirement, which has been met by our design successfully.
△ Less
Submitted 9 November, 2023;
originally announced November 2023.
-
Synchronous High-frequency Distributed Readout For Edge Processing At The Fermilab Main Injector And Recycler
Authors:
J. R. Berlioz,
M. R. Austin,
J. M. Arnold,
K. J. Hazelwood,
P. Hanlet,
M. A. Ibrahim,
A. Narayanan,
D. J. Nicklaus,
G. Praudhan,
A. L. Saewert,
B. A. Schupbach,
K. Seiya,
R. M. Thurman-Keup,
N. V. Tran,
J. Jang,
H. Liu,
S. Memik,
R. Shi,
M. Thieme,
D. Ulusel
Abstract:
The Main Injector (MI) was commissioned using data acquisition systems developed for the Fermilab Main Ring in the 1980s. New VME-based instrumentation was commissioned in 2006 for beam loss monitors (BLM)[2], which provided a more systematic study of the machine and improved displays of routine operation. However, current projects are demanding more data and at a faster rate from this aging hardw…
▽ More
The Main Injector (MI) was commissioned using data acquisition systems developed for the Fermilab Main Ring in the 1980s. New VME-based instrumentation was commissioned in 2006 for beam loss monitors (BLM)[2], which provided a more systematic study of the machine and improved displays of routine operation. However, current projects are demanding more data and at a faster rate from this aging hardware. One such project, Real-time Edge AI for Distributed Systems (READS), requires the high-frequency, low-latency collection of synchronized BLM readings from around the approximately two-mile accelerator complex. Significant work has been done to develop new hardware to monitor the VME backplane and broadcast BLM measurements over Ethernet, while not disrupting the existing operations critical functions of the BLM system. This paper will detail the design, implementation, and testing of this parallel data pathway.
△ Less
Submitted 31 August, 2022;
originally announced August 2022.
-
Accelerator Real-time Edge AI for Distributed Systems (READS) Proposal
Authors:
K. Seiya,
K. J. Hazelwood,
M. A. Ibrahim,
V. P. Nagaslaev,
D. J. Nicklaus,
B. A. Schupbach,
R. M. Thurman-Keup,
N. V. Tran,
H. Liu,
S. Memik
Abstract:
Our objective will be to integrate ML into Fermilab accelerator operations and furthermore provide an accessible framework which can also be used by a broad range of other accelerator systems with dynamic tuning needs. We will develop of real-time accelerator control using embedded ML on-chip hardware and fast communication between distributed systems in this proposal. We will demonstrate this tec…
▽ More
Our objective will be to integrate ML into Fermilab accelerator operations and furthermore provide an accessible framework which can also be used by a broad range of other accelerator systems with dynamic tuning needs. We will develop of real-time accelerator control using embedded ML on-chip hardware and fast communication between distributed systems in this proposal. We will demonstrate this technology for the Mu2e experiment by increasing the overall duty factor and uptime of the experiment through two synergistic projects. First, we will use deep reinforcement learning techniques to improve the performance of the regulation loop through guided optimization to provide stable proton beams extracted from the Delivery Ring to the Mu2e experiment. This requires the development of a digital twin of the system to model the accelerator and develop real-time ML algorithms. Second, we will use de-blending techniques to disentangle and classify overlap** beam losses in the Main Injector and Recycler Ring to reduce overall beam downtime in each machine. This ML model will be deployed within a semi-autonomous operational mode. Both applications require processing at the millisecond scale and will share similar ML-in-hardware techniques and beam instrumentation readout technology. A collaboration between Fermilab and Northwestern University will pull together the talents and resources of accelerator physicists, beam instrumentation engineers, embedded system architects, FPGA board design experts, and ML experts to solve complex real-time accelerator controls challenges which will enhance the physics program. More broadly, the framework developed for Accelerator Real-time Edge AI Distributed Systems (READS) can be applied to future projects as the accelerator complex is upgraded for the PIP-II and DUNE era.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.