-
Beyond PID Controllers: PPO with Neuralized PID Policy for Proton Beam Intensity Control in Mu2e
Authors:
Chenwei Xu,
Jerry Yao-Chieh Hu,
Aakaash Narayanan,
Mattson Thieme,
Vladimir Nagaslaev,
Mark Austin,
Jeremy Arnold,
Jose Berlioz,
Pierrick Hanlet,
Aisha Ibrahim,
Dennis Nicklaus,
Jovan Mitrevski,
Jason Michael St. John,
Gauri Pradhan,
Andrea Saewert,
Kiyomi Seiya,
Brian Schupbach,
Randy Thurman-Keup,
Nhan Tran,
Rui Shi,
Seda Ogrenci,
Alexis Maya-Isabelle Shu**,
Kyle Hazelwood,
Han Liu
Abstract:
We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an aut…
▽ More
We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an automated controller capable of providing real-time feedback and calibration of the Spill Regulation System (SRS) parameters on a millisecond timescale. We treat the Mu2e accelerator system as a Markov Decision Process suitable for Reinforcement Learning (RL), utilizing PPO to reduce bias and enhance training stability. A key innovation in our approach is the integration of a neuralized Proportional-Integral-Derivative (PID) controller into the policy function, resulting in a significant improvement in the Spill Duty Factor (SDF) by 13.6%, surpassing the performance of the current PID controller baseline by an additional 1.6%. This paper presents the preliminary offline results based on a differentiable simulator of the Mu2e accelerator. It paves the groundwork for real-time implementations and applications, representing a crucial step towards automated proton beam intensity control for the Mu2e experiment.
△ Less
Submitted 28 December, 2023;
originally announced December 2023.
-
The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT
Authors:
Nicholas Heller,
Fabian Isensee,
Dasha Trofimova,
Resha Tejpaul,
Zhongchen Zhao,
Huai Chen,
Lisheng Wang,
Alex Golts,
Daniel Khapun,
Daniel Shats,
Yoel Shoshan,
Flora Gilboa-Solomon,
Yasmeen George,
Xi Yang,
Jianpeng Zhang,
**g Zhang,
Yong Xia,
Mengran Wu,
Zhiyang Liu,
Ed Walczak,
Sean McSweeney,
Ranveer Vasdev,
Chris Hornung,
Rafat Solaiman,
Jamee Schoephoerster
, et al. (20 additional authors not shown)
Abstract:
This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Segmentation Challenge (KiTS21) held in conjunction with the 2021 international conference on Medical Image Computing and Computer Assisted Interventions (MICCAI). KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed, in addition to a larger dataset.…
▽ More
This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Segmentation Challenge (KiTS21) held in conjunction with the 2021 international conference on Medical Image Computing and Computer Assisted Interventions (MICCAI). KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed, in addition to a larger dataset. A novel annotation method was used to collect three separate annotations for each region of interest, and these annotations were performed in a fully transparent setting using a web-based annotation tool. Further, the KiTS21 test set was collected from an outside institution, challenging participants to develop methods that generalize well to new populations. Nonetheless, the top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance. An in-depth meta-analysis is presented describing which methods were used and how they faired on the leaderboard, as well as the characteristics of which cases generally saw good performance, and which did not. Overall KiTS21 facilitated a significant advancement in the state of the art in kidney tumor segmentation, and provides useful insights that are applicable to the field of semantic segmentation as a whole.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
Novel Subtypes of Pulmonary Emphysema Based on Spatially-Informed Lung Texture Learning
Authors:
Jie Yang,
Elsa D. Angelini,
Pallavi P. Balte,
Eric A. Hoffman,
John H. M. Austin,
Benjamin M. Smith,
R. Graham Barr,
Andrew F. Laine
Abstract:
Pulmonary emphysema overlaps considerably with chronic obstructive pulmonary disease (COPD), and is traditionally subcategorized into three subtypes previously identified on autopsy. Unsupervised learning of emphysema subtypes on computed tomography (CT) opens the way to new definitions of emphysema subtypes and eliminates the need of thorough manual labeling. However, CT-based emphysema subtypes…
▽ More
Pulmonary emphysema overlaps considerably with chronic obstructive pulmonary disease (COPD), and is traditionally subcategorized into three subtypes previously identified on autopsy. Unsupervised learning of emphysema subtypes on computed tomography (CT) opens the way to new definitions of emphysema subtypes and eliminates the need of thorough manual labeling. However, CT-based emphysema subtypes have been limited to texture-based patterns without considering spatial location. In this work, we introduce a standardized spatial map** of the lung for quantitative study of lung texture location, and propose a novel framework for combining spatial and texture information to discover spatially-informed lung texture patterns (sLTPs) that represent novel emphysema subtypes. Exploiting two cohorts of full-lung CT scans from the MESA COPD and EMCAP studies, we first show that our spatial map** enables population-wide study of emphysema spatial location. We then evaluate the characteristics of the sLTPs discovered on MESA COPD, and show that they are reproducible, able to encode standard emphysema subtypes, and associated with physiological symptoms.
△ Less
Submitted 9 July, 2020;
originally announced July 2020.
-
Explaining Radiological Emphysema Subtypes with Unsupervised Texture Prototypes: MESA COPD Study
Authors:
Jie Yang,
Elsa D. Angelini,
Benjamin M. Smith,
John H. M. Austin,
Eric A. Hoffman,
David A. Bluemke,
R. Graham Barr,
Andrew F. Laine
Abstract:
Pulmonary emphysema is traditionally subcategorized into three subtypes, which have distinct radiological appearances on computed tomography (CT) and can help with the diagnosis of chronic obstructive pulmonary disease (COPD). Automated texture-based quantification of emphysema subtypes has been successfully implemented via supervised learning of these three emphysema subtypes. In this work, we de…
▽ More
Pulmonary emphysema is traditionally subcategorized into three subtypes, which have distinct radiological appearances on computed tomography (CT) and can help with the diagnosis of chronic obstructive pulmonary disease (COPD). Automated texture-based quantification of emphysema subtypes has been successfully implemented via supervised learning of these three emphysema subtypes. In this work, we demonstrate that unsupervised learning on a large heterogeneous database of CT scans can generate texture prototypes that are visually homogeneous and distinct, reproducible across subjects, and capable of predicting accurately the three standard radiological subtypes. These texture prototypes enable automated labeling of lung volumes, and open the way to new interpretations of lung CT scans with finer subty** of emphysema.
△ Less
Submitted 5 December, 2016;
originally announced December 2016.
-
Sliding Window Spectrum Sensing for Full-Duplex Cognitive Radios with Low Access-Latency
Authors:
Orion Afisiadis,
Andrew C. M. Austin,
Alexios Balatsoukas-Stimming,
Andreas Burg
Abstract:
In a cognitive radio system the failure of secondary user (SU) transceivers to promptly vacate the channel can introduce significant access-latency for primary or high-priority users (PU). In conventional cognitive radio systems, the backoff latency is exacerbated by frame structures that only allow sensing at periodic intervals. Concurrent transmission and sensing using self-interference suppress…
▽ More
In a cognitive radio system the failure of secondary user (SU) transceivers to promptly vacate the channel can introduce significant access-latency for primary or high-priority users (PU). In conventional cognitive radio systems, the backoff latency is exacerbated by frame structures that only allow sensing at periodic intervals. Concurrent transmission and sensing using self-interference suppression has been suggested to improve the performance of cognitive radio systems, allowing decisions to be taken at multiple points within the frame. In this paper, we extend this approach by proposing a sliding-window full-duplex model allowing decisions to be taken on a sample-by-sample basis. We also derive the access-latency for both the existing and the proposed schemes. Our results show that the access-latency of the sliding scheme is decreased by a factor of 2.6 compared to the existing slotted full-duplex scheme and by a factor of approximately 16 compared to a half-duplex cognitive radio system. Moreover, the proposed scheme is significantly more resilient to the destructive effects of residual self-interference compared to previous approaches.
△ Less
Submitted 5 September, 2016;
originally announced September 2016.
-
Spatial Multiplexing of QPSK Signals with a Single Radio: Antenna Design and Over-the-Air Experiments
Authors:
Mohsen Yousefbeiki,
Andrew C. M. Austin,
Juan R. Mosig,
Andreas Burg,
Julien Perruisseau-Carrier
Abstract:
The paper describes the implementation and performance analysis of the first fully-operational beam-space MIMO antenna for the spatial multiplexing of two QPSK streams. The antenna is composed of a planar three-port radiator with two varactor diodes terminating the passive ports. Pattern reconfiguration is used to encode the MIMO information onto orthogonal virtual basis patterns in the far-field.…
▽ More
The paper describes the implementation and performance analysis of the first fully-operational beam-space MIMO antenna for the spatial multiplexing of two QPSK streams. The antenna is composed of a planar three-port radiator with two varactor diodes terminating the passive ports. Pattern reconfiguration is used to encode the MIMO information onto orthogonal virtual basis patterns in the far-field. A measurement campaign was conducted to compare the performance of the beam-space MIMO system with a conventional 2-by-?2 MIMO system under realistic propagation conditions. Propagation measurements were conducted for both systems and the mutual information and symbol error rates were estimated from Monte-Carlo simulations over the measured channel matrices. The results show the beam-space MIMO system and the conventional MIMO system exhibit similar finite-constellation capacity and error performance in NLOS scenarios when there is sufficient scattering in the channel. In comparison, in LOS channels, the capacity performance is observed to depend on the relative polarization of the receiving antennas.
△ Less
Submitted 30 August, 2016;
originally announced August 2016.
-
Baseband and RF Hardware Impairments in Full-Duplex Wireless Systems: Experimental Characterisation and Suppression
Authors:
Alexios Balatsoukas-Stimming,
Andrew Charles Mallory Austin,
Pavle Belanovic,
Andreas Burg
Abstract:
Hardware imperfections can significantly reduce the performance of full-duplex wireless systems by introducing non-idealities and random effects that make it challenging to fully suppress self-interference. Previous research has mostly focused on analyzing the impact of hardware imperfections on full-duplex systems, based on simulations and theoretical models. In this paper, we follow a measuremen…
▽ More
Hardware imperfections can significantly reduce the performance of full-duplex wireless systems by introducing non-idealities and random effects that make it challenging to fully suppress self-interference. Previous research has mostly focused on analyzing the impact of hardware imperfections on full-duplex systems, based on simulations and theoretical models. In this paper, we follow a measurement-based approach to experimentally identify and isolate these hardware imperfections leading to residual self-interference in full-duplex nodes. Our measurements show the important role of images arising from in-phase and quadrature (IQ) imbalance in the mixers. We also observe base-band non-linearities in the digital-to-analog converters (DAC), which can introduce strong harmonic components that have not been previously considered. A corresponding general mathematical model to suppress these components of the self-interference signal arising from the hardware non-idealities is developed from the observations and measurements. Results from a 10 MHz bandwidth full-duplex OFDM system, operating at 2.48 GHz, show up to 13 dB additional suppression, relative to state-of-the-art implementations can be achieved by jointly compensating for IQ imbalance and DAC non-linearities.
△ Less
Submitted 15 December, 2014;
originally announced December 2014.
-
Supporting 64-bit global indices in Epetra and other Trilinos packages -- Techniques used and lessons learned
Authors:
Chetan Jhurani,
Travis M. Austin,
Michael A. Heroux,
James M. Willenbring
Abstract:
The Trilinos Project is an effort to facilitate the design, development, integration and ongoing support of mathematical software libraries within an object-oriented framework. It is intended for large-scale, complex multiphysics engineering and scientific applications. Epetra is one of its basic packages. It provides serial and parallel linear algebra capabilities. Before Trilinos version 11.0, r…
▽ More
The Trilinos Project is an effort to facilitate the design, development, integration and ongoing support of mathematical software libraries within an object-oriented framework. It is intended for large-scale, complex multiphysics engineering and scientific applications. Epetra is one of its basic packages. It provides serial and parallel linear algebra capabilities. Before Trilinos version 11.0, released in 2012, Epetra used the C++ int data-type for storing global and local indices for degrees of freedom (DOFs). Since int is typically 32-bit, this limited the largest problem size to be smaller than approximately two billion DOFs. This was true even if a distributed memory machine could handle larger problems. We have added optional support for C++ long long data-type, which is at least 64-bit wide, for global indices. To save memory, maintain the speed of memory-bound operations, and reduce further changes to the code, the local indices are still 32-bit. We document the changes required to achieve this feature and how the new functionality can be used. We also report on the lessons learned in modifying a mature and popular package from various perspectives -- design goals, backward compatibility, engineering decisions, C++ language features, effects on existing users and other packages, and build integration.
△ Less
Submitted 25 July, 2013;
originally announced July 2013.
-
Managing Information for Sparsely Distributed Articles and Readers: The Virtual Journals of the Joint Institute for Nuclear Astrophysics (JINA)
Authors:
Richard H. Cyburt,
Sam M. Austin,
Timothy C. Beers,
Alfredo Estrade,
Ryan M. Ferguson,
A. Sakharuk,
Karl Smith,
Scott Warren
Abstract:
The research area of nuclear astrophysics is characterized by a need for information published in tens of journals in several fields and an extremely dilute distribution of researchers. For these reasons it is difficult for researchers, especially students, to be adequately informed of the relevant published research. For example, the commonly employed journal club is inefficient for a group con…
▽ More
The research area of nuclear astrophysics is characterized by a need for information published in tens of journals in several fields and an extremely dilute distribution of researchers. For these reasons it is difficult for researchers, especially students, to be adequately informed of the relevant published research. For example, the commonly employed journal club is inefficient for a group consisting of a professor and his two students. In an attempt to address this problem, we have developed a virtual journal (VJ), a process for collecting and distributing a weekly compendium of articles of interest to researchers in nuclear astrophysics. Subscribers are notified of each VJ issue using an email-list server or an RSS feed. The VJ data base is searchable by topics assigned by the editors, or by keywords. There are two related VJs: the Virtual Journal of Nuclear Astrophysics (JINA VJ), and the SEGUE Virtual Journal (SEGUE VJ). The JINA VJ also serves as a source of new experimental and theoretical information for the JINA REACLIB reaction rate database. References to review articles and popular level articles provide an introduction to the literature for students. The VJs and support information are available at http://groups.nscl.msu.edu/**a/journals
△ Less
Submitted 16 July, 2009;
originally announced July 2009.