-
Smart Pixels: In-pixel AI for on-sensor data filtering
Authors:
Benjamin Parpillon,
Chinar Syal,
Jieun Yoo,
Jennet Dickinson,
Morris Swartz,
Giuseppe Di Guglielmo,
Alice Bean,
Douglas Berry,
Manuel Blanco Valentin,
Karri DiPetrillo,
Anthony Badea,
Lindsey Gray,
Petar Maksimovic,
Corrinne Mills,
Mark S. Neubauer,
Gauri Pradhan,
Nhan Tran,
Dahai Wen,
Farah Fahim
Abstract:
We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart p…
▽ More
We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart pixels, each 25$\times$25 $μ$m$^2$ in size. Each pixel consists of a charge-sensitive preamplifier with leakage current compensation and three auto-zero comparators for a 2-bit flash-type ADC. The frontend is capable of synchronously digitizing the sensor charge within 25 ns. Measurement results show an equivalent noise charge (ENC) of $\sim$30e$^-$ and a total dispersion of $\sim$100e$^-$ The second version of the ROIC uses a fully connected two-layer neural network (NN) to process information from a cluster of 256 pixels to determine if the pattern corresponds to highly desirable high-momentum particle tracks for selection and readout. The digital NN is embedded in-between analog signal processing regions of the 256 pixels without increasing the pixel size and is implemented as fully combinatorial digital logic to minimize power consumption and eliminate clock distribution, and is active only in the presence of an input signal. The total power consumption of the neural network is $\sim$ 300 $μ$W. The NN performs momentum classification based on the generated cluster patterns and even with a modest momentum threshold, it is capable of 54.4\% - 75.4\% total data rejection, opening the possibility of using the pixel information at 40MHz for the trigger. The total power consumption of analog and digital functions per pixel is $\sim$ 6 $μ$W per pixel, which corresponds to $\sim$ 1 W/cm$^2$ staying within the experimental constraints.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
Skipper-in-CMOS: Non-Destructive Readout with Sub-Electron Noise Performance for Pixel Detectors
Authors:
Agustin J. Lapi,
Miguel Sofo-Haro,
Benjamin C. Parpillon,
Adi Birman,
Guillermo Fernandez-Moroni,
Lorenzo Rota,
Fabricio Alcalde Bessia,
Aseem Gupta,
Claudio Chavez Blanco,
Fernando Chierchie,
Julie Segal,
Christopher J. Kenney,
Angelo Dragone,
Shaorui Li,
Davide Braga,
Amos Fenigstein,
Juan Estrada,
Farah Fahim
Abstract:
The Skipper-in-CMOS image sensor integrates the non-destructive readout capability of Skipper Charge Coupled Devices (Skipper-CCDs) with the high conversion gain of a pinned photodiode in a CMOS imaging process, while taking advantage of in-pixel signal processing. This allows both single photon counting as well as high frame rate readout through highly parallel processing. The first results obtai…
▽ More
The Skipper-in-CMOS image sensor integrates the non-destructive readout capability of Skipper Charge Coupled Devices (Skipper-CCDs) with the high conversion gain of a pinned photodiode in a CMOS imaging process, while taking advantage of in-pixel signal processing. This allows both single photon counting as well as high frame rate readout through highly parallel processing. The first results obtained from a 15 x 15 um^2 pixel cell of a Skipper-in-CMOS sensor fabricated in Tower Semiconductor's commercial 180 nm CMOS Image Sensor process are presented. Measurements confirm the expected reduction of the readout noise with the number of samples down to deep sub-electron noise of 0.15rms e-, demonstrating the charge transfer operation from the pinned photodiode and the single photon counting operation when the sensor is exposed to light. The article also discusses new testing strategies employed for its operation and characterization.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Smartpixels: Towards on-sensor inference of charged particle track parameters and uncertainties
Authors:
Jennet Dickinson,
Rachel Kovach-Fuentes,
Lindsey Gray,
Morris Swartz,
Giuseppe Di Guglielmo,
Alice Bean,
Doug Berry,
Manuel Blanco Valentin,
Karri DiPetrillo,
Farah Fahim,
James Hirschauer,
Shruti R. Kulkarni,
Ron Lipton,
Petar Maksimovic,
Corrinne Mills,
Mark S. Neubauer,
Benjamin Parpillon,
Gauri Pradhan,
Chinar Syal,
Nhan Tran,
Dahai Wen,
Jieun Yoo,
Aaron Young
Abstract:
The combinatorics of track seeding has long been a computational bottleneck for triggering and offline computing in High Energy Physics (HEP), and remains so for the HL-LHC. Next-generation pixel sensors will be sufficiently fine-grained to determine angular information of the charged particle passing through from pixel-cluster properties. This detector technology immediately improves the situatio…
▽ More
The combinatorics of track seeding has long been a computational bottleneck for triggering and offline computing in High Energy Physics (HEP), and remains so for the HL-LHC. Next-generation pixel sensors will be sufficiently fine-grained to determine angular information of the charged particle passing through from pixel-cluster properties. This detector technology immediately improves the situation for offline tracking, but any major improvements in physics reach are unrealized since they are dominated by lowest-level hardware trigger acceptance. We will demonstrate track angle and hit position prediction, including errors, using a mixture density network within a single layer of silicon as well as the progress towards and status of implementing the neural network in hardware on both FPGAs and ASICs.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning
Authors:
Jieun Yoo,
Jennet Dickinson,
Morris Swartz,
Giuseppe Di Guglielmo,
Alice Bean,
Douglas Berry,
Manuel Blanco Valentin,
Karri DiPetrillo,
Farah Fahim,
Lindsey Gray,
James Hirschauer,
Shruti R. Kulkarni,
Ron Lipton,
Petar Maksimovic,
Corrinne Mills,
Mark S. Neubauer,
Benjamin Parpillon,
Gauri Pradhan,
Chinar Syal,
Nhan Tran,
Dahai Wen,
Aaron Young
Abstract:
Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the…
▽ More
Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 54.4-75.4%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 $μW$ with an area of less than 0.2 mm$^2$. The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
On-Sensor Data Filtering using Neuromorphic Computing for High Energy Physics Experiments
Authors:
Shruti R. Kulkarni,
Aaron Young,
Prasanna Date,
Narasinga Rao Miniskar,
Jeffrey S. Vetter,
Farah Fahim,
Benjamin Parpillon,
Jennet Dickinson,
Nhan Tran,
Jieun Yoo,
Corrinne Mills,
Morris Swartz,
Petar Maksimovic,
Catherine D. Schuman,
Alice Bean
Abstract:
This work describes the investigation of neuromorphic computing-based spiking neural network (SNN) models used to filter data from sensor electronics in high energy physics experiments conducted at the High Luminosity Large Hadron Collider. We present our approach for develo** a compact neuromorphic model that filters out the sensor data based on the particle's transverse momentum with the goal…
▽ More
This work describes the investigation of neuromorphic computing-based spiking neural network (SNN) models used to filter data from sensor electronics in high energy physics experiments conducted at the High Luminosity Large Hadron Collider. We present our approach for develo** a compact neuromorphic model that filters out the sensor data based on the particle's transverse momentum with the goal of reducing the amount of data being sent to the downstream electronics. The incoming charge waveforms are converted to streams of binary-valued events, which are then processed by the SNN. We present our insights on the various system design choices - from data encoding to optimal hyperparameters of the training algorithm - for an accurate and compact SNN optimized for hardware deployment. Our results show that an SNN trained with an evolutionary algorithm and an optimized set of hyperparameters obtains a signal efficiency of about 91% with nearly half as many parameters as a deep neural network.
△ Less
Submitted 20 July, 2023;
originally announced July 2023.
-
Memory-Immersed Collaborative Digitization for Area-Efficient Compute-in-Memory Deep Learning
Authors:
Shamma Nasrin,
Maeesha Binte Hashem,
Nastaran Darabi,
Benjamin Parpillon,
Farah Fahim,
Wilfred Gomes,
Amit Ranjan Trivedi
Abstract:
This work discusses memory-immersed collaborative digitization among compute-in-memory (CiM) arrays to minimize the area overheads of a conventional analog-to-digital converter (ADC) for deep learning inference. Thereby, using the proposed scheme, significantly more CiM arrays can be accommodated within limited footprint designs to improve parallelism and minimize external memory accesses. Under t…
▽ More
This work discusses memory-immersed collaborative digitization among compute-in-memory (CiM) arrays to minimize the area overheads of a conventional analog-to-digital converter (ADC) for deep learning inference. Thereby, using the proposed scheme, significantly more CiM arrays can be accommodated within limited footprint designs to improve parallelism and minimize external memory accesses. Under the digitization scheme, CiM arrays exploit their parasitic bit lines to form a within-memory capacitive digital-to-analog converter (DAC) that facilitates area-efficient successive approximation (SA) digitization. CiM arrays collaborate where a proximal array digitizes the analog-domain product-sums when an array computes the scalar product of input and weights. We discuss various networking configurations among CiM arrays where Flash, SA, and their hybrid digitization steps can be efficiently implemented using the proposed memory-immersed scheme. The results are demonstrated using a 65 nm CMOS test chip. Compared to a 40 nm-node 5-bit SAR ADC, our 65 nm design requires $\sim$25$\times$ less area and $\sim$1.4$\times$ less energy by leveraging in-memory computing structures. Compared to a 40 nm-node 5-bit Flash ADC, our design requires $\sim$51$\times$ less area and $\sim$13$\times$ less energy.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Smart sensors using artificial intelligence for on-detector electronics and ASICs
Authors:
Gabriella Carini,
Grzegorz Deptuch,
Jennet Dickinson,
Dionisio Doering,
Angelo Dragone,
Farah Fahim,
Philip Harris,
Ryan Herbst,
Christian Herwig,
** Huang,
Soumyajit Mandal,
Cristina Mantilla Suarez,
Allison McCarn Deiana,
Sandeep Miryala,
F. Mitchell Newcomer,
Benjamin Parpillon,
Veljko Radeka,
Dylan Rankin,
Yihui Ren,
Lorenzo Rota,
Larry Ruckman,
Nhan Tran
Abstract:
Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasi…
▽ More
Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasingly important to more efficiently capture the right experimental data, reduce downstream system complexity, and enable faster and lower-power feedback loops. In this paper, we discuss the motivations and potential applications for on-detector AI. Furthermore, the unique requirements of particle physics can uniquely drive the development of novel AI hardware and design tools. We describe existing modern work for particle physics in this area. Finally, we outline a number of areas of opportunity where we can advance machine learning techniques, codesign workflows, and future microelectronics technologies which will accelerate design, performance, and implementations for next generation experiments.
△ Less
Submitted 27 April, 2022;
originally announced April 2022.
