-
Smart Pixels: In-pixel AI for on-sensor data filtering
Authors:
Benjamin Parpillon,
Chinar Syal,
Jieun Yoo,
Jennet Dickinson,
Morris Swartz,
Giuseppe Di Guglielmo,
Alice Bean,
Douglas Berry,
Manuel Blanco Valentin,
Karri DiPetrillo,
Anthony Badea,
Lindsey Gray,
Petar Maksimovic,
Corrinne Mills,
Mark S. Neubauer,
Gauri Pradhan,
Nhan Tran,
Dahai Wen,
Farah Fahim
Abstract:
We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart p…
▽ More
We present a smart pixel prototype readout integrated circuit (ROIC) designed in CMOS 28 nm bulk process, with in-pixel implementation of an artificial intelligence (AI) / machine learning (ML) based data filtering algorithm designed as proof-of-principle for a Phase III upgrade at the Large Hadron Collider (LHC) pixel detector. The first version of the ROIC consists of two matrices of 256 smart pixels, each 25$\times$25 $μ$m$^2$ in size. Each pixel consists of a charge-sensitive preamplifier with leakage current compensation and three auto-zero comparators for a 2-bit flash-type ADC. The frontend is capable of synchronously digitizing the sensor charge within 25 ns. Measurement results show an equivalent noise charge (ENC) of $\sim$30e$^-$ and a total dispersion of $\sim$100e$^-$ The second version of the ROIC uses a fully connected two-layer neural network (NN) to process information from a cluster of 256 pixels to determine if the pattern corresponds to highly desirable high-momentum particle tracks for selection and readout. The digital NN is embedded in-between analog signal processing regions of the 256 pixels without increasing the pixel size and is implemented as fully combinatorial digital logic to minimize power consumption and eliminate clock distribution, and is active only in the presence of an input signal. The total power consumption of the neural network is $\sim$ 300 $μ$W. The NN performs momentum classification based on the generated cluster patterns and even with a modest momentum threshold, it is capable of 54.4\% - 75.4\% total data rejection, opening the possibility of using the pixel information at 40MHz for the trigger. The total power consumption of analog and digital functions per pixel is $\sim$ 6 $μ$W per pixel, which corresponds to $\sim$ 1 W/cm$^2$ staying within the experimental constraints.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
Skipper-in-CMOS: Non-Destructive Readout with Sub-Electron Noise Performance for Pixel Detectors
Authors:
Agustin J. Lapi,
Miguel Sofo-Haro,
Benjamin C. Parpillon,
Adi Birman,
Guillermo Fernandez-Moroni,
Lorenzo Rota,
Fabricio Alcalde Bessia,
Aseem Gupta,
Claudio Chavez Blanco,
Fernando Chierchie,
Julie Segal,
Christopher J. Kenney,
Angelo Dragone,
Shaorui Li,
Davide Braga,
Amos Fenigstein,
Juan Estrada,
Farah Fahim
Abstract:
The Skipper-in-CMOS image sensor integrates the non-destructive readout capability of Skipper Charge Coupled Devices (Skipper-CCDs) with the high conversion gain of a pinned photodiode in a CMOS imaging process, while taking advantage of in-pixel signal processing. This allows both single photon counting as well as high frame rate readout through highly parallel processing. The first results obtai…
▽ More
The Skipper-in-CMOS image sensor integrates the non-destructive readout capability of Skipper Charge Coupled Devices (Skipper-CCDs) with the high conversion gain of a pinned photodiode in a CMOS imaging process, while taking advantage of in-pixel signal processing. This allows both single photon counting as well as high frame rate readout through highly parallel processing. The first results obtained from a 15 x 15 um^2 pixel cell of a Skipper-in-CMOS sensor fabricated in Tower Semiconductor's commercial 180 nm CMOS Image Sensor process are presented. Measurements confirm the expected reduction of the readout noise with the number of samples down to deep sub-electron noise of 0.15rms e-, demonstrating the charge transfer operation from the pinned photodiode and the single photon counting operation when the sensor is exposed to light. The article also discusses new testing strategies employed for its operation and characterization.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning
Authors:
Jieun Yoo,
Jennet Dickinson,
Morris Swartz,
Giuseppe Di Guglielmo,
Alice Bean,
Douglas Berry,
Manuel Blanco Valentin,
Karri DiPetrillo,
Farah Fahim,
Lindsey Gray,
James Hirschauer,
Shruti R. Kulkarni,
Ron Lipton,
Petar Maksimovic,
Corrinne Mills,
Mark S. Neubauer,
Benjamin Parpillon,
Gauri Pradhan,
Chinar Syal,
Nhan Tran,
Dahai Wen,
Aaron Young
Abstract:
Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the…
▽ More
Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of O(40MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 54.4-75.4%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 $μW$ with an area of less than 0.2 mm$^2$. The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
Smart sensors using artificial intelligence for on-detector electronics and ASICs
Authors:
Gabriella Carini,
Grzegorz Deptuch,
Jennet Dickinson,
Dionisio Doering,
Angelo Dragone,
Farah Fahim,
Philip Harris,
Ryan Herbst,
Christian Herwig,
** Huang,
Soumyajit Mandal,
Cristina Mantilla Suarez,
Allison McCarn Deiana,
Sandeep Miryala,
F. Mitchell Newcomer,
Benjamin Parpillon,
Veljko Radeka,
Dylan Rankin,
Yihui Ren,
Lorenzo Rota,
Larry Ruckman,
Nhan Tran
Abstract:
Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasi…
▽ More
Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasingly important to more efficiently capture the right experimental data, reduce downstream system complexity, and enable faster and lower-power feedback loops. In this paper, we discuss the motivations and potential applications for on-detector AI. Furthermore, the unique requirements of particle physics can uniquely drive the development of novel AI hardware and design tools. We describe existing modern work for particle physics in this area. Finally, we outline a number of areas of opportunity where we can advance machine learning techniques, codesign workflows, and future microelectronics technologies which will accelerate design, performance, and implementations for next generation experiments.
△ Less
Submitted 27 April, 2022;
originally announced April 2022.
