-
A Sparse Sampling Sensor Front-end IC for Low Power Continuous SpO$_2$ \& HR Monitoring
Authors:
Sina Faraji Alamouti,
Jasmine Jan,
Cem Yalcin,
Jonathan Ting,
Ana Claudia Arias,
Rikky Muller
Abstract:
Photoplethysmography (PPG) is an attractive method to acquire vital signs such as heart rate and blood oxygenation and is frequently used in clinical and at-home settings. Continuous operation of health monitoring devices demands a low power sensor that does not restrict the device battery life. Silicon photodiodes (PD) and LEDs are commonly used as the interface devices in PPG sensors; however, u…
▽ More
Photoplethysmography (PPG) is an attractive method to acquire vital signs such as heart rate and blood oxygenation and is frequently used in clinical and at-home settings. Continuous operation of health monitoring devices demands a low power sensor that does not restrict the device battery life. Silicon photodiodes (PD) and LEDs are commonly used as the interface devices in PPG sensors; however, using of flexible organic devices can enhance the sensor conformality and reduce the cost of fabrication. In most PPG sensors, most of system power consumption is concentrated in powering LEDs, traditionally consuming mWs. Using organic devices further increases this power demand since these devices exhibit larger parasitic capacitances and typically need higher drive voltages. This work presents a sensor IC for continuous SpO$_2$ and HR monitoring that features an on-chip reconstruction-free sparse sampling algorithm to reduce the overall system power consumption by $\sim$70\% while maintaining the accuracy of the output information. The designed frontend is compatible with a wide range of devices from silicon PDs to organic PDs with parasitic capacitances up to 10 nF. Implemented in a 40 nm HV CMOS process, the chip occupies 2.43 mm$^2$ and consumes 49.7 $μ$W and 15.2 $μ$W of power in continuous and sparse sampling modes respectively. The performance of the sensor IC has been verified \textit{in vivo} with both types of devices and the results are compared against a clinical grade reference. Less than 1 bpm and 1\% mean absolute errors were achieved in both continuous and sparse modes of operation.
△ Less
Submitted 13 August, 2022;
originally announced August 2022.
-
Deep Polarimetric HDR Reconstruction
Authors:
Juiwen Ting,
Moein Shakeri,
Hong Zhang
Abstract:
This paper proposes a novel learning based high-dynamic-range (HDR) reconstruction method using a polarization camera. We utilize a previous observation that polarization filters with different orientations can attenuate natural light differently, and we treat the multiple images acquired by the polarization camera as a set acquired under different exposure times, to introduce the development of s…
▽ More
This paper proposes a novel learning based high-dynamic-range (HDR) reconstruction method using a polarization camera. We utilize a previous observation that polarization filters with different orientations can attenuate natural light differently, and we treat the multiple images acquired by the polarization camera as a set acquired under different exposure times, to introduce the development of solutions for the HDR reconstruction problem. We propose a deep HDR reconstruction framework with a feature masking mechanism that uses polarimetric cues available from the polarization camera, called Deep Polarimetric HDR Reconstruction (DPHR). The proposed DPHR obtains polarimetric information to propagate valid features through the network more effectively to regress the missing pixels. We demonstrate through both qualitative and quantitative evaluations that the proposed DPHR performs favorably than state-of-the-art HDR reconstruction algorithms.
△ Less
Submitted 26 March, 2022;
originally announced March 2022.
-
Deep Snapshot HDR Reconstruction Based on the Polarization Camera
Authors:
Juiwen Ting,
Xuesong Wu,
Kangkang Hu,
Hong Zhang
Abstract:
The recent development of the on-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images with the same ease of operation as a conventional camera. In this paper, we investigate the use of this sensor technology in high-dynamic-range (HDR) imaging. Specifically, observing that natural light can be attenuated differently…
▽ More
The recent development of the on-chip micro-polarizer technology has made it possible to acquire four spatially aligned and temporally synchronized polarization images with the same ease of operation as a conventional camera. In this paper, we investigate the use of this sensor technology in high-dynamic-range (HDR) imaging. Specifically, observing that natural light can be attenuated differently by varying the orientation of the polarization filter, we treat the multiple images captured by the polarization camera as a set captured under different exposure times. In our approach, we first study the relationship among polarizer orientation, degree and angle of polarization of light to the exposure time of a pixel in the polarization image. Subsequently, we propose a deep snapshot HDR reconstruction framework to recover an HDR image using the polarization images. A polarized HDR dataset is created to train and evaluate our approach. We demonstrate that our approach performs favorably against state-of-the-art HDR reconstruction algorithms.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Bio-inspired Gait Imitation of Hexapod Robot Using Event-Based Vision Sensor and Spiking Neural Network
Authors:
Justin Ting,
Yan Fang,
Ashwin Sanjay Lele,
Arijit Raychowdhury
Abstract:
Learning how to walk is a sophisticated neurological task for most animals. In order to walk, the brain must synthesize multiple cortices, neural circuits, and diverse sensory inputs. Some animals, like humans, imitate surrounding individuals to speed up their learning. When humans watch their peers, visual data is processed through a visual cortex in the brain. This complex problem of imitation-b…
▽ More
Learning how to walk is a sophisticated neurological task for most animals. In order to walk, the brain must synthesize multiple cortices, neural circuits, and diverse sensory inputs. Some animals, like humans, imitate surrounding individuals to speed up their learning. When humans watch their peers, visual data is processed through a visual cortex in the brain. This complex problem of imitation-based learning forms associations between visual data and muscle actuation through Central Pattern Generation (CPG). Reproducing this imitation phenomenon on low power, energy-constrained robots that are learning to walk remains challenging and unexplored. We propose a bio-inspired feed-forward approach based on neuromorphic computing and event-based vision to address the gait imitation problem. The proposed method trains a "student" hexapod to walk by watching an "expert" hexapod moving its legs. The student processes the flow of Dynamic Vision Sensor (DVS) data with a one-layer Spiking Neural Network (SNN). The SNN of the student successfully imitates the expert within a small convergence time of ten iterations and exhibits energy efficiency at the sub-microjoule level.
△ Less
Submitted 11 April, 2020;
originally announced April 2020.
-
Learning to Walk: Spike Based Reinforcement Learning for Hexapod Robot Central Pattern Generation
Authors:
Ashwin Sanjay Lele,
Yan Fang,
Justin Ting,
Arijit Raychowdhury
Abstract:
Learning to walk -- i.e., learning locomotion under performance and energy constraints continues to be a challenge in legged robotics. Methods such as stochastic gradient, deep reinforcement learning (RL) have been explored for bipeds, quadrupeds and hexapods. These techniques are computationally intensive and often prohibitive for edge applications. These methods rely on complex sensors and pre-p…
▽ More
Learning to walk -- i.e., learning locomotion under performance and energy constraints continues to be a challenge in legged robotics. Methods such as stochastic gradient, deep reinforcement learning (RL) have been explored for bipeds, quadrupeds and hexapods. These techniques are computationally intensive and often prohibitive for edge applications. These methods rely on complex sensors and pre-processing of data, which further increases energy and latency. Recent advances in spiking neural networks (SNNs) promise a significant reduction in computing owing to the sparse firing of neuros and has been shown to integrate reinforcement learning mechanisms with biologically observed spike time dependent plasticity (STDP). However, training a legged robot to walk by learning the synchronization patterns of central pattern generators (CPG) in an SNN framework has not been shown. This can marry the efficiency of SNNs with synchronized locomotion of CPG based systems providing breakthrough end-to-end learning in mobile robotics. In this paper, we propose a reinforcement based stochastic weight update technique for training a spiking CPG. The whole system is implemented on a lightweight raspberry pi platform with integrated sensors, thus opening up exciting new possibilities.
△ Less
Submitted 22 March, 2020;
originally announced March 2020.
-
An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifier
Authors:
Ali Moin,
Andy Zhou,
Abbas Rahimi,
Simone Benatti,
Alisha Menon,
Senam Tamakloe,
Jonathan Ting,
Natasha Yamamoto,
Yasser Khan,
Fred Burghardt,
Luca Benini,
Ana C. Arias,
Jan M. Rabaey
Abstract:
EMG-based gesture recognition shows promise for human-machine interaction. Systems are often afflicted by signal and electrode variability which degrades performance over time. We present an end-to-end system combating this variability using a large-area, high-density sensor array and a robust classification algorithm. EMG electrodes are fabricated on a flexible substrate and interfaced to a custo…
▽ More
EMG-based gesture recognition shows promise for human-machine interaction. Systems are often afflicted by signal and electrode variability which degrades performance over time. We present an end-to-end system combating this variability using a large-area, high-density sensor array and a robust classification algorithm. EMG electrodes are fabricated on a flexible substrate and interfaced to a custom wireless device for 64-channel signal acquisition and streaming. We use brain-inspired high-dimensional (HD) computing for processing EMG features in one-shot learning. The HD algorithm is tolerant to noise and electrode misplacement and can quickly learn from few gestures without gradient descent or back-propagation. We achieve an average classification accuracy of 96.64% for five gestures, with only 7% degradation when training and testing across different days. Our system maintains this accuracy when trained with only three trials of gestures; it also demonstrates comparable accuracy with the state-of-the-art when trained with one trial.
△ Less
Submitted 5 April, 2018; v1 submitted 27 February, 2018;
originally announced February 2018.
