Showing 1–9 of 9 results for author: Nguyen, J

Domain Adaptation using Silver Standard Labels for Ki-67 Scoring in Digital Pathology: A Step Closer to Widescale Deployment

Authors: Amanda Dy, Ngoc-Nhu Jennifer Nguyen, Seyed Hossein Mirjahanmardi, Melanie Dawe, Anthony Fyles, Wei Shi, Fei-Fei Liu, Dimitrios Androutsos, Susan Done, April Khademi

Abstract: Deep learning systems have been proposed to improve the objectivity and efficiency of Ki- 67 PI scoring. The challenge is that while very accurate, deep learning techniques suffer from reduced performance when applied to out-of-domain data. This is a critical challenge for clinical translation, as models are typically trained using data available to the vendor, which is not from the target domain.… ▽ More Deep learning systems have been proposed to improve the objectivity and efficiency of Ki- 67 PI scoring. The challenge is that while very accurate, deep learning techniques suffer from reduced performance when applied to out-of-domain data. This is a critical challenge for clinical translation, as models are typically trained using data available to the vendor, which is not from the target domain. To address this challenge, this study proposes a domain adaptation pipeline that employs an unsupervised framework to generate silver standard (pseudo) labels in the target domain, which is used to augment the gold standard (GS) source domain data. Five training regimes were tested on two validated Ki-67 scoring architectures (UV-Net and piNET), (1) SS Only: trained on target silver standard (SS) labels, (2) GS Only: trained on source GS labels, (3) Mixed: trained on target SS and source GS labels, (4) GS+SS: trained on source GS labels and fine-tuned on target SS labels, and our proposed method (5) SS+GS: trained on source SS labels and fine-tuned on source GS labels. The SS+GS method yielded significantly (p < 0.05) higher PI accuracy (95.9%) and more consistent results compared to the GS Only model on target data. Analysis of t-SNE plots showed features learned by the SS+GS models are more aligned for source and target data, resulting in improved generalization. The proposed pipeline provides an efficient method for learning the target distribution without manual annotations, which are time-consuming and costly to generate for medical images. This framework can be applied to any target site as a per-laboratory calibration method, for widescale deployment. △ Less

Submitted 7 July, 2023; originally announced July 2023.

Comments: Editors: Accepted for publication at MIDL 2023

Performance Analysis of Empirical Open-Circuit Voltage Modeling in Lithium Ion Batteries, Part-3: Experimental Results

Authors: Prarthana Pillai, James Nguyen, Balakumar Balasingam

Abstract: This paper is the third part of a series of papers about empirical approaches to open circuit voltage (OCV) modeling of lithium-ion batteries. The first part of the series proposed models to quantify various sources of uncertainties in the OCV models; and, the second part of the series presented systematic data collection approaches to compute the uncertainties in the OCV-SOC models. This paper us… ▽ More This paper is the third part of a series of papers about empirical approaches to open circuit voltage (OCV) modeling of lithium-ion batteries. The first part of the series proposed models to quantify various sources of uncertainties in the OCV models; and, the second part of the series presented systematic data collection approaches to compute the uncertainties in the OCV-SOC models. This paper uses data collected from 28 OCV characterization experiments, performed according to the data collection plan presented, to compute and analyze the following three different OCV uncertainty metrics: cell-to-cell variations, cycle-rate error, and curve fitting error. From the computed metrics, it was observed that a lower C-Rate showed smaller errors in the OCV-SOC model and vice versa. The results reported in this paper establish a relationship between the C-Rate and the uncertainty of the OCV-SOC model. This research can be thus useful to battery researchers for quantifying the tradeoff between the time taken to complete the OCV characterization test and the corresponding uncertainty in the OCV-SOC modeling. Further, quantified uncertainty model parameters can be used to accurately characterize the uncertainty in various battery management functionalities, such as state of charge and state of health estimation. △ Less

Submitted 28 June, 2023; originally announced June 2023.

Performance Analysis of Empirical Open-Circuit Voltage Modeling in Lithium Ion Batteries, Part-2: Data Collection Procedure

Authors: Prarthana Pillai, James Nguyen, Balakumar Balasingam

Abstract: This paper is the second part of a series of papers about empirical approaches to open circuit voltage (OCV) modeling and its performance comparison in lithium-ion batteries. The first part of the series introduced various sources of uncertainties in the OCV models and established a theoretical relationship between uncertainties and the performance of a battery management system. In this paper, cl… ▽ More This paper is the second part of a series of papers about empirical approaches to open circuit voltage (OCV) modeling and its performance comparison in lithium-ion batteries. The first part of the series introduced various sources of uncertainties in the OCV models and established a theoretical relationship between uncertainties and the performance of a battery management system. In this paper, clearly defined approaches for low-rate OCV data collection are defined and described in detail. The data collection is designed with consideration to several parameters that affect the experimental time. Firstly, a more suitable method to fully charge the battery at different C-Rates is defined. Secondly, the OCV characterization following the full charge is described for various performance comparisons. Finally, optimal and efficient resistance estimation profiles are discussed. From the voltage, current and time data recorded using the procedure described in this paper, the OCV-SOC relationship is characterized and its uncertainties are modeled in the third part of this series of papers. △ Less

Submitted 28 June, 2023; originally announced June 2023.

Performance Analysis of Empirical Open-Circuit Voltage Modeling in Lithium Ion Batteries, Part-1: Performance Measures

Authors: Prarthana Pillai, James Nguyen, Balakumar Balasingam

Abstract: The open circuit voltage to the state of charge (OCVSOC) characteristic is crucial for battery management systems. Using the OCV-SOC curve, the SOC and the battery capacity can be estimated in real-time. Accurate SOC and capacity information are important to carry out the majority of battery management functionalities that ensure a safe, efficient, and reliable battery pack power system. Numerous… ▽ More The open circuit voltage to the state of charge (OCVSOC) characteristic is crucial for battery management systems. Using the OCV-SOC curve, the SOC and the battery capacity can be estimated in real-time. Accurate SOC and capacity information are important to carry out the majority of battery management functionalities that ensure a safe, efficient, and reliable battery pack power system. Numerous approaches have been reported in the literature for improved SOC estimation and battery capacity estimation. These approaches focus on various estimation and filtering techniques to reduce the effect of measurement noise and uncertainties due to hysteresis and relaxation effects. Even though all the existing approaches to SOC estimation rely on the OCV-SOC characterization, little attention was paid to investigating the possibility of errors in the OCV-SOC characterization and the effect of uncertainty in the OCV-SOC curve on SOC and capacity estimates. In this paper, which is the first part of a series of three papers, the effect of OCV-SOC modeling error in the overall battery management system is discussed. The different sources of uncertainties in the OCV-SOC curve include cell-to-cell variation, temperature variation, aging drift, cycle rate effect, curve-fitting error, and measurement/estimation error. The proposed uncertainty models can be incorporated into battery management systems to improve their safety, performance, and reliability. △ Less

Submitted 28 June, 2023; originally announced June 2023.

A Classification Model Utilizing Facial Landmark Tracking to Determine Sentence Types for American Sign Language Recognition

Authors: Janice Nguyen, Y. Curtis Wang

Abstract: The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is available. As an effort to alleviate this problem, research in computer vision based real time ASL interpreting models is ongoing. However, most of these models… ▽ More The deaf and hard of hearing community relies on American Sign Language (ASL) as their primary mode of communication, but communication with others who do not know ASL can be difficult, especially during emergencies where no interpreter is available. As an effort to alleviate this problem, research in computer vision based real time ASL interpreting models is ongoing. However, most of these models are hand shape (gesture) based and lack the integration of facial cues, which are crucial in ASL to convey tone and distinguish sentence types. Thus, the integration of facial cues in computer vision based ASL interpreting models has the potential to improve performance and reliability. In this paper, we introduce a simple, computationally efficient facial expression based classification model that can be used to improve ASL interpreting models. This model utilizes the relative angles of facial landmarks with principal component analysis and a Random Forest Classification tree model to classify frames taken from videos of ASL users signing a complete sentence. The model classifies the frames as statements or assertions. The model was able to achieve an accuracy of 86.5%. △ Less

Submitted 11 May, 2023; v1 submitted 23 November, 2022; originally announced November 2022.

Production federated keyword spotting via distillation, filtering, and joint federated-centralized training

Authors: Andrew Hard, Kurt Partridge, Neng Chen, Sean Augenstein, Aishanee Shah, Hyun ** Park, Alex Park, Sara Ng, Jessica Nguyen, Ignacio Lopez Moreno, Rajiv Mathews, Françoise Beaufays

Abstract: We trained a keyword spotting model using federated learning on real user devices and observed significant improvements when the model was deployed for inference on phones. To compensate for data domains that are missing from on-device training caches, we employed joint federated-centralized training. And to learn in the absence of curated labels on-device, we formulated a confidence filtering str… ▽ More We trained a keyword spotting model using federated learning on real user devices and observed significant improvements when the model was deployed for inference on phones. To compensate for data domains that are missing from on-device training caches, we employed joint federated-centralized training. And to learn in the absence of curated labels on-device, we formulated a confidence filtering strategy based on user-feedback signals for federated distillation. These techniques created models that significantly improved quality metrics in offline evaluations and user-experience metrics in live A/B experiments. △ Less

Submitted 29 June, 2022; v1 submitted 11 April, 2022; originally announced April 2022.

Comments: Accepted to Interspeech 2022

Early Melanoma Diagnosis with Sequential Dermoscopic Images

Authors: Zhen Yu, Jennifer Nguyen, Toan D Nguyen, John Kelly, Catriona Mclean, Paul Bonnington, Lei Zhang, Victoria Mar, Zongyuan Ge

Abstract: Dermatologists often diagnose or rule out early melanoma by evaluating the follow-up dermoscopic images of skin lesions. However, existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions. Ignoring the temporal, morphological changes of lesions can lead to misdiagnosis in borderline cases. In this study, we propose a framework for automated early mela… ▽ More Dermatologists often diagnose or rule out early melanoma by evaluating the follow-up dermoscopic images of skin lesions. However, existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions. Ignoring the temporal, morphological changes of lesions can lead to misdiagnosis in borderline cases. In this study, we propose a framework for automated early melanoma diagnosis using sequential dermoscopic images. To this end, we construct our method in three steps. First, we align sequential dermoscopic images of skin lesions using estimated Euclidean transformations, extract the lesion growth region by computing image differences among the consecutive images, and then propose a spatio-temporal network to capture the dermoscopic changes from aligned lesion images and the corresponding difference images. Finally, we develop an early diagnosis module to compute probability scores of malignancy for lesion images over time. We collected 179 serial dermoscopic imaging data from 122 patients to verify our method. Extensive experiments show that the proposed model outperforms other commonly used sequence models. We also compared the diagnostic results of our model with those of seven experienced dermatologists and five registrars. Our model achieved higher diagnostic accuracy than clinicians (63.69% vs. 54.33%, respectively) and provided an earlier diagnosis of melanoma (60.7% vs. 32.7% of melanoma correctly diagnosed on the first follow-up images). These results demonstrate that our model can be used to identify melanocytic lesions that are at high-risk of malignant transformation earlier in the disease process and thereby redefine what is possible in the early detection of melanoma. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Journal ref: IEEE Transactions on Medical Imaging, 2021

Neural-Network-Optimized Degree-Specific Weights for LDPC MinSum Decoding

Authors: Linfang Wang, Sean Chen, Jonathan Nguyen, Divsalar Dariush, Richard Wesel

Abstract: Neural Normalized MinSum (N-NMS) decoding delivers better frame error rate (FER) performance on linear block codes than conventional normalized MinSum (NMS) by assigning dynamic multiplicative weights to each check-to-variable message in each iteration. Previous N-NMS efforts have primarily investigated short-length block codes (N < 1000), because the number of N-NMS parameters to be trained is pr… ▽ More Neural Normalized MinSum (N-NMS) decoding delivers better frame error rate (FER) performance on linear block codes than conventional normalized MinSum (NMS) by assigning dynamic multiplicative weights to each check-to-variable message in each iteration. Previous N-NMS efforts have primarily investigated short-length block codes (N < 1000), because the number of N-NMS parameters to be trained is proportional to the number of edges in the parity check matrix and the number of iterations, which imposes am impractical memory requirement when Pytorch or Tensorflow is used for training. This paper provides efficient approaches to training parameters of N-NMS that support N-NMS for longer block lengths. Specifically, this paper introduces a family of neural 2-dimensional normalized (N-2D-NMS) decoders with with various reduced parameter sets and shows how performance varies with the parameter set selected. The N-2D-NMS decoders share weights with respect to check node and/or variable node degree. Simulation results justify this approach, showing that the trained weights of N-NMS have a strong correlation to the check node degree, variable node degree, and iteration number. Further simulation results on the (3096,1032) protograph-based raptor-like (PBRL) code show that N-2D-NMS decoder can achieve the same FER as N-NMS with significantly fewer parameters required. The N-2D-NMS decoder for a (16200,7200) DVBS-2 standard LDPC code shows a lower error floor than belief propagation. Finally, a hybrid decoding structure combining a feedforward structure with a recurrent structure is proposed in this paper. The hybrid structure shows similar decoding performance to full feedforward structure, but requires significantly fewer parameters. △ Less

Submitted 9 July, 2021; originally announced July 2021.

Comments: This paper has been accepted by ISTC2021

Bayesian Learning-Based Adaptive Control for Safety Critical Systems

Authors: David D. Fan, Jennifer Nguyen, Rohan Thakker, Nikhilesh Alatur, Ali-akbar Agha-mohammadi, Evangelos A. Theodorou

Abstract: Deep learning has enjoyed much recent success, and applying state-of-the-art model learning methods to controls is an exciting prospect. However, there is a strong reluctance to use these methods on safety-critical systems, which have constraints on safety, stability, and real-time performance. We propose a framework which satisfies these constraints while allowing the use of deep neural networks… ▽ More Deep learning has enjoyed much recent success, and applying state-of-the-art model learning methods to controls is an exciting prospect. However, there is a strong reluctance to use these methods on safety-critical systems, which have constraints on safety, stability, and real-time performance. We propose a framework which satisfies these constraints while allowing the use of deep neural networks for learning model uncertainties. Central to our method is the use of Bayesian model learning, which provides an avenue for maintaining appropriate degrees of caution in the face of the unknown. In the proposed approach, we develop an adaptive control framework leveraging the theory of stochastic CLFs (Control Lyapunov Functions) and stochastic CBFs (Control Barrier Functions) along with tractable Bayesian model learning via Gaussian Processes or Bayesian neural networks. Under reasonable assumptions, we guarantee stability and safety while adapting to unknown dynamics with probability 1. We demonstrate this architecture for high-speed terrestrial mobility targeting potential applications in safety-critical high-speed Mars rover missions. △ Less

Submitted 4 July, 2021; v1 submitted 5 October, 2019; originally announced October 2019.

Comments: Corrected an error in section II, where previously the problem was introduced in a non-stochastic setting and wrongly assumed the solution to an ODE with Gaussian distributed parametric uncertainty was equivalent to an SDE with a learned diffusion term. See Lew, T et al. "On the Problem of Reformulating Systems with Uncertain Dynamics as a Stochastic Differential Equation"

Journal ref: IEEE International Conference on Robotics and Automation (ICRA) 2020 May 31 (pp. 4093-4099)