-
MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI
Authors:
Yan Zhuang,
Tejas Sudharshan Mathai,
Pritam Mukherjee,
Brandon Khoury,
Boah Kim,
Benjamin Hou,
Nusrat Rabbee,
Abhinav Suri,
Ronald M. Summers
Abstract:
Background: Segmentation of organs and structures in abdominal MRI is useful for many clinical applications, such as disease diagnosis and radiotherapy. Current approaches have focused on delineating a limited set of abdominal structures (13 types). To date, there is no publicly available abdominal MRI dataset with voxel-level annotations of multiple organs and structures. Consequently, a segmenta…
▽ More
Background: Segmentation of organs and structures in abdominal MRI is useful for many clinical applications, such as disease diagnosis and radiotherapy. Current approaches have focused on delineating a limited set of abdominal structures (13 types). To date, there is no publicly available abdominal MRI dataset with voxel-level annotations of multiple organs and structures. Consequently, a segmentation tool for multi-structure segmentation is also unavailable. Methods: We curated a T1-weighted abdominal MRI dataset consisting of 195 patients who underwent imaging at National Institutes of Health (NIH) Clinical Center. The dataset comprises of axial pre-contrast T1, arterial, venous, and delayed phases for each patient, thereby amounting to a total of 780 series (69,248 2D slices). Each series contains voxel-level annotations of 62 abdominal organs and structures. A 3D nnUNet model, dubbed as MRISegmentator-Abdomen (MRISegmentator in short), was trained on this dataset, and evaluation was conducted on an internal test set and two large external datasets: AMOS22 and Duke Liver. The predicted segmentations were compared against the ground-truth using the Dice Similarity Coefficient (DSC) and Normalized Surface Distance (NSD). Findings: MRISegmentator achieved an average DSC of 0.861$\pm$0.170 and a NSD of 0.924$\pm$0.163 in the internal test set. On the AMOS22 dataset, MRISegmentator attained an average DSC of 0.829$\pm$0.133 and a NSD of 0.908$\pm$0.067. For the Duke Liver dataset, an average DSC of 0.933$\pm$0.015 and a NSD of 0.929$\pm$0.021 was obtained. Interpretation: The proposed MRISegmentator provides automatic, accurate, and robust segmentations of 62 organs and structures in T1-weighted abdominal MRI sequences. The tool has the potential to accelerate research on various clinical topics, such as abnormality detection, radiotherapy, disease classification among others.
△ Less
Submitted 24 June, 2024; v1 submitted 9 May, 2024;
originally announced May 2024.
-
Priority aware grou**-based multihop routing scheme for RIS-assisted wireless networks
Authors:
Lakshmikanta Sau,
Priyadarshi Mukherjee,
Sasthi C. Ghosh
Abstract:
Reconfigurable intelligent surfaces (RISs) is a novel communication technology that has been recognized and recently presented as a candidate for beyond fifth generation wireless communication technology. In this paper, we propose a priority aware user traffic dependent grou** based multihop routing scheme for a RIS-assisted millimeter wave (mmWave) device-to-device (D2D) communication network w…
▽ More
Reconfigurable intelligent surfaces (RISs) is a novel communication technology that has been recognized and recently presented as a candidate for beyond fifth generation wireless communication technology. In this paper, we propose a priority aware user traffic dependent grou** based multihop routing scheme for a RIS-assisted millimeter wave (mmWave) device-to-device (D2D) communication network with spatially correlated channels. Specifically, the proposed scheme exploits the priority of the users (based on their respective delay constrained applications) and the aspect of spatial correlation in the narrowly spaced reflecting elements of the RISs. In this context, we establish a multihop connection for information transfer from one of the users to its desired receiver based on the other users in the neighbourhood, their respective traffic characteristics, and the already deployed RISs in the surroundings. Moreover, we also take into account the impact of considering practical discrete phase shifts at the RIS patches instead of its ideal continuous counterpart. Furthermore, we claim as well as demonstrate that the existing classic least remaining distance (LRD)-based approach is not always the optimal solution. Finally, numerical results demonstrate the advantages of the proposed strategy and that it significantly outperforms the existing benchmark schemes in terms of system performance metrics such as data throughput, energy consumption, as well as energy efficiency.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Enhancing chest X-ray datasets with privacy-preserving large language models and multi-type annotations: a data-driven approach for improved classification
Authors:
Ricardo Bigolin Lanfredi,
Pritam Mukherjee,
Ronald Summers
Abstract:
In chest X-ray (CXR) image analysis, rule-based systems are usually employed to extract labels from reports, but concerns exist about label quality. These datasets typically offer only presence labels, sometimes with binary uncertainty indicators, which limits their usefulness. In this work, we present MAPLEZ (Medical report Annotations with Privacy-preserving Large language model using Expeditiou…
▽ More
In chest X-ray (CXR) image analysis, rule-based systems are usually employed to extract labels from reports, but concerns exist about label quality. These datasets typically offer only presence labels, sometimes with binary uncertainty indicators, which limits their usefulness. In this work, we present MAPLEZ (Medical report Annotations with Privacy-preserving Large language model using Expeditious Zero shot answers), a novel approach leveraging a locally executable Large Language Model (LLM) to extract and enhance findings labels on CXR reports. MAPLEZ extracts not only binary labels indicating the presence or absence of a finding but also the location, severity, and radiologists' uncertainty about the finding. Over eight abnormalities from five test sets, we show that our method can extract these annotations with an increase of 5 percentage points (pp) in F1 score for categorical presence annotations and more than 30 pp increase in F1 score for the location annotations over competing labelers. Additionally, using these improved annotations in classification supervision, we demonstrate substantial advancements in model quality, with an increase of 1.7 pp in AUROC over models trained with annotations from the state-of-the-art approach. We share code and annotations.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
Weakly Supervised Detection of Pheochromocytomas and Paragangliomas in CT
Authors:
David C. Oluigboa,
Bikash Santra,
Tejas Sudharshan Mathai,
Pritam Mukherjee,
Jianfei Liu,
Abhishek Jha,
Mayank Patel,
Karel Pacak,
Ronald M. Summers
Abstract:
Pheochromocytomas and Paragangliomas (PPGLs) are rare adrenal and extra-adrenal tumors which have the potential to metastasize. For the management of patients with PPGLs, CT is the preferred modality of choice for precise localization and estimation of their progression. However, due to the myriad variations in size, morphology, and appearance of the tumors in different anatomical regions, radiolo…
▽ More
Pheochromocytomas and Paragangliomas (PPGLs) are rare adrenal and extra-adrenal tumors which have the potential to metastasize. For the management of patients with PPGLs, CT is the preferred modality of choice for precise localization and estimation of their progression. However, due to the myriad variations in size, morphology, and appearance of the tumors in different anatomical regions, radiologists are posed with the challenge of accurate detection of PPGLs. Since clinicians also need to routinely measure their size and track their changes over time across patient visits, manual demarcation of PPGLs is quite a time-consuming and cumbersome process. To ameliorate the manual effort spent for this task, we propose an automated method to detect PPGLs in CT studies via a proxy segmentation task. As only weak annotations for PPGLs in the form of prospectively marked 2D bounding boxes on an axial slice were available, we extended these 2D boxes into weak 3D annotations and trained a 3D full-resolution nnUNet model to directly segment PPGLs. We evaluated our approach on a dataset consisting of chest-abdomen-pelvis CTs of 255 patients with confirmed PPGLs. We obtained a precision of 70% and sensitivity of 64.1% with our proposed approach when tested on 53 CT studies. Our findings highlight the promising nature of detecting PPGLs via segmentation, and furthers the state-of-the-art in this exciting yet challenging area of rare cancer management.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Automated Classification of Body MRI Sequence Type Using Convolutional Neural Networks
Authors:
Kimberly Helm,
Tejas Sudharshan Mathai,
Boah Kim,
Pritam Mukherjee,
Jianfei Liu,
Ronald M. Summers
Abstract:
Multi-parametric MRI of the body is routinely acquired for the identification of abnormalities and diagnosis of diseases. However, a standard naming convention for the MRI protocols and associated sequences does not exist due to wide variations in imaging practice at institutions and myriad MRI scanners from various manufacturers being used for imaging. The intensity distributions of MRI sequences…
▽ More
Multi-parametric MRI of the body is routinely acquired for the identification of abnormalities and diagnosis of diseases. However, a standard naming convention for the MRI protocols and associated sequences does not exist due to wide variations in imaging practice at institutions and myriad MRI scanners from various manufacturers being used for imaging. The intensity distributions of MRI sequences differ widely as a result, and there also exists information conflicts related to the sequence type in the DICOM headers. At present, clinician oversight is necessary to ensure that the correct sequence is being read and used for diagnosis. This poses a challenge when specific series need to be considered for building a cohort for a large clinical study or for develo** AI algorithms. In order to reduce clinician oversight and ensure the validity of the DICOM headers, we propose an automated method to classify the 3D MRI sequence acquired at the levels of the chest, abdomen, and pelvis. In our pilot work, our 3D DenseNet-121 model achieved an F1 score of 99.5% at differentiating 5 common MRI sequences obtained by three Siemens scanners (Aera, Verio, Biograph mMR). To the best of our knowledge, we are the first to develop an automated method for the 3D classification of MRI sequences in the chest, abdomen, and pelvis, and our work has outperformed the previous state-of-the-art MRI series classifiers.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Semantic Image Synthesis for Abdominal CT
Authors:
Yan Zhuang,
Benjamin Hou,
Tejas Sudharshan Mathai,
Pritam Mukherjee,
Boah Kim,
Ronald M. Summers
Abstract:
As a new emerging and promising type of generative models, diffusion models have proven to outperform Generative Adversarial Networks (GANs) in multiple tasks, including image synthesis. In this work, we explore semantic image synthesis for abdominal CT using conditional diffusion models, which can be used for downstream applications such as data augmentation. We systematically evaluated the perfo…
▽ More
As a new emerging and promising type of generative models, diffusion models have proven to outperform Generative Adversarial Networks (GANs) in multiple tasks, including image synthesis. In this work, we explore semantic image synthesis for abdominal CT using conditional diffusion models, which can be used for downstream applications such as data augmentation. We systematically evaluated the performance of three diffusion models, as well as to other state-of-the-art GAN-based approaches, and studied the different conditioning scenarios for the semantic mask. Experimental results demonstrated that diffusion models were able to synthesize abdominal CT images with better quality. Additionally, encoding the mask and the input separately is more effective than naïve concatenating.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Performance Analysis of Various EfficientNet Based U-Net++ Architecture for Automatic Building Extraction from High Resolution Satellite Images
Authors:
Tareque Bashar Ovi,
Nomaiya Bashree,
Protik Mukherjee,
Shakil Mosharrof,
Masuma Anjum Parthima
Abstract:
Building extraction is an essential component of study in the science of remote sensing, and applications for building extraction heavily rely on semantic segmentation of high-resolution remote sensing imagery. Semantic information extraction gap constraints in the present deep learning based approaches, however can result in inadequate segmentation outcomes. To address this issue and extract buil…
▽ More
Building extraction is an essential component of study in the science of remote sensing, and applications for building extraction heavily rely on semantic segmentation of high-resolution remote sensing imagery. Semantic information extraction gap constraints in the present deep learning based approaches, however can result in inadequate segmentation outcomes. To address this issue and extract buildings with high accuracy, various efficientNet backbone based U-Net++ has been proposed in this study. The designed network, based on U-Net, can improve the sensitivity of the model by deep supervision, voluminous redesigned skip-connections and hence reducing the influence of irrelevant feature areas in the background. Various effecientNet backbone based encoders have been employed when training the network to enhance the capacity of the model to extract more relevant feature. According on the experimental findings, the suggested model significantly outperforms previous cutting-edge approaches. Among the 5 efficientNet variation Unet++ based on efficientb4 achieved the best result by scoring mean accuracy of 92.23%, mean iou of 88.32%, and mean precision of 93.2% on publicly available Massachusetts building dataset and thus showing the promises of the model for automatic building extraction from high resolution satellite images.
△ Less
Submitted 5 September, 2023;
originally announced October 2023.
-
Chaotic Waveform-based Signal Design for Noncoherent SWIPT Receivers
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
This paper proposes a chaotic waveform-based multi-antenna receiver design for simultaneous wireless information and power transfer (SWIPT). Particularly, we present a differential chaos shift keying (DCSK)-based SWIPT multiantenna receiver architecture, where each antenna switches between information transfer (IT) and energy harvesting (EH) modes depending on the receiver's requirements. We take…
▽ More
This paper proposes a chaotic waveform-based multi-antenna receiver design for simultaneous wireless information and power transfer (SWIPT). Particularly, we present a differential chaos shift keying (DCSK)-based SWIPT multiantenna receiver architecture, where each antenna switches between information transfer (IT) and energy harvesting (EH) modes depending on the receiver's requirements. We take into account a generalized frequency-selective Nakagami-m fading model as well as the nonlinearities of the EH process to derive closed-form analytical expressions for the associated bit error rate (BER) and the harvested direct current (DC), respectively. We show that, both depend on the parameters of the transmitted waveform and the number of receiver antennas being utilized in the IT and EH mode. We investigate a trade-off in terms of the BER and energy transfer by introducing a novel achievable `success rate - harvested energy' region. Moreover, we demonstrate that energy and information transfer are two conflicting tasks and hence, a single waveform cannot be simultaneously optimal for both IT and EH. Accordingly, we propose appropriate transmit waveform designs based on the application specific requirements of acceptable BER or harvested DC or both. Numerical results demonstrate the importance of chaotic waveform-based signal design and its impact on the proposed receiver architecture.
△ Less
Submitted 3 April, 2024; v1 submitted 25 August, 2023;
originally announced August 2023.
-
DRAMS: Double-RIS Assisted Multihop Routing Scheme for Device-to-Device Communication
Authors:
Lakshmikanta Sau,
Priyadarshi Mukherjee,
Sasthi C. Ghosh
Abstract:
Reconfigurable intelligent surfaces (RISs) is a promising solution for enhancing the performance of multihop wireless communication networks. In this paper, we propose a double-RIS assisted multihop routing scheme for a device-to-device (D2D) communication network. Specifically, the scheme is dependent on the already deployed RISs and users in the surroundings. Besides the RISs, the emphasis of th…
▽ More
Reconfigurable intelligent surfaces (RISs) is a promising solution for enhancing the performance of multihop wireless communication networks. In this paper, we propose a double-RIS assisted multihop routing scheme for a device-to-device (D2D) communication network. Specifically, the scheme is dependent on the already deployed RISs and users in the surroundings. Besides the RISs, the emphasis of this work is to make more use of the existing intermediate users (IUs), which can act as relays. Hence, the density of RIS deployment in the surroundings can be reduced, which leads to the avoidance of resource wastage. However, we cannot solely depend on the IUs because this implies complete dependence on their availability for relaying and as a result, the aspect of reliability in terms of delay-constrained information transfer cannot be guaranteed. Moreover, the IUs are considered capable of energy harvesting and as a result, they do not waste their own energy in the process of volunteering to act as a relay for other users. Numerical results demonstrate the advantage of the proposed scheme over some existing approaches and lastly, useful insights related to the scheme design are also drawn, where we characterize the maximum acceptable delay at each hop under different set-ups.
△ Less
Submitted 22 March, 2024; v1 submitted 11 July, 2023;
originally announced July 2023.
-
Generative AI for Rapid Diffusion MRI with Improved Image Quality, Reliability and Generalizability
Authors:
Amir Sadikov,
Xinlei Pan,
Hannah Choi,
Lanya T. Cai,
Pratik Mukherjee
Abstract:
Diffusion MRI is a non-invasive, in-vivo biomedical imaging method for map** tissue microstructure. Applications include structural connectivity imaging of the human brain and detecting microstructural neural changes. However, acquiring high signal-to-noise ratio dMRI datasets with high angular and spatial resolution requires prohibitively long scan times, limiting usage in many important clinic…
▽ More
Diffusion MRI is a non-invasive, in-vivo biomedical imaging method for map** tissue microstructure. Applications include structural connectivity imaging of the human brain and detecting microstructural neural changes. However, acquiring high signal-to-noise ratio dMRI datasets with high angular and spatial resolution requires prohibitively long scan times, limiting usage in many important clinical settings, especially for children, the elderly, and in acute neurological disorders that may require conscious sedation or general anesthesia. We employ a Swin UNEt Transformers model, trained on augmented Human Connectome Project data and conditioned on registered T1 scans, to perform generalized denoising of dMRI. We also qualitatively demonstrate super-resolution with artificially downsampled HCP data in normal adult volunteers. Remarkably, Swin UNETR can be fine-tuned for an out-of-domain dataset with a single example scan, as we demonstrate on dMRI of children with neurodevelopmental disorders and of adults with acute evolving traumatic brain injury, each cohort scanned on different models of scanners with different imaging protocols at different sites. We exceed current state-of-the-art denoising methods in accuracy and test-retest reliability of rapid diffusion tensor imaging requiring only 90 seconds of scan time. Applied to tissue microstructural modeling of dMRI, Swin UNETR denoising achieves dramatic improvements over the state-of-the-art for test-retest reliability of intracellular volume fraction and free water fraction measurements and can remove heavy-tail noise, improving biophysical modeling fidelity. Swin UNeTR enables rapid diffusion MRI with unprecedented accuracy and reliability, especially for probing biological tissues for scientific and clinical applications. The code and model are publicly available at https://github.com/ucsfncl/dmri-swin.
△ Less
Submitted 6 October, 2023; v1 submitted 9 March, 2023;
originally announced March 2023.
-
On the Level Crossing Rate of Fluid Antenna Systems
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
Multiple-input multiple-output (MIMO) technology has significantly impacted wireless communication, by providing extraordinary performance gains. However, a minimum inter-antenna space constraint in MIMO systems does not allow its integration in devices with limited space. In this context, the concept of fluid antenna systems (FASs) appears to be a potent solution, where there is no such restricti…
▽ More
Multiple-input multiple-output (MIMO) technology has significantly impacted wireless communication, by providing extraordinary performance gains. However, a minimum inter-antenna space constraint in MIMO systems does not allow its integration in devices with limited space. In this context, the concept of fluid antenna systems (FASs) appears to be a potent solution, where there is no such restriction. In this paper, we investigate the average level crossing rate (LCR) of such FASs. Specifically, we derive closed-form analytical expressions of the LCR of such systems and extensive Monte-Carlo simulations validate the proposed analytical framework. Moreover, we also demonstrate that under certain conditions, the LCR obtained coincides with that of a conventional selection combining-based receiver. Finally, the numerical results also provide insights regarding the selection of appropriate parameters that enhance the system performance.
△ Less
Submitted 3 May, 2022;
originally announced May 2022.
-
Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set
Authors:
Roxana Daneshjou,
Kailas Vodrahalli,
Roberto A Novoa,
Melissa Jenkins,
Weixin Liang,
Veronica Rotemberg,
Justin Ko,
Susan M Swetter,
Elizabeth E Bailey,
Olivier Gevaert,
Pritam Mukherjee,
Michelle Phung,
Kiana Yekrang,
Bradley Fong,
Rachna Sahasrabudhe,
Johan A. C. Allerup,
Utako Okata-Karigane,
James Zou,
Albert Chiou
Abstract:
Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on images of diverse skin tones or uncommon diseases. To ascertain potential biases in algorithm performance in this context, we curated the Diverse Dermatology I…
▽ More
Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on images of diverse skin tones or uncommon diseases. To ascertain potential biases in algorithm performance in this context, we curated the Diverse Dermatology Images (DDI) dataset-the first publicly available, expertly curated, and pathologically confirmed image dataset with diverse skin tones. Using this dataset of 656 images, we show that state-of-the-art dermatology AI models perform substantially worse on DDI, with receiver operator curve area under the curve (ROC-AUC) drop** by 27-36 percent compared to the models' original test results. All the models performed worse on dark skin tones and uncommon diseases, which are represented in the DDI dataset. Additionally, we find that dermatologists, who typically provide visual labels for AI training and test datasets, also perform worse on images of dark skin tones and uncommon diseases compared to ground truth biopsy annotations. Finally, fine-tuning AI models on the well-characterized and diverse DDI images closed the performance gap between light and dark skin tones. Moreover, algorithms fine-tuned on diverse skin tones outperformed dermatologists on identifying malignancy on images of dark skin tones. Our findings identify important weaknesses and biases in dermatology AI that need to be addressed to ensure reliable application to diverse patients and diseases.
△ Less
Submitted 15 March, 2022;
originally announced March 2022.
-
Differential Chaos Shift Keying-based Wireless Power Transfer over a Frequency Selective Channel
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
This paper studies the performance of a differential chaos shift keying (DCSK)-based wireless power transfer (WPT) setup in a frequency selective scenario. Particularly, by taking into account the nonlinearities of the energy harvesting (EH) process and a generalized frequency selective Nakagami-m fading channel, we derive closed-form analytical expressions for the harvested energy in terms of the…
▽ More
This paper studies the performance of a differential chaos shift keying (DCSK)-based wireless power transfer (WPT) setup in a frequency selective scenario. Particularly, by taking into account the nonlinearities of the energy harvesting (EH) process and a generalized frequency selective Nakagami-m fading channel, we derive closed-form analytical expressions for the harvested energy in terms of the transmitted waveform and channel parameters. A simplified closed-form expression for the harvested energy is also obtained for a scenario, where the delay spread is negligible in comparison to the transmit symbol duration. Nontrivial design insights are provided, where it is shown how the power delay profile of the channel as well as the parameters of the transmitted waveform affect the EH performance. Our results show that a frequency selective channel is comparatively more beneficial for WPT compared to a flat fading scenario. However, a significant delay spread negatively impacts the energy transfer.
△ Less
Submitted 9 March, 2022;
originally announced March 2022.
-
ASOC: Adaptive Self-aware Object Co-localization
Authors:
Koteswar Rao Jerripothula,
Prerana Mukherjee
Abstract:
The primary goal of this paper is to localize objects in a group of semantically similar images jointly, also known as the object co-localization problem. Most related existing works are essentially weakly-supervised, relying prominently on the neighboring images' weak-supervision. Although weak supervision is beneficial, it is not entirely reliable, for the results are quite sensitive to the neig…
▽ More
The primary goal of this paper is to localize objects in a group of semantically similar images jointly, also known as the object co-localization problem. Most related existing works are essentially weakly-supervised, relying prominently on the neighboring images' weak-supervision. Although weak supervision is beneficial, it is not entirely reliable, for the results are quite sensitive to the neighboring images considered. In this paper, we combine it with a self-awareness phenomenon to mitigate this issue. By self-awareness here, we refer to the solution derived from the image itself in the form of saliency cue, which can also be unreliable if applied alone. Nevertheless, combining these two paradigms together can lead to a better co-localization ability. Specifically, we introduce a dynamic mediator that adaptively strikes a proper balance between the two static solutions to provide an optimal solution. Therefore, we call this method \textit{ASOC}: Adaptive Self-aware Object Co-localization. We perform exhaustive experiments on several benchmark datasets and validate that weak-supervision supplemented with self-awareness has superior performance outperforming several compared competing methods.
△ Less
Submitted 27 January, 2022;
originally announced January 2022.
-
Disparities in Dermatology AI: Assessments Using Diverse Clinical Images
Authors:
Roxana Daneshjou,
Kailas Vodrahalli,
Weixin Liang,
Roberto A Novoa,
Melissa Jenkins,
Veronica Rotemberg,
Justin Ko,
Susan M Swetter,
Elizabeth E Bailey,
Olivier Gevaert,
Pritam Mukherjee,
Michelle Phung,
Kiana Yekrang,
Bradley Fong,
Rachna Sahasrabudhe,
James Zou,
Albert Chiou
Abstract:
More than 3 billion people lack access to care for skin disease. AI diagnostic tools may aid in early skin cancer detection; however most models have not been assessed on images of diverse skin tones or uncommon diseases. To address this, we curated the Diverse Dermatology Images (DDI) dataset - the first publicly available, pathologically confirmed images featuring diverse skin tones. We show tha…
▽ More
More than 3 billion people lack access to care for skin disease. AI diagnostic tools may aid in early skin cancer detection; however most models have not been assessed on images of diverse skin tones or uncommon diseases. To address this, we curated the Diverse Dermatology Images (DDI) dataset - the first publicly available, pathologically confirmed images featuring diverse skin tones. We show that state-of-the-art dermatology AI models perform substantially worse on DDI, with ROC-AUC drop** 29-40 percent compared to the models' original results. We find that dark skin tones and uncommon diseases, which are well represented in the DDI dataset, lead to performance drop-offs. Additionally, we show that state-of-the-art robust training methods cannot correct for these biases without diverse training data. Our findings identify important weaknesses and biases in dermatology AI that need to be addressed to ensure reliable application to diverse patients and across all disease.
△ Less
Submitted 15 November, 2021;
originally announced November 2021.
-
Multi-dimensional Lorenz-Based Chaotic Waveforms for Wireless Power Transfer
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
In this paper, we investigate multi-dimensional chaotic signals with respect to wireless power transfer (WPT). Specifically, we analyze a multi-dimensional Lorenz-based chaotic signal under a WPT framework. By taking into account the nonlinearities of the energy harvesting process, closed-form analytical expressions for the average harvested energy are derived. Moreover, the practical limitations…
▽ More
In this paper, we investigate multi-dimensional chaotic signals with respect to wireless power transfer (WPT). Specifically, we analyze a multi-dimensional Lorenz-based chaotic signal under a WPT framework. By taking into account the nonlinearities of the energy harvesting process, closed-form analytical expressions for the average harvested energy are derived. Moreover, the practical limitations of the high power amplifier (HPA) at the transmitter are also taken into consideration. We interestingly observe that for these types of signals, high peak-to-average-power-ratio (PAPR) is not the only criterion for obtaining enhanced WPT. We demonstrate that while the HPA imperfections do not significantly affect the signal PAPR, it notably degrades the energy transfer performance. As the proposed framework is general, we also demonstrate its application with respect to a Henon signal based WPT. Finally we compare Lorenz and Henon signals with the conventional multisine waveforms in terms of WPT performance.
△ Less
Submitted 4 October, 2021;
originally announced October 2021.
-
Differential Chaos Shift Keying-based Wireless Power Transfer with Nonlinearities
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
In this paper, we investigate conventional communication-based chaotic waveforms in the context of wireless power transfer (WPT). Particularly, we present a differential chaos shift keying (DCSK)-based WPT architecture, that employs an analog correlator at the receiver, in order to boost the energy harvesting (EH) performance. We take into account the nonlinearities of the EH process and derive cl…
▽ More
In this paper, we investigate conventional communication-based chaotic waveforms in the context of wireless power transfer (WPT). Particularly, we present a differential chaos shift keying (DCSK)-based WPT architecture, that employs an analog correlator at the receiver, in order to boost the energy harvesting (EH) performance. We take into account the nonlinearities of the EH process and derive closed-form analytical expressions for the harvested direct current (DC) under a generalized Nakagami-m block fading model. We show that, in this framework, both the peak-to-average-power-ratio of the received signal and the harvested DC, depend on the parameters of the transmitted waveform. Furthermore, we investigate the case of deterministic unmodulated chaotic waveforms and demonstrate that, in the absence of a correlator, modulation does not affect the achieved harvested DC. On the other hand, it is shown that for scenarios with a correlator-aided receiver, DCSK significantly outperforms the unmodulated case. Based on this observation, we propose a novel DCSK-based signal design, which further enhances the WPT capability of the proposed architecture; corresponding analytical expressions for the harvested DC are also derived. Our results demonstrate that the proposed architecture and the associated signal design, can achieve significant EH gains in DCSK-based WPT systems. Furthermore, we also show that, even by taking into account the nonlinearities at the transmitter amplifier, the proposed chaotic waveform performs significantly better in terms of EH, when compared with the existing multisine signals.
△ Less
Submitted 28 May, 2021;
originally announced May 2021.
-
Differential chaos shift keying-based wireless power transfer
Authors:
Priyadarshi Mukherjee,
Constantinos Psomas,
Ioannis Krikidis
Abstract:
In this work, we investigate differential chaos shift keying (DCSK), a communication-based waveform, in the context of wireless power transfer (WPT). Particularly, we present a DCSK-based WPT architecture, that employs an analog correlator at the receiver in order to boost the energy harvesting (EH) performance. By taking into account the nonlinearities of the EH process, we derive closed-form ana…
▽ More
In this work, we investigate differential chaos shift keying (DCSK), a communication-based waveform, in the context of wireless power transfer (WPT). Particularly, we present a DCSK-based WPT architecture, that employs an analog correlator at the receiver in order to boost the energy harvesting (EH) performance. By taking into account the nonlinearities of the EH process, we derive closed-form analytical expressions for the peak-to-average-power-ratio of the received signal as well as the harvested power. Nontrivial design insights are provided, where it is shown how the parameters of the transmitted waveform affects the EH performance. Furthermore, it is demonstrated that the employment of a correlator at the receiver achieves significant EH gains in DCSK-based WPT systems.
△ Less
Submitted 25 March, 2021;
originally announced April 2021.
-
Model Synthesis for Communication Traces of System-on-Chip Designs
Authors:
Hao Zheng,
Md Rubel Ahmed,
Parijat Mukherjee,
Mahesh C. Ketkar,
** Yang
Abstract:
Concise and abstract models of system-level behaviors are invaluable in design analysis, testing, and validation. In this paper, we consider the problem of inferring models from communication traces of system-on-chip~(SoC) designs. The traces capture communications among different blocks of a SoC design in terms of messages exchanged. The extracted models characterize the system-level communicatio…
▽ More
Concise and abstract models of system-level behaviors are invaluable in design analysis, testing, and validation. In this paper, we consider the problem of inferring models from communication traces of system-on-chip~(SoC) designs. The traces capture communications among different blocks of a SoC design in terms of messages exchanged. The extracted models characterize the system-level communication protocols governing how blocks exchange messages, and coordinate with each other to realize various system functions. In this paper, the above problem is formulated as a constraint satisfaction problem, which is then fed to a SMT solver. The solutions returned by the SMT solver are used to extract the models that accept the input traces. In the experiments, we demonstrate the proposed approach with traces collected from a transaction-level simulation model of a multicore SoC design and traces of a more detailed multicore SoC design developed in GEM5 environment.
△ Less
Submitted 13 February, 2021;
originally announced February 2021.
-
Quantifying the unknown impact of segmentation uncertainty on image-based simulations
Authors:
Michael C. Krygier,
Tyler LaBonte,
Carianne Martinez,
Chance Norris,
Krish Sharma,
Lincoln N. Collins,
Partha P. Mukherjee,
Scott A. Roberts
Abstract:
Image-based simulation, the use of 3D images to calculate physical quantities, fundamentally relies on image segmentation to create the computational geometry. However, this process introduces image segmentation uncertainty because there is a variety of different segmentation tools (both manual and machine-learning-based) that will each produce a unique and valid segmentation. First, we demonstrat…
▽ More
Image-based simulation, the use of 3D images to calculate physical quantities, fundamentally relies on image segmentation to create the computational geometry. However, this process introduces image segmentation uncertainty because there is a variety of different segmentation tools (both manual and machine-learning-based) that will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be both nonintuitive and surprisingly nontrivial. We also establish that simply bounding the uncertainty can fail in situations that are sensitive to image segmentation. While our work does not eliminate segmentation uncertainty, it makes visible the previously unrecognized range of uncertainty currently plaguing image-based simulation, enabling more credible simulations.
△ Less
Submitted 9 September, 2021; v1 submitted 17 December, 2020;
originally announced December 2020.
-
Distributed Adaptive and Resilient Control of Multi-Robot Systems with Limited Field of View Interactions using Q-Learning
Authors:
Pratik Mukherjee,
Matteo Santilli,
Andrea Gasparri,
Ryan K. Williams
Abstract:
In this paper, we consider the problem of dynamically tuning gains for multi-robot systems (MRS) under potential based control design framework where the MRS team coordinates to maintain a connected topology while equipped with limited field of view sensors. Applying the potential-based control framework and assuming robot interaction is encoded by a triangular geometry, we derive a distributed co…
▽ More
In this paper, we consider the problem of dynamically tuning gains for multi-robot systems (MRS) under potential based control design framework where the MRS team coordinates to maintain a connected topology while equipped with limited field of view sensors. Applying the potential-based control framework and assuming robot interaction is encoded by a triangular geometry, we derive a distributed control law in order to achieve the topology control objective. A typical shortcoming of potential-based control in distributed networks is that the overall system behavior is highly sensitive to gain-tuning. To overcome this limitation, we propose a distributed and adaptive gain controller that preserves a designed pairwise interaction strength, independent of the network size. Over that, we implement a control scheme that enables the MRS to be resilient against exogenous attacks on on-board sensors or actuator of the robots in MRS. In this regard, we model additive sensor and actuator faults which are induced externally to render the MRS unstable. However, applying $H_{\infty}$ control protocols by employing a static output-feedback design technique guarantees bounded $L_2$ gains of the error induced by the sensor and actuator fault signals. Finally, we apply policy iteration based Q-Learning to solve for adaptive gains for the discrete-time MRS. Simulation results are provided to support the theoretical findings.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
-
MIMO SWIPT Systems with Power Amplifier Nonlinearities and Memory Effects
Authors:
Priyadarshi Mukherjee,
Souhir Lajnef,
Ioannis Krikidis
Abstract:
In this letter, we study the impact of nonlinear high power amplifier (HPA) on simultaneous wireless information and power transfer (SWIPT), for a point-to-point multiple-input multiple-output communication system. We derive the rate-energy (RE) region by taking into account the HPA nonlinearities and its associated memory effects. We show that HPA significantly degrades the achievable RE region,…
▽ More
In this letter, we study the impact of nonlinear high power amplifier (HPA) on simultaneous wireless information and power transfer (SWIPT), for a point-to-point multiple-input multiple-output communication system. We derive the rate-energy (RE) region by taking into account the HPA nonlinearities and its associated memory effects. We show that HPA significantly degrades the achievable RE region, and a predistortion technique is investigated for compensation. The performance of the proposed predistortion scheme is evaluated in terms of RE region enhancement. Numerical results demonstrate that approximately 24% improvement is obtained for both power-splitting and time-splitting SWIPT architectures.
△ Less
Submitted 14 August, 2020;
originally announced August 2020.
-
Attentional networks for music generation
Authors:
Gullapalli Keerti,
A N Vaishnavi,
Prerana Mukherjee,
A Sree Vidya,
Gattineni Sai Sreenithya,
Deeksha Nayab
Abstract:
Realistic music generation has always remained as a challenging problem as it may lack structure or rationality. In this work, we propose a deep learning based music generation method in order to produce old style music particularly JAZZ with rehashed melodic structures utilizing a Bi-directional Long Short Term Memory (Bi-LSTM) Neural Network with Attention. Owing to the success in modelling long…
▽ More
Realistic music generation has always remained as a challenging problem as it may lack structure or rationality. In this work, we propose a deep learning based music generation method in order to produce old style music particularly JAZZ with rehashed melodic structures utilizing a Bi-directional Long Short Term Memory (Bi-LSTM) Neural Network with Attention. Owing to the success in modelling long-term temporal dependencies in sequential data and its success in case of videos, Bi-LSTMs with attention serve as the natural choice and early utilization in music generation. We validate in our experiments that Bi-LSTMs with attention are able to preserve the richness and technical nuances of the music performed.
△ Less
Submitted 6 February, 2020;
originally announced February 2020.
-
Indian EmoSpeech Command Dataset: A dataset for emotion based speech recognition in the wild
Authors:
Subham Banga,
Ujjwal Upadhyay,
Piyush Agarwal,
Aniket Sharma,
Prerana Mukherjee
Abstract:
Speech emotion analysis is an important task which further enables several application use cases. The non-verbal sounds within speech utterances also play a pivotal role in emotion analysis in speech. Due to the widespread use of smartphones, it becomes viable to analyze speech commands captured using microphones for emotion understanding by utilizing on-device machine learning models. The non-ver…
▽ More
Speech emotion analysis is an important task which further enables several application use cases. The non-verbal sounds within speech utterances also play a pivotal role in emotion analysis in speech. Due to the widespread use of smartphones, it becomes viable to analyze speech commands captured using microphones for emotion understanding by utilizing on-device machine learning models. The non-verbal information includes the environment background sounds describing the type of surroundings, current situation and activities being performed. In this work, we consider both verbal (speech commands) and non-verbal sounds (background noises) within an utterance for emotion analysis in real-life scenarios. We create an indigenous dataset for this task namely "Indian EmoSpeech Command Dataset". It contains keywords with diverse emotions and background sounds, presented to explore new challenges in audio analysis. We exhaustively compare with various baseline models for emotion analysis on speech commands on several performance metrics. We demonstrate that we achieve a significant average gain of 3.3% in top-one score over a subset of speech command dataset for keyword spotting.
△ Less
Submitted 18 October, 2019;
originally announced October 2019.
-
Experimental Validation of Stable Coordination for Multi-Robot Systems with Limited Fields of View using a PortableMulti-Robot Testbed
Authors:
Pratik Mukherjee,
Matteo Santilli,
Andrea Gasparri,
Ryan K Williams
Abstract:
In this paper, we address the problem of stable coordinated motion in multi-robot systems with limited fields of view (FOVs). These problems arise naturally for multi-robot systems that interact based on sensing, such as our case study of multiple unmanned aerial vehicles (UAVs) each equipped with several cameras that are used for detecting neighboring UAVs. In this context, our contributions are:…
▽ More
In this paper, we address the problem of stable coordinated motion in multi-robot systems with limited fields of view (FOVs). These problems arise naturally for multi-robot systems that interact based on sensing, such as our case study of multiple unmanned aerial vehicles (UAVs) each equipped with several cameras that are used for detecting neighboring UAVs. In this context, our contributions are: i) first, we derive a framework for studying stable motion and distributed topology control for multi-robot systems with limited FOVs; and ii) Then, we provide experimental results in indoor and challenging outdoor environments (e.g., with wind speeds up to 10 mph) with a team of UAVs to demonstrate the performance of the proposed control framework using a portable multi-robot experimental set-up.
△ Less
Submitted 16 September, 2019;
originally announced September 2019.
-
Multi-level Attention network using text, audio and video for Depression Prediction
Authors:
Anupama Ray,
Siddharth Kumar,
Rutvik Reddy,
Prerana Mukherjee,
Ritu Garg
Abstract:
Depression has been the leading cause of mental-health illness worldwide. Major depressive disorder (MDD), is a common mental health disorder that affects both psychologically as well as physically which could lead to loss of lives. Due to the lack of diagnostic tests and subjectivity involved in detecting depression, there is a growing interest in using behavioural cues to automate depression dia…
▽ More
Depression has been the leading cause of mental-health illness worldwide. Major depressive disorder (MDD), is a common mental health disorder that affects both psychologically as well as physically which could lead to loss of lives. Due to the lack of diagnostic tests and subjectivity involved in detecting depression, there is a growing interest in using behavioural cues to automate depression diagnosis and stage prediction. The absence of labelled behavioural datasets for such problems and the huge amount of variations possible in behaviour makes the problem more challenging. This paper presents a novel multi-level attention based network for multi-modal depression prediction that fuses features from audio, video and text modalities while learning the intra and inter modality relevance. The multi-level attention reinforces overall learning by selecting the most influential features within each modality for the decision making. We perform exhaustive experimentation to create different regression models for audio, video and text modalities. Several fusions models with different configurations are constructed to understand the impact of each feature and modality. We outperform the current baseline by 17.52% in terms of root mean squared error.
△ Less
Submitted 3 September, 2019;
originally announced September 2019.
