-
CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI
Authors:
Zi Wang,
Fanwen Wang,
Chen Qin,
Jun Lyu,
Ouyang Cheng,
Shuo Wang,
Yan Li,
Mengyao Yu,
Haoyu Zhang,
Kunyuan Guo,
Zhang Shi,
Qirong Li,
Ziqiang Xu,
Ya**g Zhang,
Hao Li,
Sha Hua,
Binghua Chen,
Longyu Sun,
Mengting Sun,
Qin Li,
Ying-Hua Chu,
Wenjia Bai,
**g Qin,
Xiahai Zhuang,
Claudia Prieto
, et al. (7 additional authors not shown)
Abstract:
Cardiac magnetic resonance imaging (MRI) has emerged as a clinically gold-standard technique for diagnosing cardiac diseases, thanks to its ability to provide diverse information with multiple modalities and anatomical views. Accelerated cardiac MRI is highly expected to achieve time-efficient and patient-friendly imaging, and then advanced image reconstruction approaches are required to recover h…
▽ More
Cardiac magnetic resonance imaging (MRI) has emerged as a clinically gold-standard technique for diagnosing cardiac diseases, thanks to its ability to provide diverse information with multiple modalities and anatomical views. Accelerated cardiac MRI is highly expected to achieve time-efficient and patient-friendly imaging, and then advanced image reconstruction approaches are required to recover high-quality, clinically interpretable images from undersampled measurements. However, the lack of publicly available cardiac MRI k-space dataset in terms of both quantity and diversity has severely hindered substantial technological progress, particularly for data-driven artificial intelligence. Here, we provide a standardized, diverse, and high-quality CMRxRecon2024 dataset to facilitate the technical development, fair evaluation, and clinical transfer of cardiac MRI reconstruction approaches, towards promoting the universal frameworks that enable fast and robust reconstructions across different cardiac MRI protocols in clinical practice. To the best of our knowledge, the CMRxRecon2024 dataset is the largest and most diverse publicly available cardiac k-space dataset. It is acquired from 330 healthy volunteers, covering commonly used modalities, anatomical views, and acquisition trajectories in clinical cardiac MRI workflows. Besides, an open platform with tutorials, benchmarks, and data processing tools is provided to facilitate data usage, advanced method development, and fair performance evaluation.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stains
Authors:
Shengyi Hua,
Fang Yan,
Tianle Shen,
Xiaofan Zhang
Abstract:
Large amounts of digitized histopathological data display a promising future for develo** pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for downstream tasks. However, the gap between natural and histopathological images hinders the direct application of existing methods. In this work, we present PathoDue…
▽ More
Large amounts of digitized histopathological data display a promising future for develo** pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for downstream tasks. However, the gap between natural and histopathological images hinders the direct application of existing methods. In this work, we present PathoDuet, a series of pretrained models on histopathological images, and a new self-supervised learning framework in histopathology. The framework is featured by a newly-introduced pretext token and later task raisers to explicitly utilize certain relations between images, like multiple magnifications and multiple stains. Based on this, two pretext tasks, cross-scale positioning and cross-stain transferring, are designed to pretrain the model on Hematoxylin and Eosin (H\&E) images and transfer the model to immunohistochemistry (IHC) images, respectively. To validate the efficacy of our models, we evaluate the performance over a wide variety of downstream tasks, including patch-level colorectal cancer subty** and whole slide image (WSI)-level classification in H\&E field, together with expression level prediction of IHC marker and tumor identification in IHC field. The experimental results show the superiority of our models over most tasks and the efficacy of proposed pretext tasks. The codes and models are available at https://github.com/openmedlab/PathoDuet.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Complexity of Government response to Covid-19 pandemic: A perspective of coupled dynamics on information heterogeneity and epidemic outbreak
Authors:
Xiaoqi Zhang,
Jie Fu,
Sheng Hua,
Han Liang,
Zi-Ke Zhang
Abstract:
This study aims at modeling the universal failure in preventing the outbreak of COVID-19 via real-world data from the perspective of complexity and network science. Through formalizing information heterogeneity and government intervention in the coupled dynamics of epidemic and infodemic spreading; first, we find that information heterogeneity and its induced variation in human responses significa…
▽ More
This study aims at modeling the universal failure in preventing the outbreak of COVID-19 via real-world data from the perspective of complexity and network science. Through formalizing information heterogeneity and government intervention in the coupled dynamics of epidemic and infodemic spreading; first, we find that information heterogeneity and its induced variation in human responses significantly increase the complexity of the government intervention decision. The complexity results in a dilemma between the socially optimal intervention that is risky for the government and the privately optimal intervention that is safer for the government but harmful to the social welfare. Second, via counterfactual analysis against the COVID-19 crisis in Wuhan, 2020, we find that the intervention dilemma becomes even worse if the initial decision time and the decision horizon vary. In the short horizon, both socially and privately optimal interventions agree with each other and require blocking the spread of all COVID-19-related information, leading to a negligible infection ratio 30 days after the initial reporting time. However, if the time horizon is prolonged to 180 days, only the privately optimal intervention requires information blocking, which would induce a catastrophically higher infection ratio than that in the counter-factual world where the socially optimal intervention encourages early-stage information spread. These findings contribute to the literature by revealing the complexity incurred by the coupled infodemic-epidemic dynamics and information heterogeneity to the governmental intervention decision, which also sheds insight into the design of an effective early warning system against the epidemic crisis in the future.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction
Authors:
Chengyan Wang,
Jun Lyu,
Shuo Wang,
Chen Qin,
Kunyuan Guo,
Xinyu Zhang,
Xiaotong Yu,
Yan Li,
Fanwen Wang,
Jianhua **,
Zhang Shi,
Ziqiang Xu,
Yapeng Tian,
Sha Hua,
Zhensen Chen,
Meng Liu,
Mengting Sun,
Xutong Kuang,
Kang Wang,
Haoran Wang,
Hao Li,
Yinghua Chu,
Guang Yang,
Wenjia Bai,
Xiahai Zhuang
, et al. (3 additional authors not shown)
Abstract:
Cardiac magnetic resonance imaging (CMR) has emerged as a valuable diagnostic tool for cardiac diseases. However, a limitation of CMR is its slow imaging speed, which causes patient discomfort and introduces artifacts in the images. There has been growing interest in deep learning-based CMR imaging algorithms that can reconstruct high-quality images from highly under-sampled k-space data. However,…
▽ More
Cardiac magnetic resonance imaging (CMR) has emerged as a valuable diagnostic tool for cardiac diseases. However, a limitation of CMR is its slow imaging speed, which causes patient discomfort and introduces artifacts in the images. There has been growing interest in deep learning-based CMR imaging algorithms that can reconstruct high-quality images from highly under-sampled k-space data. However, the development of deep learning methods requires large training datasets, which have not been publicly available for CMR. To address this gap, we released a dataset that includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects. Imaging studies include cardiac cine and map** sequences. Manual segmentations of the myocardium and chambers of all the subjects are also provided within the dataset. Scripts of state-of-the-art reconstruction algorithms were also provided as a point of reference. Our aim is to facilitate the advancement of state-of-the-art CMR image reconstruction by introducing standardized evaluation criteria and making the dataset freely accessible to the research community. Researchers can access the dataset at https://www.synapse.org/#!Synapse:syn51471091/wiki/.
△ Less
Submitted 19 September, 2023;
originally announced September 2023.
-
One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction
Authors:
Zi Wang,
Xiaotong Yu,
Chengyan Wang,
Weibo Chen,
Jiazheng Wang,
Ying-Hua Chu,
Hongwei Sun,
Rushuai Li,
Peiyong Li,
Fan Yang,
Haiwei Han,
Taishan Kang,
Jianzhong Lin,
Chen Yang,
Shufu Chang,
Zhang Shi,
Sha Hua,
Yan Li,
Juan Hu,
Liuhong Zhu,
Jianjun Zhou,
Mei**g Lin,
Jiefeng Guo,
Congbo Cai,
Zhong Chen
, et al. (3 additional authors not shown)
Abstract:
Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its accessibility. The k-space undersampling offers a solution, yet the resultant artifacts necessitate meticulous removal during image reconstruction. Although Deep…
▽ More
Magnetic resonance imaging (MRI) is a widely used radiological modality renowned for its radiation-free, comprehensive insights into the human body, facilitating medical diagnoses. However, the drawback of prolonged scan times hinders its accessibility. The k-space undersampling offers a solution, yet the resultant artifacts necessitate meticulous removal during image reconstruction. Although Deep Learning (DL) has proven effective for fast MRI image reconstruction, its broader applicability across various imaging scenarios has been constrained. Challenges include the high cost and privacy restrictions associated with acquiring large-scale, diverse training data, coupled with the inherent difficulty of addressing mismatches between training and target data in existing DL methodologies. Here, we present a novel Physics-Informed Synthetic data learning framework for Fast MRI, called PISF. PISF marks a breakthrough by enabling generalized DL for multi-scenario MRI reconstruction through a single trained model. Our approach separates the reconstruction of a 2D image into many 1D basic problems, commencing with 1D data synthesis to facilitate generalization. We demonstrate that training DL models on synthetic data, coupled with enhanced learning techniques, yields in vivo MRI reconstructions comparable to or surpassing those of models trained on matched realistic datasets, reducing the reliance on real-world MRI data by up to 96%. Additionally, PISF exhibits remarkable generalizability across multiple vendors and imaging centers. Its adaptability to diverse patient populations has been validated through evaluations by ten experienced medical professionals. PISF presents a feasible and cost-effective way to significantly boost the widespread adoption of DL in various fast MRI applications.
△ Less
Submitted 28 February, 2024; v1 submitted 24 July, 2023;
originally announced July 2023.
-
From Single-Visit to Multi-Visit Image-Based Models: Single-Visit Models are Enough to Predict Obstructive Hydronephrosis
Authors:
Stanley Bryan Z. Hua,
Mandy Rickard,
John Weaver,
Alice Xiang,
Daniel Alvarez,
Kyla N. Velear,
Kunj Sheth,
Gregory E. Tasian,
Armando J. Lorenzo,
Anna Goldenberg,
Lauren Erdman
Abstract:
Previous work has shown the potential of deep learning to predict renal obstruction using kidney ultrasound images. However, these image-based classifiers have been trained with the goal of single-visit inference in mind. We compare methods from video action recognition (i.e. convolutional pooling, LSTM, TSM) to adapt single-visit convolutional models to handle multiple visit inference. We demonst…
▽ More
Previous work has shown the potential of deep learning to predict renal obstruction using kidney ultrasound images. However, these image-based classifiers have been trained with the goal of single-visit inference in mind. We compare methods from video action recognition (i.e. convolutional pooling, LSTM, TSM) to adapt single-visit convolutional models to handle multiple visit inference. We demonstrate that incorporating images from a patient's past hospital visits provides only a small benefit for the prediction of obstructive hydronephrosis. Therefore, inclusion of prior ultrasounds is beneficial, but prediction based on the latest ultrasound is sufficient for patient risk stratification.
△ Less
Submitted 27 December, 2022;
originally announced December 2022.
-
A semantic hierarchical graph neural network for text classification
Authors:
Shuai Hua,
Xinxin Li,
Yunpeng **g,
Qunfeng Liu
Abstract:
The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually emerged and shown its advantages, but the existing models mainly focus on directly inputting words as graph nodes into the GNN models ignoring the different level…
▽ More
The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually emerged and shown its advantages, but the existing models mainly focus on directly inputting words as graph nodes into the GNN models ignoring the different levels of semantic structure information in the samples. To address the issue, we propose a new hierarchical graph neural network (HieGNN) which extracts corresponding information from word-level, sentence-level and document-level respectively. Experimental results on several benchmark datasets achieve better or similar results compared to several baseline methods, which demonstrate that our model is able to obtain more useful information for classification from samples.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
CytoImageNet: A large-scale pretraining dataset for bioimage transfer learning
Authors:
Stanley Bryan Z. Hua,
Alex X. Lu,
Alan M. Moses
Abstract:
Motivation: In recent years, image-based biological assays have steadily become high-throughput, sparking a need for fast automated methods to extract biologically-meaningful information from hundreds of thousands of images. Taking inspiration from the success of ImageNet, we curate CytoImageNet, a large-scale dataset of openly-sourced and weakly-labeled microscopy images (890K images, 894 classes…
▽ More
Motivation: In recent years, image-based biological assays have steadily become high-throughput, sparking a need for fast automated methods to extract biologically-meaningful information from hundreds of thousands of images. Taking inspiration from the success of ImageNet, we curate CytoImageNet, a large-scale dataset of openly-sourced and weakly-labeled microscopy images (890K images, 894 classes). Pretraining on CytoImageNet yields features that are competitive to ImageNet features on downstream microscopy classification tasks. We show evidence that CytoImageNet features capture information not available in ImageNet-trained features. The dataset is made available at https://www.kaggle.com/stanleyhua/cytoimagenet.
△ Less
Submitted 23 November, 2021; v1 submitted 22 November, 2021;
originally announced November 2021.
-
Reasonableness discussion and analysis for Hyperledger Fabric configuration
Authors:
Song Hua,
Shenbin Zhang,
Bingfeng Pi,
Jun Sun,
Kazuhiro Yamashita,
Yoshihide Nomura
Abstract:
Blockchain, as a distributed ledger technology, becomes more and more popular in both industry and academia. Each peer in blockchain system maintains a copy of ledger and makes sure of data consistency through consensus protocol. Blockchain system can provide many benefits such as immutability, transparency and security. Hyperledger Fabric is permissioned blockchain platform hosted by Linux founda…
▽ More
Blockchain, as a distributed ledger technology, becomes more and more popular in both industry and academia. Each peer in blockchain system maintains a copy of ledger and makes sure of data consistency through consensus protocol. Blockchain system can provide many benefits such as immutability, transparency and security. Hyperledger Fabric is permissioned blockchain platform hosted by Linux foundation. Fabric has various components such as peer, ordering service, chaincode and state database. The structure of Fabric network is very complicated to provide reliable permissioned blockchain service. Generally, developers must deal with hundreds of parameters to configure a network. That will cause many reasonableness problems in configurations. In this paper, we focus on how to detect reasonableness problems in Fabric configurations. Firstly, we discuss and provide a reasonableness problem knowledge database based on the perspectives of functionality, security and performance. Secondly, we implemented a detect tool for reasonableness check to Fabric. Finally, we collect 108 sample networks as the testing dataset in the experiment. The result shows our tool can help developers to locate reasonableness problems and understand their network better.
△ Less
Submitted 22 May, 2020;
originally announced May 2020.
-
Sparse Optimization for Green Edge AI Inference
Authors:
Xiangyu Yang,
Sheng Hua,
Yuanming Shi,
Hao Wang,
Jun Zhang,
Khaled B. Letaief
Abstract:
With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing capability. In such scenarios, energy efficiency becomes a primary concern. In this paper, we present a joint inference task selection and downlink beamforming strateg…
▽ More
With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing capability. In such scenarios, energy efficiency becomes a primary concern. In this paper, we present a joint inference task selection and downlink beamforming strategy to achieve energy-efficient edge AI inference through minimizing the overall power consumption consisting of both computation and transmission power consumption, yielding a mixed combinatorial optimization problem. By exploiting the inherent connections between the set of task selection and group sparsity structural transmit beamforming vector, we reformulate the optimization as a group sparse beamforming problem. To solve this challenging problem, we propose a log-sum function based three-stage approach. By adopting the log-sum function to enhance the group sparsity, a proximal iteratively reweighted algorithm is developed. Furthermore, we establish the global convergence analysis and provide the ergodic worst-case convergence rate for this algorithm. Simulation results will demonstrate the effectiveness of the proposed approach for improving energy efficiency in edge AI inference systems.
△ Less
Submitted 13 March, 2020; v1 submitted 24 February, 2020;
originally announced February 2020.
-
Reconfigurable Intelligent Surface for Green Edge Inference
Authors:
Sheng Hua,
Yong Zhou,
Kai Yang,
Yuanming Shi
Abstract:
Reconfigurable intelligent surface (RIS) as an emerging cost-effective technology can enhance the spectrum- and energy-efficiency of wireless networks. In this paper, we consider an RIS-aided green edge inference system, where the inference tasks generated from resource-limited mobile devices (MDs) are uploaded to and cooperatively performed at multiple resource-enhanced base stations (BSs). Takin…
▽ More
Reconfigurable intelligent surface (RIS) as an emerging cost-effective technology can enhance the spectrum- and energy-efficiency of wireless networks. In this paper, we consider an RIS-aided green edge inference system, where the inference tasks generated from resource-limited mobile devices (MDs) are uploaded to and cooperatively performed at multiple resource-enhanced base stations (BSs). Taking into account both the computation and uplink/downlink transmit power consumption, we formulate an overall network power consumption minimization problem, which calls for the joint design of the set of tasks performed by each BS, transmit and receive beamforming vectors of the BSs, transmit power of the MDs, and uplink/downlink phase-shift matrices at the RIS. Such a problem is a mixed combinatorial optimization problem with nonconvex constraints and is highly intractable. To address the challenge of the combinatorial objective, a group sparse reformulation is proposed by exploiting the group sparsity structure of the beamforming vectors, while a block-structured optimization (BSO) approach is proposed to decouple the optimization variables. Finally, we propose a BSO with mixed $\ell_{1,2}$-norm and difference-of-convex-functions (DC) based three-stage framework to solve the problem, where the mixed $\ell_{1,2}$-norm is adopted to induce the group sparsity of beamforming vectors and DC is adopted to effectively handle the nonconvex rank-one constraint after matrix lifting. Numerical results demonstrate the supreme gain of deploying an RIS and confirm the effectiveness of the proposed algorithm over the baseline algorithms.
△ Less
Submitted 5 December, 2019; v1 submitted 2 December, 2019;
originally announced December 2019.
-
A Truthful Auction based Incentive Framework for Femtocell Access
Authors:
Sha Hua,
Xuejun Zhuo,
Shivendra S. Panwar
Abstract:
As cellular operators are suffering from a data explosion problem, and users are consequently experiencing poor data services, the introduction of femtocells offers a cost-effective way to mitigate this problem. Femtocells enable larger network capacity by increasing spatial reuse of the spectrum and shortening the distance to the users. Existing work has shown that open access femtocells, which a…
▽ More
As cellular operators are suffering from a data explosion problem, and users are consequently experiencing poor data services, the introduction of femtocells offers a cost-effective way to mitigate this problem. Femtocells enable larger network capacity by increasing spatial reuse of the spectrum and shortening the distance to the users. Existing work has shown that open access femtocells, which allow unregistered macro users to connect, are efficient in reducing inter-cell interference and offloading traffic. However, a major obstacle constraining the potential capability of femtocells and open access is the lack of incentives for privately-owned femtocells to serve unregistered users. Hence in this paper, we propose a Vickrey-Clarke-Groves (VCG) auction based incentive framework for accessing such selfish femtocells. We consider two scenarios: One scenario involves a single macro user and another scenario has multiple macro users. We design auction schemes for both scenarios and show analytically that our schemes are truthful and have low computational complexity. Extensive simulations validate these properties and show huge performance improvement to the macro users.
△ Less
Submitted 16 January, 2013; v1 submitted 17 October, 2012;
originally announced October 2012.
-
The Urge to Merge: When Cellular Service Providers Pool Capacity
Authors:
Sha Hua,
Pei Liu,
Shivendra Panwar
Abstract:
As cellular networks are turning into a platform for ubiquitous data access, cellular operators are facing a severe data capacity crisis due to the exponential growth of traffic generated by mobile users. In this work, we investigate the benefits of sharing infrastructure and spectrum among two cellular operators. Specifically, we provide a multi-cell analytical model using stochastic geometry to…
▽ More
As cellular networks are turning into a platform for ubiquitous data access, cellular operators are facing a severe data capacity crisis due to the exponential growth of traffic generated by mobile users. In this work, we investigate the benefits of sharing infrastructure and spectrum among two cellular operators. Specifically, we provide a multi-cell analytical model using stochastic geometry to identify the performance gain under different sharing strategies, which gives tractable and accurate results. To validate the performance using a realistic setting, we conduct extensive simulations for a multi-cell OFDMA system using real base station locations. Both analytical and simulation results show that even a simple cooperation strategy between two similar operators, where they share spectrum and base stations, roughly quadruples capacity as compared to the capacity of a single operator. This is equivalent to doubling the capacity per customer, providing a strong incentive for operators to cooperate, if not actually merge.
△ Less
Submitted 8 November, 2011;
originally announced November 2011.
-
A Silicon-Based Micro Gas Turbine Engine for Power Generation
Authors:
X. -C. Shan,
Z. -F. Wang,
R. Maeda,
Y. F. Sun,
M. Wu,
J. S. Hua
Abstract:
This paper reports on our research in develo** a micro power generation system based on gas turbine engine and piezoelectric converter. The micro gas turbine engine consists of a micro combustor, a turbine and a centrifugal compressor. Comprehensive simulation has been implemented to optimal the component design. We have successfully demonstrated a silicon-based micro combustor, which consists…
▽ More
This paper reports on our research in develo** a micro power generation system based on gas turbine engine and piezoelectric converter. The micro gas turbine engine consists of a micro combustor, a turbine and a centrifugal compressor. Comprehensive simulation has been implemented to optimal the component design. We have successfully demonstrated a silicon-based micro combustor, which consists of seven layers of silicon structures. A hairpin-shaped design is applied to the fuel/air recirculation channel. The micro combustor can sustain a stable combustion with an exit temperature as high as 1600 K. We have also successfully developed a micro turbine device, which is equipped with enhanced micro air-bearings and driven by compressed air. A rotation speed of 15,000 rpm has been demonstrated during lab test. In this paper, we will introduce our research results major in the development of micro combustor and micro turbine test device.
△ Less
Submitted 21 November, 2007;
originally announced November 2007.