Generative AI-Driven Human Digital Twin in IoT-Healthcare: A Comprehensive Survey

Abstract

The Internet of things (IoT) can significantly enhance the quality of human life, specifically in healthcare, attracting extensive attentions to IoT-healthcare services. Meanwhile, the human digital twin (HDT) is proposed as an innovative paradigm that can comprehensively characterize the replication of the individual human body in the digital world and reflect its physical status in real time. Naturally, HDT is envisioned to empower IoT-healthcare beyond the application of healthcare monitoring by acting as a versatile and vivid human digital testbed, simulating the outcomes and guiding the practical treatments. However, successfully establishing HDT requires high-fidelity virtual modeling and strong information interactions but possibly with scarce, biased and noisy data. Fortunately, a recent popular technology called generative artificial intelligence (GAI) may be a promising solution because it can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data. This survey particularly focuses on the implementation of GAI-driven HDT in IoT-healthcare. We start by introducing the background of IoT-healthcare and the potential of GAI-driven HDT. Then, we delve into the fundamental techniques and present the overall framework of GAI-driven HDT. After that, we explore the realization of GAI-driven HDT in detail, including GAI-enabled data acquisition, communication, data management, digital modeling, and data analysis. Besides, we discuss typical IoT-healthcare applications that can be revolutionized by GAI-driven HDT, namely personalized health monitoring and diagnosis, personalized prescription, and personalized rehabilitation. Finally, we conclude this survey by highlighting some future research directions.

I Introduction

I-A Background

The Internet of the Things (IoT) refers to a group of Internet-connected devices that have computing capability, are easy to identify, and are able to share data over the Internet without the need for direct touch [1]. The IoT progression has led to unmatched connectivity among devices, paving the way for the creation of intelligent environments, enabling new ways of working, communicating, interacting, entertaining, and living [2]. Notably, IoT is leading to a paradigm shift in the healthcare industry, which are termed IoT-healthcare [3, 4]. A global healthcare organization estimates that roughly 17.5 million lives are lost annually due to inefficiencies in collecting and analyzing health data [5]. Fortunately, the advancement of IoT-healthcare presents a promising avenue to tackle these challenges [6]. By enabling the real-time collection and transmission of pertinent health data to servers for in-depth healthcare analysis via personal IoT devices, it can prompt timely healthcare alerts and proactive interventions for saving lives [7, 8]. IoT-healthcare has been widely applied in healthcare monitoring, including blood glucose monitoring, cardiac monitoring, respiration monitoring and blood pressure monitoring, providing people with pervasive healthcare services [6, 7].

Meanwhile, digital twin (DT) has attracted substantial attentions since 2002 when Michael Grieves delivered a presentation at the University of Michigan [9]. With the continuous progression, DT, nowadays, is characterized as a smart, evolving system that precisely mirrors a physical entity at various granularity levels, and monitors, controls, and optimizes the physical objects during its lifecycle [10]. When adopting DT in the human-centric systems, a revolutionary technology known as Human Digital Twin (HDT) has emerged. HDT is a promising technology and game changer for IoT-healthcare, taking this field to another level. HDT can create a digital replica of a human body, comprehensively and precisely characterizing each individual in the digital space while reflecting its physical status in real time [11, 12, 13, 14, 15].

Besides, with visualization and interaction characteristics, HDT is envisioned as a versatile and vivid human digital testbed for revolutionizing the IoT-healthcare, beyond healthcare monitoring applications mentioned above. For instance, a patient’s HDT can be implemented in silico treatment simulations and experiments, facilitating the development of finely-tailored, personalized treatment plans [16]. Additionally, a doctor’s HDT with expert-level medical knowledge can be a personal 24/7 doctor to answer the patients’ queries [17].

The successful establishment and implementation of HDT largely depend on the high-fidelity human modeling, supported by comprehensive individual-level data encompassing appearance, movement, and physiological data, acquired from multi-source, such as IoT devices. In addition, as an intelligent human digital testbed, HDT needs to generate various human-like feedback during immersive real-virtual interactions. These include, for example, providing intuitive feedback on drug-disease responses, and simulating haptic feedback to replicate the tactile sensations experienced by humans in real-world scenarios. All such requirements are difficult to meet due to several crucial reasons, e.g., data scarcity, bias, noise and intricate digital modeling. Fortunately, generative artificial intelligence (GAI) has been recognized as a promising technology that can effectively fulfill or assist the implementation of HDT for IoT-healthcare [18].

GAI can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data [19, 20]. Specifically, GAI models, such as generative adversarial network (GAN), variational autoencoder (VAE), transformer, and diffusion model, with their powerful creativities and data analysis abilities can generate ultra-realistic individual-level data and make informed decisions for HDT in IoT-healthcare, which will be elaborated in Section III. Thus, our survey focuses on how GAI enables HDT in IoT-healthcare, namely GAI-driven HDT in IoT-healthcare.

I-B Review Methodology

We identify three specific research questions that lead to the accomplishment of this work in the following.

1) RQ1: What is the definition of HDT? And what GAI models can be potentially applied in HDT?

2) RQ2: How GAI can enable the implementation of HDT?

3) RQ3: How GAI-driven HDT empowers IoT-healthcare?

We perform this survey in a systematic way following the guidelines, preferred reporting items for systematic reviews and meta-analyses (PRISMA) [21], which consists of three phases, i.e., identification, screening, eligibility and included.

1. Identification: For the literature review, we used three scientific platforms: Google Scholar, Scopus and Web of Science. The search string is defined as shown in Table I. Only papers written in English were included. Using these criteria, we found 2,416 papers on Google Scholar, 900 on Scopus, and 1,679 on Web of Science. We then eliminated duplicates from all the papers found. Additionally, some papers that were not highly relevant, potentially due to certain platforms ignoring logical operators (i.e., AND and OR), were also filtered out. The total number of selected papers in this phase was 1,736.

2. Screening: In this phase, we evaluated the selected papers in identification phase on the basis of their titles and abstracts. In this survey, we focus on the application of GAI techniques in building HDT from the perspective of IoT-healthcare. Specifically, GAI techniques are expected to enable each component of HDT, including data acquisition, communication, data management, digital modeling, and data analysis, which will be elaborated in Section III. All of these GAI-driven components are required to potentially empower IoT-healthcare. Thus, following these criteria, we further filtered these 1736 papers to be 369 papers by examining their titles and abstracts.

3. Eligibility and Included: Since the titles and abstracts of some papers were not clear enough to be directly evaluated, a full-text screening was performed on these 369 papers during this phase. We followed the criteria from the screening phase. Finally, a total of 172 papers were included in this paper.

TABLE I: Search String of Acquiring the Literature.

I-C Related Work and Contributions

Given the increasing interest of GAI-driven HDT in IoT-healthcare, several surveys and tutorials have been recently published [22, 23, 24, 25, 26, 27]. Table II presents a comparison of these related works compared with ours.

TABLE II: Comparison of The Related Work with Our Survey.

Specifically, Habibzadeh et al. in [6] surveyed the existing and emerging technologies that can enable IoT-healthcare. It presented the enabling technologies by investigating three of IoT-healthcare primary components: 1) sensing and data acquisition; 2) communication; and 3) data analytics and inference. Based on these, they also highlight some IoT-healthcare applications, including blood glucose monitoring, cardiac monitoring, respiration monitoring, blood pressure monitoring, among others. Yang et al. in [7] investigated the IoT-healthcare applications with high relevance to daily health routines, including activity recognition, fitness assistance, vital signs monitoring, daily dietary tracking, and sleep monitoring. Additionally, they surveyed the ways of implementing these applications based on leveraging of sensors, such as device-based paradigms using hardware on the body, and device-free paradigms using wireless signal transceivers. However, these surveys mainly focused on healthcare monitoring enabled by IoT, ignoring the power of integration of HDT, which can significantly enrich the application of IoT-healthcare.

With the prevalence of HDT, there are several surveys are liberating the power of HDT in IoT-healthcare. Chen et al. in [13] comprehensively explored the networking architecture and key supporting technologies for realizing HDT in personalized healthcare. Specifically, the networking architecture consisted of data acquisition, communication, computation, data management, data analysis and decision making layers. They surveyed the enabling technologies for each layer. Additionally, they delved into the application of HDT in personalized healthcare, including personalized diagnosis, prescription, surgery, and rehabilitation. Sun et al. in [28] highlighted that the HDT can revolutionize IoT-healthcare by providing customized diagnosis and treatment. They revealed that by using a patient’s HDT, the medical system can predict the patient’s immune response to infection or injury, which can help doctors diagnose diseases precisely. Additionally, they investigated that the patient’s HDT can be used as a vivid digital testbed before the prescription or surgery, thereby supporting personalized treatment in a non-invasive manner. Furthermore, they surveyed more specific applications of HDT in IoT-healthcare, including cardiovascular disease, surgery, pharmacy, orthopaedics and COVID-19. However, none of them discuss the role of GAI for HDT in IoT-healthcare.

GAI, with its superior data generation and analysis capabilities, has attracted a myriad of researches recently, and many of them focused on its application in healthcare. AlAmir et al. in [29] discussed the recent advancements in GANs, particularly in the healthcare field. Specifically, they investigated the extension models of GANs by classifying and introducing them individually. Then, they surveyed the applications of these GAN models in medical images, including cross-modality synthesis, segmentation, augmentation, detection, classification, registration and reconstruction. Shokrollahi et al. in [30] delved into the critical role of GAI, such as transformers and diffusion models, in healthcare applications, including medical imaging, protein structure prediction, clinical documentation, diagnostic assistance, radiology interpretation, clinical decision support, drug design and molecular representation. Such applications have significantly enhanced clinical diagnosis, data reconstruction, and drug synthesis.

Unlike the above surveys that broadly cover IoT-healthcare, HDT, and GAI, ours specifically investigates the pivotal role of GAI in HDT within IoT-healthcare by providing comprehensive and up-to-date review of the current works. GAI’s exceptional capabilities in data generation and analysis are crucial for improving all aspects of HDT implementation, from data collection and management to digital modeling and analysis. Our work marks the first in-depth survey of GAI-driven HDT in IoT-healthcare, offering insights into its application in personalized health monitoring adiagnosis, prescription, and rehabilitation. We also highlight current challenges and envisage future directions, ensuring our survey captures the emerging trends in this evolving field. The contributions of this survey can be summarized as follows, which also aims to answer to research questions listed in Section I-B :

• We thoroughly review the HDT and GAI technique, including differences between HDT and the conventional DT and the framework of HDT, as well as the popular GAI models.

• We explore the implementation of GAI-driven HDT. We comprehensively explain how GAI enables each component of HDT’s framework, including data acquisition, digital modeling, communication,data management and data analysis.

• We survey GAI-driven HDT in IoT-healthcare applications, including personalized health monitoring and diagnosis, prescription, and rehabilitation.

• We outline several open issues and future directions in GAI-driven HDT in IoT-healthcare, hel** to drive the development of this field.

The rest of this paper is organized as follows: Section II aims to answer RQ1 in Section I-B, which presents the fundamentals of HDT and GAI, and gives an overview of the framework of GAI-driven HDT. Section III aims to answer RQ2 in Section I-B, where the implementation of GAI-driven HDT is analyzed in detail. Section IV aims to answer RQ3 in Section I-B, which surveys the IoT-healthcare application of GAI-driven HDT, including personalized health monitoring and diagnosis, personalized prescription, and personalized rehabilitation. Section V explores several future research directions of GAI-driven HDT in IoT-healthcare. Section VI concludes this survey paper.

II Fundamentals of HDT and GAI

II-A Human Digital Twin

HDT as the versatile and vivid digital portrayal of individual, is breathing life into the digital world. According to Emergen Research, the global market for HDT will grow from $29.51\$$ billion in 2022 to about $530\$$ billion in 2032 [31]. With the continuous advancement of HDT, the IoT-healthcare is being revolutionized by HDT [13, 14, 32, 18].

HDT, focuses on digital replicas of human beings while the conventional DT limits the attention to non-living physical entities, e.g., machines [33] and networks [34]. Then, several distinguishing characteristics between HDT and the conventional DT are detailed below and summarized in Table III.

TABLE III: Differences Between HDT and the Conventional DT.

• Physiology and psychology: The most significant difference between HDT and conventional DT is physiology and psychology [35, 36, 37]. This includes attributes such as: i) physiological characteristics, e.g., brain electrophysiologic signals, blood oxygen level and heart rate; ii) perceptual abilities, e.g., visual sensitivity, pressure sensitivity and temperature sensitivity; iii) emotional state, e.g., happiness, depression and anxiety; iv) personality characteristics, e.g., personality type, propensity to trust, and propensity towards suspicion.

• Behavioral rule: Human beings’ external behaviors highly depend on the individual subjective consciousness. Particularly, internal behaviors, such as the progression of diseases and emotional states, are generally influenced by multi-source and complex factors, including external environments. In contrast, machines generally follow predominantly model-based and predetermined behavioral rules [38, 39]. Therefore, humans are highly complex systems with greater uncertainty levels than machines. The abstract processes of human beings in HDT are significantly more challenging than those of machines in the conventional DT.

• Metrics for evaluation: The human-centered paradigm of HDT requires improving human beings’ well-being by considering their roles, needs, talents and rights. Meanwhile, the conventional DT commonly takes the performance-centered interest first for improving production and economic benefits. Specifically, the conventional DT typically prioritize metrics such as efficiency, productivity, effectiveness, and profitability. However, HDT extends the scope of metrics to contain usability, user experience, etc [12].

• Data complexity: Human beings are more heterogeneous and unstructured than non-living machines. Consequently, unlike the conventional DT, building a high-fidelity digital representation model of any human entity in HDT requires diverse and complex data from multiple sources. In addition to physiological data, unstructured data from environmental factors and social media play a crucial role in abstracting human virtual twins. This is due to the significant correlation between human beings and such external data sources [13].

• Mobility pattern: Unlike the position-fixed machines in the conventional DT, the mobility patterns in HDT may be highly predictable. The mobility patterns of human beings can be categorized into human positional and postural mobility. Positional mobility, like a person moving from indoors to outdoors, may cause radio frequency (RF) propagation characteristics to change and even the service migrations. Additionally, the postural mobility of a human, like lying, sitting, walking, may cause signal strength to fluctuate due to the influence of human bodies on the path loss, known as body shadowing [13].

As the distinct features of HDT outlined above, the successful implementation of HDT relies on five essential components: data acquisition, communication, data management, digital modeling, and data analysis [12, 13, 14, 40]. These components form the framework of HDT. Note that, in HDT, the physical entity, i.e., the individual, in the physical world is called a physical twin (PT), while the corresponding virtual one in the digital world is called a virtual twin (VT). Section III delves into how GAI facilitates the actualization of HDT by bolstering each component within the framework of HDT. Before this, we introduce the GAI technique, unveiling its potential for enabling HDT.

II-B GAI Techniques

In this subsection, we delve into the recent primary trends of GAI models, including generative adversarial network, variational autoencoder, transformer and diffusion model [19, 41]. These models find frequent applications in HDT for IoT-healthcare [42, 43, 44, 45].

Figure 1: The workflow of recent primary trends of GAI models, including generative adversarial network, variational autoencoder, transformer and diffusion model.

Generative adversarial network: As depicted in Fig. 1, the GAN comprises two neural networks engaged in a competitive process to create new samples resembling a specific distribution [46]. The first network, the generator, aims to produce synthetic samples by comprehending the underlying distribution of the training data. Meanwhile, the discriminator, the second network, distinguishes between real and synthetic data generated by the generator. Its task is to accurately differentiate real samples and provide feedback to enhance the quality of the generated samples. Throughout the GAN training process, these two networks iteratively refine their performance adversarially, engaging in a competitive interplay until they achieve a stable equilibrium. This continuous refinement allows the generator to create more realistic samples while enabling the discriminator to better distinguish between real and synthetic data.

GAN is significant for HDT in IoT-healthcare, because of its ability to enrich training data, by generating realistic synthetic data. It can ensure patient privacy through anonymized data creation, facilitate data imputation with their cross-modality data translation capabilities, and aid in early anomaly detection for health conditions [42]. For example, a heart dynamics, represented by a ordinary differential equations (ODE) system, was integrated into the training of a GAN to generate biologically plausible electrocardiogram (ECG) data [47], which can be used to solve the ECG data scarcity issue when digital modeling of cardiac activities. Additionally, a chained GAN-based approach, which connected multiple GAN models, was proposed to simulate the pathology of tissues in the human body. Specifically, it included three steps: i) shape generation with a mask generator; ii) initial simulation via domain-specific heuristics; iii) detail refinement with a refining generator. This approach can be used to model tissue digital twin in HDT, as well as help diagnose diseases and predict their progress [48].

Variational autoencoder: The core idea of VAE is to transform input data to a low-dimensional latent space representation [49]. Illustrated in Fig. 1, VAE comprises two neural networks. The first network, known as the encoder, maps input data to a latent space, often assumed to follow a Gaussian distribution characterized by learned mean and variance parameters. In contrast, the other network, the decoder, undertakes the task of reconstructing the original input data from a sample drawn from the latent space distribution. The decoder aims to generate a reconstructed sample closely resembling the input data. Throughout the training process, the encoder and decoder parameters are optimized to minimize the reconstruction error. Additionally, a regularization term, the Kullback-Leibler divergence, is introduced to ensure that the learned latent space distribution closely aligns with a standard Gaussian distribution. This regularization term contributes to the overall objective of refining the latent space representation in the VAE framework.

VAE is pivotal for HDT in IoT-healthcare. The first key function is compressing and generating complex health data. Additionally, it is also instrumental in anomaly detection, aiding in the early identification of health issues. Moreover, VAE can support health prediction by simulating disease progression [43]. For instance, a VAE-based approach was introduced to reconstruct complete body movements using input signals from the PT’s head-mounted device (HMD) [50]. Specifically, the encoder took the input signals and mapped it into a latent space. Then, this latent space representation was used by the decoder to reconstruct the complete body movements. This method enabled the digital reconstruction of full-body motion based on signals from the head and hands. Similar VAE-based human motion generation was also presented in [51]. These proved beneficial for accurately modeling human motions in scenarios where motion data obtained from the PT may inadequately represent complete body movements, thereby aiding motion monitoring endeavors. Furthermore, a VAE-based method was proposed to predict potential subsequent steps in the clinical measurement trajectory of a patient encountering an ischemic stroke [52]. The model was trained on data from 1216 ischemic stroke patients in the medical information mart for intensive care-IV database. This approach holds promise in simulating disease progression within HDT, thereby assisting in customizing treatment plans tailored to individual patients.

Transformer: Transformer excels at capturing contextual information and long-distance dependencies in text [53]. The architecture used in this model is an encoder-decoder structure, as illustrated in Fig. 1. The encoder employs a bidirectional information propagation process to comprehend the input text. The decoder, found in most transformer architectures, generates words sequentially. This type of decoder is commonly referred to as an autoregressive decoder. With this architecture, embedding with self-attention mechanisms, it can effectively process the relevant information in the input sequence, making the generated text more accurate, coherent, and able to consider more contextual information.

Transformer is well-matched for HDT in IoT-healthcare by adeptly managing sequential health data, such as EHRs and sensor information. The proficiency in sequence-to-sequence tasks allows it to accurately interpret input sequences and generate corresponding outputs. Furthermore, thanks to the multi-head attention mechanism, transformers can masterfully navigate the intricate web of relationships among diverse health data types, e.g., clinical notes and lab results, enhancing their utility in complex healthcare environments [44]. For example, the state-of-the-art language generation model, generative pre-trained transformer (GPT), has been incorporated into EHR workflows to autonomously respond to patients’ healthcare inquiries [54]. This model can be visualized as an HDT representing a doctor, equipped with extensive medical knowledge, capable of addressing patient queries. Additionally, a pre-trained transformer-based approach has been proposed to concurrently learn gene and cell embeddings from a vast amount of single-cell sequencing data. The model further leveraged attention mechanism to capture intricate gene-to-gene interactions at the single-cell level [55]. This approach holds promise in digitally modeling diverse facets of cellular processes within HDT, offering insights into personalized responses to treatments.

Figure 2: The framework of GAI-driven HDT. It includes the GAI-enabled data acquisition, data management, data modeling and data analysis. With the implementation of them, the GAI-driven HDT can be applied in IoT-healthcare, including personalized health monitoring and diagnosis, personalized prescription, and personalized rehabilitation.

Diffusion model: Unlike GANs and VAEs, the diffusion model employs a series of sequential transformations on the input distribution [56, 19]. Specifically, as depicted in Fig. 1, this model constructs a Markov chain comprising diffusion steps where noise is incrementally introduced to the input data. Subsequently, a reverse process is implemented, gradually removing noise from the distribution to generate the desired data samples. This inverse method transforms noise distribution back to the original data distribution through a gradual denoising process.

Diffusion model is particularly applicable to HDT in IoT-healthcare. It can recreate complex, high-dimensional distributions of data learned from extensive relevant health datasets. This ability enables the diffusion model to capture the intricacies and variations of human health states and processes, thereby generating highly accurate and individual-specific data involved in HDT [45]. For instance, a diffusion model-based approach was proposed to generate individual electroencephalogram (EEG) data [57]. Specifically, the model was trained on maps of electrode-frequency distribution, which were created from extensive EEG datasets labeled with emotions. It can help solve the EEG data scarcity issue in HDT, and enable HDT to digitally model brain activity patterns, supporting the neurological health monitoring. Additionally, by collaborating with an assistive modality embedding as prior information to diffusion model formulation, a diffusion model-based approach was proposed for positron emission tomography (PET) denoising [58]. It can be used to denoise the acquired data with noise, providing cleaned data to HDT for better personalized healthcare monitoring and diagnostic accuracy. Besides, a diffusion-based unconditional 3D human generative model was proposed to 3D human generation [59]. To be more specific, it learned from 2D human images, leveraging the superior modeling and editing capabilities of structured 2D latents over 1D. The method combined a structured 3D-aware auto-decoder with a latent diffusion model to manage the structured 2D latent space effectively. This approach can facilitate the precise digital modeling of 3D human appearances within HDT.

In addition to the aforementioned models, other GAI models, such as normalizing flows and score-based generative models, have also been effectively implemented in HDT for IoT-healthcare [60, 61].

II-C Framework of GAI-driven HDT

In this subsection, we give an overview of the framework of GAI-driven HDT, as shown in Fig. 2.

Data acquisition component is significantly crucial for HDT, which is the fuel of HDT. The required substantial health data, such as EEG, ECG, and magnetic resonance imaging (MRI) data, for HDT commonly collected from the IoT-enabled pervasive sensing and medical institutions [62]. However, these traditional data acquisitions methods are usually inefficient due to various factors [63, 64]. To this end, GAI can generate ultra-realistic health data based on the collected data for enriching the datasets.

The communication component plays a bridge role in HDT, which is responsible for bi-directional data transmissions between the physical and digital worlds, such as the transmission of the collected data and the feedback in the informal world. However, these data are usually large-scale, multi-modal, and time-sensitive, which are hard to fully met by traditional communication systems [65]. To this end, GAI-enabled communication, such as GAI-enabled semantic communication [66, 67, 68] and cross-modal communication [69], can be applied to support communication in HDT by generating the transmitted data at the received sides, enhancing the data transmission performances.

Data management component is the core of HDT, where each component will interact with it for data access. Data from both physical and digital worlds, including collected, generated, and simulated ones, are large-scale, leakage-sensitive, and complex. To well manage these data, effective pre-processing, as well as security and privacy schemes are needed. To this end, GAI can be used in data imputation, data denoise, etc., for data pre-processing. Besides, GAI can generate deidentified data while preserving all the patterns from the original data for protecting private data.

Digital modeling component is responsible for the human digitalization procedure in HDT. The digitalization procedure models the high-fidelity human body based on the collected data. However, traditional digital modeling methods highly rely on accurate simulation parameters, which is hard to achieve. To this end, GAI, with its robust generation capabilities, can be adapted to model humans digitally, including cells, tissues, organs, etc.

Data analysis component is essential in HDT, which is responsible for analyzing data in HDT for driving the IoT-healthcare applications. GAI with its strong analysis capabilities can be used in data classification for classifying diseases, data segmentation for obtaining key disease information, anomaly detection for identifying abnormal status, and prediction for predicting health status.

Based on the built GAI-driven HDT described above, it will significantly enhance the IoT-healthcare. It can be used in personalized health monitoring and diagnosis, prescription, and rehabilitation, acting as the intelligent and vivid human digital testbed.

In the following sections, we will delve into the implementation of GAI-driven HDT in IoT-healthcare.

III GAI-driven HDT Implementation

TABLE IV: Summary of GAI-based Approach for Data Acquisition in HDT.

III-A GAI-enabled Data Acquisition

Figure 3: Overview of the GAN-based biomedical signal synthesis, SynsigGAN, proposed in [71]. The collected signals proceed through the preprocessing stage, eliminating noise and refining the signals using discrete wavelet transform, thresholding, and inverse discrete wavelet transform. After preprocessing, the signals are forwarded to the segmentation stage that uses the Z-score to solve the amplitude scaling problem and eliminate offset. Next is the GAN, which takes in the segmented signals and generates synthetic biomedical signals using bidirectional grid long short-term memory for generator network and convolutional neural network for the discriminator. Finally, SynsigGAN outputs the synthesized biomedical signals.

Data forms the cornerstone of HDT development and service provision [13]. Commonly employed data acquisition methods for HDT primarily stem from diverse sources, including medical institutions [70], as well as both non-invasive and invasive sensors equipped in PTs [40]. Nevertheless, these methods present challenges due to their time-consuming, costly, intrusive nature, and limited scalability. This restricts acquiring extensive individual-level data essential for robust HDT development and comprehensive service delivery. GAI can significantly assist the data acquisition in HDT, by offering diverse and highly realistic synthetic data. In the following, we introduce several common synthetic HDT data generated by GAI, including synthetic physiological, medical imaging and motion data, as summarized in Table IV.

The physiological data, such as ECG, EEG, and photoplethysmogram (PPG), hold significant importance for HDT. By generating synthetic physiological data, GAI mitigates the limitations of traditional physiological data acquisition methods, reducing costs and time associated with collecting extensive real-world physiological data. For instance, SynSigGAN proposed by Hazra et al. in [71] can generate synthesized PPG data, as shown in Fig. 3. In SynSigGAN, the bidirectional grid long short-term memory (LSTM) and the convolutional neural network (CNN) had been used for generator network and discriminator network, respectively, and it was trained on BIDMC PPG and respiration datasets [72]. In addition, diffusion model-based approaches also applied in physiological data generation. Alcaraz et al. in [73] designed a diffusion model-based approach, called structured state space diffusion-ECG (SSSD-ECG), for generating synthetic 12-lead ECG data. SSSD-ECG was built on the SSSD^S4 model architecture [74] and trained on PTB-XL dataset [75], which was a publicly available collection of clinical 12-lead ECG data comprising 21,837 records from 18,885 patients. These highly realistic synthetic physiological data can significantly amplify the physiological datasets that required by HDT, to enhance the performance.

Figure 4: Overview of the diffusion model-based histopathology image synthesis approach proposed in [76]. The real histopathology images are extracted the genotype information firstly, then it is used as a conditional input to the diffusion probabilistic model, which generates synthetic histopathology images that are tailored to specific genotypes.

The medical imaging data hold significant importance for HDT. Medical imaging provides detailed insights into a PT’s anatomy, allowing for a precise digital representation. This information aids in creating accurate simulations of physiological structures and functions within the VT. Besides, by integrating this data, the VT can simulate and predict the progression of diseases. However, existing medical imaging acquisition methods rely on medical imaging devices, such as MRI or computed tomography (CT) scanners, which encounter high costs, patient discomfort, and safety concerns. To this end, GAI can generate synthetic medical images, augmenting existing datasets without additional patient scans. For instance, Moghadam et al. in [76] proposed a diffusion model-based approach for the synthesis of histopathology images, as shown in Fig. 4. Specifically, the authors used color normalization to force the diffusion model-based approach to learn morphological patterns, and used perception prioritized weighting, aiming to prioritize focusing on diffusion stages with more important structural histopathology contents. Experimental results showed that the proposed approach outperformed the GAN-based approach proposed in [77] by generating high quality histopathology images of brain cancer. While diffusion model and GAN made remarkable progress in medical image generation, they cannot explicitly learn the probability density function of the input data and are highly sensitive to the hyperparameter selections. To mitigate these issues, Hajij et al. in [61] investigated normalizing flows (NFs) based approach as an alternative for synthesizing medical images. Particularly, the authors trained a RealNVP [78], a popular NF model for medical image synthesis, on two medical imaging datasets: chest X-ray [79] and skin cancer [80]. The experimental results showed that the NF-based medical image synthesis approach is an attractive alternative to GAN-based and diffusion model-based approaches.

Figure 5: Overview of AGRoL proposed in [81]. It takes the orientations of the head and hands from HMDs and hand controllers as the input. These input processed by AGRoL. The architecture of AGRoL is presented in the middle of this figure, where $t$ is the noising step. $x_{t}^{1:N}$ denotes the motion sequence of length $N$ at step $t$, which is pure Gaussian noises when $t=0$. $p^{1:N}$ denotes the sparse upper body signals of length $N$. $\hat{x}_{t}^{1:N}$ denotes the denoised motion sequence at step $t$. The output is the synthesized full body motion.

The motion data is significant for HDT, which can be used to model and simulate a PT’s entire body posture and movements in the digital space. Motion modeling in HDT can enable critical HDT services, such as motion monitoring during rehabilitation and injury prediction during exercise. Existing motion data acquisition mainly through wearable devices [13], which has several drawbacks hindering the complete and accurate motion data acquisition. For example, humans may not always be equipped with a large number of motion sensors for acquiring comprehensive motion data, which results in the acquired data can only characterize partial motion. Moreover, issues related to signal transmission, such as poor connectivity, signal interference, or obstructions caused by complex human mobility, can result in data loss or corruption during transmission. In this regard, GAI has been successfully applied in motion data synthesis, which can be a promising solution. For instance, Dittadi et al. in [50] proposed a VAE-based approach to generate full-body motion based on an impoverished control signal coming from HMDs. Specifically, to reconstruct the articulated poses of a human skeleton from noisy streams of head and hand pose, the authors proposed VAE-based approach decomposed the problem into a generative model of human pose, with an inference model that mapped input signals into the learned latent embedding. Experiment results showed that the proposed approach can faithfully reconstruct the walking motion of the person wearing an HMD. Additionally, to accelerate the motion generation rate to meet online application requirements, Du et al. in [81] proposed a diffusion model-based approach, called avatars grow legs (AGRoL), to generate the full-body poses conditioned on the sparse tracking signals from HMDs, as shown in Fig. 5. To enable gradual denoising and produce smooth motion sequences, the authors proposed a block-wise injection scheme that added diffusion timestep embedding before every intermediate neural network block. With this timestep embedding strategy, AGRoL achieved SOTA performance on the full-body motion synthesis task without any extra losses that were commonly used in other motion prediction methods. In addition, due to the lightweight architecture, AGRoL can generate realistic, smooth motions while achieving real-time inference speed, making it suitable for online applications.

In summary, GAI offers promising solutions to address the limitations of current data acquisition methods in HDT by generating diverse and high-realistic datasets.

III-B GAI-enabled Communication

HDT relies on real-time data transmission to keep synchronization between any PT-VT pair to ensure high-fidelity of VT [82, 83, 84]. This synchronization is, however, data-driven and delay-sensitive. Furthermore, data acquired in the physical world is often massive and complex. In addition to real-time synchronization, interacting with VTs involves more complex information that needs to be transmitted between the PT and users in the physical world. Multi-modal information, such as 3D virtual items, text, images, haptic signals, among others, needs to be transmitted in HDT under various applications, such as the virtual surgery, to enhance the immersive experience. These specific characteristics place a significant burden on current communication networks [85]. To address these issues, this subsection delves into the GAI-aid semantic communication [67] and cross-modal communication [69] for communication in HDT, as summarized in Table V.

TABLE V: Summary of GAI-based Approach for Communication in HDT.

Semantic communication is expected to enable the data transmission between the PT and VT pair in HDT, tackling the challenges of unnecessary transmission of vast amounts that cause high bandwidth consumption, more latency, and experience with bad quality of service (QoS) by only transmitting meaningful and task-oriented information extracted from the original information [86, 87]. Generally, semantic communication extracts the “meaning” of any transmitted information at the transmitter and encodes the extracted features. Then, this semantic information is transmitted to the intending receiver and is “interrupted” and decoded by the receiver. GAI with its creativity is applied in receiver side to reconstruct the original information from the received semantic information. For instance, Raha et al. in [88] proposed a GAN-aid semantic communication framework for transmitting images or videos. Specifically, by considering resource limitations inherent in edge devices, such as HMDs, and the need for low-latency transmission in HDT applications, such as the real-time PT-VT synchronization task, the authors utilized a lightweight mobile segment anything model [89] for essential semantic information extraction from the images or videos. Then, on the receiver side, the authors proposed a pix-to-pix GAN approach to reconstruct and denoise the received semantic frames. The simulation results showed that the proposed framework can reduce up to 93.45% of the communication cost while maintaining the original information. In addition to GAN-aid semantic communication, the diffusion model with strong synthesizing multimedia content abilities has also been applied in this field. For example, Grassucci et al. in [90] introduced a semantic diffusion model designed to reconstruct photorealistic images at the receiver side. This model was trained using noisy semantics and incorporated a fast denoising semantic block to enhance the quality of inferred images. Consequently, the receiver can reconstruct semantically-consistent samples from the compressed semantic images transmitted by the sender over a noisy channel. These methods can be applied in HDT for rehabilitation training to reduce bandwidth usage and latency. The cameras are utilized to capture the patient’s motion, and from the captured extensive images or videos, semantic features are extracted. Subsequently, the highly-compressed semantic information is transmitted to the digital world, where GAI is employed to regenerate the images or videos, and then, synchronizing the motion of the corresponding VT. This approach enables real-time monitoring and analysis of rehabilitation conditions [18, 87].

The interactions in HDT applications, such as virtual surgery, commonly involve with audio, visual and haptic signals to provide users with human interactive and immersive experiences. To support such interactions within HDT, cross-modal communication [69], which involves collaborative audio-visual and haptic interactions, presents a promising solution. It adeptly resolves the distinct requirements among these modalities when they coexist. However, long transmission distance between the physical and digital world or possible poor network conditions may result in missing signals and distortion, negatively impacting the users’ experiences. To this end, researchers have explored using GAI to enable cross-modal signal reconstruction within the cross-modal communication to compensate for defective signals and achieve high-fidelity communication. For instance, by fully using of the correlation between image and haptic modalities, Liu et al. in [91] proposed a GAN-based approach to transform the images into the corresponding haptic signals. Specifically, the authors extract the image features firstly to obtain the required category information. Then, they adopted the cross-domain GAN, DiscoGAN [92], to generate the desired haptic spectrograms belonging to that category. In addition to cross-modal unidirectional map** illustrated above, the cross-modal bidirectional map** is investigated to enhance the cross-modal signal reconstruction. For example, Fang et al. in [93] proposed a VAE-based approach for bidirectional map** between visual and haptic signals. Specifically, the authors firstly adopted the visual VAE model and the haptic VAE for compressing visual and haptic data, respectively. Then, they employed a conditional flow model to connect the latent feature spaces of these two VAE models. The forward process of the flow model was the map** from the haptic to the visual latent feature space, while the reverse process was the map** from the visual to the haptic latent feature space. Based on this, the cross-modal bidirectional map** between visual and haptic signals can be successfully implemented on one model. These GAI-aid cross-modal communication approaches are crucial for cross-modal interactions in HDT. For example, during virtual acupuncture training, when a doctor interacts with a patient’s VT, haptic signals may be missed or distorted due to the degraded channel conditions, while the visual signals are successfully received by the doctor’s VR device [94]. To provide the immersive experience, the GAI-aid haptic signal reconstruction approach can be utilized to reconstruct the haptic signals from the visual signals.

III-C GAI-enabled Data Management

Data management is a crucial step in the successful implementation of HDT. First, the collected multi-source data in HDT may have the characteristics of heterogeneity, multi-scale and high noises. Hence, as the critical step in data management, data pre-processing is indispensable in HDT, such that issues like missing data and noise data can be properly handled, and thereby providing high-quality data for downstream tasks in HDT [13]. Moreover, the data in HDT are highly sensitive, especially for individual-level data, and any leakage may result in serious ethical and moral concerns. Therefore, effective security and privacy schemes are imperative to protect data in HDT. In the following, we will discuss the application of GAI in data pre-processing, followed by its application in security and privacy schemes, as summarized in Table VI.

TABLE VI: Summary of GAI-based Approach for Data Management in HDT.

Traditional data imputation methods, such as K-nearest neighbors-based [95] and deep learning-based imputation [96], often rely on existing observed data for modeling and prediction, and cannot directly generate new data samples. This will make it hard for traditional data imputation methods to handle missing severe data issues, such as data modality missing. To this end, GAI, with its powerful generative capabilities, can effectively handle the missing data issues in HDT. For instance, with the potential of substituting missing data accurately and efficiently, Dong et al. in [97] used GAN to impute missing values in large clinical datasets collected from PTs with mixed-type variables. Specifically, the method adopted by authors was generative adversarial imputation nets (GAIN), where the generator observed some components of a real clinical data vector, imputed the missing components conditioned on what was actually observed, and outputs a complete clinical data vector. The discriminator then took a completed clinical data vector and attempted to determine which components were observed and which were imputed. Additionally, to ensure that discriminator forced generator to learn the desired data distribution, the authors provided discriminator with some additional information in the form of a hint vector. The accuracy of GAIN was measured by imputation error, defined as the difference between the imputed values and real value. Specifically, normalized root mean square error (NRMSE) was used to assess difference for continuous variables, while proportion of falsely classified (PFC) was used for categorical variables. The experimental results showed that GAIN outperformed the traditional imputation models, MICE [98] and missForest [99], in terms of NRMSE and PFC in the imputation of missing data in clinical datasets, under the missingness rate of 20% and 50%. Acquiring multi-modality data is crucial for the implementation of HDT. However, the missing modalities may happen in some conditions, such as failure in data transmission. Fortunately, diffusion models have shown favorable results for generating missing modalities utilizing cross-modalities and producing ones using other modality types. For instance, Lyu et al. in [100] proposed a GAI framework, called diffusion and score-matching models, which took advantage of the recently introduced denoising diffusion probabilistic models (DDPMs) [101] and score-based diffusion models [102], for translating MRI to CT. Specifically, they presented conditional DDPM and conditional stochastic differential equation (SDE) [103], where their reverse process was conditioned on T2w MRI images. The authors adopted the DDPM and SDE with three different sampling methods, namely Euler-Maruyama, Prediction-Corrector, and probability flow ordinary differential equation. In their experiments, they utilized the structural structural similarly index measure (SSIM) and peak signal-to-noise ratio (PSNR) metrics to evaluate their quality of translating MRI to CT. The datasets used in this experiment is Gold Atlas male pelvis dataset [104], and the results showed that the proposed method achieved SSIM = 0.86 and PSNR = 27.31, which was superior than both GAN (SSIM = 0.83, PSNR = 26.84) and CNN-based methods (SSIM = 0.84, PSNR = 26.98) [105]. Similarly, to cope with the missing modality issue, Meng et al. in [60] proposed a unified multi-modal conditional score-based generative approach (UMM-CSGM), which synthesized the missing modality based on all remaining modalities as conditions. The proposed model was a conditional SDE format, employing only a score-based network to learn different cross-modal conditional distributions. The experimental results showed that the UMM-CSGM could generate missing-modality images with higher fidelity and structural information of the brain tissue compared to GAN-based methods [106, 107, 108, 109, 110].

Noise data is a common issue during the data acquisition in HDT. Noise reduces the data quality and is especially significant when the point of interests are minor and have relatively low contrast, which hinders the downstream tasks in HDT [111]. Traditional data denoise methods, such as CNN-based [112] and U-Net-based methods [113], highly rely on a significant amount of labeled training data to build the denoising models. However, obtaining such data is challenging, especially at the individual level. To this end, with the strong generative abilities of GAI, it is convenient for diverse denoising problems in HDT data. For instance, PET is a medical imaging technique used to detect metabolic activities within the human body. The information provided by PET can be used to update or calibrate the VT models. However, due to various physical degradation factors, PET often suffers from low SNR and resolution. To denoise the PET images, a DDPM-based method has been proposed for PET image denoising. Gong et al. in [58] proposed the DDPM-based framework for PET denoising, called PET-DDPM, which collaborated with an assistive modality embedding as prior information to DDPM formulation. Quantitative results demonstrated that PET-DDPM with SSIM = 0.91 and PSNR = 33. 84 outperformed U-Net based denoising networks with SSIM = 0.87 and PSNR = 33.32 [114], showcasing its superior performance in PET denoising. For denoising MRI that with severely SNR-limited, Xiang et al. in [115] proposed a self-supervised denoising method, called denoising diffusion models for denoising diffusion MRI (DDM²). Specifically, their approach consisted of three stages, which integrated statistic-based denoising theory into diffusion models and performed denoising through conditional generation. During inference, they represented input noisy measurements as a sample from an intermediate posterior distribution within the diffusion Markov chain. The experiment results showed that DDM² demonstrated superior denoising performances ascertained with clinically-relevant visual qualitative and quantitative metrics than Noise2Score (N2S) [116] and other denoising methods. Specifically, DDM² not only suppressed noise the most but also restored anatomical details commented by two neuroradiologists. Additionally, compared to N2S, DDM² demonstrated an average of 0.95 and 0.93 improvement on SNR and Contrast-to-Noise Ratio, respectively.

Figure 6: Block diagram of ADS-GAN for individual EHR anonymization [119]. The generator uses original sample ($x$) and random vector ($z$) to generate sample ($\hat{x}$). The summation of distribution loss (LD) and identifiability loss (LI) is back-propagated to the generator. Both the generator and discriminator are implemented with multi-layer perceptrons.

HDT environments may suffer from various security threats, such as eavesdrop** attacks in data transmission between PTs and VTs causing privacy leakage. A typical privacy protection mechanism for HDT data is anonymization [117, 118]. However, this method can easily compromise the data distribution, and it is hard to balance data privacy and usability. To this end, GAI can generate synthesized HDT data, which maximally preserves original data distribution while guaranteeing data security and privacy. For instance, to lower the risk of breaching individual confidentiality during data sharing in HDT, Yoon et al. in [119] proposed a GAN-based framework, called anonymization through data synthesis using GAN (ADS-GAN), for generating synthetic data that closely approximates the distribution of variables in an original EHR dataset, achieving anonymization of EHR, as shown in Fig. 6. Specifically, ADS-GAN generated the synthetic data conditioned on the original data, and different from traditional conditional GAN framework, conditioning variables in ADS-GAN were not pre-determined but instead were optimized from real EHR. Additionally, authors proposed a mathematical definition for identifiability to quantify the degree of anonymization. Particularly, $\epsilon$-identifiability they defined meant that the probability of patients can not identifiable by the synthetic patient data was larger than $\geq 1-\epsilon$, which was attributed to the synthetic patient data were “different enough” from the real ones. To prevent re-identification by generated synthetic data, authors integrated the constraint, $\epsilon$-identifiability, into ADS-GAN. To this end, they designed a identifiability loss for training discriminator in ADS-GAN. The experiment results showed that ADS-GAN performed superior than traditional conditional GAN frameworks, i.e., PATE-GAN [120] and WGAN-GP [105]. ADS-GAN can be 27% and 67% better than PATE-GAN in terms of both Jensen-Shannon Divergence (JSD) and the Wasserstein distance with the same identifiability. While with the same quality of the generated samples, ADS-GAN reduced the identifiability by 41% compared to WGAN-GP.

In summary, GAI is a promising technique for data management in HDT, handling data pre-processing and security and privacy issues.

III-D GAI-enabled Digital Modeling

In HDT, digital modeling refers to digitally model the PT and virtualized in the digital world based on the acquired data and various digital modeling technologies, forming the VT.

The classic HDT digital modeling technology, mechanistic modeling, has pioneered the integration of biology and physiology domain knowledge to allow robust and accurate modeling [121]. For instance, a human heart DT model has been developed, which consisting of approximately 100 million virtual heart cell patches, with each patch modeled by around 50 equations [122]. The human heart DT accurately represented the interconnected cardiac muscle cells, effectively simulating the transmission of electrical currents through these cells and the subsequent initiation of the heartbeat. However, as the human heart DT, mechanistic modeling requires massive and accurate simulation parameters, which are particularly challenging to acquire from biological entities in the human body, i.e., from molecular to organ level, and are typically limited to only a subset of all available biomolecular [121]. GAI techniques can overcome these challenges, through learning the underlying distribution and sequential or temporal relations of data for modeling. In the following, we provide a survey of the application of GAI in HDT digital modeling, including digital modeling of human cells, tissues and organs, as summarized in Table VII.

TABLE VII: Summary of GAI-based Approach for Digital Modeling in HDT.

Figure 7: Overview of the transformer-based cell DT, scGPT, proposed in [55]. (a) Large-scale scRNA-seq datasets from cell atlas are obtained from medical institutions and input to the input embedding module. (b) The input contains three layers of information, the gene token, expression value, and condition tokens (modality, batch, perturbation condition, et al.). (c) A specially designed mask-attention transformer is proposed to conduct generative pre-training on single-cell sequencing data. (d) For downstream applications (e.g., multiomic integration, gene network inference, perturbation prediction, and clustering), the pre-trained model weights can be finetuned on the new data.

First, GAI techniques have shown their strong abilities in digitally modeling human cells. For instance, Lotfollahi et al. in [123] built a VAE-based cell DT, scGen, for predicting transcriptional response to drug perturbations. Specifically, scGen combined VAE and latent space vector arithmetics for high-dimensional sing-cell gene expression data. scGen can accurately model perturbation and infection response of cells across cell types. The results of the simulations showcased that scGen successfully learned cell-type responses, indicating its ability to capture distinguishing features between responding and non-responding genes and cells. Furthermore, the simulation results provided evidence for the enhanced generalization capabilities of scGen compared to mechanistic modeling approaches, which are typically tailored to specific cellular settings. In addition, the authors further developed another VAE-based cell DT, compositional perturbation autoencoder (CPA), to predict cellular response to unseen drugs, drug combinations and dosages in high-throughput screens [124]. CPA combined the interpretability of linear models with the flexibility of deep learning approaches for single‐cell response modeling. The authors envisioned that with the accurate modeling of the cell, CPA will accelerate therapeutic applications using single-cell technologies. Similarly, Donovan-Maiye et al. in [125] developed a VAE-based cell DT to predict cell morphology by generating cell images. Specifically, they employed stacked conditional $\beta$-VAE to first learn a latent representation of cell morphology, and then learn a latent representation of subcellular structure localization which is conditioned on the learned cell morphology under treatment. Inspired by parallels between linguistic constructs and cellular biology, where text comprises words, similarly, cells are defined by genes, pre-trained transformers are envisioned to model the cell DT. Cui et al. in [55] developed a transformer-based cell DT, scGPT, a generative pre-trained foundation model that harnessed the power of pre-trained transformers on a vast amount of single-cell sequencing data, as shown in Fig. 7. The use of transformers in scGPT enabled the simultaneous learning of gene and cell embeddings, which facilitated the modeling of various aspects of cellular processes. In addition, by leveraging the attention mechanism of transformers, scGPT captures gene-to-gene interactions at the single-cell level, providing an additional layer of interpretability.

Figure 8: Overview of the GAN-based tissue DT, ScarGAN, propoesd in [48]. A mask generator simulates the shape of scar tissuesegmentation mask (left ventricular endo is light blue; left ventricular myo is green; left ventricular endo is orange; scartissue is red); a heuristic-based method provides an initial simulated scar tissue using the simulated shape; a refining generator add details of scar tissue to the image.

GAI has been successfully applied in the digital modeling of human tissues for digital pathology [126]. For instance, Quiros et al. in [127] developed a GAN-based tissue DT, PathologyGANs, for simulating the morphological characteristics of cancer tissue. Specifically, PathologyGANs combined BigGAN [128], StyleGAN [129], and relativistic average discriminator [130] to learn representations of entire tissue architecture. Then, they used these characteristics to structure PathologyGANs’ latent space (e.g., color, texture, spatial features of cancer and normal cells, and their interaction). Thus, PathologyGANs can generate high-fidelity cancer tissue images from the structured latent space. The simulation showed that the quality of the generated cancer tissue images did not allow pathologists to reliably find differences between real and generated images. It indicated that the proposed GAN-based tissue DT can accurately characterize the features of cancer tissues. To reduce the frequent need to collect scans from patients, Lau et al. in [48] built a GAN-based tissue DT, ScarGAN, to simulate the pathology of scar tissue on healthy myocardium, as shown in Fig. 8. Specifically, ScarGAN was based on chained GAN, and the simulation process included 3 steps: i) a mask generator to simulate the shape of the scar tissue; ii) a domain-specific heuristic to produce the initial simulated scar tissue from the mask; iii) a refining generator to add details to the simulated scar tissue. The experimental results conducted by the authors showed that ScarGAN can high realistically simulate scar tissue on normal scans, such that experienced radiologists could not distinguish between real and simulated scar tissue.

GAI has been used in the digital modeling of human organs for computationally reproducing normal and pathological organ function and treatment effect. For instance, Ahmadian et al. in [131] built a GAN-based organ DT, coined ReconGAN, to predict the risk of vertebral fracture (VF). Specifically, ReconGAN consisted of a deep convolutional GAN (DCGAN) [132], image-processing steps, and finite element (FE) based shape optimization to reconstruct the vertebra model. The synthetic trabecular microstructural models generated by DCGAN were infused into the vertebra cortical shell extracted from the patient’s diagnostic CT scans using an FE-based shape optimization approach to achieve a smooth transition between trabecular to cortical regions. The final geometrical model of the vertebra was converted into a high-fidelity FE model to simulate the VF response using a continuum damage model under compression and flexion loading conditions. The experiments implemented by the authors demonstrated that the built GAN-based vertebra DT can accurately simulate and predict the risk of VF in a cancer patient with spinal metastasis. As the core organ of human bodies, the GAI aided human heart digital modeling has also been investigated. For instance, to overcome the long acquisition time and complex acquisition of cardiac data, ** (3Dir MVM) data. Specifically, the HDL was featured by a hybrid UNet and a GAN with a foreground-background generation scheme. The experimental results demonstrated that the synthetic 3Dir MVM data generated from the HDL algorithm can accurately and quantitatively assess the cardiac motion in three orthogonal directions of the left ventricle.

In summary, the data-driven GAI based digital modeling can effectively overcome the shortcomings of mechanistic modeling, including requiring accurate simulation parameters and sufficient prior domain knowledge. Therefore, GAI is a promising technique for digital modeling of HDT.

III-E GAI-enabled Data Analysis

Data analysis is the crucial component in HDT, which analyzes the data collected from the physical world and the data generated in the digital world. The results from data analysis are essential information in providing HDT services, such as diagnosis and prescription. Traditional data analysis methods, such as CNN-based [134] and U-Net based methods [135], highly rely on a large amount of labeled data and difficult in handling high-dimensional HDT data. To this end, GAI has showcased remarkable potential in data analysis, including classification, segmentation, anomaly detection and prediction, as summarized in Table VIII.

TABLE VIII: Summary of GAI-based Approach for Data Analysis in HDT.

Figure 9: Overview of the GAI-based classification model, CNN-DVIT, proposed in [137]. It is able to take continuous 12-lead ECG signals as input and output the arrhythmia diagnosis result in an end-to-end manner. Specifically, the model is composed of three main components: (a) a CNN-based backbone for feature extraction from each lead; (b) a deformable attention transformer encoder module to combine the CNN-extracted features and the positional encoding; and (3) the classification layer to obtain the probability that each patient may have for each type of heart disease.

Figure 10: Overview of the diffusion model and GAN-based vessel segmentation method, DARL, proposed in [140]. In path (a), given a real noisy angiography image $x_{t_{a}}^{a}$, DARL estimates vessel segmentation mask $\hat{s}^{v}$. In path (b), given a real noisy background image $x_{t_{b}}^{b}$ and a vessel-like fractal mask $s^{f}$, DARL generates a synthetic angiography image $\hat{x}^{a}$.

The data classification is crucial for HDT services, such as early prevention and diagnosis of diseases. For example, when doctors remotely diagnose a patient through the patient’s VT, classification models can quickly and automatically identify and classify the patient’s diseases. Recent studies have shown the potential of the GAI-based methods in this field. For instance, Dhinagar et al. in [136] investigated vision transformer (ViT) architecture for high-stakes neuroimaging downstream tasks, focusing on Alzheimer’s disease classification based on 3D brain MRI. The authors evaluated the effects of different training strategies including pre-training, data augmentation and learning rate warm-ups followed by annealing, and emphasized the importance of these strategies in neuroimaging applications. Similarly, Dong et al. in [137] proposed a ViT-based end-to-end multi-label arrhythmia classification model, called CNN-DVIT, for the 12-lead ECG with varied-length recordings, as shown in Fig. 9. Specifically, CNN-DVIT was based on a combination of CNN with depthwise separable convolution, and a ViT architecture with deformable attention. Besides, the authors introduced the spatial pyramid pooling layer to accept varied-length ECG signals. Experimental results showed that CNN-DVIT outperformed the most recent transformer-based ECG classification methods [138].

Data segmentation play a crucial role in data analysis within the realm of HDT. Segmentation allows complex HDT data to be subdivided and analyzed to extract critical information. For instance, through image segmentation, the different regions and structures within an image can be separated, such as organs and tumors. This facilitates quantitative analysis and measurements, such as measuring organ volumes and calculating tumor growth rates. This important information can be provided for HDT’s subsequent services, such as surgical planning, treatment plans and diagnosis. GAI has been successfully implemented in this field. It is worth note that , for data analysis in HDT, analyzing organs or other human structures from medical images is not a deterministic pixel-wise process, but underlies the assessment of the whole image or, on smaller scale, assessing the neighboring pixels’ diversity. In this regard, Rahman et al. in [139] leveraged the stochastic sampling step in the diffusion model to produce diverse and multiple masks. Specifically, the authors introduced a single diffusion model-based ambiguous segmentation network, called collectively intelligent medical diffusion (CIMD), that can generate multiple plausible annotations from a single input image. The CIMD utilized the noisy segmentation ground-truth masks concatenated to the original image to prevent the conventional diffusion process usage in the segmentation task from producing more resilient results, rather than arbitrary masks. The authors validated the CIMD in three different medical image modalities, namely CT, ultrasound and MRI. The experimental results showed that CIMD outperformed existing SOTA ambiguous segmentation networks in terms of accuracy while preserving naturally occurring variation. Similarly, Kim et al. in [140] proposed a diffusion adversarial representation learning (DARL) model, which leveraged a denoising diffusion probabilistic mode with adversarial learning, for self-supervised vessel segmentation, aiming to diagnose vascular diseases and treatment planning, as shown in Fig. 10. Specifically, DARL model consisted of two main modules, where the diffusion module learned background image distribution, and the generation module generated vessel segmentation masks or synthetic angiograms using the proposed switchable spatially-adaptive denormalization algorithm. Experimental results showed that DARL model significantly outperforms existing unsupervised and self-supervised vessel segmentation methods.

In the context of HDT, anomaly detection for HDT data plays a critical role. Anomaly detection helps identify abnormal patterns or conditions in HDT data early, enabling proactive health alerts from HDT and timely intervention before a condition deteriorates. GAI has been successfully implemented in this field. For instance, Guo et al. in [141] designed a cascade VAE-based anomaly detector (CVAD) for outlier detection in medical images. Specifically, with a focus on the generalizability of anomaly detector, CVAD combined latent representation at multiple scales, before being fed to a discriminator to distinguish the out-of-distribution (OOD) data from the in-distribution data. The reconstruction error and the OOD probability predicted by the binary discriminator were used to determine the anomalies. Extensive experiments on multiple intra- and inter-class OOD medical imaging datasets showed CVAD’s effectiveness and generalizability. The GAN-based approaches are also successfully applied in anomaly detection. For instance, Nakao et al. in [142] designed an auto-encoding GAN ($\alpha$-GAN) framework, which was a combination of a GAN and a VAE, for anomaly detection in chest radiographs. The experimental results showed that $\alpha$-GAN can correctly visualize various lesions including a lung mass, cardiomegaly, pleural effusion, bilateral hilar lymphadenopathy, and even dextrocardia. However, the VAE-based and GAN-based anomaly detection methods are often complicated to train or have difficulties to preserve fine details in the medical images [143]. To this end, Wolleb et al. in [143] proposed a weakly supervised anomaly detection method based on denoising diffusion implicit models (DDIMs) [56]. Specifically, the authors combined the deterministic iterative noising and denoising scheme with classifier guidance for image-to-image translation between diseased and healthy subjects. The authors applied this method on two different medical datasets, namely BRATS2020 brain tumor datasets and the CheXpert datasets [144]. Experimental results showed that this method can preserves details of the input image unaffected by the disease while realistically representing the diseased part.

Prediction plays a critical role in data analysis, which can provide informed information for HDT services. For instance, the disease progression and drug response can be predicted in patient’ VTs based on HDT data. With this, doctors can optimize the intervention and design the customized treatment plans for patients. GAI has been successfully implemented in this field. For instance, Allen et al. in [52] proposed a $\beta$-VAE based HDT to forecast clinical measurement trajectory in patients who went on to experience an ischemic stroke. Specifically, the $\beta$-VAE based HDT model was used to generate possible next steps in a patient’s disease progression. The model was trained on data extracted from the medical information mart for intensive care-IV database [145]. The database contains 1216 patients with useable trajectories that experienced ischemic stroke. Experimental results demonstrated that the model can accurately forecast the progression of relevant clinical measurements in patients at risk of ischemic stroke, which was virtually indistinguishable from real patient data. Additionally, transformer-based approaches have also been used in prediction of disease progression. For instance, Hu et al. in [146] applied four BERT-based models, including the original BERT [147], BioBERT [148], RoBERTa [149], and DistilBERT [150], to ophthalmology clinical text from EHR, predicting the progression of glaucoma. Experiment results showed that these four BERT-based models outperformed clinical predictions by an ophthalmologist’s review of the same clinical information. The authors qualitatively evaluated the BERT-based models by performing explainability studies based on the self-attention mechanisms of the BERT-models. Based on this, the authors can evaluate what types of words were most important for predictions.

In summary, GAI is a key enabling technology for data analysis in HDT, analyzing the HDT data for classification, segmentation, anomaly detection and prediction.

III-F Promoting the GAI-driven HDT

In order to successfully integrate GAI-driven HDT technology into IoT-healthcare, it is vital to involve both patients and healthcare professionals in the process. Here we provide a few strategies for engaging them in the development and adoption of GAI-driven HDT.

1) Educational workshops and training: Start by building knowledge about GAI-driven HDT among healthcare professionals. Educating them on the benefits and limitations, explaining how it can be effectively used, discussing privacy concerns, and any possible adverse effects, can enable healthcare professionals to use it more effectively and also communicate these aspects convincingly to the patients.

2) Collaborative development: Involve healthcare professionals in the development process of these applications to ensure they align with current workflow and improve healthcare delivery. In turn, the developer should also do navigation for understanding the demands and concerns of patients. Their first-hand insights are invaluable to make the technology even more helpful and user-friendly.

3) Ethical and privacy concerns: To mitigate the potential ethical and privacy issues, there needs to be a solid foundation of transparency. Ethical AI is imperative to be considered. There needs to be a solid foundation of transparency. The GAI-driven HDT technology providers should be able to provide clear explanations of its processes and decisions to both patients healthcare professionals. This means explicit consent should be obtained before any personal health data is collected or used. The GAI-driven HDT should be trained and tested to ensure that it does not exhibit any bias, ensuring fairness and equity in healthcare provisioning. Additionally, accountability and oversight are needed to ensure the individuals or the entities responsible for the GAI-driven HDT making its corresponding decisions accountable. Besides, the strategies for ensuring data privacy and security are crucial. Technologies such as blockchain [151], federated learning [152], differential privacy [153], secure multi-party computation [154], and physical layer security aware wireless communications [155, 156, 157], can be designed and implemented for GAI-driven HDT to prevent unauthorized access and data breaches.

IV GAI-driven HDT in IoT-Healthcare Applications

The remarkable capabilities of GAI-driven HDT in a wide range of IoT-healthcare applications, including personalized health monitoring and diagnosis, prescription, and rehabilitation. In this section, we will delve into the details of these IoT-healthcare applications, exploring how GAI-driven HDT is revolutionizing each of them.

IV-A Personalized Health Monitoring and Diagnosis

Figure 11: The application of GAI-driven HDT in the personalized health monitoring and diagnosis, where the GAN-based approach, proposed in [158] is used as an example. The collected ECG signals from the physical twin are transmitted to the GAI-driven HDT for ECG signal analysis. Specifically, the GAN-based approach is a two-level hierarchical deep learning framework: (a) first-level MadeGAN for anomaly detection; (b) second-level classification for arrhythmia type identification; (c) Multi-branching output. If there are abnormities in collected data, the virtual twin will initiate health alerts to either the physical twin or medical institution for interventions.

The GAI for HDT can be applied in personalized health monitoring and diagnosis. By leveraging the robust data analysis capabilities, GAI can analyze collected patient data in HDT, enabling anomaly detection for personalized health monitoring and diagnosis, as shown in Fig. 11. For example, a VT continuously receives data streams from its corresponding PT, namely the patient, encompassing vital metrics like heart rate, blood pressure, and ECG signals, etc. Utilizing GAI, the VT can analyze this data, identifying deviations from expected norms, such as cardiac irregularities or other health concerns. Detected anomalies trigger alerts to the patient and healthcare providers, signaling potential irregularities or cardiac issues. Consequently, GAI for HDT is a personalized health monitoring system that delivers timely health warnings.

GAI has been successfully applied in anomaly detection from the collected patient data in HDT. For example, Wang et al. in [158] proposed a GAN-based approach for ECG signal analysis, achieving automatic cardiac diagnosis, as shown in Fig. 11. Specifically, the proposed approach involved two-level hierarchical deep learning framework with GAN. The first-level model was composed of a memory-augmented deep autoencoder with GAN (MadeGAN), which aimed to differentiate abnormal signals from normal ECGs for anomaly detection. The second-level learning aimed at robust multi-class classification for different arrhythmia identification, which was achieved by integrating the transfer learning technique to transfer knowledge from the first-level learning with the multi-branching architecture to handle the data-lacking and imbalanced data issues. The performance of the GAN-based anomaly detection was evaluated by two global performance metrics, i.e., area under receiver-operating-characteristic curve (AUROC), and area under precision-recall curve (AUPRC). The ROC characterizes the relationship between false positive rate (FPR) and true positive rate (TPR). Then, AUROC is a score quantifying the general prediction performance across all thresholds. Meanwhile, the AUPRC evaluates the general relationship between recall and precision. In the GAN-based anomaly detection, the performance of the proposed MadeGAN was superior than traditional methods, i.e., AutoEncoder (AE) and BeatGAN [159]. Specifically, MadeGAN achieved the best performance with AUROC and AUPRC scores of 0.954 and 0.936. In addition, MadeGAN improved AUROC by 5.3% compared with AE (0.906), and by 1.4% compared with BeatGAN (0.941). Furthermore, the improvement of AUPRC is more significant, with an increase of 5.6% and 1.5% compared with AE (0.886) and BeatGAN (0.922), respectively.

In addition, the industry is also walking on this way, aiming to facilitate the implementation of GAI-driven HDT. The global leader in GAI for pathology, Paige, leverages large and diverse dataset in cancer diagnostics to develop their GAI-based products for cancer pathology detection and analysis [160]. Their GAI-based products has been independently validated and clinically utilized by hospitals and labs around the world, and the reduction in cancer detection errors reaches 70% [161], while the reduction in time to diagnosis is 65.5% [162]. It is expected that such powerful tools can be integrated into HDT for personalized health monitoring and diagnosis.

Thus, GAI-driven HDT holds the promise of delivering precise, timely, and proactive personalized health monitoring and diagnosis, enhancing patient care and overall well-being.

IV-B Personalized Prescription

Figure 12: The application of GAI-driven HDT in the personalized prescription, where the GAI-based approach, SNF–CVAE method, proposed in [163] is used as an example: (a) Calculating drug similarity matrices using the drug-related datasets obtaining from the medical institution. (b) Applying a heuristic process to select the most informative, least redundant subset of drug similarity matrices. (c) Applying a non-linear similarity network fusion process to integrate the selected similarity matrices into a comprehensive drug similarity matrix. (d) Training a collective VAE model with drug similarity information and drug–disease interactions to predict novel drug–disease interactions. Finally, the output is used to choose the optimal drug for the patient.

The GAI-driven HDT can be applied in the personalized prescription. GAI empowers the HDT to predict and simulate treatment outcomes, enabling personalized prescription, as shown in Fig. 12. For instance, considering an Alzheimer’s patient’s VT, doctors can virtually test various candidate drugs on the VT. Then, leveraging GAI within the VT, the interactions of each drug with the patient’s Alzheimer’s disease can be predicted and simulated. Upon deriving insights from the GAI-driven HDT, doctors can pinpoint the most effective drug tailored to the patient’s specific health profile.

GAI has been successfully applied in treatment outcome predictions and simulations inside the HDT for personalized prescriptions. For instance, Jarada et al. in [163] proposed a VAE-based approach, called similarity network fusion-collective VAE (SNF-CVAE), for predicting drug-disease interactions, as shown in Fig. 12. Specifically, SNF-CVAE integrated similarity measures, similarity selection, SNF, and CVAE to conduct a non-linear analysis and improve the drug-disease interaction prediction accuracy. For evaluating the performance of SNF-CVAE in drug-disease interactions, authors introduced five evaluation metrics, i.e., precision, recall, F1-score, area under curve-receiver operator characteristic (AUC-ROC), and area under curve-precision-recall (AUC-PR) [164]. Specifically, Precision $=TP/(TP+FP)$, Recall $=TP/(TP+FN)$, and F1-score $=2*(Precision*Recall)/(Precision+Recall)$. $TP$ was predicted and known drug-disease interactions, $TN$ was unpredicted and unknown drug–disease interactions, $FP$ was predicted and unknown drug–disease interactions, and $FN$ was unpredicted and known drug–disease interactions. Additionally, AUC-ROC can be described as plotting the $TP$ against $FP$, while AUC-PR can be described as a trade-off between Precision and Recall. The simulation results showed that SNF-CVAE achieved significantly higher accuracy with Precision = 0.902, Recall = 0.883, F1-score = 0.893, AUC-ROC = 0.958 and AUC-PR = 0.970, compared the traditional methods, Pareto dominance and collaborative filtering-based drug-disease prediction [165] with Precision = 0.487, Recall = 0.085, F1-score = 0.144, AUC-ROC = 0.542 and AUC-PR = 0.225.

Beyond the academic successes, the industry has also achieved some milestones in this area. The pioneer in utilizing GAI for drug discovery and development, Insilico Medicine, had developed a GAI powered commercially available platform, Pharma.AI [166]. Their lead drug, INS018_055, was discovered and designed using Pharma.AI, which was designed to treat the devastating lung condition idiopathic pulmonary fibrosis (IPF) [167]. IPF is a disease marked by excessive scarring of the lungs that affects 5 million people worldwide and has few treatment options. INS018_055 was nominated as a preclinical candidate – a record 18 months from target discovery — and quickly accelerated into further trials, from first-in-human, to Phase I trials with healthy volunteers, where the drug showed excellent results, delivering a favorable pharmacokinetic and safety profile. Now (i.e., March 2024), the drug is currently in Phase 2a trials in both the U.S. and China with IPF patients – less than 4 years from discovery. Thus, compared to traditional drug discovery methods, which typically takes from 10 to 15 years to develop a drug, the GAI-driven methods presented here has significantly shorten the process. Promisingly, Pharma.AI can be integrated into the development of GAI-driven HDT, which can acts the human digital testbed by simulating the drug-disease interactions.

The continuous advancement of GAI-driven HDT can offer the potential for more diverse and accurate predictions and simulations of treatment outcomes. This capability facilitates more versatile personalized prescriptions, ultimately optimizing treatment outcomes.

IV-C Personalized Rehabilitation

Figure 13: The application of GAI-driven HDT in the personalized rehabilitation, where the GAI-based approach, pose-guided condition diffusion model, proposed in [168] is used as an example. The physical twin mimics the motions of virtual twin, and the motions of the physical twin are collected and input into the machine learning model for obtaining the physical twin’s objective and personalized insights. The training datasets of the machine learning model are enriched by the pose-guided condition diffusion model, which is based on a latent diffusion model combined with the ControlNet.

The GAI for HDT can be applied in the personalized rehabilitation training. Based on the built patient’s VT, the doctor or physical therapist can simulate different rehabilitation training scenarios by controlling the VT’s target posture. For example, if the patient needs balance training, the doctor can adjust the VT’s posture to create a personalized unstable state that requires balance subject to the patient’s profile. Then, the patient, namely the PT, observes the VT’s movements and attempts to mimic its posture to improve their balance. Then, the IoT devices are used to collect the patient’s motion data, and transmit to the VT for monitoring and evaluation. Then, the VT serves as virtual “coach” providing real-time feedback and guidance to help the patient posture correction and actively progress through their rehabilitation training.

During this personalized rehabilitation training, machine learning-based approaches are usually utilized to enhance the monitoring and evaluation process in the VT, providing objective and personalized insights. This method relies on substantial high-quality data to obtain a robust and accurate machine learning model. This data should encompass a diverse range of exercises and rehabilitation contexts, as well as holistic patient profiles. However, acquiring such data poses significant obstacles, such as data availability and privacy concerns, especially in individual-level. To this end, GAI can be used to generate synthetic data in the context of personalized rehabilitation training for enhancing the performance of the virtual “coach” role of VT, as shown in Fig. 13. For instance, Mennella et al. in [168] proposed a diffusion model-based approach, pose-guided condition diffusion model, to generate synthetic data that mimicked realistic-looking human movements in a rehabilitation context. Specifically, the data generation framework used the latent diffusion model in combination with ControlNet [169], and was trained on a pre-labeled dataset of 6 rehabilitation exercises. To evaluate the performance of the proposed approach, authors adopted qualitative and quantitative evaluation methods. As a rehabilitation specialist with extensive expertise in biomechanical and motion analysis, the first author of this paper undertook the assessment of the generated images for qualitative evaluation. As for quantitative evaluation, authors adopted the Inception score (IS), the Frechet Inception distance (FID), the Structural similarity index (SSMI), and the detection score for person-class (DS-person). These metrics provided a comprehensive evaluation of the fidelity, quality, and visual resemblance of the generated images to the ground truth images. Experiment results showed that the synthetic datasets achieved high-quality performance, i.e., IS = 162.94, FID = 299.06, SSMI = 0.545, DS-person = 0.789.

These synthetic datasets can be tailored to target various aspects of rehabilitation, including postural correction, joint mobility, balance training, and functional movements. Additionally, it can also be customized according to patient profiles, achieving personalized rehabilitation training. In summary, these GAI-based data augmentation methods are significant for HDT in rehabilitation training by enhancing the monitoring and evaluation process.

V Future Research Directions

The GAI-driven HDT in IoT-healthcare is revolutionizing the healthcare industry, as surveyed above. This exciting field is nascent, and therefore, some critical issues remain unexplored and are of great importance.

V-A Deriving Energy-Efficient Scheme

Implementing such a large model, GAI-driven HDT, requires substantial requirements in computation, communication, and storage resources due to the high parametric complexity of GAI-driven HDT and the necessity for vast datasets. For instance, 10,000 graphical processing unit (GPU) cards were employed to run an HDT brain [170, 171]. It will certainly result in large energy consumption, and generate significant carbon dioxide emissions, jeopardizing sustainability. Thus, the energy-efficient scheme for the implementation of GAI-driven HDT is imperative. Techniques such as pruning, knowledge distillation, quantization, and green learning, have been proposed to address this issue. However, these solutions come at the cost of sacrificing the accuracy of GAI-driven HDT, which is a critical issue, especially in IoT-healthcare. Therefore, it should carefully balance accuracy and sustainability in energy-efficient GAI-driven HDT.

V-B Designing Human-centric Evaluation Metrics

Human-centric metric design for evaluating the performance of GAI-driven HDT in IoT-healthcare is inherently challenging. It should encompass the accuracy and reliability of the GAI generated content compared to the PTs’ real health data. This involves defining parameters to evaluate the fidelity of the VTs’ behavior, responses, and predictive capabilities in the context of the IoT-healthcare enabled by GAI. One of potential solution is the integration of GAI evaluation metrics, such as inception score and Frechet inception distance, and healthcare knowledge. Based on these, the continual evaluation and refinement of the GAI-driven HDT can ultimately enhance the performance in IoT-healthcare.

V-C Accelerating Real-time Responsiveness

The slow generation process of GAI models poses significant challenges for develo** GAI-driven HDT in IoT-healthcare. This delay hampers real-time applications, such as immersive interactions with VTs, and limits the responsiveness necessary for instant healthcare interventions, such as timely diagnostics or immediate treatment recommendations in critical conditions. Thus, accelerating real-time responsiveness of GAI-driven HDT is imperative to ensure timely and effective healthcare outcomes. One potential solution is refining and optimizing GAI algorithms to expedite the generation process. Advanced parallel computing techniques, such as leveraging high-performance computing or distributed computing frameworks, can significantly accelerate model training and generation, mitigating the latency and enhancing agility in responding to critical healthcare needs.

V-D Seamless Integration of GAI-driven HDT with Existing Healthcare IT Ecosystems

The integration of GAI-driven HDT into existing healthcare IT ecosystems is a fundamental requirement for the successful practical implementation. In this process, numerous many interoperability issues, such as efficient data exchange and effective data integration between these two types of systems. Standardized application programming interfaces (APIs) and web services is a practical solution to these challenges. In this regard, one significant integration issue to overcome is the existence of various data structures and standards within these two types of systems. To confront this complexity, deploying uniform data formats, such as health level seven (HL7) and fast healthcare interoperability resources (FHIR), is advisable. These formats are widely recognizable within global healthcare IT infrastructures, and their use in GAI-driven HDT can aid it in communicating effectively with existing healthcare IT infrastructures, allowing a streamlined process of data exchange and integration. However, the adoption of HL7 and FHIR in GAI-driven HDT would arise many challenges. For example, both them are complex data standards, with a broad range of elements and structures, which will pose a challenge for the GAI-driven HDT in terms of data processing and understanding. Additionally, map** the data from the GAI-driven HDT to these formats is another challenging task due to varying data types and intricate data relationships. Tackling these integration and interoperability issues would provide a clearer roadmap for the practical implementation of GAI- driven HDT in IoT-healthcare.

VI Conclusions

In this survey, we have shed light on implementing GAI-driven HDT in IoT-healthcare. Specifically, we have introduced IoT-healthcare, and envisioned the potential of utilizing GAI-driven HDT. Then, we have reviewed the fundamentals of HDT and GAI and illustrated the framework of GAI-driven HDT. After that, we have analyzed the implementation of GAI-driven HDT:

1) GAI can assist the data acquisition in HDT, by generating diverse and highly realistic synthetic data, including synthetic physiological, medical imaging and motion data.

2) GAI can offer efficient communication schemes for HDT, including GAI-aid semantic communication and GAI-aid cross-modal communication.

3) GAI can be used in data management of HDT by generating the missed data for data imputation, and clean data for data denoising. Additionally, GAI can produce synthesized yet authentic HDT data largely, preserving the original data distribution, whilst ensuring data security and privacy.

4) GAI can empower digital modeling in HDT, including digital modeling of human cells, tissues and organs.

5) GAI can facilitate data analysis in HDT, including classification, segmentation, anomaly detection and prediction.

Based on this, we have further presented the IoT-healthcare applications of GAI-driven HDT, such as personalized health monitoring and diagnosis, personalized prescription, and personalized rehabilitation. Finally, we have outlined some future research directions.

Jiayuan Chen received the M.S. degree with the College of Computer Science and Technology, Nan**g University of Aeronautics and Astronautics (NUAA), Nan**g, China, where he is currently pursuing the Ph.D. degree in Computer Science and Technology. His research interests include reinforcement learning, generative AI and network management.

You Shi received the M.S. degree from the School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, China, in 2020. He is pursuing a Ph.D. at the College of Computer Science and Technology, Nan**g University of Aeronautics and Astronautics (NUAA), Nan**g, China. His main research interests include mobile edge computing, online optimization, and service deployment.

Changyan Yi (Member, IEEE) received the Ph.D. degree from the Department of Electrical and Computer Engineering, University of Manitoba, MB, Canada, in 2018. He is currently a Professor with the College of Computer Science and Technology, Nan**g University of Aeronautics and Astronautics (NUAA), Nan**g, China. His research interests include stochastic optimization, game theory, incentive mechanism, with applications in various communication and networking systems.

Hongyang Du received the BEng degree from the School of Electronic and Information Engineering, Bei**g Jiaotong University, Bei**g, in 2021, and the PhD degree from the Interdisciplinary Graduate Program at the College of Computing and Data Science, Energy Research Institute @ NTU, Nanyang Technological University, Singapore, in 2024. His research interests include edge intelligence, generative AI, and semantic communications.

JiaWen Kang (Senior Member, IEEE) received the M.S. degree and the Ph.D. degree from the Guangdong University of Technology, China, in 2015 and 2018, respectively. He is currently a full professor at the Guangdong University of Technology. He has been a postdoc at Nanyang Technological University from 2018 to 2021, Singapore. His research interests mainly focus on blockchain, Metaverse, and AIGC in wireless communications and networking.

Dusit Niyato (Fellow, IEEE) is a professor in the College of Computing and Data Science, at Nanyang Technological University, Singapore. He received B.Eng. from King Mongkuts Institute of Technology Ladkrabang (KMITL), Thailand and Ph.D. in Electrical and Computer Engineering from the University of Manitoba, Canada. His research interests are in the areas of sustainability, edge intelligence, decentralized machine learning, and incentive mechanism design.