11email: [email protected] 22institutetext: Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
22email: [email protected] 33institutetext: Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China 44institutetext: Institute of Medical Intelligence and XR, The Chinese University of Hong Kong, Hong Kong, China
Comprehensive Generative Replay for Task-Incremental Segmentation with Concurrent Appearance and Semantic Forgetting
Abstract
Generalist segmentation models are increasingly favored for diverse tasks involving various objects from different image sources. Task-Incremental Learning (TIL) offers a privacy-preserving training paradigm using tasks arriving sequentially, instead of gathering them due to strict data sharing policies. However, the task evolution can span a wide scope that involves shifts in both image appearance and segmentation semantics with intricate correlation, causing concurrent appearance and semantic forgetting. To solve this issue, we propose a Comprehensive Generative Replay (CGR) framework that restores appearance and semantic knowledge by synthesizing image-mask pairs to mimic past task data, which focuses on two aspects: modeling image-mask correspondence and promoting scalability for diverse tasks. Specifically, we introduce a novel Bayesian Joint Diffusion (BJD) model for high-quality synthesis of image-mask pairs with their correspondence explicitly preserved by conditional denoising. Furthermore, we develop a Task-Oriented Adapter (TOA) that recalibrates prompt embeddings to modulate the diffusion model, making the data synthesis compatible with different tasks. Experiments on incremental tasks (cardiac, fundus and prostate segmentation) show its clear advantage for alleviating concurrent appearance and semantic forgetting. Code is available at https://github.com/**gyzhang/CGR.
Keywords:
Incremental Learning Generative Replay Diffusion Model.1 Introduction
For medical image segmentation, there is an increasing demand for a generalist model capable of handling diverse tasks, involving multiple objectives in various imaging conditions [15, 7, 11]. As data for different tasks is often dispersed across clinical departments with stringent data sharing policies [17], aggregating these task data as a consolidated set is impractical for model training [14] while Task-Incremental Learning (TIL) emerges as a storage-efficient and privacy-protecting paradigm. It enables a generalist model to learn from sequentially arriving tasks, where, notably, these tasks vary widely without predefined restrictions, addressing diverse objectives even across different anatomical regions and imaging devices.
A straightforward TIL approach is to consecutively finetune the model using only the current task, yet leading to dramatic failure on previously learned tasks, attributed to: 1) co-occurrence of appearance discrepancy and semantic shift, as tasks can evolve in a wide scope that involves not only heterogeneous data from multiple resources but also varying objectives with distinct anatomy [15]; and 2) ignorance of appearance-semantics correspondence, making the model’s memorizability even fragile to such drastic task shifts [9]. We identify this phenomenon as concurrent appearance and semantic forgetting, which is under-studied in TIL.
However, in contrast to this challenging TIL scenario where appearance and semantic forgetting are intrinsically coupled, prevalent research recognizes these forgetting problems separately, addressing each by customized paradigms. Specifically, Class-Incremental Learning (CIL) alleviates semantic forgetting for an increasing variety of segmentation objectives within a confined region [14] through distilling [4, 27] and transferring [12, 23] semantic prototypes. Nevertheless, in the TIL context, where objectives often span entirely different regions with substantial appearance discrepancies, CIL methods would suffer intractable appearance forgetting that hinders the reliability of semantic transfer and distillation [14, 4]. In addition, Domain-Incremental Learning (DIL) combats appearance forgetting for a deterministic objective via style regularization [10, 8, 24] and appearance recovery using image-only generative replay with error-prone mask reuse [9, 3]. Yet, in TIL with varying objectives, such intricate semantic shift disrupts the style-oriented regularization and even makes the image-only replay dominated by the current task objective [9], leading to semantic forgetting in DIL methods for past objectives. Overall, while existing DIL and CIL effectively tackle either appearance or semantic forgetting individually, they fall short of a comprehensive TIL perspective that simultaneously considers both issues with high correspondence.
Based on the above issues, compared with traditional DIL and CIL schemes, the main challenge in TIL lies in how to construct a unified framework that comprehensively overcomes concurrent appearance and semantic forgetting, rather than treating them separately. Inspired by the practical data rehearsal [26], our insight involves synthesizing both images and their corresponding segmentation masks to simulate diverse past task data, which serves as a comprehensive replay mechanism to recover the coupled image appearance and segmentation semantics for memory evoking. Recently, diffusion models [5] have provided a cutting-edge image synthesis approach especially for the medical field [16], yet they are limited in simultaneously synthesizing the corresponding segmentation masks due to the ignorance of essential image-mask correlation [1]. Moreover, diffusion models exhibit a decent versatility in switching between synthesis tasks under the guidance of text prompts [19] with Contrastive Language-Image Pretraining (CLIP)-based embedding [18]. However, this pretrained embedding poses a significant domain gap for our customized medical context [11], misguiding the diffusion model and impeding its scalable data synthesis for replaying diverse tasks. These insights motivate us to pursue comprehensive replay using a diffusion model, focusing on two aspects: preserving crucial image-mask correspondence, and regulating the CLIP-based embedding to make data synthesis compatible with diverse tasks.
In this paper, we present to our knowledge the first TIL paradigm for medical image segmentation, accommodating a wide task scope with diverse objectives. Our contributions are three-fold: 1) We propose a Comprehensive Generative Replay (CGR) framework to reduce concurrent appearance and semantic forgetting across diverse tasks, by generating image-mask pairs to reproduce past task data; 2) We design a novel Bayesian Joint Diffusion (BJD) model for structure-realistic synthesis of image-mask pairs, formulating their correspondence as conditional distributions and optimizing through conditional denoising; and 3) We propose a Task-Oriented Adapter (TOA) that recalibrates the CLIP-based embedding to modulate the diffusion model, promoting synthesis scalability for diverse tasks. We evaluate our method on tasks for cardiac, fundus, and prostate segmentation, showing its minimal forgetting and clear advantages over DIL and CIL methods.
2 Method
In the Task-Incremental Learning (TIL) scenario, we train a segmentation model with sequentially arriving tasks. At each learning round , we only obtain data from the current task of paired images and segmentation masks, without access to past tasks . Fig. 1 illustrates our Comprehensive Generative Replay (CGR) framework to reduce concurrent appearance and semantic forgetting, as and both have diverse distributions under drastic task shifts.
2.1 Bayesian Joint Diffusion Model
To combat concurrent appearance and semantic forgetting in TIL, we synthesize paired images and segmentation masks to mimic past task inputs using diffusion models [5]. To achieve this, a naive way is to directly model the joint distribution of images and masks [25], but their correspondence is often disrupted and even ignored [1]. Therefore, we propose a Bayesian framework to preserve image-mask correspondence, ensuring precise semantics well-aligned in the recovered images.
Naive Joint Diffusion (NJD) Model. To synthesize paired images and masks using a diffusion model, a basic idea is to learn their joint distribution through applying forward and reverse processes [5] on image-mask pairs [1]. It should be performed in each previous learning round to simulate past task data . Specifically, in the forward process, given an original image-mask pair of the task , we gradually add Gaussian noise to it, and achieve noisy pairs over steps for training a denoising network . Then, this is utilized in the reverse process to iteratively recover from .
The denoising network can be trained with the Maximum Likelihood Estimation (MLE) on the image-mask joint distribution, i.e., . It could be simplified for the joint denoising score matching [1], under a naive assumption that images and masks are nearly independent [25] with their correlation being corrupted by noise added in the forward process. Specifically, in the forward step , noise and are added to and of the task , respectively, leading to and with a noise level . Then, given these as inputs, is trained to jointly predict both noise as a multi-channel output to recover the image-mask distribution in this task:
(1) |
However, the correspondence between images and masks is easily distorted by the random noise added simultaneously to both elements, especially with noise levels increasing gradually in the forward process. It can cause misaligned appearance and semantics, hampering the synthesis of structure-realistic image-mask pairs.
Bayesian Joint Diffusion (BJD) Model. To solve this problem, we propose a Bayesian framework that leverages conditional distributions to model the image-mask correspondence. To this end, the MLE objective can be reformulated as:
(2) |
where can be regarded as a degenerated NJD case [25] under the assumption of independence with correspondence being distorted, converted to a similar joint denoising as Eq. (1). Moreover, and for conditional distributions capture interactions across images and masks, enforcing alignment between appearance and semantics. Notably, they could be simplified for conditional denoising [6], where the noise-free mask and image are used alternatively as reliable references for clear unidirectional correspondence, rather than adding noise simultaneously that would corrupt directional correspondence:
(3) |
Intuitively, conditional image denoising with restores image appearance that aligns with semantics from the clear mask , while conditional mask denoising with captures accurate semantics in the clean image . Although conditional denoising incurs higher FLOPs during training, it does not involve extra learnable parameters, avoiding higher FLOPs during inference.
2.2 Task-Oriented Adapter (TOA)
In our TIL scenario, BJD needs to scale across diverse data distributions of previous tasks, in order to simulate each task effectively. To ensure such versatility, a practical approach is to modulate the diffusion model with text prompts encoded as CLIP-based embedding [19]. However, this embedding is pretrained on natural language-image databases [18] and may not be compatible with our customized tasks [11]. To address this problem, we propose a Task-Oriented Adapter (TOA) to recalibrate the prompt embedding, and leverage a cross attention mechanism to modulate the BJD model for scalable data synthesis across diverse tasks.
TOA Architecture. We establish a text prompt template [11] for task characterization: “[M] images of [A] for [SO]”, where [M], [A] and [SO] represent the modality, region, and objective, respectively. Given a task with index , the text prompt is fed into the CLIP encoder [18] to obtain the prompt embedding , which is further recalibrated by a task-specific, lightweight two-layer adapter , ensuring scalability for various tasks in a memory-efficient way:
(4) |
where is a learnable factor to modify the recalibration strength.
Modulated Denoising Network. The recalibrated embedding is utilized to modulate BJD for task-specific data synthesis. We combine with the output from each intermediate layer of the denoising network using cross-attention [21], assembling them into a modulated denoising network for BJD:
(5) |
Here, , , and are learnable query, key, and value for cross attention in each layer . Moreover, is the channel number and is the softmax function.
2.3 Replay for Memory Evoking and Updating
Based on the BJD with TOA, we perform DDIM sampling [20] to generate image-mask pairs for replaying past task data, denoted as . The replayed data evokes faded memory when learning on a new task, and this memory should also be updated to include the new task for subsequent replay in future rounds [3].
Memory Evoking. To evoke previous memory when learning on a new task, we take the replayed past task datasets to jointly train the segmentation model together with the current task data , where the segmentation loss is calculated for and using cross-entropy with a trade-off :
(6) |
Memory Updating. In addition to mimicking past tasks, the memory-evoking diffusion model should also simulate the current task data for subsequent replays in TIL. Therefore, we update the BJD model using loss functions measured on and with a trade-off , while equip** the modulated denoising network through TOA for scalable data synthesis:
(7) |
3 Experiments
Dataset. We evaluated our method on three tasks: 1) cardiac MRI segmentation [2] with 320 subjects for three structures of the left ventricle, the right ventricle, and the left ventricular myocardium; 2) fundus segmentation [22] with 1060 subjects for the optic cup and disc; and 3) prostate MRI segmentation [13] with 116 subjects. They present concurrent appearance and semantic shifts due to varying imaging conditions and diverse objectives. For data pre-processing, cardiac and prostate images were resampled to unit spacing and resized to 256256 in the axis plane, while fundus images were cropped to 800800 around the optic disc and resized to the same size 256256. In each task, the dataset was split into 60%, 15%, and 25% for training, validation, and testing, respectively.
Experimental Setting. We organized these segmentation tasks in two learning schedules: with data arriving sequentially for cardiac, fundus and prostate segmentation, and as a reverse order. After completing learning on the final task, we evaluated the model on current and previous tasks using the Dice Score Coefficient (DSC) and the Hausdorff Distance (HD).
Implementation. We used 2D Res-UNet as our segmentation backbone due to its strong generalist transferability [7]. It was trained using Adam Optimizer with learning rate 210-4, batch size 16, and iteration number 4104. For BJD with forward steps, we employed a 2D-UNet as the denoising network [5], using AdamW Optimizer with learning rate 110-4, batch size 8 and iteration number 4105. We empirically synthesized 3000 image-mask pairs for each previous task. We empirically set and as 0.25 for a suitable trade-off [9].
Learning order | (Cardiac Fundus Prostate) | (Prostate Fundus Cardiac) | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Task | Previous | Current | Mean | Previous | Current | Mean | Previous | Current | Mean | Previous | Current | Mean | |||||
Cardiac | Fundus | Prostate | Cardiac | Fundus | Prostate | Prostate | Fundus | Cardiac | Prostate | Fundus | Cardiac | ||||||
Metric | DSC (%) | HD (pixel) | DSC (%) | HD (pixel) | |||||||||||||
BaseLine | JointTrain | 89.79 | 89.34 | 90.81 | 89.98 | 2.02 | 5.10 | 3.36 | 3.49 | 90.81 | 89.34 | 89.79 | 89.98 | 3.36 | 5.10 | 2.02 | 3.49 |
FineTune | 0.03 | 0.02 | 91.06 | 30.37 | NaN | NaN | 2.69 | NaN | 0.00 | 0.00 | 89.60 | 29.87 | NaN | NaN | 2.11 | NaN | |
DIL | EWC [8] | 21.84 | 49.41 | 73.37 | 48.20 | 139.89 | 25.88 | 15.31 | 60.36 | 0.27 | 44.59 | 58.47 | 34.44 | 151.96 | 62.38 | 38.84 | 84.40 |
LwF [10] | 46.76 | 82.37 | 88.08 | 72.40 | 12.95 | 9.44 | 6.49 | 9.63 | 19.34 | 77.89 | 86.94 | 61.39 | 11.95 | 12.50 | 3.89 | 9.45 | |
GAR [3] | 86.12 | 84.39 | 90.30 | 86.94 | 4.63 | 11.76 | 2.93 | 6.44 | 73.27 | 84.51 | 89.19 | 82.33 | 5.61 | 8.38 | 2.18 | 5.39 | |
CIL | PLOP [4] | 22.47 | 72.39 | 81.96 | 58.94 | 32.54 | 15.93 | 13.21 | 20.56 | 68.62 | 79.16 | 85.18 | 77.65 | 5.25 | 13.53 | 5.10 | 7.96 |
MEIL [12] | 39.84 | 74.05 | 88.20 | 67.36 | 20.68 | 12.30 | 5.84 | 12.94 | 4.51 | 41.42 | 86.54 | 44.16 | 24.34 | 73.17 | 3.98 | 33.83 | |
HSI [14] | 85.40 | 81.96 | 89.78 | 85.72 | 5.56 | 10.82 | 2.77 | 6.38 | 67.60 | 81.27 | 89.24 | 79.37 | 7.89 | 14.70 | 2.09 | 8.23 | |
TIL | CGR (-BJD) | 85.43 | 86.02 | 90.28 | 87.24 | 3.89 | 7.16 | 2.74 | 4.60 | 83.02 | 85.36 | 89.34 | 85.91 | 5.52 | 7.22 | 2.02 | 4.92 |
CGR (-TOA) | 86.77 | 86.78 | 90.47 | 88.01 | 3.50 | 6.62 | 3.26 | 4.46 | 85.08 | 85.89 | 89.31 | 86.76 | 4.72 | 7.16 | 2.00 | 4.63 | |
CGR (ours) | 87.48 | 87.99 | 90.68 | 88.71 | 2.81 | 5.83 | 2.93 | 3.86 | 88.00 | 87.40 | 89.31 | 88.24 | 4.68 | 6.06 | 2.07 | 4.27 |
Comparison with State-of-the-Arts. We compared our TIL framework called Comprehensive Generative Replay (CGR), including a Bayesian Joint Diffusion (BJD) model and a Task-Oriented Adapter (TOA), with state-of-the-art methods: 1) Baselines: JointTrain that gathers all task data for joint training, and FineTune that sequentially finetunes the model using only current task data; 2) DIL schemes: EWC [8] and LwF [10] using appearance regularization terms, and GAR [3] based on generative appearance replay without concurrent semantics synthesis; and 3) CIL schemes: PLOP [4] using class distillation and MEIL [12] transferring class prototypes, and HSI [14] alleviating semantic shift under slight data heterogeneity, yet halting in an extremely simple TIL case restricted in an enclosed region, unlike our scenario with a broader task range.
As presented in Table 1, FineTune fails drastically for previous tasks, yielding 0.00% DSC and NaN HD due to concurrent appearance and semantic forgetting during task evolution. Although DIL and CIL schemes can outperform FineTune, their advantages are modest, addressing forgetting problems partially for either appearance or semantics. Notably, GAR achieves a relatively higher performance in the DIL scheme by predicting segmentation masks on the replayed images to generate restored yet error-prone semantics [9], while HSI stands out in the CIL scheme owing to its dual-flow module with batch renormalization layers to resist to mild image heterogeneity alongside semantic shift. However, their performance is still hindered in the TIL scenario, where tasks arrive with not only significant data discrepancy but also entirely different objectives. Our CGR shows the best performance closer to JointTrain, e.g. substantially outperforming GAR and HSI with 1.77% and 2.99% DSC for the learning order , demonstrating its clear advantages in addressing both appearance and semantic forgetting for TIL.
Furthermore, Fig. 2 visualizes the segmentation results for previous and current tasks. Most methods exhibit sufficient adaptation capability on the current task, except EWC and PLOP with over-strong regularization terms. Our CGR achieves the precise shape and smooth boundary, especially for previous tasks, whereas other methods show considerable limitations.
Effectiveness of Bayesian Joint Diffusion (BJD). We visualize in Fig. 3(a) the synthesized image-mask pairs for cardiac, fundus and prostate segmentation. The image-mask pairs generated without BJD, i.e., using the Naive Joint Diffusion (NJD) instead, often suffer irregular structure fracture and disruption. BJD provides the structure-realistic data synthesis with normal shapes preserved for different segmentation objectives, significantly improving our CGR method over the BJD-deactivated counterpart (-BJD), as shown in Table 1 for ablation study.
Contribution of Task-Oriented Adapter (TOA). In Fig. 3(b), we use t-SNE to visualize the distributions of synthesized image-mask pairs with and without TOA attached to the BJD model. TOA enhances the compactness of inner-task distribution and the separability of inter-task distribution, promoting scalability of data synthesis across tasks. Integrating TOA in CGR has superiority over the TOA-deactivated counterpart (-TOA), as shown in Table 1 for ablation study.
Robustness to Learning Order. We validate the robustness of our method to variations in the learning order, as shown in Table 1 using forward and reversed orders. Other methods exhibit unstable performance and significant fluctuations under different learning orders. Notably, our CGR consistently outperforms these methods by a stable and substantial margin, highlighting its strong robustness.
4 Conclusion
This paper presents a novel TIL framework for medical image segmentation, addressing concurrent appearance and semantic forgetting as tasks evolve widely. To achieve this, we propose a Comprehensive Generative Replay (CGR) framework that synthesizes past task data including paired images and masks, where their correspondence is captured by a Bayesian Joint Diffusion (BJD) model with Task-Oriented Adapter (TOA) for synthesis scalability. The broader significance of our work may lie in the extension on foundation models, providing a promising avenue for accumulating generalist skills in artificial general intelligence. In the future, we will conduct more comprehensive experiments to validate the robustness of CGR on multi-organ or tumor segmentation datasets.
4.0.1 Acknowledgements
This research is partially supported by Specific Project of Shanghai Jiao Tong University for "Invigorating Inner Mongolia through Science and Technology" (2022XYJG0001–01–17), the funding from Star of SJTU Programme, a grant from the Researh Grants Council of the Hong Kong Special Administrative Region, China (Project No.: T45-401/22-N), and a grant from Hong Kong Innovation and Technology Fund (Project No.: MHP/085/21).
4.0.2 \discintname
The authors have no competing interests to declare that are relevant to the content of this article.
References
- [1] Bao, F., Nie, S., Xue, K., Li, C., Pu, S., Wang, Y., Yue, G., Cao, Y., Su, H., Zhu, J.: One transformer fits all distributions in multi-modal diffusion at scale. arXiv preprint arXiv:2303.06555 (2023)
- [2] Campello, V.M., Gkontra, P., Izquierdo, C., Martin-Isla, C., Sojoudi, A., Full, P.M., Maier-Hein, K., Zhang, Y., He, Z., Ma, J., et al.: Multi-centre, multi-vendor and multi-disease cardiac segmentation: the m&ms challenge. IEEE Transactions on Medical Imaging 40(12), 3543–3554 (2021)
- [3] Chen, B., Thandiackal, K., Pati, P., Goksel, O.: Generative appearance replay for continual unsupervised domain adaptation. arXiv preprint arXiv:2301.01211 (2023)
- [4] Douillard, A., Chen, Y., Dapogny, A., Cord, M.: Plop: Learning without forgetting for continual semantic segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 4040–4050 (2021)
- [5] Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. Advances in neural information processing systems 33, 6840–6851 (2020)
- [6] Ho, J., Salimans, T.: Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598 (2022)
- [7] Huang, Z., Wang, H., Deng, Z., Ye, J., Su, Y., Sun, H., He, J., Gu, Y., Gu, L., Zhang, S., et al.: Stu-net: Scalable and transferable medical image segmentation models empowered by large-scale supervised pre-training. arXiv preprint arXiv:2304.06716 (2023)
- [8] Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al.: Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences 114(13), 3521–3526 (2017)
- [9] Li, K., Yu, L., Heng, P.A.: Domain-incremental cardiac image segmentation with style-oriented replay and domain-sensitive feature whitening. IEEE Transactions on Medical Imaging 42(3), 570–581 (2022)
- [10] Li, Z., Hoiem, D.: Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence 40(12), 2935–2947 (2017)
- [11] Liu, J., Zhang, Y., Chen, J.N., Xiao, J., Lu, Y., A Landman, B., Yuan, Y., Yuille, A., Tang, Y., Zhou, Z.: Clip-driven universal model for organ segmentation and tumor detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 21152–21164 (2023)
- [12] Liu, P., Wang, X., Fan, M., Pan, H., Yin, M., Zhu, X., Du, D., Zhao, X., Xiao, L., Ding, L., et al.: Learning incrementally to segment multiple organs in a ct image. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 714–724. Springer (2022)
- [13] Liu, Q., Dou, Q., Yu, L., Heng, P.A.: Ms-net: multi-site network for improving prostate segmentation with heterogeneous mri data. IEEE transactions on medical imaging 39(9), 2713–2724 (2020)
- [14] Liu, X., Shih, H.A., Xing, F., Santarnecchi, E., El Fakhri, G., Woo, J.: Incremental learning for heterogeneous structure segmentation in brain tumor mri. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 46–56. Springer (2023)
- [15] Ma, J., He, Y., Li, F., Han, L., You, C., Wang, B.: Segment anything in medical images. Nature Communications 15(1), 654 (2024)
- [16] Müller-Franzes, G., Niehues, J.M., Khader, F., Arasteh, S.T., Haarburger, C., Kuhl, C., Wang, T., Han, T., Nebelung, S., Kather, J.N., et al.: Diffusion probabilistic models beat gans on medical images. arXiv preprint arXiv:2212.07501 (2022)
- [17] Price, W.N., Cohen, I.G.: Privacy in the age of medical big data. Nature medicine 25(1), 37–43 (2019)
- [18] Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: International conference on machine learning. pp. 8748–8763. PMLR (2021)
- [19] Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp. 10684–10695 (2022)
- [20] Song, J., Meng, C., Ermon, S.: Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 (2020)
- [21] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Advances in neural information processing systems 30 (2017)
- [22] Wang, S., Yu, L., Li, K., Yang, X., Fu, C.W., Heng, P.A.: Dofe: Domain-oriented feature embedding for generalizable fundus image segmentation on unseen datasets. IEEE Transactions on Medical Imaging 39(12), 4237–4248 (2020)
- [23] Wu, H., Wang, Z., Zhao, Z., Chen, C., Qin, J.: Continual nuclei segmentation via prototype-wise relation distillation and contrastive learning. IEEE Transactions on Medical Imaging (2023)
- [24] Zhang, J., Gu, R., Xue, P., Liu, M., Zheng, H., Zheng, Y., Ma, L., Wang, G., Gu, L.: S3r: Shape and semantics-based selective regularization for explainable continual segmentation across multiple sites. IEEE Transactions on Medical Imaging (2023)
- [25] Zhang, J., Li, S., Lu, Y., Fang, T., McKinnon, D., Tsin, Y., Quan, L., Yao, Y.: Jointnet: Extending text-to-image diffusion for dense distribution modeling. arXiv preprint arXiv:2310.06347 (2023)
- [26] Zhang, J., Xue, P., Gu, R., Gu, Y., Liu, M., Pan, Y., Cui, Z., Huang, J., Ma, L., Shen, D.: Learning towards synchronous network memorizability and generalizability for continual segmentation across multiple sites. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 380–390. Springer (2022)
- [27] Zhao, D., Yuan, B., Shi, Z.: Inherit with distillation and evolve with contrast: Exploring class incremental semantic segmentation without exemplar memory. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023)