A Foundation Model for Brain Lesion Segmentation with Mixture of Modality Experts
Authors:
Xinru Zhang,
Ni Ou,
Berke Doga Basaran,
Marco Visentin,
Mengyun Qiao,
Renyang Gu,
Cheng Ouyang,
Yaou Liu,
Paul M. Matthew,
Chuyang Ye,
Wenjia Bai
Abstract:
Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics on different imaging modalities. Due to this complexity, brain lesion segmentation methods are often developed in a task-specific manner. A specific segmentation…
▽ More
Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics on different imaging modalities. Due to this complexity, brain lesion segmentation methods are often developed in a task-specific manner. A specific segmentation model is developed for a particular lesion type and imaging modality. However, the use of task-specific models requires predetermination of the lesion type and imaging modality, which complicates their deployment in real-world scenarios. In this work, we propose a universal foundation model for 3D brain lesion segmentation, which can automatically segment different types of brain lesions for input data of various imaging modalities. We formulate a novel Mixture of Modality Experts (MoME) framework with multiple expert networks attending to different imaging modalities. A hierarchical gating network combines the expert predictions and fosters expertise collaboration. Furthermore, we introduce a curriculum learning strategy during training to avoid the degeneration of each expert network and preserve their specialization. We evaluated the proposed method on nine brain lesion datasets, encompassing five imaging modalities and eight lesion types. The results show that our model outperforms state-of-the-art universal models and provides promising generalization to unseen datasets.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
Tell me a story about yourself: The words of shop** experience and self-satisfaction
Authors:
L Petruzzellis,
A Fronzetti Colladon,
M Visentin,
J. -C. Chebat
Abstract:
In this paper we investigate the verbal expression of shop** experience obtained by a sample of customers asked to freely verbalize how they felt when entering a store. Using novel tools of Text Mining and Social Network Analysis, we analyzed the interviews to understand the connection between the emotions aroused during the shop** experience, satisfaction and the way participants link these c…
▽ More
In this paper we investigate the verbal expression of shop** experience obtained by a sample of customers asked to freely verbalize how they felt when entering a store. Using novel tools of Text Mining and Social Network Analysis, we analyzed the interviews to understand the connection between the emotions aroused during the shop** experience, satisfaction and the way participants link these concepts to self-satisfaction and self-identity. The results show a prominent role of emotions in the discourse about the shop** experience before purchasing and an inward-looking connection to the self. Our results also suggest that modern retail environment should enhance the hedonic shop** experience in terms of fun, fantasy, moods, and emotions.
△ Less
Submitted 6 August, 2021;
originally announced August 2021.
Non-convex cost functionals in boosting algorithms and methods for panel selection
Authors:
Marco Visentin
Abstract:
In this document we propose a new improvement for boosting techniques as proposed in Friedman '99 by the use of non-convex cost functional. The idea is to introduce a correlation term to better deal with forecasting of additive time series. The problem is discussed in a theoretical way to prove the existence of minimizing sequence, and in a numerical way to propose a new "ArgMin" algorithm. The…
▽ More
In this document we propose a new improvement for boosting techniques as proposed in Friedman '99 by the use of non-convex cost functional. The idea is to introduce a correlation term to better deal with forecasting of additive time series. The problem is discussed in a theoretical way to prove the existence of minimizing sequence, and in a numerical way to propose a new "ArgMin" algorithm. The model has been used to perform the touristic presence forecast for the winter season 1999/2000 in Trentino (italian Alps).
△ Less
Submitted 20 February, 2001;
originally announced February 2001.
