Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation
Authors:
Ji-Jia Wu,
Andy Chia-Hao Chang,
Chieh-Yu Chuang,
Chun-Pei Chen,
Yu-Lun Liu,
Min-Hung Chen,
Hou-Ning Hu,
Yung-Yu Chuang,
Yen-Yu Lin
Abstract:
This paper addresses text-supervised semantic segmentation, aiming to learn a model capable of segmenting arbitrary visual concepts within images by using only image-text pairs without dense annotations. Existing methods have demonstrated that contrastive learning on image-text pairs effectively aligns visual segments with the meanings of texts. We notice that there is a discrepancy between text a…
▽ More
This paper addresses text-supervised semantic segmentation, aiming to learn a model capable of segmenting arbitrary visual concepts within images by using only image-text pairs without dense annotations. Existing methods have demonstrated that contrastive learning on image-text pairs effectively aligns visual segments with the meanings of texts. We notice that there is a discrepancy between text alignment and semantic segmentation: A text often consists of multiple semantic concepts, whereas semantic segmentation strives to create semantically homogeneous segments. To address this issue, we propose a novel framework, Image-Text Co-Decomposition (CoDe), where the paired image and text are jointly decomposed into a set of image regions and a set of word segments, respectively, and contrastive learning is developed to enforce region-word alignment. To work with a vision-language model, we present a prompt learning mechanism that derives an extra representation to highlight an image segment or a word segment of interest, with which more effective features can be extracted from that segment. Comprehensive experimental results demonstrate that our method performs favorably against existing text-supervised semantic segmentation methods on six benchmark datasets.
△ Less
Submitted 5 April, 2024;
originally announced April 2024.
Homoepitaxy of rhombohedral-stacked MoS2 with room temperature switchable ferroelectricity
Authors:
Tilo H. Yang,
Hsiang-Chi Hu,
Fu-Xiang Rikudo Chen,
Po-Yen Lin,
Yu-Fan Chiang,
Wen-Hao Chang,
Yi-Hao Kuo,
Yu-Seng Ku,
Bor-Wei Liang,
Alice Chinghsuan Chang,
Han-Chieh Lo,
Yu-Chen Chang,
Yi-Cheng Chen,
Ting-Hua Lu,
Chun-Liang Lin,
Yann-Wen Lan
Abstract:
The discovery of interfacial ferroelectricity in two-dimensional rhombohedral (3R)-stacked semiconductors opens up a new pathway for achieving ultrathin computing-in-memory devices. However, exploring ferroelectricity switching in natural 3R crystals is difficult due to lack of co-existing 3R stacking domains. Here, we present that MoS2 homoepitaxial patterns with 3R polytypic domains can manifest…
▽ More
The discovery of interfacial ferroelectricity in two-dimensional rhombohedral (3R)-stacked semiconductors opens up a new pathway for achieving ultrathin computing-in-memory devices. However, exploring ferroelectricity switching in natural 3R crystals is difficult due to lack of co-existing 3R stacking domains. Here, we present that MoS2 homoepitaxial patterns with 3R polytypic domains can manifest switchable ferroelectricity at room-temperature. Based on the diffusion limited aggregation theory, such MoS2 patterns are formed under the low Mo chemical potential and low temperature with respect to common chemical vapor deposition synthesis. The alternation of 3R polytypes in the MoS2 homoepitaxial patterns, observed by scanning transmission electron microscopy, accounts for ferroelectricity switching. The MoS2 field-effect transistors with 3R polytypic domains exhibit a repeatable counterclockwise hysteresis with gate voltage swee**, an indication of ferroelectricity switching, and the memory window exceeds those measured for compact-shaped 3R bilayer devices. This work provides a direct growth concept for layered 3R-based ferroelectric memory.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
