Showing 1–9 of 9 results for author: Zhou, J H

Mixup Your Own Pairs

Authors: Yilei Wu, Zijian Dong, Chongyao Chen, Wangchunshu Zhou, Juan Helen Zhou

Abstract: In representation learning, regression has traditionally received less attention than classification. Directly applying representation learning techniques designed for classification to regression often results in fragmented representations in the latent space, yielding sub-optimal performance. In this paper, we argue that the potential of contrastive learning for regression has been overshadowed… ▽ More In representation learning, regression has traditionally received less attention than classification. Directly applying representation learning techniques designed for classification to regression often results in fragmented representations in the latent space, yielding sub-optimal performance. In this paper, we argue that the potential of contrastive learning for regression has been overshadowed due to the neglect of two crucial aspects: ordinality-awareness and hardness. To address these challenges, we advocate "mixup your own contrastive pairs for supervised contrastive regression", instead of relying solely on real/augmented samples. Specifically, we propose Supervised Contrastive Learning for Regression with Mixup (SupReMix). It takes anchor-inclusive mixtures (mixup of the anchor and a distinct negative sample) as hard negative pairs and anchor-exclusive mixtures (mixup of two distinct negative samples) as hard positive pairs at the embedding level. This strategy formulates harder contrastive pairs by integrating richer ordinal information. Through extensive experiments on six regression datasets including 2D images, volumetric images, text, tabular data, and time-series signals, coupled with theoretical analysis, we demonstrate that SupReMix pre-training fosters continuous ordered representations of regression data, resulting in significant improvement in regression performance. Furthermore, SupReMix is superior to other approaches in a range of regression challenges including transfer learning, imbalanced training data, and scenarios with fewer training samples. △ Less

Submitted 29 September, 2023; v1 submitted 28 September, 2023; originally announced September 2023.

Comments: The first two authors equally contributed to this work

Beyond the Snapshot: Brain Tokenized Graph Transformer for Longitudinal Brain Functional Connectome Embedding

Authors: Zijian Dong, Yilei Wu, Yu Xiao, Joanna Su Xian Chong, Yueming **, Juan Helen Zhou

Abstract: Under the framework of network-based neurodegeneration, brain functional connectome (FC)-based Graph Neural Networks (GNN) have emerged as a valuable tool for the diagnosis and prognosis of neurodegenerative diseases such as Alzheimer's disease (AD). However, these models are tailored for brain FC at a single time point instead of characterizing FC trajectory. Discerning how FC evolves with diseas… ▽ More Under the framework of network-based neurodegeneration, brain functional connectome (FC)-based Graph Neural Networks (GNN) have emerged as a valuable tool for the diagnosis and prognosis of neurodegenerative diseases such as Alzheimer's disease (AD). However, these models are tailored for brain FC at a single time point instead of characterizing FC trajectory. Discerning how FC evolves with disease progression, particularly at the predementia stages such as cognitively normal individuals with amyloid deposition or individuals with mild cognitive impairment (MCI), is crucial for delineating disease spreading patterns and develo** effective strategies to slow down or even halt disease advancement. In this work, we proposed the first interpretable framework for brain FC trajectory embedding with application to neurodegenerative disease diagnosis and prognosis, namely Brain Tokenized Graph Transformer (Brain TokenGT). It consists of two modules: 1) Graph Invariant and Variant Embedding (GIVE) for generation of node and spatio-temporal edge embeddings, which were tokenized for downstream processing; 2) Brain Informed Graph Transformer Readout (BIGTR) which augments previous tokens with trainable type identifiers and non-trainable node identifiers and feeds them into a standard transformer encoder to readout. We conducted extensive experiments on two public longitudinal fMRI datasets of the AD continuum for three tasks, including differentiating MCI from controls, predicting dementia conversion in MCI, and classification of amyloid positive or negative cognitively normal individuals. Based on brain FC trajectory, the proposed Brain TokenGT approach outperformed all the other benchmark models and at the same time provided excellent interpretability. The code is available at https://github.com/ZijianD/Brain-TokenGT.git △ Less

Submitted 12 July, 2023; v1 submitted 3 July, 2023; originally announced July 2023.

Comments: MICCAI 2023

Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activity

Authors: Zijiao Chen, Jiaxin Qing, Juan Helen Zhou

Abstract: Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain recordings, work on recovering continuous visual experiences in the form of videos is limited. In this work, we propose Mind-Video that learns spatiotemporal informatio… ▽ More Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain recordings, work on recovering continuous visual experiences in the form of videos is limited. In this work, we propose Mind-Video that learns spatiotemporal information from continuous fMRI data of the cerebral cortex progressively through masked brain modeling, multimodal contrastive learning with spatiotemporal attention, and co-training with an augmented Stable Diffusion model that incorporates network temporal inflation. We show that high-quality videos of arbitrary frame rates can be reconstructed with Mind-Video using adversarial guidance. The recovered videos were evaluated with various semantic and pixel-level metrics. We achieved an average accuracy of 85% in semantic classification tasks and 0.19 in structural similarity index (SSIM), outperforming the previous state-of-the-art by 45%. We also show that our model is biologically plausible and interpretable, reflecting established physiological processes. △ Less

Submitted 19 May, 2023; originally announced May 2023.

Comments: 15 pages, 11 figures, submitted to anonymous conference

High-temperature thermoelectric properties with Th$_{3-x}$Te$_4$

Authors: Jizhu Hu **xin Zhong Jun Zhou

Abstract: Th$_3$Te$_4$ materials are potential candidates for commercial thermoelectric (TE) materials at high-temperature due to their superior physical properties. We incorporate the multiband Boltzmann transport equations with firstprinciples calculations to theoretically investigate the TE properties of Th$_3$Te$_4$ materials. As a demonstration of our method, the TE properties of La$_3$Te$_4$ are simil… ▽ More Th$_3$Te$_4$ materials are potential candidates for commercial thermoelectric (TE) materials at high-temperature due to their superior physical properties. We incorporate the multiband Boltzmann transport equations with firstprinciples calculations to theoretically investigate the TE properties of Th$_3$Te$_4$ materials. As a demonstration of our method, the TE properties of La$_3$Te$_4$ are similar with that of Ce$_3$Te$_4$ at low-temperature, which is consistent with the experiment. Then we systematically calculate the electrical conductivity, the Seebeck coefficient, and the power factor of the two materials above based on parameters obtained from first-principles calculations as well as several other fitting parameters. Our results reveal that for the electron--optical-phonon scattering at high temperatures, a linear dependence of optical phonon energy on temperature explains better the experimental results than a constant optical phonon energy. Based on this, we predict that the TE properties of Ce$_3$Te$_4$ is better than La$_3$Te$_4$ at high temperatures and the optimal carrier concentration corresponding to Ce$_3$Te$_4$ shifts upward with increasing temperature. The optimal carrier concentration of Ce$_3$Te$_4$ is around $1.6\times10^{21}$cm$^{-3}$ with the peak power factor 13.07 $μ$Wcm$^{-1}$K$^{-2}$ at $T=1200$K. △ Less

Submitted 6 January, 2023; originally announced January 2023.

Decomposing 3D Neuroimaging into 2+1D Processing for Schizophrenia Recognition

Authors: Mengjiao Hu, Xudong Jiang, Kang Sim, Juan Helen Zhou, Cuntai Guan

Abstract: Deep learning has been successfully applied to recognizing both natural images and medical images. However, there remains a gap in recognizing 3D neuroimaging data, especially for psychiatric diseases such as schizophrenia and depression that have no visible alteration in specific slices. In this study, we propose to process the 3D data by a 2+1D framework so that we can exploit the powerful deep… ▽ More Deep learning has been successfully applied to recognizing both natural images and medical images. However, there remains a gap in recognizing 3D neuroimaging data, especially for psychiatric diseases such as schizophrenia and depression that have no visible alteration in specific slices. In this study, we propose to process the 3D data by a 2+1D framework so that we can exploit the powerful deep 2D Convolutional Neural Network (CNN) networks pre-trained on the huge ImageNet dataset for 3D neuroimaging recognition. Specifically, 3D volumes of Magnetic Resonance Imaging (MRI) metrics (grey matter, white matter, and cerebrospinal fluid) are decomposed to 2D slices according to neighboring voxel positions and inputted to 2D CNN models pre-trained on the ImageNet to extract feature maps from three views (axial, coronal, and sagittal). Global pooling is applied to remove redundant information as the activation patterns are sparsely distributed over feature maps. Channel-wise and slice-wise convolutions are proposed to aggregate the contextual information in the third view dimension unprocessed by the 2D CNN model. Multi-metric and multi-view information are fused for final prediction. Our approach outperforms handcrafted feature-based machine learning, deep feature approach with a support vector machine (SVM) classifier and 3D CNN models trained from scratch with better cross-validation results on publicly available Northwestern University Schizophrenia Dataset and the results are replicated on another independent dataset. △ Less

Submitted 21 November, 2022; v1 submitted 21 November, 2022; originally announced November 2022.

Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding

Authors: Zijiao Chen, Jiaxin Qing, Tiange Xiang, Wan Lin Yue, Juan Helen Zhou

Abstract: Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing high-quality images with correct semantics from brain recordings is a challenging problem due to the complex underlying representations of brain signals and the sca… ▽ More Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing high-quality images with correct semantics from brain recordings is a challenging problem due to the complex underlying representations of brain signals and the scarcity of data annotations. In this work, we present MinD-Vis: Sparse Masked Brain Modeling with Double-Conditioned Latent Diffusion Model for Human Vision Decoding. Firstly, we learn an effective self-supervised representation of fMRI data using mask modeling in a large latent space inspired by the sparse coding of information in the primary visual cortex. Then by augmenting a latent diffusion model with double-conditioning, we show that MinD-Vis can reconstruct highly plausible images with semantically matching details from brain recordings using very few paired annotations. We benchmarked our model qualitatively and quantitatively; the experimental results indicate that our method outperformed state-of-the-art in both semantic map** (100-way semantic classification) and generation quality (FID) by 66% and 41% respectively. An exhaustive ablation study was also conducted to analyze our framework. △ Less

Submitted 28 March, 2023; v1 submitted 13 November, 2022; originally announced November 2022.

Comments: 8 pages, 9 figures, 2 tables, accepted by CVPR2023, see https://mind-vis.github.io/ for more information

ACM Class: I.4, I.5, J.3

Brain MRI-based 3D Convolutional Neural Networks for Classification of Schizophrenia and Controls

Authors: Mengjiao Hu, Kang Sim, Juan Helen Zhou, Xudong Jiang, Cuntai Guan

Abstract: Convolutional Neural Network (CNN) has been successfully applied on classification of both natural images and medical images but not yet been applied to differentiating patients with schizophrenia from healthy controls. Given the subtle, mixed, and sparsely distributed brain atrophy patterns of schizophrenia, the capability of automatic feature learning makes CNN a powerful tool for classifying sc… ▽ More Convolutional Neural Network (CNN) has been successfully applied on classification of both natural images and medical images but not yet been applied to differentiating patients with schizophrenia from healthy controls. Given the subtle, mixed, and sparsely distributed brain atrophy patterns of schizophrenia, the capability of automatic feature learning makes CNN a powerful tool for classifying schizophrenia from controls as it removes the subjectivity in selecting relevant spatial features. To examine the feasibility of applying CNN to classification of schizophrenia and controls based on structural Magnetic Resonance Imaging (MRI), we built 3D CNN models with different architectures and compared their performance with a handcrafted feature-based machine learning approach. Support vector machine (SVM) was used as classifier and Voxel-based Morphometry (VBM) was used as feature for handcrafted feature-based machine learning. 3D CNN models with sequential architecture, inception module and residual module were trained from scratch. CNN models achieved higher cross-validation accuracy than handcrafted feature-based machine learning. Moreover, testing on an independent dataset, 3D CNN models greatly outperformed handcrafted feature-based machine learning. This study underscored the potential of CNN for identifying patients with schizophrenia using 3D brain MR images and paved the way for imaging-based individual-level diagnosis and prognosis in psychiatric disorders. △ Less

Submitted 14 March, 2020; originally announced March 2020.

Comments: 4 PAGES

Experimental evidence of crystal symmetry protection for the topological nodal line semimetal state in ZrSiS

Authors: C. C. Gu, J. Hu, X. L. Chen, Z. P. Guo, B. T. Fu, Y. H. Zhou, C. An, Y. Zhou, R. R. Zhang, C. Y. Xi, Q. Y. Gu, C. Park, H. Y. Shu, W. G. Yang, L. Pi, Y. H. Zhang, Y. G. Yao, Z. R. Yang, J. H. Zhou, J. Sun, Z. Q. Mao, M. L. Tian

Abstract: Tunable symmetry breaking plays a crucial role for the manipulation of topological phases of quantum matter. Here, through combined high-pressure magneto-transport measurements, Raman spectroscopy, and X-ray diffraction, we demonstrate a pressure-induced topological phase transition in nodal-line semimetal ZrSiS. Symmetry analysis and first-principles calculations suggest that this pressure-induce… ▽ More Tunable symmetry breaking plays a crucial role for the manipulation of topological phases of quantum matter. Here, through combined high-pressure magneto-transport measurements, Raman spectroscopy, and X-ray diffraction, we demonstrate a pressure-induced topological phase transition in nodal-line semimetal ZrSiS. Symmetry analysis and first-principles calculations suggest that this pressure-induced topological phase transition may be attributed to weak lattice distortions by non-hydrostatic compression, which breaks some crystal symmetries, such as the mirror and inversion symmetries. This finding provides some experimental evidence for crystal symmetry protection for the topological semimetal state, which is at the heart of topological relativistic fermion physics. △ Less

Submitted 18 November, 2019; originally announced November 2019.

Comments: 27 pages, 17 figures

Journal ref: Physical Review B 100, 205124 (2019)

Graphene based widely-tunable and singly-polarized pulse generation with random fiber lasers

Authors: B. C. Yao, Y. J. Rao, Z. N. Wang, Y. Wu, J. H. Zhou, H. Wu, M. Q. Fan, X. L. Cao, W. L. Zhang, Y. F. Chen, Y. R. Li, D. Churkin, S. Turitsyn, C. W. Wong

Abstract: Pulse generation often requires a stabilized cavity and its corresponding mode structure for initial phase-locking. Contrastingly, modeless cavity-free random lasers provide new possibilities for high quantum efficiency lasing that could potentially be widely tunable spectrally and temporally. Pulse generation in random lasers, however, has remained elusive since the discovery of modeless gain las… ▽ More Pulse generation often requires a stabilized cavity and its corresponding mode structure for initial phase-locking. Contrastingly, modeless cavity-free random lasers provide new possibilities for high quantum efficiency lasing that could potentially be widely tunable spectrally and temporally. Pulse generation in random lasers, however, has remained elusive since the discovery of modeless gain lasing. Here we report coherent pulse generation with modeless random lasers based on the unique polarization selectivity and broadband saturable absorption of monolayer graphene. Simultaneous temporal compression of cavity-free pulses are observed with such a polarization modulation, along with a broadly-tunable pulsewidth across two orders of magnitude down to 900 ps, a broadly-tunable repetition rate across three orders of magnitude up to 3 MHz, and a singly-polarized pulse train at 41 dB extinction ratio, about an order of magnitude larger than conventional pulsed fiber lasers. Moreover, our graphene-based pulse formation also demonstrates robust pulse-to-pulse stability and wide-wavelength operation due to the cavity-less feature. Such a graphene-based architecture not only provides a tunable pulsed random laser for fiber-optic sensing, speckle-free imaging, and laser-material processing, but also a new way for the non-random CW fiber lasers to generate widely tunable and singly-polarized pulses. △ Less

Submitted 22 December, 2015; v1 submitted 10 December, 2015; originally announced December 2015.

Comments: 8 pages paper with 4 figures, has been accepted on Nature Scientific Reports