-
Can Brain Signals Reveal Inner Alignment with Human Languages?
Authors:
William Han,
Jielin Qiu,
Jiacheng Zhu,
Mengdi Xu,
Douglas Weber,
Bo Li,
Ding Zhao
Abstract:
Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the relationship and dependency between EEG and language. To study at the representation level, we introduced \textbf{MTAM}, a \textbf{M}ultimodal \textbf{T}ransformer \…
▽ More
Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the relationship and dependency between EEG and language. To study at the representation level, we introduced \textbf{MTAM}, a \textbf{M}ultimodal \textbf{T}ransformer \textbf{A}lignment \textbf{M}odel, to observe coordinated representations between the two modalities. We used various relationship alignment-seeking techniques, such as Canonical Correlation Analysis and Wasserstein Distance, as loss functions to transfigure features. On downstream applications, sentiment analysis and relation detection, we achieved new state-of-the-art results on two datasets, ZuCo and K-EmoCon. Our method achieved an F1-score improvement of 1.7% on K-EmoCon and 9.3% on Zuco datasets for sentiment analysis, and 7.4% on ZuCo for relation detection. In addition, we provide interpretations of the performance improvement: (1) feature distribution shows the effectiveness of the alignment module for discovering and encoding the relationship between EEG and language; (2) alignment weights show the influence of different language semantics as well as EEG frequency features; (3) brain topographical maps provide an intuitive demonstration of the connectivity in the brain regions. Our code is available at \url{https://github.com/Jason-Qiu/EEG_Language_Alignment}.
△ Less
Submitted 4 May, 2024; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Computer simulation of surgical interventions for the treatment of refractory pulmonary hypertension
Authors:
Seong Woo Han,
Charles Puelz,
Craig G. Rusin,
Daniel J. Penny,
Ryan Coleman,
Charles S. Peskin
Abstract:
This paper describes computer models of three interventions used for treating refractory pulmonary hypertension (RPH). These procedures create either an atrial septal defect, a ventricular septal defect, or, in the case of a Potts shunt, a patent ductus arteriosus. The aim in all three cases is to generate a right-to-left shunt, allowing for either pressure or volume unloading of the right side of…
▽ More
This paper describes computer models of three interventions used for treating refractory pulmonary hypertension (RPH). These procedures create either an atrial septal defect, a ventricular septal defect, or, in the case of a Potts shunt, a patent ductus arteriosus. The aim in all three cases is to generate a right-to-left shunt, allowing for either pressure or volume unloading of the right side of the heart in the setting of right ventricular failure, while maintaining cardiac output. These shunts are created, however, at the expense of introducing de-oxygenated blood into the systemic circulation, thereby lowering the systemic arterial oxygen saturation. The models developed in this paper are based on compartmental descriptions of human hemodynamics and oxygen transport. An important parameter included in our models is the cross-sectional area of the surgically created defect. Numerical simulations are performed to compare different interventions and various shunt sizes and to assess their impact on hemodynamic variables and oxygen saturations. We also create a model for exercise and use it to study exercise tolerance in simulated pre-intervention and post-intervention RPH patients.
△ Less
Submitted 24 November, 2021; v1 submitted 28 January, 2021;
originally announced January 2021.
-
FFusionCGAN: An end-to-end fusion method for few-focus images using conditional GAN in cytopathological digital slides
Authors:
Xiebo Geng,
Sibo Liua,
Wei Han,
Xu Li,
Jiabo Ma,
**gya Yu,
Xiuli Liu,
Sahoqun Zeng,
Li Chen,
Shenghua Cheng
Abstract:
Multi-focus image fusion technologies compress different focus depth images into an image in which most objects are in focus. However, although existing image fusion techniques, including traditional algorithms and deep learning-based algorithms, can generate high-quality fused images, they need multiple images with different focus depths in the same field of view. This criterion may not be met in…
▽ More
Multi-focus image fusion technologies compress different focus depth images into an image in which most objects are in focus. However, although existing image fusion techniques, including traditional algorithms and deep learning-based algorithms, can generate high-quality fused images, they need multiple images with different focus depths in the same field of view. This criterion may not be met in some cases where time efficiency is required or the hardware is insufficient. The problem is especially prominent in large-size whole slide images. This paper focused on the multi-focus image fusion of cytopathological digital slide images, and proposed a novel method for generating fused images from single-focus or few-focus images based on conditional generative adversarial network (GAN). Through the adversarial learning of the generator and discriminator, the method is capable of generating fused images with clear textures and large depth of field. Combined with the characteristics of cytopathological images, this paper designs a new generator architecture combining U-Net and DenseBlock, which can effectively improve the network's receptive field and comprehensively encode image features. Meanwhile, this paper develops a semantic segmentation network that identifies the blurred regions in cytopathological images. By integrating the network into the generative model, the quality of the generated fused images is effectively improved. Our method can generate fused images from only single-focus or few-focus images, thereby avoiding the problem of collecting multiple images of different focus depths with increased time and hardware costs. Furthermore, our model is designed to learn the direct map** of input source images to fused images without the need to manually design complex activity level measurements and fusion rules as in traditional methods.
△ Less
Submitted 2 January, 2020;
originally announced January 2020.
-
Simulating the Entropic Collapse of Coarse-Grained Chromosomes
Authors:
Tyler N. Shendruk,
Martin Bertrand,
Hendrick W. de Haan,
James L. Harden,
Gary W. Slater
Abstract:
Depletion forces play a role in the compaction and de-compation of chromosomal material in simple cells but it remains debatable whether they are sufficient to account for chromosomal collapse. We present coarse-grained molecular dynamics simulations, which reveal that depletion-induced attraction is sufficient to cause the collapse of a flexible chain of large structural monomers immersed in a ba…
▽ More
Depletion forces play a role in the compaction and de-compation of chromosomal material in simple cells but it remains debatable whether they are sufficient to account for chromosomal collapse. We present coarse-grained molecular dynamics simulations, which reveal that depletion-induced attraction is sufficient to cause the collapse of a flexible chain of large structural monomers immersed in a bath of smaller depletants. These simulations use an explicit coarse-grained computational model that treats both the supercoiled DNA structural monomers and the smaller protein crowding agents as combinatorial, truncated Lennard-Jones spheres. By presenting a simple theoretical model, we quantitatively cast the action of depletants on supercoiled bacterial DNA as an effective solvent quality. The rapid collapse of the simulated flexible chromosome at the predicted volume fraction of depletants is a continous phase transition. Additional physical effects to such simple chromosome models, such as enthalpic interactions between structural monomers or chain rigidity, are required if the collapse is to be a first-order phase transition.
△ Less
Submitted 16 November, 2014; v1 submitted 10 July, 2014;
originally announced July 2014.
