-
Expert Insight-Enhanced Follow-up Chest X-Ray Summary Generation
Authors:
Zhichuan Wang,
Kinhei Lee,
Qiao Deng,
Tiffany Y. So,
Wan Hang Chiu,
Yeung Yu Hui,
Bing**g Zhou,
Edward S. Hui
Abstract:
A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination. Majority of the efforts on automatic generation of radiology report pertain to reporting the former, but not the latter, type of findings. To the best of the auth…
▽ More
A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination. Majority of the efforts on automatic generation of radiology report pertain to reporting the former, but not the latter, type of findings. To the best of the authors' knowledge, there is only one work dedicated to generating summary of the latter findings, i.e., follow-up summary. In this study, we therefore propose a transformer-based framework to tackle this task. Motivated by our observations on the significance of medical lexicon on the fidelity of summary generation, we introduce two mechanisms to bestow expert insight to our model, namely expert soft guidance and masked entity modeling loss. The former mechanism employs a pretrained expert disease classifier to guide the presence level of specific abnormalities, while the latter directs the model's attention toward medical lexicon. Extensive experiments were conducted to demonstrate that the performance of our model is competitive with or exceeds the state-of-the-art.
△ Less
Submitted 6 May, 2024; v1 submitted 1 May, 2024;
originally announced May 2024.
-
Grounded Knowledge-Enhanced Medical VLP for Chest X-Ray
Authors:
Qiao Deng,
Zhongzhen Huang,
Yunqi Wang,
Zhichuan Wang,
Zhao Wang,
Xiaofan Zhang,
Qi Dou,
Yeung Yu Hui,
Edward S. Hui
Abstract:
Medical vision-language pre-training has emerged as a promising approach for learning domain-general representations of medical image and text. Current algorithms that exploit the global and local alignment between medical image and text could however be marred by the redundant information in medical data. To address this issue, we propose a grounded knowledge-enhanced medical vision-language pre-…
▽ More
Medical vision-language pre-training has emerged as a promising approach for learning domain-general representations of medical image and text. Current algorithms that exploit the global and local alignment between medical image and text could however be marred by the redundant information in medical data. To address this issue, we propose a grounded knowledge-enhanced medical vision-language pre-training (GK-MVLP) framework for chest X-ray. In this framework, medical knowledge is grounded to the appropriate anatomical regions by using a transformer-based grounded knowledge-enhanced module for fine-grained alignment between anatomical region-level visual features and the textural features of medical knowledge. The performance of GK-MVLP is competitive with or exceeds the state of the art on downstream chest X-ray disease classification, disease localization, report generation, and medical visual question-answering tasks. Our results show the advantage of incorporating grounding mechanism to remove biases and improve the alignment between chest X-ray image and radiology report.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
Map** Dynamical Magnetic Responses of Ultra-thin Micron-size Superconducting Films using Nitrogen-vacancy Centers in Diamond
Authors:
Ying Xu,
Yijun Yu,
Yuen Yung Hui,
Yudan Su,
Jun Cheng,
Huan-Cheng Chang,
Yuanbo Zhang,
Y. Ron Shen,
Chuanshan Tian
Abstract:
Two-dimensional superconductors have attracted growing interest because of their scientific novelty, structural tunability, and useful properties. Studies of their magnetic responses, however, are often hampered by difficulties to grow large-size samples of high quality and uniformity. We report here an imaging method that employed NV- centers in diamond as sensor capable of map** out the microw…
▽ More
Two-dimensional superconductors have attracted growing interest because of their scientific novelty, structural tunability, and useful properties. Studies of their magnetic responses, however, are often hampered by difficulties to grow large-size samples of high quality and uniformity. We report here an imaging method that employed NV- centers in diamond as sensor capable of map** out the microwave magnetic field distribution on an ultrathin superconducting film of micron size. Measurements on a 33nm-thick film and a 125nm-thick bulk-like film of $Bi_2Sr_2CaCu_2O_{8+δ}$ revealed that the ac Meissner effect (or repulsion of ac magnetic field) set in at 78K and 91K, respectively; the latter was the superconducting transition temperature (Tc) of both films. The unusual ac magnetic response of the thin film presumably was due to thermally excited vortex-antivortex diffusive motion in the film. Spatial resolution of our ac magnetometer was limited by optical diffraction and the noise level was at 14 $μT/Hz^{1/2}$. The technique could be extended with better detection sensitivity to extract local ac conductivity/susceptibility of ultrathin or monolayer superconducting samples as well as ac magnetic responses of other two-dimensional exotic thin films of limited lateral size.
△ Less
Submitted 16 May, 2019;
originally announced May 2019.
-
Mutually enhancing light emission between plasmonic nanostructures and fluorescent emitters
Authors:
**gyi Zhao,
Yuqing Cheng,
Hongming Shen,
Yuen Yung Hui,
Huan-Cheng Chang,
Qihuang Gong,
Guowei Lu
Abstract:
We demonstrate that the fluorescent emitters can increase light emission from the plasmonic nanostructures in turn. With the help of atomic force microscopy, a hybrid system consisting of a fluorescent nanodiamond and a gold nanoparticle was assembled step-by-step for in situ optical measurements. We found that the emission from the nanoparticle increased compared with that before coupling. The in…
▽ More
We demonstrate that the fluorescent emitters can increase light emission from the plasmonic nanostructures in turn. With the help of atomic force microscopy, a hybrid system consisting of a fluorescent nanodiamond and a gold nanoparticle was assembled step-by-step for in situ optical measurements. We found that the emission from the nanoparticle increased compared with that before coupling. The interaction between plasmonic nanostructures and fluorescent emitter was understood as an entity based on the concept of a quantized optical cavity by considering the nanodiamond and the nanoparticle as a two-level energy system and a nanoresonator, respectively. The theoretical calculations reveal that both the plasmonic coupling effect and the dielectric nanoantenna effect contribute to the enhancement of light emission from the gold nanoparticles.
△ Less
Submitted 25 April, 2017; v1 submitted 19 March, 2017;
originally announced March 2017.