-
CliBench: Multifaceted Evaluation of Large Language Models in Clinical Decisions on Diagnoses, Procedures, Lab Tests Orders and Prescriptions
Authors:
Mingyu Derek Ma,
Chenchen Ye,
Yu Yan,
Xiaoxuan Wang,
Peipei **,
Timothy S Chang,
Wei Wang
Abstract:
The integration of Artificial Intelligence (AI), especially Large Language Models (LLMs), into the clinical diagnosis process offers significant potential to improve the efficiency and accessibility of medical care. While LLMs have shown some promise in the medical domain, their application in clinical diagnosis remains underexplored, especially in real-world clinical practice, where highly sophis…
▽ More
The integration of Artificial Intelligence (AI), especially Large Language Models (LLMs), into the clinical diagnosis process offers significant potential to improve the efficiency and accessibility of medical care. While LLMs have shown some promise in the medical domain, their application in clinical diagnosis remains underexplored, especially in real-world clinical practice, where highly sophisticated, patient-specific decisions need to be made. Current evaluations of LLMs in this field are often narrow in scope, focusing on specific diseases or specialties and employing simplified diagnostic tasks. To bridge this gap, we introduce CliBench, a novel benchmark developed from the MIMIC IV dataset, offering a comprehensive and realistic assessment of LLMs' capabilities in clinical diagnosis. This benchmark not only covers diagnoses from a diverse range of medical cases across various specialties but also incorporates tasks of clinical significance: treatment procedure identification, lab test ordering and medication prescriptions. Supported by structured output ontologies, CliBench enables a precise and multi-granular evaluation, offering an in-depth understanding of LLM's capability on diverse clinical tasks of desired granularity. We conduct a zero-shot evaluation of leading LLMs to assess their proficiency in clinical decision-making. Our preliminary results shed light on the potential and limitations of current LLMs in clinical settings, providing valuable insights for future advancements in LLM-powered healthcare.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
All Attention U-NET for Semantic Segmentation of Intracranial Hemorrhages In Head CT Images
Authors:
Chia Shuo Chang,
Tian Sheuan Chang,
Jiun Lin Yan,
Li Ko
Abstract:
Intracranial hemorrhages in head CT scans serve as a first line tool to help specialists diagnose different types. However, their types have diverse shapes in the same type but similar confusing shape, size and location between types. To solve this problem, this paper proposes an all attention U-Net. It uses channel attentions in the U-Net encoder side to enhance class specific feature extraction,…
▽ More
Intracranial hemorrhages in head CT scans serve as a first line tool to help specialists diagnose different types. However, their types have diverse shapes in the same type but similar confusing shape, size and location between types. To solve this problem, this paper proposes an all attention U-Net. It uses channel attentions in the U-Net encoder side to enhance class specific feature extraction, and space and channel attentions in the U-Net decoder side for more accurate shape extraction and type classification. The simulation results show up to a 31.8\% improvement compared to baseline, ResNet50 + U-Net, and better performance than in cases with limited attention.
△ Less
Submitted 16 December, 2023;
originally announced December 2023.
-
Deep Gait Tracking With Inertial Measurement Unit
Authors:
Jien De Sui,
Tian Sheuan Chang
Abstract:
This paper presents a convolutional neural network based foot motion tracking with only six-axis Inertial-Measurement-Unit (IMU) sensor data. The presented approach can adapt to various walking conditions by adopting differential and window based input. The training data are further augmented by sliding and random window samplings on IMU sensor data to increase data diversity for better performanc…
▽ More
This paper presents a convolutional neural network based foot motion tracking with only six-axis Inertial-Measurement-Unit (IMU) sensor data. The presented approach can adapt to various walking conditions by adopting differential and window based input. The training data are further augmented by sliding and random window samplings on IMU sensor data to increase data diversity for better performance. The proposed approach fuses predictions of three dimensional output into one model. The proposed fused model can achieve average error of 2.30+-2.23 cm in X-axis, 0.91+-0.95 cm in Y-axis and 0.58+-0.52 cm in Z-axis.
△ Less
Submitted 10 May, 2022;
originally announced May 2022.
-
RangeSeg: Range-Aware Real Time Segmentation of 3D LiDAR Point Clouds
Authors:
Tzu-Hsuan Chen,
Tian Sheuan Chang
Abstract:
Semantic outdoor scene understanding based on 3D LiDAR point clouds is a challenging task for autonomous driving due to the sparse and irregular data structure. This paper takes advantages of the uneven range distribution of different LiDAR laser beams to propose a range aware instance segmentation network, RangeSeg. RangeSeg uses a shared encoder backbone with two range dependent decoders. A heav…
▽ More
Semantic outdoor scene understanding based on 3D LiDAR point clouds is a challenging task for autonomous driving due to the sparse and irregular data structure. This paper takes advantages of the uneven range distribution of different LiDAR laser beams to propose a range aware instance segmentation network, RangeSeg. RangeSeg uses a shared encoder backbone with two range dependent decoders. A heavy decoder only computes top of a range image where the far and small objects locate to improve small object detection accuracy, and a light decoder computes whole range image for low computational cost. The results are further clustered by the DBSCAN method with a resolution weighted distance function to get instance-level segmentation results. Experiments on the KITTI dataset show that RangeSeg outperforms the state-of-the-art semantic segmentation methods with enormous speedup and improves the instance-level segmentation performance on small and far objects. The whole RangeSeg pipeline meets the real time requirement on NVIDIA\textsuperscript{\textregistered} JETSON AGX Xavier with 19 frames per second in average.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
-
Beyond the Isotropic Lifshitz Endpoint
Authors:
Tom T. S. Chang
Abstract:
The puzzle of the disappearance of isotropic Lifshitz points in condensed matter physics is explained from the point of view of the Wilsonian renormalization group. In analogy to the commensurate ideas of metamagnetic phase transitions, we describe the physics of thermodynamic states beyond an isotropic Lifshitz endpoint. Such phenomenon may be understood in terms of a statistically isotropic envi…
▽ More
The puzzle of the disappearance of isotropic Lifshitz points in condensed matter physics is explained from the point of view of the Wilsonian renormalization group. In analogy to the commensurate ideas of metamagnetic phase transitions, we describe the physics of thermodynamic states beyond an isotropic Lifshitz endpoint. Such phenomenon may be understood in terms of a statistically isotropic environment of coexisting multi-incommensurate helicoidal states. In addition to the magnetic and condensed matter discussions, we consider also an interesting example in the context of dynamical evolution.
△ Less
Submitted 17 June, 2019;
originally announced June 2019.
-
Complexity Induced Sporadic Localized Multifractal Antiscreening in Gravitational Evolution at Large Scales
Authors:
Tom T. S. Chang
Abstract:
It has been suggested that antiscreening effects due to the running of the gravitational constant G might provide a partial solution to the dark matter mystery. It has also been hypothesized that renormalization group scaling transformations at large scales might supply the theoretical explanation. In this letter, we demonstrate that multifractal coarse-graining scaling effects due to classical fl…
▽ More
It has been suggested that antiscreening effects due to the running of the gravitational constant G might provide a partial solution to the dark matter mystery. It has also been hypothesized that renormalization group scaling transformations at large scales might supply the theoretical explanation. In this letter, we demonstrate that multifractal coarse-graining scaling effects due to classical fluctuations in the IR with consecutive symmetry breakings in gravitational evolution and induced running of the gravitational constant with fractal structures at larger scales may provide the plausible explanation of the observed results of weak lensing observations and beyond. The sporadic and localized antiscreening due to the running of the gravitational constant can also provide the backbone for the cosmic evolution and large scale structure formation. Our interpretation of this interesting finding is that such effects are the result of the complexity phenomenon involving the evolution of large-scale multifractal structures and accompanying fluctuations, not the conventional arguments suggesting quantum gravity being the primary cause. We also suggest that the running of the cosmological constant due to such stochastic complexity evolution may provide a key to the understanding of the observed cosmic acceleration.
△ Less
Submitted 26 August, 2015;
originally announced August 2015.
