GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated Assessment
Authors:
Senthujan Senkaiahliyan,
Augustin Toma,
Jun Ma,
An-Wen Chan,
Andrew Ha,
Kevin R. An,
Hrishikesh Suresh,
Barry Rubin,
Bo Wang
Abstract:
OpenAI's large multimodal model, GPT-4V(ision), was recently developed for general image interpretation. However, less is known about its capabilities with medical image interpretation and diagnosis. Board-certified physicians and senior residents assessed GPT-4V's proficiency across a range of medical conditions using imaging modalities such as CT scans, MRIs, ECGs, and clinical photographs. Alth…
▽ More
OpenAI's large multimodal model, GPT-4V(ision), was recently developed for general image interpretation. However, less is known about its capabilities with medical image interpretation and diagnosis. Board-certified physicians and senior residents assessed GPT-4V's proficiency across a range of medical conditions using imaging modalities such as CT scans, MRIs, ECGs, and clinical photographs. Although GPT-4V is able to identify and explain medical images, its diagnostic accuracy and clinical decision-making abilities are poor, posing risks to patient safety. Despite the potential that large language models may have in enhancing medical education and delivery, the current limitations of GPT-4V in interpreting medical images reinforces the importance of appropriate caution when using it for clinical decision-making.
△ Less
Submitted 14 November, 2023;
originally announced March 2024.
