LLM on FHIR -- Demystifying Health Records
Authors:
Paul Schmiedmayer,
Adrit Rao,
Philipp Zagar,
Vishnu Ravi,
Aydin Zahedivash,
Arash Fereydooni,
Oliver Aalami
Abstract:
Objective: To enhance health literacy and accessibility of health information for a diverse patient population by develo** a patient-centered artificial intelligence (AI) solution using large language models (LLMs) and Fast Healthcare Interoperability Resources (FHIR) application programming interfaces (APIs). Materials and Methods: The research involved develo** LLM on FHIR, an open-source mo…
▽ More
Objective: To enhance health literacy and accessibility of health information for a diverse patient population by develo** a patient-centered artificial intelligence (AI) solution using large language models (LLMs) and Fast Healthcare Interoperability Resources (FHIR) application programming interfaces (APIs). Materials and Methods: The research involved develo** LLM on FHIR, an open-source mobile application allowing users to interact with their health records using LLMs. The app is built on Stanford's Spezi ecosystem and uses OpenAI's GPT-4. A pilot study was conducted with the SyntheticMass patient dataset and evaluated by medical experts to assess the app's effectiveness in increasing health literacy. The evaluation focused on the accuracy, relevance, and understandability of the LLM's responses to common patient questions. Results: LLM on FHIR demonstrated varying but generally high degrees of accuracy and relevance in providing understandable health information to patients. The app effectively translated medical data into patient-friendly language and was able to adapt its responses to different patient profiles. However, challenges included variability in LLM responses and the need for precise filtering of health data. Discussion and Conclusion: LLMs offer significant potential in improving health literacy and making health records more accessible. LLM on FHIR, as a pioneering application in this field, demonstrates the feasibility and challenges of integrating LLMs into patient care. While promising, the implementation and pilot also highlight risks such as inconsistent responses and the importance of replicable output. Future directions include better resource identification mechanisms and executing LLMs on-device to enhance privacy and reduce costs.
△ Less
Submitted 25 January, 2024;
originally announced February 2024.
A Cost-Effective Test Bench for Evaluating Safe Human-Robot Interaction in Mobile Robotics
Authors:
Atefeh Fereydooni,
Armin Azarakhsh,
Ayda Shafiei,
Hesam Zandi,
Mehdi Delrobaei
Abstract:
Safety concerns have risen as robots become more integrated into our daily lives and continue to interact closely with humans. One of the most crucial safety priorities is preventing collisions between robots and people walking nearby. Despite develo** various algorithms to address this issue, evaluating their effectiveness on a cost-effective test bench remains a significant challenge. In this…
▽ More
Safety concerns have risen as robots become more integrated into our daily lives and continue to interact closely with humans. One of the most crucial safety priorities is preventing collisions between robots and people walking nearby. Despite develo** various algorithms to address this issue, evaluating their effectiveness on a cost-effective test bench remains a significant challenge. In this work, we propose a solution by introducing a simple yet functional platform that enables researchers and developers to assess how humans interact with mobile robots. This platform is designed to provide a quick yet accurate evaluation of the performance of safe interaction algorithms and make informed decisions for future development. The platform's features and structure are detailed, along with the initial testing results using two preliminary algorithms. The results obtained from the evaluation were consistent with theoretical calculations, demonstrating its effectiveness in assessing human-robot interaction. Our solution provides a preliminary yet reliable approach to ensure the safety of both robots and humans in their daily interactions.
△ Less
Submitted 7 December, 2023;
originally announced December 2023.