-
ARCollab: Towards Multi-User Interactive Cardiovascular Surgical Planning in Mobile Augmented Reality
Authors:
Pratham Mehta,
Harsha Karanth,
Haoyang Yang,
Timothy Slesnick,
Fawwaz Shaw,
Duen Horng Chau
Abstract:
Surgical planning for congenital heart diseases requires a collaborative approach, traditionally involving the 3D-printing of physical heart models for inspection by surgeons and cardiologists. Recent advancements in mobile augmented reality (AR) technologies have offered a promising alternative, noted for their ease-of-use and portability. Despite this progress, there remains a gap in research ex…
▽ More
Surgical planning for congenital heart diseases requires a collaborative approach, traditionally involving the 3D-printing of physical heart models for inspection by surgeons and cardiologists. Recent advancements in mobile augmented reality (AR) technologies have offered a promising alternative, noted for their ease-of-use and portability. Despite this progress, there remains a gap in research exploring the use of multi-user mobile AR environments for facilitating collaborative cardiovascular surgical planning. We are develo** ARCollab, an iOS AR application designed to allow multiple surgeons and cardiologists to interact with patient-specific 3D heart models in a shared environment. ARCollab allows surgeons and cardiologists to import heart models, perform gestures to manipulate the heart, and collaborate with other users without having to produce a physical heart model. We are excited by the potential for ARCollab to make long-term real-world impact, thanks to the ubiquity of iOS devices that will allow for ARCollab's easy distribution, deployment and adoption.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Evaluating Cardiovascular Surgical Planning in Mobile Augmented Reality
Authors:
Haoyang Yang,
Pratham Darrpan Mehta,
Jonathan Leo,
Zhiyan Zhou,
Megan Dass,
Anish Upadhayay,
Timothy C. Slesnick,
Fawwaz Shaw,
Amanda Randles,
Duen Horng Chau
Abstract:
Advanced surgical procedures for congenital heart diseases (CHDs) require precise planning before the surgeries. The conventional approach utilizes 3D-printing and cutting physical heart models, which is a time and resource intensive process. While rapid advances in augmented reality (AR) technologies have the potential to streamline surgical planning, there is limited research that evaluates such…
▽ More
Advanced surgical procedures for congenital heart diseases (CHDs) require precise planning before the surgeries. The conventional approach utilizes 3D-printing and cutting physical heart models, which is a time and resource intensive process. While rapid advances in augmented reality (AR) technologies have the potential to streamline surgical planning, there is limited research that evaluates such AR approaches with medical experts. This paper presents an evaluation with 6 experts, 4 cardiothoracic surgeons, and 2 cardiologists, from Children's Healthcare of Atlanta (CHOA) Heart Center to validate the usability and technical innovations of CardiacAR, a prototype mobile AR surgical planning application. Potential future improvements based on user feedback are also proposed to further improve the design of CardiacAR and broaden its access.
△ Less
Submitted 22 August, 2022;
originally announced August 2022.
-
Using mobile phone sensor technology for mental health research: Integrated analysis to identify hidden challenges and potential solutions
Authors:
Tjeerd W Boonstra,
Jennifer Nicholas,
Quincy JJ Wong,
Frances Shaw,
Samuel Townsend,
Helen Christensen
Abstract:
Background: Mobile phone sensor technology has great potential in providing behavioral markers of mental health. However, this promise has not yet been brought to fruition. Objective: The objective of our study was to examine challenges involved in develo** an app to extract behavioral markers of mental health from passive sensor data. Methods: Both technical challenges and acceptability of pass…
▽ More
Background: Mobile phone sensor technology has great potential in providing behavioral markers of mental health. However, this promise has not yet been brought to fruition. Objective: The objective of our study was to examine challenges involved in develo** an app to extract behavioral markers of mental health from passive sensor data. Methods: Both technical challenges and acceptability of passive data collection for mental health research were assessed based on literature review and results obtained from a feasibility study. Socialise, a mobile phone app developed at the Black Dog Institute, was used to collect sensor data (Bluetooth, global positioning system, and battery status) and investigate views and experiences of a group of people with lived experience of mental health challenges (N=32). Results: On average, sensor data were obtained for 55% (Android) and 45% (iPhone OS) of scheduled scans. Battery life was reduced from 21.3 hours to 18.8 hours when scanning every 5 minutes with a reduction of 2.5 hours or 12%. Despite this relatively small reduction, most participants reported that the app had a noticeable effect on their battery life. In addition to battery life, the purpose of data collection, trust in the organization that collects data, and perceived impact on privacy were identified as main factors for acceptability. Conclusions: Based on the findings of the feasibility study and literature review, we recommend a commitment to open science and transparent reporting and stronger partnerships and communication with users. Sensing technology has the potential to greatly enhance the delivery and impact of mental health care. Realizing this requires all aspects of mobile phone sensor technology to be rigorously assessed.
△ Less
Submitted 17 July, 2018; v1 submitted 22 May, 2018;
originally announced May 2018.
