2024 - 2025
COLLABORATIVE SIMULATION PLATFORM
A major challenge in the medical extended reality space is simultaneous training of multiple users across distances of medical diagnostic and procedural skills. To address this challenge, we will develop an open-source software development kit (SDK) platform to allow MIXR sites and members to collaborate freely and run simulation course content on the platform. The platform will allow for both AR and VR training and will have the capability to run sessions at multiple sites simultaneously.
Output/Deliverables:
In addition to the SDK platform itself, we will create a toolbox to develop simulation use cases, and to demonstrate that the platform is useable between MIXR partner sites and the AFRL, then will generate pilot data.
ASSESSMENT OF HOW LATENCY AFFECTS PROCEDURE PERFORMANCE
A lack of standardized measures of how XR headsets affect medical procedure performance remains a major gap. We will use ultrasound-guided needle biopsy of a breast mass (a short, yet technically difficult procedure) to study how latency and other visual artifacts of an XR headset affect procedure performance. Metrics studied will include a) physiologic responses (heart rate, heart rate variability, and galvanic skin response), b) procedure success, c) error rate, and d) performance time.
Output/Deliverables:
We will perform a pilot study with medical students and first- and second-year surgical residents with minimal experience in doing breast biopsies to assess the test bed, to inform a larger randomized cross-over study.
QUANTIFYING & CHARACTERIZING LATENCY & CYBERSICKNESS IN IMMERSIVE MEDICAL ENVIRONMENTS
As cybersickness is a key obstacle to the full deployment of VR environments, understanding the phenomenon and how to mitigate it is at the root of all aspects of immersion. Building on our previous MIXR work, we will complete our validation of EEG-based measurement of cybersickness, and relate these measures to the optical flow of a given scene (i.e. how much the scene changes from frame to frame).
Output/Deliverables:
Using open-source software, we will incorporate our cybersickness measures into a benchmark for assessing the likelihood of a given immersive scenario causing cybersickness (in other words, a program that can "look at" a given stereo
STANDARDIZATION OF XR INTERGRATION IN HEALTHCARE FACILITIES
Security and implementation barriers are a significant roadblock to widespread adoption of XR in hospitals and medical schools. To create a standardization paradigm, we will compile the various workflows for onboarding XR technologies planned for utilization in both clinical and non-clinical settings. Devices and applications will undergo the standard process, with transparency between the IT infrastructural teams and the medical teams providing the implementation. Workflows will be distributed, along with a list of issues affecting these technologies which either expedite or hinder their progression. In addition, a roadmap will be created to understand the various teams needed, their specific functions, as well as when these teams are activated throughout the onboarding process (and what limits their activation). The onboarding workflow will be reviewed and a generalized guideline of the onboarding process will be provided to the IAB to foster transparency in this process.
Output/Deliverables:
Using open-source software, we will incorporate our cybersickness measures into a benchmark for assessing the likelihood of a given immersive scenario causing cybersickness (in other words, a program that can "look at" a given stereo