2023 - 2024

EVALUTION METHODS FOR MARKERLESS REGISTRATION

Image registration methods for surgical applications raise safety and effectiveness concerns compared to more traditional frame-based techniques. To address this for the specific case of extra-corporal membrane oxygenation (ECMO) cannulation, we conducted a background survey with experts to define the steps of an XR-based training course in this procedure. To build the camera-based AR tracking application, we video recorded ECMO training, acquiring footage to be used in markerless tracking software.

Output/Deliverables:

Three different lighting conditions were tested to determine the adaptability and quality of the tracking software, as well as account for unpredictable lighting in the real world. The variable lighting conditions consisted of low, medium, and high global illumination. We were able to recognize and track targeted medical instruments (i.e. cannula, ultrasound probe, and syringes) in 3D space, and to perform segmentation on the same objects.