MIXED REALITY (MR) CARE-DELIVERY GUIDANCE SYSTEM TO SUPPORT MEDICAL EVENT MANAGEMENT ON LONG DURATION EXPLORATION MISSIONS

This project is funded by the Translational Research Institute for Space Health (TRISH) through a NASA cooperative agreement (PI: Dr. Roger Dias)

We are integrating medical simulation, instructional design and professional movie production with advanced photogrammetry and video volumetric techniques to create a highly realistic and immersive virtual environment for emergency care training during space missions. This project leverages extended reality (XR) technologies to deliver engaging and interactive training for astronauts on medical event management. 

BEHIND THE SCENES

STEP 1: 3D  Environment Capture using Photogrammetry

A physical spacecraft simulator located at the STRATUS Center for Medical Simulation was captured in 3D to generate a virtual spacecraft.

Virtual Spacecraft in 3D:

STEP 2: Medical Simulation Scenario and Branching Narrative Design

STEP 3: Volumetric Video Capture of Professional Actors Performing a Medical Scenario

Digital twins of the Astroauts during a Medical Emergency:

Integration of virtual environment (photogrammetry) with virtual astronauts (video volumetric)

STEP 4: Interactive XR Experience created in the Unreal engine