MIXED REALITY (MR) CARE-DELIVERY GUIDANCE SYSTEM TO SUPPORT MEDICAL EVENT MANAGEMENT ON LONG DURATION EXPLORATION MISSIONS
This project is funded by the Translational Research Institute for Space Health (TRISH) through a NASA cooperative agreement (PI: Dr. Roger Dias)
We are integrating medical simulation, instructional design and professional movie production with advanced photogrammetry and video volumetric techniques to create a highly realistic and immersive virtual environment for emergency care training during space missions. This project leverages extended reality (XR) technologies to deliver engaging and interactive training for astronauts on medical event management.
BEHIND THE SCENES
STEP 1: 3D Environment Capture using Photogrammetry
A physical spacecraft simulator located at the STRATUS Center for Medical Simulation was captured in 3D to generate a virtual spacecraft.
Virtual Spacecraft in 3D:
STEP 2: Medical Simulation Scenario and Branching Narrative Design
STEP 3: Volumetric Video Capture of Professional Actors Performing a Medical Scenario
Digital twins of the Astroauts during a Medical Emergency:
Integration of virtual environment (photogrammetry) with virtual astronauts (video volumetric)
STEP 4: Interactive XR Experience created in the Unreal engine