Task Autonomous Diagnostic Imaging Performed by Untrained Operators Using Augmented Reality as a Form of ‘Just-in-Time' Training (NSBRI-Martin) (Completed)
Last Published:  07/29/22 01:33:24 PM (Central)
Short Title: Augmented Reality Training
Responsible HRP Element: Human Factors and Behavioral Performance
Collaborating Org(s):
National Space Biomedical Research Institute (NSBRI)
Funding Status: Completed - Task completed and produced a deliverable
Procurement Mechanism(s):

During exploration-class missions the time-delay in communication will necessitate crew autonomy for medical testing which is currently done using remote guidance by an expert on the ground. To overcome this problem, just-in-time (JIT) training has been used to provide specific steps and information to crew members to guide them through routine ultrasound medical tests. However, these tutorials do not provide real-time interactive guidance to assist the crew members in improving image quality. Thus JIT training must be employed through which astronauts can access a library of procedures to help guide them through technically challenging medical procedures in which they have little or no previous training. However, because ultrasound and optical coherence tomography (OCT) imaging require operator dependent skills, simply having knowledge available prior to attempting these procedure will not necessarily result in images with sufficient quality to ensure adequate results. Advances in augmented reality technology provide the opportunity for crew members to interact with a patient while receiving feedback on how to complete and improve medical image acquisition.

  1. Develop an audio-visual tutorial using augmented reality glasses that guides non-experts through an abdominal trauma ultrasound protocol.

  2. Develop an audio-visual tutorial using augmented-reality glasses to guide an untrained operator through the setup and acquisition of an OCT protocol.

  3. Evaluate the quality of abdominal ultrasound and OCT images acquired by untrained operators using augmented reality guidance during ground-based testing with images acquired using current JIT techniques.

  4. Compare the time and costs required to develop tutorials and complete imaging studies using augmented reality tutorials with the time and costs of to current JIT practices to determine whether time efficiencies exist.


This task will address the gaps by improving the just-in-time (JIT) training materials for ultrasound imaging using augmented reality and expand the crew’s medical, diagnostic, and research capabilities to include OCT guidance by providing advanced training using a detailed, timely, and user-friendly method.