Gap HARI-02: We need to develop design guidelines for effective human-automation-robotic systems in operational environments that may include distributed, non-colocated adaptive mixed-agent teams with variable transmission latencies. (Previous Title: SHFE-HARI-02)
Last Published:  07/31/19 10:05:30 AM (Central)
Responsible Element: Human Factors and Behavioral Performance (HFBP)
Status: Open
Description

Initial State of Gap:



The design of human and automated/robotic (HAR) systems for NASA's future missions presents significant challenges because of the new types of systems that will be required for the NASA-unique mission constraints and operational environments. While current Mars rovers provide valuable experience with the daily planning and uploading of commands for a single asset from Earth, future missions will require real-time coordinated interaction between multiple humans, automation, and robotic assets at multiple locations and at different distances ranging from proximate, on-orbit, in-transit and from Earth.  Currently, there is limited experience in analogous domains that contend with human-in-the-loop interactions over long and varying latency. As a result, few human-centered design guidelines exist for HAR systems. Design guidelines for HAR systems, which address new types of interfaces, interactions, and control inputs, are necessary to ensure safe and efficient mission operations.



Interim Steps:

  • Assess the state-of-the-art technologies for mixed agent systems.
    • Determine applicability to crewed space missions of 1) new technologies in advanced automation and robotic systems (e.g., swarms of miniaturized helicopters) and 2) interface (i.e., input/output) hardware and software technologies (e.g., game controllers, augmented reality systems).   
    • Evaluate innovative HAR interactions, e.g., multimodal interfaces, for space operations.
    • For these new technologies and HAR interactions, identify if novel usability measures are required.
  • Document the different system interface design needs as driven by candidate DRMs (integrating results from HARI-04 and HARI-01). Include design guideline needs of both flight and ground crew interfaces.
  • Develop design guidelines that take into account human capabilities and limitations with regards to managing multiple robotic assets.
    • Solicit and conduct research to understand how to integrate non-colocated (i.e., physically distributed) human and robotic assets that may be controlled in multiple coordinate frames.
    • Design guidelines should focus on spatial and temporal situation awareness, and asset’s state awareness and control usability.
  • Develop design guidelines that take into account human capabilities and limitations with regards to management of automation or robotic asset(s) under time-varying communication latencies.
    • Solicit and conduct research to understand how to integrate humans and automation/robotic asset(s) with different communication delays (i.e., asynchronies) between crew talking to Earth flight controllers and crew controlling robots on the remote, planetary surface.
    • Design guidelines should allow for latency variability, specifically for intermittent changes in communication bandwidths constraints and path length.   
  • Develop design guidelines that enable crew autonomy, specifically for the management of multiple automated systems.
    • Solicit and conduct research to understand human capabilities and limitations with regards to maintaining situation awareness across many critical vehicle/habitat systems that are currently monitored and operated by ground controllers.
    • Design guidelines should focus on interfaces and interactions that allow crew to intercede when necessary and/or regain situation awareness in order to quickly recover after an anomaly.
  • Solicit and conduct research on identified HAR systems (from HARI-04) that do not have design guidelines regarding mode awareness and for which mode awareness is key (e.g., adaptive automation or robot assets with mixed levels of automation), resulting in proposed guidelines.
  • Integrate research results to establish a set of design guidelines for the various HAR systems that will be needed for future space missions.

Approach:

  • Through workshops, conferences, and literature reviews, track the state-of-the-art in industry, academia, and government of HAR technologies across application domains.
  • Utilize solicited and directed projects to identify and validate methods that enable the design of effective and safe multi-agent HAR systems.
  • Utilize solicited and directed research to refine and validate results obtained in an operational context and in analogs.
  • Disseminate empirical and analytical findings through conferences, journal articles, and NASA Technical Memorandums (TMs).
Target for Closure
Guidelines including mitigation plans and design recommendations for mission-relevant HAR systems, reported in appropriate publications, standards, and stakeholder panels.
Mappings
Risk Risk of Inadequate Design of Human and Automation/Robotic Integration
You are here! Gap HARI-02: We need to develop design guidelines for effective human-automation-robotic systems in operational environments that may include distributed, non-colocated adaptive mixed-agent teams with variable transmission latencies. (Previous Title: SHFE-HARI-02)
Active
Completed
Planned-Funded

Documentation:
No Documentation Available