HRR - Task - HCAAM: Conversation analysis to measure and manage trust in virtual assistants

NASA Logo Human Research Roadmap HRP Exploration Data

Evidence Risks Gaps Tasks Reports

Explore Search

- HARI-02
  - HARI
- HARI-03
  - HARI
- HCI-03
  - HCI
- MPTASK-02
  - MPTASK

HCAAM: Conversation analysis to measure and manage trust in virtual assistants

Last Published: 07/31/19 10:05:33 AM (Central)

Task Book: Entry Unavailable
Principal Investigator: Lee, John D.

Short Title: Conversation Trust Analysis

Responsible HRP Element: Human Factors and Behavioral Performance

Collaborating Org(s):

Other:

Funding Status: Active - Currently funded and in progress

Procurement Mechanism(s):

Solicited

Aims:

This task is part of the Human Capabilities Assessments for Autonomous Missions (HCAAM) Virtual NASA Specialized Center of Research (VNSCOR) deliverable.

Aim 1: Develop real-time conversational indicators of trust.
- TOCA aid (Total Organic Carbon Analyze)—As a prototypical virtual assistant
- Develop conversational indicators of trust from the AMO TOCA study data
- Develop and validate TOCA as a microworld testbed
Aim 2: Assess robustness of real-time conversational indicators of trust under long duration mission stresses.
- Data collected in a manner that mirrors the experiment from Aim 1 that used the TOCA microworld
Aim 3: Develop and evaluate conversational affordances for managing trust. Similar to Aim 1, this evaluation will be a ground-based study using participants from University of Wisconsin-Madison and NASA JSC who will work with an intelligent virtual agent in the TOCA microworld.
- Validation in the HERA environment
- Develop principles and guidelines for trust measurement and calibration

Resources (Ground Analog)

Deliverables (1)

Category: Risk Characterization, Quantification
Subcategory: Evidence or Risk Characterization

Description:

The outcomes of this research will promote more effective interactions and acceptance of virtual assistants, and will provide new analytic techniques for understanding how people work with automated agents as team members. Three advances for trustable technology require the development of new analytic techniques for understanding human interaction with automated teammates.

Deliverables include:

Interim definition phase progress report
Develop and document principles and guidelines for trust measurement and calibration
Paper and tool for trust estimation
TOCA testbed
Final report with guidelines and standards on trust and technology

Internal Customers:
None External Customers:
None

Mappings

Risk of Inadequate Design of Human and Automation/Robotic Integration

HARI-02: We need to develop design guidelines for effective human-automation-robotic systems in operational environments that may include distributed, non-colocated adaptive mixed-agent teams with variable transmission latencies. (Previous Title: SHFE-HARI-02)

HARI-03: We do not know how to quantify overall human-automation-robotic system performance to inform and evaluate system designs to ensure safe and efficient space mission operations. (Previous title: SHFE-HARI-03)

HCAAM: Conversation analysis to measure and manage trust in virtual assistants

Risk of Inadequate Human-Computer Interaction

HCI-03: We need HCI guidelines (e.g., display configuration, screen-navigation) to mitigate the performance decrements and operational conditions of long duration spaceflight. (Previous title: SHFE-HCI-03)

HCAAM: Conversation analysis to measure and manage trust in virtual assistants

Risk of Inadequate Mission, Process and Task Design

MPTASK-02: We need methods and tools to support mission, process, and task design. (Previous title: SHFE-TASK-02)

HCAAM: Conversation analysis to measure and manage trust in virtual assistants

Related Tasks (117)

Print View...

PRRs (3)

NASA Developer: Daniel Febus Responsible NASA Official: Dave Hanson Contact HRP for a 508 compliant PDF Budgets, Strategic Plans, and Accountability Reports Equal Employment Opportunity Data Posted Pursuant to the No Fear Act Information-Dissemination Policies and Inventories Freedom of Information Act President's Management Agenda Privacy Policy & Important Notices Inspector General Hotline Contact HRP Human Health and Performance DIR Johnson Space Center USA.gov ExpectMore.gov

Ground-Based Flight Analogs Controlled Research Analog, Short Duration (2 months or less) – isolated and confined with spaceflight mission scenario [e.g., HERA, NEEMO]
Number of Subjects	0

Common Item(s)
	Risk of Inadequate Human-Computer Interaction
	HCI-03: We need HCI guidelines (e.g., display configuration, screen-navigation) to mitigate the performance decrements and operational conditions of long duration spaceflight. (Previous title: SHFE-HCI-03)