1. Provide a user friendly software program that is capable of capturing crew member behavior as it occurs.
2. Assist experts in identifying potential behavioral, interpersonal, and psychosocial issues by:
   1. Providing a system that organizes behavioral evaluations into groupings that can be used to identify behavioral patterns.
   2. Producing reports that provide useful information for making informed decisions.
   3. Displaying several related programs simultaneously in a single user interface.
3. Offer automated feedback based on identified behavioral patterns or possible behavioral issues.

 Monitoring can serve several operational goals:

1. Monitoring during personnel selection activities can provide valuable input for the selection of compatible team members and of individuals with psychological profiles suited to teamwork in extreme environments and situations.

2. Monitoring during training activities can provide diagnostic information useful in guiding further instruction and coaching as well as in determining the composition of teams prior to mission deployment.

3. Monitoring during missions can provide forewarning of potential operational failures due to disruptions of team functioning and give the opportunity to take preventative measures.

Aims:

1. Complete a literature review and conducting an operational assessment of current monitoring tools and technologies that are relevant to the Team Risk (specifically focusing on monitoring task performance, psychosocial performance, and teamwork).

2. Reporting interim findings at the completion of each of the project components.

1) Determine optimal ways through which to assess and monitor important team outcomes and factors relating to those outcomes

2) Develop an ongoing normative database that will aid in the determination of the most optimal measures and monitoring tools of crew performance, crew cohesion, and crew-ground interaction

1. The structure and function of communication channels within and between simulated space-dwelling and Earth-based groups;
2. Factors associated with variations in the behavioral management systems between space-dwelling and Earth- based groups;
3. Factors associated with variations in workloads, stressful time pressure, and conflict conditions
4. Behavioral and psychosocial interaction systems between spaceflight crews and Earth-centered mission support operations that are most likely to influence individual and group performance during long-duration missions.

1. Identification of antecedents underlying the development and maintenance of team cohesion;
2. Development and evaluation of training techniques to enhance team cohesion formation;
3. Development of measurement and monitoring systems to support team cohesion regulation, maintenance, and repair;
4. Recommendations for flight crews and ground control teams for
   1. training design and delivery
   2. monitoring and regulation systems

1. Evaluate feasibility of assessing verbal and non-verbal communications through an automated measures to provide insight into team cohesion, affective and cognitive states and team performance.

2. Conduct analysis with crew data resources.

Data may be collected via analogous populations or crew members on orbit (currently TBD).
This task is part of the BHP/SHFE/HHC Sensorimotor Integrated Campaign. This task informs gap Bmed2.

During Phase I, Vecna demonstrated the feasibility of Automatic Video-based Motion Analysis (AVIMA), a video-based human motion analysis and visualization tool that automatically processes video footage of humans without the use of specialized markers. AVIMA features key innovations such as a video analytics module, a human motion analysis module which automatically estimates and tracks the 3D human body pose from video footage across a variety of operating scenarios, and a video analytics module which automatically interprets the subjects’ movements with respect to their operational environment, objects in the environment, and other crewmates. This video analytics module also locates, annotates, and counts how many times the crew performed a specific action, traversed a particular path, or accessed a piece of hardware.  

Phase II work leveraged the Phase I preliminary designs and prototype results. The team explored machine learning algorithms to detect human presence in a scene and completed a product that will detect when a person enters a specified region.

Mitigation/Partial mitigation of the gap/risk: This research assisted in defining requirements for an advanced tool to efficiently analyze 2-dimensional video.

Specific aims of this project are twofold: (1) develop a methodology to assess cognitive and emotional state “at a distance” through spontaneous verbal output in real-time communications and (2) produce a real-time assessment tool to detect cognitive performance deficits, stress, fatigue, anxiety, and depression in the spaceflight operational setting. Primary tasks for the first year include: (1) the development of a working model of cognitive performance deficits, stress, fatigue and anxiety in spaceflight and (2) the generation of a lexicon (in American English) indicative of these constructs. Second and third years of the project will focus on the validation of the lexical methodology through a multi-level empirical research. The primary tasks include: (1) validation via archival analysis of previously collected data, (2) validation studies conducted with representative and analogue populations, and (3) delivery of a transparent system which allows for real-time assessment and graphical display of stress processes drawn from ongoing verbal or textual communications. These tasks will afford an investigation of the topography of shifts in lexicon word use over the course of individual and team performance, examine lexicon word use to gauge stress effects, cognitive load, anxiety, etc., and predict individual and team performance outcomes.