publications
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
National STEM Assessment Conference
Assessing Problem-solving Strategies in Chemistry Using the IMMEX™ System
Melanie Cooper, Ronald H. Stevens and Thomas Holme
Abstract:
This paper outlines the development and utility of a problem-solving assessment system called IMMEX™ (Interactive MultiMedia Exercises). This system presents students with a complex problem to solve in an online environment. Student actions are tracked and data-mining strategies allow the clustering of many possible problem-solving pathways into specific strategy types. The system provides reliable and repeatable measures of student problem solving, which can be used to determine effective teaching strategies or to evaluate research studies in chemistry. Future developments that will allow the system to be part of a comprehensive assessment strategy within an undergraduate chemistry curriculum are also possible.
For more information Email: Info@TeamNeuroDynamics.com
intelligent tutoring systems
A Bayesian Network Approach for Modeling the Influence of Contextual Variables on Scientific Problem Solving
Ronald H. Stevens and Vandana Thadani
Abstract:
This paper describes the causal relationships between students' problem-solving effectiveness (i.e. reaching a correct solution) and strategy (i.e. approach) and multiple contextual variables including experience, gender, classroom environment, and task difficulty. Performances of the IMMEX™ problem set Hazmat (n~33,000) were first modeled by Item Response Theory analysis to provide a measure of effectiveness and then by self-organizing artificial neural networks and hidden Markov modeling to provide measures of strategic efficiency. Correlation findings were then used to link the variables into a Bayesian network representation. Sensitivity analysis indicated that whether a problem was solved or not was most likely influenced by findings related to the problem under investigation and the classroom environment while strategic approaches were most influenced by the actions taken, the classroom environment and the number of problems previously performed. Subsequent testing with unknown performances indicated that the strategic approaches were most easily predicted (17% error rate), whereas whether the problem was solved was more difficult (32% error rate).
For more information Email: Info@TeamNeuroDynamics.com
Augmented Cognition
Integrating EEG Models of Cognitive Load with Machine Learning Models of Scientific Problem Solving
Ronald H. Stevens, Trysha L. Galloway and Chris Berka
Abstract:
We have conducted studies with wireless headsets to explore the relationship of working cognitive load (EEG-WL), distraction (EEG-DT) and engagement (EEG-E) and problem solving efficiency and effectiveness on a series of qualitative chemistry, biology and mathematics simulations. As students gained experience by working multiple cases, the EEG-E levels decreased with the reduced novelty of the problem space, the WL levels remained similar and the DT levels were variable. This EEG-DT variability was associated with the relative difficulty of the problem, by the misinterpretation of data, and / or by uncertainty associated with the solution of the problem. To refine the analysis, real-time estimates of EEG-WL, EEG-DT and EEG-E obtained at one second intervals were interleaved with timeline representations of the problem solving process to associate the dynamics of cognitive function with the dynamics of problem solving and learning. Elevated EEG-E frequently occurred shortly after the selection of test data, especially during the first problem performance, and also when the students were taking notes. EEG-WL values fluctuated over the case performance but with no obvious relationship to EEG-DT or EEG-E. EEGDT was closely linked with missing the case solution and was often reciprocal to the EEG-E. These results indicate that real time monitoring of EEG can begin to contribute a dynamic dimension to classroom problem solving and could help design approaches for real-time feedback to improve learning.
For more information Email: Info@TeamNeuroDynamics.com
Augmented Cognition
Integrating Innovative Neuro-educational Technologies (I-Net) into K-12 Science Classrooms
Ronald H. Stevens, Trysha L .Galloway and Chris Berka
Abstract:
With the U.S. facing a decline in science, math and engineering skills, there is a need for educators in these fields to team with engineers and cognitive scientists to pioneer novel approaches to science education. There is a strong need for the incorporation problem solving and emerging neuroscience technologies into mainstream classrooms, and for students and teachers to experience what it means at a very personal level, to engage in and struggle with solving difficult science problems. An innovating and engaging way of doing this is by making the problem solving process visible through the use of realtime electroencephalography cognitive metrics. There are educational, task, and measurement challenges that must be addressed to accomplish this goal. In this paper we detail some of these challenges, and possible solutions, to develop a framework for a new set of Interactive Neuro-Educational Technologies (I-Net).
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition
Allocation of Time, EEG-Engagement and EEG-Workload Resources as Scientific Problem Solving Skills Are Acquired in the Classroom
Ronald H. Stevens, Trysha L. Galloway and Chris Berka
Abstract:
We have studied EEG-derived metrics of Workload (WL) and Engagement (E) as students developed and refined their problem solving approaches to determine the degree to which these are modulated as problem solving experience is gained. The problem solving tasks (IMMEX™) used for these studies were a series of science and mathematics online simulations designed for middle school students. Comparison of WL and E levels on IMMEX™ tasks and baseline cognitive tasks indicated that the simulations recruited high levels of both WL and E. Detailed second-by second analysis of these metrics during problem solving indicated they were dynamic with cycles of high and low values. Aggregated comparisons of WL and E across students as they gained experience in problem solving showed rapid decreases in time on task while E and particularly WL showed little change. Performances where the solution was missed were significantly lower in WL than when the problem was solved. Analysis of WL and E of individual students showed fluctuations of E with practice with some students showing decreased levels with time and others showing increases. When the levels of WL and E were compared across strategies accounted to be novice or proficient by probabilistic modeling there were no significant differences. These findings indicate that as students practice and refine their problem solving strategies the levels, and changes in the mental effort put into the process is not easily predicted by the changes in the speed of the task, by whether or not the problem was solved, or whether the resulting strategy is more novice or expert.
For more information Email: Info@TeamNeuroDynamics.com
Institute for defense analyses
Applications of Stochastic Analyses for Collaborative Learning and Cognitive Assessment
Amy Soller and Ronald H. Stevens
Abstract:
This paper presents a basic introduction to some popular stochastic analysis methods from an unbiased disciplinary perspective. Examples ranging from fields as diverse as defense analysis, cognitive science, and instruction are illustrated throughout to demonstrate the variety of applications that benefit from such stochastic analysis methods and models. Two applications of longitudinal stochastic analysis methods to collaborative and cognitive training environments are discussed in detail. The first application applies a combination of latent mixed Markov modeling and multidimensional scaling for modeling, analyzing, and supporting the process of online knowledge sharing. In the second application, a combination of iterative nonlinear machine learning algorithms is applied to identify latent classes of problem-solving strategies. The examples illustrated in this paper are instances of an increasing global trend toward interdisciplinary research. As this trend continues to grow, research that takes advantage of the gaps and overlaps in analytical methodologies between disciplines will save time, effort, and research funds.
For more information Email: Info@TeamNeuroDynamics.com
user modeling
EEG-Related Changes in Cognitive Workload, Engagement and Distraction as Students Acquire Problem Solving Skill
Ronald H. Stevens, Trysha L .Galloway and Chris Berka
Abstract:
We have begun to model changes in electroencephalography (EEG) derived measures of cognitive workload, engagement and distraction as individuals developed and refined their problem solving skills in science. For the same problem solving scenario(s) there were significant differences in the levels and dynamics of these three metrics. As expected, workload increased when students were presented with problem sets of greater difficulty. Less expected, however, was the finding that as skills increased, the levels of workload did not decrease accordingly. When these indices were measured across the navigation, decision, and display events within the simulations significant differences in workload and engagement were often observed. Similarly, event-related differences in these categories across a series of the tasks were also often observed, but were highly variable across individuals.
For more information Email: Info@TeamNeuroDynamics.com
Technology, Instruction, Cognition and Learning
Quantifying Student's Scientific Problem Solving Efficiency and Effectiveness
Ronald H. Stevens and Vandana Thadani
Abstract:
Using online problem-solving tasks and machine learning tools, a measure has been developed to quantify the effectiveness and efficiency of students' problem solving strategies. This measure can be normalized across problem solving tasks allowing the efficiency of problem solving to be measured across individuals, classes, schools and science domains. This extensible approach has relevance for helping teachers to teach, students to learn, and administrators to make intelligent, data-driven decisions via documentation of students' problem solving progress.
For more information Email: Info@TeamNeuroDynamics.com
Journal of College Science Teaching
Is Collaborative Grouping an Effective Instructional Strategy?: Using IMMEX™ to Find New Answers to an Old Question
Edward Case, Ronald H. Stevens and Melanie Cooper
Abstract:
While problem solving is a generally accepted goal of most science courses, it has previously been difficult to determine the extent to which students' problem solving abilities are impacted by these courses. Interactive Multi-Media Exercises (IMMEX™) is a web-based software package that can deliver multiple cases case-based problems and keep track of the information students use in solving problems. Analysis of this tracking data provides insight into the strategies being employed by students. This study uses the IMMEX™ system to determine the effect of collaborative grouping on the problem-solving strategies of students in first year chemistry courses. We begin with problem solving because it represents the ultimate goal chemistry education. Individuals who can address novel situations and arrive, at a suitable course of action are valued in society. Such behavior is what we mean by problem solving.
For more information Email: Info@TeamNeuroDynamics.com
Chemistry Education research and Practice (A)
Reliable Multi Method Assessment of Metacognition Use in Chemistry Problem Solving
Melanie M. Cooper, Santiago Sandi-Urenab and Ron Stevens
Abstract:
Metacognition is fundamental in achieving understanding of chemistry and developing of problem solving skills. This paper describes an across-method-and-time instrument designed to assess the use of metacognition in chemistry problem solving. This multi method instrument combines a self report, namely the Metacognitive Activities Inventory (MCA-I), with a concurrent automated online instrument, Interactive MultiMedia Exercises (IMMEX). IMMEX™ presents participants with ill defined problems and collects students' actions as they navigate the problem space. Artificial neural networks and hidden Markov modeling applied to the data collected with IMMEX™ produce two assessment parameters: the strategy state, which is related to the metacognitive qualities of the solution path employed, and the ability which is a measure of the problem difficulty students can properly handle. The ability values are significantly correlated with the MCA-I scores, and groups of students who performed using more metacognitive state strategies had significantly higher mean MCA-I values than those using fewer metacognitive strategies. This evidence is indicative of convergence between the methods. This instrument can be used diagnostically to guide the implementation of interventions to promote the use of metacognition; it takes little instructional time, is readily available and allows for the assessment of large cohorts.
For more information Email: Info@TeamNeuroDynamics.com
Journal of Chemical Education
An Assessment of the Effect of Collaborative Groups on Students' Problem-Solving Strategies and Abilities
Melanie M. Cooper, Charles T. Cox, Jr., Minory Nammouz, and Edward Case and Ronald Stevens
Abstract:
This paper reports the use of tools to probe the effectiveness of using small-group interaction to improve problem solving. We find that most students' problem-solving strategies and abilities can be improved by working in short-term, collaborative groups without any other intervention. This is true even for students who have stabilized on a problem-solving strategy and who have stabilized at a problem-solving ability level. Furthermore, we find that even though most students improve by a factor of about 10% in student ability, there are two exceptions: Female students who are classified as pre-formal on a test of logical thinking improve by almost 20% when paired with concrete students; however if two students at the concrete level are paired together no improvement is seen.
For more information Email: Info@TeamNeuroDynamics.com
Chemistry Education research and Practice (B)
Advancements in Curriculum and Assessment by the Use of IMMEX™ Technology in the Organic Laboratory
Charles T. Cox Jr., Melanie M. Cooper, Rebecca Pease, Krystal Buchanan, Laura Hernandez-Cruz, Ron Stevens, John Picione & Thomas Holme
Abstract:
The use of web-based software and course management systems for the delivery of online assessments in the chemistry classroom is becoming more common. IMMEX™ software, like other web-based software, can be used for delivering assessments and providing feedback, but differs in that it offers additional features designed to give insights and promote improvements in problem solving strategies. This report describes some of the features offered with IMMEX™ software and provides a detailed description of how IMMEX™ problems are best implemented into the organic laboratory.
For more information Email: Info@TeamNeuroDynamics.com
IMMEX™ Project, UCLA
A Value-Based Approach for Quantifying Student's Scientific Problem Solving Efficiency and Effectiveness Within and Across Educational Systems
Ronald H. Stevens, Ph. D.
Abstract:
The challenge addressed in this study is: 'What is a suitable description of problem solving that can capture important cognitive and performance information about an individual's problem solving, yet provide rapid and meaningful comparisons within and across science domains and educational systems?' While such a measure would have practical benefits at many levels of education, there are also theoretical reasons to support these developments. In this manuscript we first discuss the need for developing assessments of problem solving and focus on creating metrics to track the development of these skills over prolonged periods of time. Next, we describe the IMMEX™ problem solving environment that provides a wide range of online problem solving experiences for students from middle school through medical school. Then, by using a combination of machine learning tools, we describe a value-based metric of problem solving that allows assessment of problem solving across scientific domains, levels of education, and educational systems. Lastly, we show how this measure can be used to identify classrooms where students' progress at developing these skills is not progressing as predicted by other achievement scores.
For more information Email: Info@TeamNeuroDynamics.com
Human Factors and Ergonomics Society
Assessing Student's Mental Representations of Complex Problem Spaces with EEG Technologies
Ronald H. Stevens, Trysha L .Galloway, Chris Berka, Robin Johnson & Marcia Sprang
Abstract:
We have developed a neurophysiologic-based assessment of student's understanding of complex problem spaces that blends the population-based advantages of probabilistic performance modeling with the detection of neurophysiologic signals. It is designed to be rapid and effective in complex environments where assessment is often imprecise. Cohorts of novices, and experts encoded chemistry problem spaces by performing a series of online problem solving simulations. The stable memory encoding was verified by comparing their strategies with established probabilistic models of strategic performance. Then, we probed the neural correlates of the encoded problem space by measuring differential EEG signatures that were recorded in response to rapidly presented sequences of chemical reactions that represented different valid or invalid approaches for solving the chemistry problems. We found that experts completed performances in stacks more rapidly than did novices and they also correctly identified a higher percentage of reactions. Event related potentials revealed showed increased positivities in the 100-400 ms following presentation of the image preceding the decision when compared with the other stack images. This neural activity was used to explore reasons why students missed performances in the stack. One situation occurred when students appeared to have a lapse of attention. This was characterized by increased power in the 12-15 Hz range, a decrease in the ERP positivities at 100-400 ms after the final image presentation, and a slower reaction time. A second situation occurred when the students' decisions were almost entirely the reverse of what were expected. These responses were characterized by ERP morphologies similar to those of correct decisions suggesting the student had mistaken one set of chemical reactions for another.
For more information Email: Info@TeamNeuroDynamics.com
International Conference on Computers in Education
Tracking the Development of Problem Solving Skills with Learning Trajectories
Ronald H. Stevens, Carol Beal & Marcia Sprang
Abstract:
Learning trajectories have been developed for 1650 students who solved a series of online chemistry problem solving simulations using quantitative measures of the efficiency and the effectiveness of their problem solving approaches. These analyses showed that the poorer problem solvers, as determined by item response theory analysis, were modifying their strategic efficiency as rapidly as the better students, but did not converge on effective outcomes. This trend was also observed at the classroom level with the more successful classes simultaneously improving both their problem solving efficiency and effectiveness. A strong teacher effect was observed, with multiple classes of the same teacher showing consistently high or low problem solving performance. The analytic approach was then used to better understand how interventions designed to improve problem solving exerted their effects. Placing students in collaborative groups increased both the efficiency and effectiveness of the problem solving process, while providing pedagogical text messages increased problem solving effectiveness, but at the expense of problem solving efficiency.
For more information Email: Info@TeamNeuroDynamics.com
Journal of the Learning Sciences
Measuring Complex Features of Science Instruction: Developing Tools To Investigate the Link Between Teaching and Learning
Vandana Thadani, Ronald H. Stevens & Annie Tao
Abstract:
There is a growing national recognition that teachers and teaching are at the heart of successful educational reform. However, few tools exist for measuring classroom instruction. The primary purpose of this article is to describe methods we developed to measure and study teaching, specifically while teachers were using a multimedia intervention for promoting scientific problem solving. Lessons were videotaped, and coding schemes were developed to measure 2 aspects of teaching: (a) the lesson's organization, particularly whole-class instruction used to introduce problems and share students' work; and (b) the nature of tasks and questions given to students. Results showed that the coding schemes were reliable and that they detected differences in instruction across teachers. Qualitative analyses were consistent with the quantitative findings. The codes also captured features of teaching that would have been difficult to detect or verify with qualitative observations alone. Finally, we explored how these measures could be used with student outcome data to examine the relationship between teaching and learning in future studies. We argue that quantitative measures of instruction serve many purposes, not the least of which is allowing researchers to explore the relationship between teaching and student learning at a high degree of granularity.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition
Can Neurophysiologic Synchronies Provide a Platform for Adapting Team Performance?
Ronald H. Stevens, Trysha L .Galloway, Chris Berka & Marcia Sprang
Abstract:
We have explored using neurophysiologic patterns as an approach for developing a deeper understanding of how teams collaborate when solving time-critical, complex real-world problems. Fifteen students solved substance abuse management simulations individually, and then in teams of three while measures of mental workload (WL) and engagement (E) were generated by electroencephalography (EEG). High and low workload and engagement levels were identified at each epoch for each team member and vectors of these measures were clustered by self organizing artificial neural networks. The resulting patterns, termed neurophysiologic synchronies, differed for the five teams reflecting the teams' efficiency. When the neural synchronies were compared across the collaboration, segments were identified where different synchronies were preferentially expressed. This approach may provide an approach for monitoring the quality of team work during complex, real-world and possible one of a kind problem solving, and for adaptively modifying the teamwork flow when optimal synchronies are not frequent.
For more information Email: Info@TeamNeuroDynamics.com
Human Factors and Ergonomics Society
Temporal Sequences of Neurophysiologic Synchronies can Identify Changes in Team Cognition
Ronald H. Stevens, Trysha L. Galloway, Chris Berka and Adrienne Behneman
Abstract:
Neurophysiologic synchronies (NS) are the second-by-second expression of the levels of cognitive measures by individual members of a team. Previously we showed that the NS obtained from EEG-derived measures of engagement (EEG-E) were not random across a variety of teamwork situations, but changed with changing task demands. In this study we hypothesized that the expression of different NS may represent unobserved states of the team and that the sequence of NS expression may contain long memory relevant to the performance of the team. To test this hypothesis we performed hidden Markov modeling of the EEG-E NS streams from novice and expert Navy submarine piloting and navigation teams and show that the dynamic expression of states derived from these models identified short and long-term changes in the behavior of teams.
For more information Email: Info@TeamNeuroDynamics.com
Behavior Representation in Modeling
Identification and Application of Neurophysiologic Synchronies for Studying Team Behavior
Ronald H. Stevens, Trysha L. Galloway, Chris Berka and Adrienne Behneman
Abstract:
We describe a process for collecting and combining neurophysiologic signals derived from individual members of a team to develop pattern categories showing the normalized expression of these signals at each second for the team as a whole. The expression of different neurophysiologic synchrony patterns is sensitive to changes in the behavior of teams over time and perhaps to the level of expertise. The utility and limitations of using this approach are demonstrated for three tasks including a team emotion recall research study, an educational study where teams of high school students solved substance abuse simulations and a complex training study where Submarine Officer Advanced Candidate trainees performed submarine piloting and navigation exercises.
For more information Email: Info@TeamNeuroDynamics.com
Interservice / Industry Training Simulation and Education
A Neurophysiologic Approach for Studying Team Cognition
Ronald H. Stevens, Trysha L. Galloway, Chris Berka and Adrienne Behneman
Abstract:
The objective is to combine simultaneous neurophysiologic signals from team members to develop pattern categories, called neurophysiologic synchronies (NS) that can be related to the second-by-second activities of teams. Neurophysiologic synchronies are a low level data stream that can be collected and analyzed in real time and in realistic settings. If the expression of different NS patterns is sensitive to changes in the behavior of teams over time they may be a useful tool for studying team cognition. EEG-derived measures of engagement from team members were normalized and pattern classified by self-organizing artificial neural networks and hidden Markov models. The temporal expression of these patterns was mapped onto team events. Across multiple teamwork tasks NS expression was shown to be non-random and sensitive to changes in the task and the activities of team members. These studies suggest that neurophysiologic indicators measured by EEG may be useful for studying team behavior not only at the milliseconds level, but at more extended time frames.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (A)
Mapping Cognitive Attractors onto the Dynamic Landscapes of Teamwork
Ronald H. Stevens and Jamie C. Gorman
Abstract:
The objective of this study was to apply ideas from complexity theory to derive new models of teamwork. The measures include EEG-derived measures of Engagement and Workload obtained from submarine piloting and navigation (SPAN) teams and communication streams from Uninhibited Air Vehicle Synthetic Task Environments (UAV-STE). We show that despite large differences in the data streams and modeling, similar changes are seen in the respective order parameters in response to task perturbations and the experience of the team. These changes may provide a pathway for future adaptive training systems as both order parameters could conceivably be modeled and reported in real time.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (B)
Team Resilience: A Neurodynamic Perspective
Ronald H. Stevens, Trysha L. Galloway, Jerry Lamb, Ronald Steed and Cynthia Lamb
Abstract:
Neurophysiologic models were created from US Navy navigation teams performing required simulations that captured their dynamic responses to the changing task environment. Their performances were simultaneously rated by two expert observers for team resilience using a team process rubric adopted by the US Navy Submarine Force. Symbolic neurodynamic (NS) representations of the 1-40 Hz EEG amplitude fluctuations of the crew were created each second displaying the EEG levels of each team member in the context of the other crew members and in the context of the task. Quantitative estimates of the NS fluctuations were made using a moving window of entropy. Periods of decreased entropy were considered times of increased team neurodynamic organization; e.g. when there were prolonged and restricted relationships between the EEG-PSD levels of the crew. Resilient teams showed significantly greater neurodynamic organization in the pre-simulation Briefing than the less resilient teams. Most of these neurodynamic organizations occurred in the 25-40 Hz PSD bins. In contrast, the more resilient teams showed significantly lower neurodynamic organization during the Scenario than the less resilient teams with the greatest differences in the 12-20 Hz PSD bins. The results indicate that the degree of neurodynamic organization reflects the performance dynamics of the team with more organization being important during the pre-mission briefing while less organization (i.e. more flexibility) important while performing the task.
For more information Email: Info@TeamNeuroDynamics.com
Human Factors
Cognitive Neurophysiologic Synchronies: What Can They Contribute to the Study of Teamwork?
Ronald H. Stevens, Trysha L. Galloway, Peter Wang and Chris Berka
Abstract:
OBJECTIVE: Cognitive neurophysiologic synchronies (NS) are low-level data streams derived from electroencephalography (EEG) measurements that can be collected and analyzed in near real time and in realistic settings. The objective of this study was to relate the expression of NS for engagement to the frequency of conversation between team members during Submarine Piloting and Navigation (SPAN) simulations.
BACKGROUND: If the expression of different NS patterns is sensitive to changes in the behavior of teams, they may be a useful tool for studying team cognition.
METHOD: EEG-derived measures of engagement (EEG-E) from SPAN team members were normalized and pattern classified by self-organizing artificial neural networks and hidden Markov models. The temporal expression of these patterns was mapped onto team events and related to the frequency of team members' speech. Standardized models were created with pooled data from multiple teams to facilitate comparisons across teams and levels of expertise and to provide a framework for rapid monitoring of team performance.
RESULTS: The NS expression for engagement shifted across task segments and internal and external task changes.These changes occurred within seconds and were affected more by changes in the task than by the person speaking.Shannon entropy measures of the NS data stream showed decreases associated with periods when the team was stressed and speaker entropy was high.
CONCLUSION: These studies indicate that expression of neurophysiologic indicators measured by EEG may complement rather than duplicate communication metrics as measures of team cognition.
APPLICATION: Neurophysiologic approaches may facilitate the rapid determination of the cognitive status of a team and support the development of novel adaptive approaches to optimize team function.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (C)
Developing Systems for the Rapid Modeling of Team Neurodynamics
Ronald H. Stevens, Trysha L. Galloway, Chris Berka and Peter Wang
Abstract:
Cognitive Neurophysiologic synchronies (NS) are a low level data stream derived from EEG measurements that can be collected and analyzed in near real time and in realistic settings. We are using NS to develop systems that can rapidly determine the functional status of a team with the goals of being able to assess the quality of a teams' performance / decisions, and to adaptively rearrange the team or task components to better optimize the team. EEG-derived measures of engagement from Submarine Piloting and Navigation team members were normalized and pattern classified by self-organizing artificial neural networks and hidden Markov models. The temporal expression of these patterns were mapped onto team events and related to the frequency of team members' speech. Standardized models were created using pooled data from multiple teams and were used to compare NS expression across teams, training sessions and levels of expertise. These models have also been incorporated into software systems that can provide for rapid (minutes) after training feedback to the team and provide a framework for future real-time monitoring.
For more information Email: Info@TeamNeuroDynamics.com
PULSE, IEEE Engineering in Medicine & Biology
Neurotechnology to Accelerate Learning: During Marksmanship Training
Adrieanne Behneman, Chris Berka, Ronald H. Stevens, Brian Vila, Veasna Tan, Trysha L .Galloway, Robin Johnson & Gibby Raphael
Abstract:
This article explores the psychophysiological metrics during expert and novice performances in marksmanship, combat deadly force judgment and decision making (DFJDM), and interactions of teams. Electroencephalography (EEG) and electrocardiography (ECG) are used to characterize the psychophysiological profiles within all categories. Closed-loop biofeedback was administered to accelerate learning during marksmanship training in which the results show a difference in groups that received feedback compared with the control. During known distance marksmanship and DFJDM scenarios, experts show superior ability to control physiology to meet the demands of the task. Expertise in teaming scenarios is characterized by higher levels of cohesiveness than those seen in novices.
For more information Email: Info@TeamNeuroDynamics.com
Human Factors and Ergonomics Society Annual Meeting
Mapping Neurophysiologic Synchrony Attractor States and Entropy Fluctuations during Submarine Piloting and Navigation
Ronald H. Stevens, Trysha L. Galloway, Peter Wang and Chris Berka
Abstract:
Our objective was to apply ideas from complexity theory to derive expanded models of Submarine Piloting and Navigation (SPAN) showing how teams cognitively respond to task changes and how this was altered with experience. The cognitive measure highlighted was an electroencephalography (EEG)-derived measure of engagement (EEG-E) that was modeled into a collective team variable termed neurophysiologic synchronies of engagement (NS_E) thus showing the engagement of each of 6 team members as well as the engagement of the team as a whole. We show that the dominant NS_E patterns were different for novice and experienced teams, and that experienced teams used a larger repertoire of potential NS_E patterns. Estimates of the Shannon entropy of the NS_E data streams provided a quantitative history of NS_E fluctuations which were associated with the efficiency of the SPAN teams in updating the ship's position.
For more information Email: Info@TeamNeuroDynamics.com
Behavior Representation in Modeling & Simulation
Mapping Cognitive Attractor States during Submarine Piloting and Navigations
Ronald H. Stevens, Trysha L. Galloway and Peter Wang
Abstract:
Teamwork is complicated, complex, and noisy. The ecological perspective of teamwork (Cooke et al, 2009) draws on this complexity to describe a dynamic view of teamwork where individuals are viewed as a rich dynamic system with the state of each member depending on the state of others. Patterns of interaction and activity qualitatively emerge that are characterized by fluctuations to and from stable states. The goal of this study was to apply these ideas of self- organization and attractor landscapes from complexity theory to develop neurophysiologic models of teamwork that may be sensitive to levels of team experience. Our hypotheses was that more experienced teams would exhibit looser cognitive coupling than novice teams who need to more explicitly track one another's behavior. Qualitatively this would result in the use of different cognitive attractor states, and a decreased proportion of time spent in these states.
For more information Email: Info@TeamNeuroDynamics.com
Computational and Mathematical Organization Theory
Modeling the Neurodynamic Complexity of Submarine Navigation Teams
Ronald H. Stevens, Trysha L. Galloway, Peter Wang, Chris Berka, Veasna Tan, Thomas Wohlgemuth, Jerry Lamb & Robert Buckles
Abstract:
Our objective was to apply ideas from complexity theory to derive neurophysiologic models of Submarine Piloting and Navigation showing how teams cognitively organize around changes in the task and how this organization is altered with experience. The cognitive metric highlighted was an electroencephalography (EEG)- derived measure of engagement (termed NS_E) which was modeled into a collective team variable showing the engagement of each of 6 team members as well as the engagement of the team as a whole. We show that during a navigation task the NS_E data stream contains historical information about the cognitive organization of the team and that this organization can be quantified by fluctuations in the Shannon entropy of the data stream. The fluctuations in the NS_E entropy were complex, showing both rapid changes over a period of seconds and longer fluctuations that occurred over periods of minutes. The periods of low NS_E entropy represented moments when the team's cognition had undergone significant re-organization, i.e. when fewer NS_E symbols were being expressed. Decreases in NS_E entropy were associated with periods of poorer team performance as indicated by delays/omissions in the regular determination of the submarine's position; parallel communication data suggested that these were also periods of increased stress. Experienced submarine navigation teams performed better than Junior Officer teams, had higher overall levels of NS_E entropy and appeared more cognitively flexible as indicated by the use of a larger repertoire of available NS_E patterns. The quantitative information in the NS_E entropy may provide a framework for designing future adaptive team training systems as it can be modeled and reported in near real time.
For more information Email: Info@TeamNeuroDynamics.com
NONLINEAR DYNAMICS, PSYCHOLOGY, AND LIFE SCIENCES
The Organizational Neurodynamics of Teams
Ronald H Stevens, Jamie C. Gorman, Polemnia Amazeen, Aaron Likens and Trysha L.Galloway
Abstract:
Our objective was to apply ideas from complexity theory to derive expanded neurodynamic models of Submarine Piloting and Navigation showing how teams cognitively organize around task changes. The cognitive metric highlighted was an electroencephalography-derived measure of engagement (termed neurophysiologic synchronies of engagement) that was modeled into collective team variables showing the engagement of each of six team members as well as that of the team as a whole. We modeled the cognitive organization of teams using the information content of the neurophysiologic data streams derived from calculations of their Shannon entropy. We show that the periods of team cognitive reorganization 1) occurred as a natural product of teamwork particularly around periods of stress; 2) appeared structured around episodes of communication; 3) occurred following deliberate external perturbation to team function; and 4) were less frequent in experienced navigation teams. These periods of reorganization were lengthy, lasting up to 10 minutes. As the overall entropy levels of the neurophysiologic data stream are significantly higher for expert teams, this measure may be a useful candidate for modeling teamwork and its development over prolonged periods of training.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (A)
Analysis of Semantic Content and Its Relation to Team Neurophysiology during Submarine Crew Training
Jamie C Gorman, Melanie J Martin, Terri A Dunbar, Ronald H. Stevens and Trysha L. Galloway
Abstract:
A multi-level framework for analyzing team cognition based on team communication content and team neurophysiology is described. The semantic content of team communication in submarine training crews is quantified using Latent Semantic Analysis (LSA), and their team neurophysiology is quantified using the previously described neurophysiologic synchrony method. In the current study, we validate the LSA communication metrics by demonstrating their sensitivity to variations in training segment and by showing that less experienced (novice) crews can be differentiated from more experienced crews based on the semantic relatedness of their communications. Cross-correlations between an LSA metric and a team neurophysiology metric are explored to examine fluctuations in the lead-lag relationship between team communication and team neurophysiology as a function of training segment and level of team experience. Finally, the implications of this research for team training and assessment are considered.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (B)
How Long Is the Coastline of Teamwork?
John Kolm, Ronald H. Stevens and Trysha L. Galloway
Abstract:
A five-state Markov model is proposed for group and team operation and evolution that has a stronger basis in neurodynamics, greater descriptive accuracy and higher predictive value than many existing models. The derivation of this model from the symbolic analysis of normalized EEG activity during assigned team and group tasks is discussed, as are observations on team and group dynamics which emerge from the model. The predictive value of the model is shown when applied to independent data from submarine crew evolutions. Observations are offered on team dynamics which show the five-state model and its accompanying state transitions to be necessary and sufficient to describe both linear and non-linear team dynamics, and to begin unifying these traditional and new approaches in a straightforward way.
For more information Email: Info@TeamNeuroDynamics.com
Foundations of Augmented Cognition (C)
How Tasks Help Shape the Neurodynamic Rhythms and Organizations of Teams
Ronald H. Stevens, Trysha L. Galloway, Gwendolyn Campbell, Chris Berka and Pierre Balthazard
Abstract:
We have modeled neurophysiologic indicators of Engagement and Workload to determine the influence the task has on the resulting neurodynamic rhythms and organizations of teams. The tasks included submarine piloting and navigation and anti-submarine warfare military simulations, map navigation tasks for high school students and business case discussions for entrepreneurial / corporate teams. The team composition varied from two to six persons and all teams had teamwork experience with the tasks. For each task condition teams developed task-specific neurodynamic rhythms. These task-specific rhythms were present during much of the task but could be interrupted by exogenous or endogenous disturbances to the team or environment. The effects of these disturbances could be rapidly detected by changes in the entropy levels of the team neurodynamics symbol streams. These results suggest the possibility of performing task-specific comparisons of the rhythms and organizations across teams expanding the opportunities for rapid detection of less than successful performances and targeted interventions.
For more information Email: Info@TeamNeuroDynamics.com
SOCIAL NEUROSCIENCE
Neural Signatures of Team Coordination are Revealed by Multifractal Analysis
Aaron Likens, Polemnia Amazeen, Ronald H. Stevens Trysha L. Galloway and Jamie Gormam
Abstract:
The quality of a team depends on its ability to deliver information through a hierarchy of team members and negotiate processes spanning different time scales. That structure and the behavior that results from it pose problems for researchers because multiply-nested interactions are not easily separated. We explored the behavior of a six-person team engaged in a Submarine Piloting and Navigation (SPAN) task using the tools of dynamical systems. The data were a single entropy time series that showed the distribution of activity across six team members, as recorded by nine-channel electroencephalography (EEG). A single team's data were analyzed for the purposes of illustrating the utility of multifractal analysis and allowing for in-depth exploratory analysis of temporal characteristics. Could the meaningful events experienced by one of these teams be captured using multifractal analysis, a dynamical systems tool that is specifically designed to extract patterns across levels of analysis? Results indicate that nested patterns of team activity can be identified from neural data streams, including both routine and novel events. The novelty of this tool is the ability to identify social patterns from the brain activity of individuals in the social interaction. Implications for application and future directions of this research are discussed.
For more information Email: Info@TeamNeuroDynamics.com
FOUNDATIONS OF AUGMENTED COGNITION
Teams Reorganize Neurodynamically When They Sense Loss of Control
Ronald H. Stevens and Trysha L. Galloway
Abstract:
Perturbations to the normal flow of teamwork arise externally through changes in the environment or internally as a result of the team's processes / decisions. We used quantitative neurophysiologic models of the rhythms and organizations of teams to examine the effects of these two classes of perturbations on team neurodynamics. Electroencephalographic (EEG) signals from dyads were transformed into cognitive workload estimates and then into neurodynamic symbols (NS) showing the second-by-second workload of each individual as well as the team. Periods of changing cognitive organizations were identified by a moving average smoothing of the Shannon entropy of the NS data stream and related to team speech, actions and responses to external and internal task changes. Dyads performing an unscripted map navigation (HCRC Map Task) developed fluctuating NS dynamics around the construct of workload which were disrupted by external task perturbations or when the team became confused or uncertain of their progress. Importantly, we detected no significant neurodynamic fluctuations associated with periods when the team made mistakes and did not realize they made the mistake. These results indicated that neurodynamics reorganizations occurred in teams in response to multiple types of perturbations, but primarily when the team perceived difficulties.
For more information Email: Info@TeamNeuroDynamics.com
Human Factors and Ergonomics Society
Submarine Navigation Team Resilience Linking EEG and Behavioral Models
Ronald H. Stevens, Trysha L. Galloway and Cynthia Lamb
Abstract:
Advances in the assessment of submarine piloting and navigation teams have created opportunities for linking behavioral observations of team performances with neurodynamic measures of team organization, synchrony and change. Submarine navigation teams (n=12) were fitted with EEG headsets and recorded while conducting required navigation simulations. In parallel, their performances were assessed for team resilience by two evaluators using a team process rubric adopted by the Submarine Force. EEG models of team synchrony were created symbolically which identified times when there was increased across-team cognitive organization induced by the simulation and / or interactions with other crew members. One set of these organizations was observed in the 10 Hz EEG frequency band and coincided with the periodic activity of updating the ship's position (e.g. Rounds). There were also periods of increased team synchrony between 25-40 Hz which were present during some Rounds events but were more prominent with task changes or when the team was stressed. More resilient teams had fewer periods of team synchrony and these were of smaller magnitude than those found in less resilient teams. These results indicate that both routine and unexpected activities trigger increased neurophysiologic synchrony / coherence in teams and that periods of persistent synchrony may signal a team being challenged.
For more information Email: Info@TeamNeuroDynamics.com
Social Neuroscience
Toward a Quantitative Description of the Neurodynamic Organizations of Teams
Ronald H. Stevens and Trysha L. Galloway
Abstract:
The goal was to develop quantitative models of the neurodynamic organizations of teams that could be used for comparing performance within and across teams and sessions. A symbolic modeling system was developed, where raw electroencephalography (EEG) signals from dyads were first transformed into second-by-second estimates of the cognitive Workload or Engagement of each person and transformed again into symbols representing the aggregated levels of the team. The resulting neurodynamic symbol streams had a persistent structure and contained segments of differential symbol expression. The quantitative Shannon entropy changes during these periods were related to speech, performance, and team responses to task changes. The dyads in an unscripted map navigation task (Human Communication Research Centre (HCRC) Map Task (MT)) developed fluctuating dynamics for Workload and Engagement, as they established their teamwork rhythms, and these were disrupted by external changes to the task. The entropy fluctuations during these disruptions differed in frequency, magnitude, and duration, and were associated with qualitative and quantitative changes in team organization and performance. These results indicate that neurodynamic models may be reliable, sensitive, and valid indicators of the changing neurodynamics of teams around which standardized quantitative models can begin to be developed.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS SOCIETY ANNUAL MEETING
What Will Quantitative Measures of Teamwork Look Like in 10 Years?
Session Chair: Eduardo Salas, Panelists: Ron Stevens, Jamie Gorman, Nancy J Cooke, Stephen Guastello & Alina A. von Davier
Introduction:
Nationwide there is a need for cost-effective training solutions that are highly automated, adaptable, and capable of producing quantifiable behavioral changes in teams that are indicative of deep learning. In contrast to what is known about individual skill acquisition and persistence, relatively little is known about how team process skills develop; how well these skills once learned in one context transfer to another context; how long the skills persist when unused; and, what interventions or training will most rapidly restore them? Answering these questions is challenging due to the limited number of quantitative teamwork measures that track team performance, cohesion and flexibility across teams, time, environments and training protocols. Adopting a scientific approach for studying the effects of training interventions is problematic without theory and methods that are aligned and capable of representing and capturing the dynamics of team performance. A confluence of new technologies will soon generate enormous amounts of new data at an unprecedented level of detail about teams. But these data will also raise questions of their own; principally how researchers will make sense of the expected onslaught of data and derive general organizing principles that guide the co-evolution of the complex team and task interactions. This suggests the need for novel methods and ways of thinking about team dynamics and measurement. Our goals are to speculate, given where we are, where the measurement and assessment of learning and performance of teams and of individuals in teams might go in the next decade and how we might get there. As such, some sample 'Big' Questions' that the panelists were asked to consider in their presentations include: What types of high and low level data abstractions might provide the most useful quantitative information about teamwork? • Across which biologic and interpersonal scales of teamwork will the strongest information flows be found? • Can dynamical clues tell us how well a team is performing / will perform? • In addition to performance assessment, what can we learn from dynamics about team flexibility, cohesion, leadership, and resilience? • How can we disentangle individual contributions from the team contribution and accurately measure them?
For more information Email: Info@TeamNeuroDynamics.com
ENCYCLOPEDIA OF INFORMATION SCIENCE AND TECHNOLOGY
Team Neurodynamics
Ronald H. Stevens
Abstract:
Team neurodynamics is the study of the changing rhythms and organizations of teams from the perspective of neurophysiology. As a discipline, team neurodynamics is located at the intersection of collaborative learning, psychometrics, complexity theory and neurobiology with the resulting principles and applications both drawing from and contributing to these specialties. This chapter describes the tools for studying team neurodynamics and shows the potential of these methods and models for better understanding team formation and function. The models developed are reliable, sensitive and valid indicators of the changing neurodynamics of teams around which standardized quantitative models can begin to be developed. The technology is intended for documenting how rapidly teams are progressing towards proficiency and expertise and for understanding why some teams function better than others.
For more information Email: Info@TeamNeuroDynamics.com
FOUNDATIONS OF AUGMENTED COGNITION
Team Resilience: A Neurodynamic Perspective
Ronald H. Stevens, Trysha L. Galloway, Jerry Lamb, Ronald Steed and Cynthia Lamb
Abstract:
Neurophysiologic models were created from US Navy navigation teams performing required simulations that captured their dynamic responses to the changing task environment. Their performances were simultaneously rated by two expert observers for team resilience using a team process rubric adopted by the US Navy Submarine Force. Symbolic neurodynamic (NS) representations of the 1–40 Hz EEG amplitude fluctuations of the crew were created each second displaying the EEG levels of each team member in the context of the other crew members and in the context of the task. Quantitative estimates of the NS fluctuations were made using a moving window of entropy. Periods of decreased entropy were considered times of increased team neurodynamic organization; e.g. when there were prolonged and restricted relationships between the EEG–PSD levels of the crew. Resilient teams showed significantly greater neurodynamic organization in the pre-simulation Briefing than the less resilient teams. Most of these neurodynamic organizations occurred in the 25–40 Hz PSD bins. In contrast, the more resilient teams showed significantly lower neurodynamic organization during the Scenario than the less resilient teams with the greatest differences in the 12–20 Hz PSD bins. The results indicate that the degree of neurodynamic organization reflects the performance dynamics of the team with more organization being important during the pre–mission briefing while less organization (i.e. more flexibility) important while performing the task.
For more information Email: Info@TeamNeuroDynamics.com
THE JOURNAL OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY
Cross-Level Effects Between Neurophysiology and Communication During Team Training
Jamie C Gorman, Melanie J Martin, Terri A Dunbar, Ronald H Stevens, Trysha L Galloway, Polemnia G Amazeen and Aaron D Likens
Abstract:
Objective: We investigated cross-level effects, which are concurrent changes across neural and cognitive-behavioral levels of analysis as teams interact, between neurophysiology and team communication variables under variations in team training.
Background: When people work together as a team, they develop neural, cognitive, and behavioral patterns that they would not develop individually. It is currently unknown whether these patterns are associated with each other in the form of cross-level effects.
Method: Team-level neurophysiology and latent semantic analysis communication data were collected from submarine teams in a training simulation. We analyzed whether (a) both neural and communication variables change together in response to changes in training segments (briefing, scenario, or debriefing), (b) neural and communication variables mutually discriminate teams of different experience levels, and (c) peak cross-correlations between neural and communication variables identify how the levels are linked.
Results: Changes in training segment led to changes in both neural and communication variables, neural and communication variables mutually discriminated between teams of different experience levels, and peak cross-correlations indicated that changes in communication precede changes in neural patterns in more experienced teams.
Conclusion: Cross-level effects suggest that teamwork is not reducible to a fundamental level of analysis and that training effects are spread out across neural and cognitive-behavioral levels of analysis. Cross-level effects are important to consider for theories of team performance and practical aspects of team training.
Application: Cross-level effects suggest that measurements could be taken at one level (e.g., neural) to assess team experience (or skill) on another level (e.g., cognitive-behavioral).
For more information Email: Info@TeamNeuroDynamics.com
NONLINEAR DYNAMICS, PSYCHOLOGY, AND LIFE SCIENCES
Tracing Neurodynamic Information Flows during Teamwork
Ronald H. Stevens and Trysha L. Galloway
Abstract:
The goal of this study was to evaluate different neurodynamic representations for their ability to describe the interactions of team members with each other and with the changing task. Electroencephalography (EEG) data streams were collected from six crew members of a submarine piloting and navigation team while they performed a required training simulation. A representation of neurodynamic organization was first generated by creating symbols every second that showed the EEG power levels of each crew member. The second-by-second expression of these symbols continuously varied with the changing task, and the magnitude, duration and frequency of these variations could be quantitated using a moving window of Shannon entropy over the symbol stream. These changes in neurodynamic organization (i.e. entropy) were seen in the alpha, beta and gamma EEG frequency bands. A representation of team members' synchrony was created by measuring the mutual information in the EEG power levels for fourteen dyad combinations. Mutual information was present in the gamma EEG band, and elevated levels were distributed throughout the task. These discrete periods of synchrony were poorly correlated at zero lag with either changes in the team's neurodynamic organization, or speech patterns.
For more information Email: Info@TeamNeuroDynamics.com
SOCIAL NEUROSCIENCE
Modeling the Neurodynamic Organizations and Interactions of Teams
Ronald H. Stevens and Trysha L. Galloway
Abstract:
Across-brain neurodynamic organizations arise when teams perform coordinated tasks. We describe a symbolic electroencephalographic (EEG) approach that identifies when team neurodynamic organizations occur and demonstrate its utility with scientific problem solving and submarine navigation tasks. Each second, neurodynamic symbols (NS) were created showing the 1-40 Hz EEG power spectral densities for each team member. These data streams contained a performance history of the team's across-brain neurodynamic organizations. The degree of neurodynamic organization was calculated each second from a moving window average of the Shannon entropy over the task. Decreased NS entropy (i.e., greater neurodynamic organization) was prominent in the ~16 Hz EEG bins during problem solving, while during submarine navigation, the maximum NS entropy decreases were ~10 Hz and were associated with establishing the ship's location. Decreased NS entropy also occurred in the 20-40 Hz bins of both teams and was associated with uncertainty or stress. The highest mutual information levels, calculated from the EEG values of team dyads, were associated with decreased NS entropy, suggesting a link between these two measures. These studies show entropy and mutual information mapping of symbolic EEG data streams from teams can be useful for identifying organized across-brain team activation patterns.
For more information Email: Info@TeamNeuroDynamics.com
INTERNATIONAL SYMPOSIUM ON HUMAN FACTORS AND ERGONOMICS IN HEALTH
Toward Objective Measures of Team Dynamics During Healthcare Simulation Training
Ronald H. Stevens, Trysha L. Galloway, Jamie Gorman, Ann Willemsen-Dunlap and Don Halpin
Abstract:
Three-person teams of fourth-year medical students or experienced operating room practitioners performed simulations around the construct of ventilation. Team member communications together with EEG-derived brainwaves were collected and classified each second and the changing neurodynamic as well as communication organizations of the team were modeled. The fluctuating neurodynamic organizations were obtained from symbolic representations of the EEG power levels of team members while changes in communication were determined by Latent Semantic analysis - derived measures of communication content.
The neurodynamic organizations of the teams at the 10 Hz (alpha) and 39 Hz (gamma) EEG frequencies fluctuated with task demands. The frequency, magnitudes, and durations of these fluctuations differed between novice and expert teams, and these changes in the team's neurodynamic organizations were paralleled by dynamic changes in communication and improvements in TeamSTEPPS® ratings. Neurodynamic and communication measures of team organization may therefore be valuable tools for understanding and assessing the short term dynamics of teams during simulation training, complementing and extending observational evaluations of teams.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS SOCIETY
Intermediate Neurodynamic Representations: A Pathway towards Quantitative Measurements of Teamwork?
Ronald H. Stevens, Trysha L. Galloway and Ann Willemsen-Dunlap
Abstract:
We explored the possible linkages between expert observational ratings of team performance and the fluctuating neurodynamics of healthcare and submarine navigation teams while they conducted realistic training in natural settings. Second-by-second symbolic representations were created of team member's electroencephalographic (EEG) power across the 1-40 Hz EEG spectrum, and quantitative estimates of the changing dynamics were calculated from the Shannon entropy of the data streams. Significant correlations were seen between the symbol streams entropy levels and ratings of team performance by observers using TeamSTEPPS® (healthcare), or Submarine Team Behavior Toolkit (submarine teams) rubrics. These results suggest that the frequency, magnitude, and / or durations of the teams' neurodynamic fluctuations might reflect performance aspects detected by expert raters.
For more information Email: Info@TeamNeuroDynamics.com
ENTROPY
Healthcare Teams Neurodynamically Reorganize When Resolving Uncertainty
Ronald H. Stevens, Trysha L. Galloway, Don Halpin and Ann Willemsen-Dunlap
Abstract:
Research on the microscale neural dynamics of social interactions has yet to be translated into improvements in the assembly, training and evaluation of teams. This is partially due to the scale of neural involvements in team activities, spanning the millisecond oscillations in individual brains to the minutes/hours performance behaviors of the team. We have used intermediate neurodynamic representations to show that healthcare teams enter persistent (50-100 s) neurodynamic states when they encounter and resolve uncertainty while managing simulated patients. Each of the second symbols was developed situating the electroencephalogram (EEG) power of each team member in the contexts of those of other team members and the task. These representations were acquired from EEG headsets with 19 recording electrodes for each of the 1-40 Hz frequencies. Estimates of the information in each symbol stream were calculated from a 60 s moving window of Shannon entropy that was updated each second, providing a quantitative neurodynamic history of the team's performance. Neurodynamic organizations fluctuated with the task demands with increased organization (i.e., lower entropy) occurring when the team needed to resolve uncertainty. These results show that intermediate neurodynamic representations can provide a quantitative bridge between the micro and macro scales of teamwork.
For more information Email: Info@TeamNeuroDynamics.com
INNOVATIVE ASSESSMENT OF COLLABORATION
Linking Team Neurodynamic Organizations with Observational Ratings of Team Performance
Ronald H. Stevens, Trysha L. Galloway, Jerry Lamb, Ronald Steed and Cynthia Lamb
Abstract:
We have investigated the correlations between the levels of team resilience as determined by expert raters and the degree of the teams' neurodynamic organization determined by electroencephalography (EEG). Neurophysiologic models were created from submarine navigation teams that captured their dynamic responses to changing task environments during required simulation training. The teams were simultaneously rated for resilience by two expert observers using a team process rubric developed and adopted by the U.S. Navy. Symbolic neurodynamic representations of the power levels in the 1-40 Hz EEG frequency bands were created each second from each crew member. These symbols captured the EEG power of each team member in the context of the other team members and also in the context of the task. Quantitative estimates of the changes in the symbol distributions over time were constructed by a moving window of Shannon entropy. Periods of decreased entropy were observed when the distribution of symbols in this window became smaller, for example, when there were prolonged and restricted relationships between the EEG power levels among the crew members, that is, less neurodynamic flexibility. Team resilience was correlated with the neurodynamic entropy levels. The correlation sign, however, depended on the training segment with negative correlations during the presimulation briefing and positive correlations in the scenario training segment. These studies indicate that neurodynamic representations of teams can be generated that bridge the microscales of EEG measurement with macroscales of behavioral ratings. From a training perspective, the results suggest that neurodynamic rigidity (i.e., everybody on the same page) might be beneficial while teams are preparing for the simulation, but during the scenario, increased neurodynamic flexibility contributes more to team resilience.
For more information Email: Info@TeamNeuroDynamics.com
FRONTIERS IN PSYCHOLOGY
Are Neurodynamic Organizations a Fundamental Property of Teamwork?
Ronald H. Stevens and Trysha L. Galloway
Abstract:
When performing a task it is important for teams to optimize their strategies and actions to maximize value and avoid the cost of surprise. The decisions teams make sometimes have unintended consequences and they must then reorganize their thinking, roles and/or configuration into corrective structures more appropriate for the situation. In this study we ask: What are the neurodynamic properties of these reorganizations and how do they relate to the moment-by-moment, and longer, performance-outcomes of teams?. We describe an information-organization approach for detecting and quantitating the fluctuating neurodynamic organizations in teams. Neurodynamic organization is the propensity of team members to enter into prolonged (minutes) metastable neurodynamic relationships as they encounter and resolve disturbances to their normal rhythms. Team neurodynamic organizations were detected and modeled by transforming the physical units of each team member's EEG power levels into Shannon entropy-derived information units about the team's organization and synchronization. Entropy is a measure of the variability or uncertainty of information in a data stream. This physical unit to information unit transformation bridges micro level social coordination events with macro level expert observations of team behavior allowing multimodal comparisons across the neural, cognitive and behavioral time scales of teamwork. The measures included the entropy of each team member's data stream, the overall team entropy and the mutual information between dyad pairs of the team. Mutual information can be thought of as periods related to team member synchrony. Comparisons between individual entropy and mutual information levels for the dyad combinations of three-person teams provided quantitative estimates of the proportion of a person's neurodynamic organizations that represented periods of synchrony with other team members, which in aggregate provided measures of the overall degree of neurodynamic interactions of the team. We propose that increased neurodynamic organization occurs when a team's operating rhythm can no longer support the complexity of the task and the team needs to expend energy to re-organize into structures that better minimize the “surprise” in the environment. Consistent with this hypothesis, the frequency and magnitude of neurodynamic organizations were less in experienced military and healthcare teams than they were in more junior teams. Similar dynamical properties of neurodynamic organization were observed in models of the EEG data streams of military, healthcare and high school science teams suggesting that neurodynamic organization may be a common property of teamwork. The innovation of this study is the potential it raises for developing globally applicable quantitative models of team dynamics that will allow comparisons to be made across teams, tasks and training protocols.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS SOCIETY
Demonstration of a Method for Real-time Detection of Anomalies in Team Communication
David A.P. Grimm, Jamie Gorman, Ronald Stevens, Trysha Galloway, Ann Willemsen-Dunlap & Don Halpin
Abstract:
When performing a task it is important for teams to optimize their strategies and actions to maximize value and avoid the cost of surprise. The decisions teams make sometimes have unintended consequences and they must then reorganize their thinking, roles and/or configuration into corrective structures more appropriate for the situation. In this study we ask: What are the neurodynamic properties of these reorganizations and how do they relate to the moment-by-moment, and longer, performance-outcomes of teams? We describe an information-organization approach for detecting and quantitating the fluctuating neurodynamic organizations in teams. Neurodynamic organization is the propensity of team members to enter into prolonged (minutes) metastable neurodynamic relationships as they encounter and resolve disturbances to their normal rhythms. Team neurodynamic organizations were detected and modeled by transforming the physical units of each team member's EEG power levels into Shannon entropy-derived information units about the team's organization and synchronization. Entropy is a measure of the variability or uncertainty of information in a data stream. This physical unit to information unit transformation bridges micro level social coordination events with macro level expert observations of team behavior allowing multi-modal comparisons across the neural, cognitive and behavioral time scales of teamwork. The measures included the entropy of each team member's data stream, the overall team entropy and the mutual information between dyad pairs of the team. Mutual information can be thought of as periods related to team member synchrony. Comparisons between individual entropy and mutual information levels for the dyad combinations of three-person teams provided quantitative estimates of the proportion of a person's neurodynamic organizations that represented periods of synchrony with other team members, which in aggregate provided measures of the overall degree of neurodynamic interactions of the team. We propose that increased neurodynamic organization occurs when a team's operating rhythm can no longer support the complexity of the task and the team needs to expend energy to re-organize into structures that better minimize the "surprise" in the environment. Consistent with this hypothesis, the frequency and magnitude of neurodynamic organizations were less in experienced military and healthcare teams than they were in more junior teams. Similar dynamical properties of neurodynamic organization were observed in models of the EEG data streams of military, healthcare and high school science teams suggesting that neurodynamic organization may be a common property of teamwork. The innovation of this study is the potential it raises for developing globally applicable quantitative models of team dynamics that will allow comparisons to be made across teams, tasks and training protocols.
For more information Email: Info@TeamNeuroDynamics.com
TEAM DYNAMICS OVER TIME
Low Level Predictors of Team Dynamics: A Neurodynamic Approach
Ronald H. Stevens, Trysha L. Galloway and Ann Willemsen-Dunlap
Abstract:
Purpose:
In this chapter we highlight a neurodynamic approach that is showing promise as a quantitative measure of team performance.
Methodology/Approach:
During teamwork the rapid electroencephalographic (EEG) oscillations that emerge on the scalp were transformed into symbolic data streams which provided historical details at a second-by-second resolution of how the team perceived the evolving task and how they adjusted their dynamics to compensate for, and anticipate new task challenges. Key to this approach are the different strategies that can be used to reduce the data dimensionality, including compression, abstraction and taking advantage of the natural redundancy in biologic signals.
Findings:
The framework emerging is that teams continually enter and leave organizational neurodynamic partnerships with each other, so-called metastable states, depending on the evolving task, with higher level dynamics arising from mechanisms that naturally integrate over faster microscopic dynamics.
Practical Implications:
The development of quantitative measures of the momentary dynamics of teams is anticipated to significantly influence how teams are assembled, trained, and supported. The availability of such measures will enable objective comparisons to be made across teams, training protocols, and training sites. They will lead to better understandings of how expertise is developed and how training can be modified to accelerate the path toward expertise.
Originality/Value:
The innovation of this study is the potential it raises for developing globally applicable quantitative models of team dynamics that will allow comparisons to be made across teams, tasks, and training protocols.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS SOCIETY ANNUAL MEETING
A Team's Neurodynamic Organization is More than the Sum of its Members
Ronald H. Stevens, Trysha L. Galloway and Ann Willemsen-Dunlap
The information within the neurodynamic data streams of teams engaged in naturalistic decision making was separated into information unique to each team member, the information shared by two or more team members, and team-specific information related to interactions with the task and team members. Most of the team information consisted of the information contained in an individual's neurodynamic data stream. The information in an individual's data stream that was shared with another team member was highly variable being 1-60% of the total information in another person's data stream. From the shared, individual, and team information it becomes possible to assign quantitative values to both the neurodynamics of each team member during the task, as well as the interactions among the members of the team.
HUMAN FACTORS AND ERGONOMICS IN HEALTH CARE
Neurodynamic and Communication Analysis of Healthcare Teams During Simulation Debriefings
Ronald H. Stevens, Ann Willemsen-Dunlap, Jamie Gorman, Trysha L. Galloway, David Grimm & Don Halpin
Abstract:
Objective: To determine whether a dynamical analysis of neural and communication data streams provide fine-grained insights into healthcare team debriefings.
Background: Debriefing plays a key role in experiential learning activities such as healthcare simulation because it bolsters the transfer of experience into learning through a process of reflection. There have been few studies examining the neural and communication dynamics of teams as team members are supported by trained facilitators in making better sense of their performance.
Method: Electroencephalographic (EEG) - derived brain waves and speech were recorded from experienced and medical student healthcare teams during post-simulation debriefings. Quantitative estimates of the neurodynamic organizations of individual team members and the team were modeled from the EEG data streams at different scalp locations and at frequencies from 1-40 Hz. In parallel the dynamics of speech turn taking were quantified by recurrence frequency analysis.
Results: Neurodynamic organizations were preferentially detected from sensors over the parietal lobes with activities present in the alpha, beta and gamma frequency bands. Rhythmic structures emerged as correlations between speech, discussion blocks and team & team member neurodynamic organizations.
Conclusion: Organizational representations help reveal the neurodynamic, communication, and cognitive structures of debriefing.
Application: The quantitative neurodynamic and communication measures will allow direct comparisons of debriefing structures across teams and debriefing protocols.
For more information Email: Info@TeamNeuroDynamics.com
THE JOURNAL OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY
Neuroergonomics: Quantitative Modeling of Individual, Shared, and Team Neurodynamic Information
Ronald H. Stevens, Trysha L. Galloway and Ann Willemsen-Dunlap
Abstract:
Objective: The aim of this study was to use the same quantitative measure and scale to directly compare the neurodynamic information/organizations of individual team members with those of the team.
Background: Team processes are difficult to separate from those of individual team members due to the lack of quantitative measures that can be applied to both process sets.
Method: Second-by-second symbolic representations were created of each team member's electroencephalographic power, and quantitative estimates of their neurodynamic organizations were calculated from the Shannon entropy of the symbolic data streams. The information in the neurodynamic data streams of health care (N = 24), submarine navigation (N = 12), and high school problem-solving (N = 13) dyads was separated into the information of each team member, the information shared by team members, and the overall team information.
Results: Most of the team information was the sum of each individual's neurodynamic information. The remaining team information was shared among the team members. This shared information averaged ~15% of the individual information, with momentary levels of 1% to 80%.
Conclusion: Continuous quantitative estimates can be made from the shared, individual, and team neurodynamic information about the contributions of different team members to the overall neurodynamic organization of a team and the neurodynamic interdependencies among the team members.
Application: Information models provide a generalizable quantitative method for separating a team's neurodynamic organization into that of individual team members and that shared among team members.
For more information Email: Info@TeamNeuroDynamics.com
FRONTIERS IN HUMAN NEUROSCIENCE
Tracing Neurodynamic Information Flows in Healthcare Teams during Simulation Training
Ronald H. Stevens, Trysha L. Galloway, Don Halpin and Ann Willemsen-Dunlap
Abstract:
The ubiquity of teams in society has made the development of dynamic models of teamwork a priority for many sectors of the human factors community, especially models that can be applied in multiple team settings through the capture of generic properties of team member dynamics. In this presentation we will explore how we can begin to ‘make sense’ of the information in these data streams that are being recorded from teams at increasingly higher resolutions, and what can we expect to learn about teams through the application of different representations, transformations and aggregations of information. The goal is to describe how meaning can be extracted from large-scale dynamical data to make inferences about teamwork that are useful in both the theoretical and practical sense.
We have developed an information-organization approach for detecting and quantitating the fluctuating neurodynamic organizations in teams. Neurodynamic organization is the propensity of team members to enter into prolonged (seconds-minutes) metastable neurodynamic relationships as they encounter and resolve disturbances to their normal rhythms. Team neurodynamic organizations were detected and modeled by transforming the physical units of each team member’s EEG power levels into Shannon entropy-derived information units about the team’s organization and synchronization. Entropy is a measure of the variability or uncertainty of information in a data stream. This physical unit to information unit transformation bridges micro level social coordination events with macro level expert observations of team behavior allowing multimodal comparisons across the neural, cognitive and behavioral time scales of teamwork.
Each second, neurodynamic symbols (NS) were created showing the EEG power spectral densities (PSD) at the 1-40 Hz frequency bins for each team member. These data streams contained a history of the team’s across-brain neurodynamic organizations, and the degree of organization was calculated from a moving average window of the Shannon entropy of task segments. An example of the symbol dynamics and the corresponding entropy profile for a healthcare team performance is shown in Figure 1. The symbol expressions were not temporally uniform, but were punctuated by segments of restricted NS expression that persisted for 1 – 4 minutes. Qualitatively, the NS expressions varied with the training session segments suggesting a neurodynamic form of task specificity.
Fig. 1. Expression of neurodynamic symbols for a healthcare performance.
The EEG PSD were separated into high, medium and low categories compared with the performance average. Every second each person’s EEG power levels were classified into the lower, middle, or upper third of their performance average and assigned the symbols -1, 1, and 3. With three team members and three EEG power levels, the symbol space consisted of 27 symbols. In the above figure a symbol was added for each second of the performance. The lines indicate junctions between different training segments. The fluctuating trace is the entropy of the symbol stream that was calculated over a 60s moving window. More recently the information in the neurodynamic data streams of teams engaged in naturalistic decision making (healthcare (n=24), submarine navigation (n=12) or high school collaborative problem-solving (n=11) was separated into information unique to each team member, the information shared by two or more team members, and team-specific information related to interactions with the task and team members. Most of the team information consisted of the information contained in an individual’s neurodynamic data stream. The information in an individual’s data stream that was shared with another team member was highly variable being 1-60% of the total information in another person’s data stream. From the shared, individual, and team information it becomes possible to quantitatively describe the dynamics of each team member during the task, as well as the neurodynamic interactions between members of the team. The innovation of this study is the potential it raises for developing globally applicable quantitative models of both individual and team dynamics that will allow comparisons to be made across teams, tasks and training protocols.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS
Making Sense of Team Information
Ronald H. Stevens, Trysha L. Galloway, Ann Willemsen-Dunlap, Jamie Gorman and Don Halpin
Abstract:
This paper describes how meaning can be extracted from large-scale dynamical data to make inferences about teamwork that are useful in both the theoretical and practical sense. The dynamics of an anesthesiology team are viewed from the perspectives of: 1) changes in the team's neurodynamic organizations with large and small changes in the task; 2) how team member's neurodynamics contribute to team neurodynamics; 3) the relationships between task events, heart-rate and neural dynamic organizations; 4) the linkages between speech flow, team and team member neurodynamics and topic discussions during Debriefing; and, 5) the micro-scale neural dynamics reflecting the involvement of the parietal lobes and gamma frequencies. These examples show how different sources of team data can contribute to multi-modal understandings of individual and teams dynamics that span micro and macro scales of teamwork.
For more information Email: Info@TeamNeuroDynamics.com
BUILDING INTELLIGENT TUTORING SYSTEMS FOR TEAMS
Toward Rapid and Predictive Neurodynamic Feedback and Scaffolding for Teams
Ronald H. Stevens, Trysha L. Galloway, Ann Willemsen-Dunlap and Anthony M. Avellino
Abstract:
This chapter describes a neurodynamic modeling approach which may be useful for dynamically assessing teamwork in healthcare and military situations. It begins with a description of electroencephalographic (EEG) signal acquisition and the transformation of the physical units of EEG signals into quantities of information. This transformation provides quantitative, dynamic, and generalizable neurodynamic models that are directly comparable across teams, tasks, training protocols, and team experience levels using the same measurement scale, bits of information. These bits of information can be further used to dynamically guide team performance or to provide after-action feedback that is linked to task events and team actions.
These ideas are instantiated and expanded in the second section of the chapter by showing how these data abstractions, compressions, and transformations take advantage of the natural information redundancy in biologic signals to substantially reduce the number of data dimensions, making the incorporation of neurodynamic feedback into Intelligent Tutoring Systems (ITSs) achievable.
For more information Email: Info@TeamNeuroDynamics.com
THE JOURNAL OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY
Training Machines to Recognize Neural Correlates of Team and Team Member Uncertainty
Ronald H. Stevens and Trysha L. Galloway
Every human decision has its origins in uncertainty. Despite its ubiquity, and theoretical understandings, there are few ways of dynamically tracking moment-by-moment uncertainties. Knowing when a team or one of its members was beginning to experience uncertainty would provide a basis for assessment-intervention loops enabling machines to better support human activities. In this paper we describe efforts to train machines to recognize neural correlates of team and team member uncertainty.
Second-by-second symbolic representations of EEG power were created from each team member and quantitative estimates of their neurodynamic information were calculated from the Shannon entropy of the symbol streams. Neurodynamic information was isolated from thirty-one 70-127s segments where speech indicated surprise or uncertainty by team members. The first 70s of these segments were classified by self-organizing artificial neural networks to provide profiles of the onset of uncertainty.
The thirty-one segments were classified into six artificial neural network categories based on dynamic profiles and the levels of neurodynamic information. The categories were sufficiently distinct to suggest that alternative forms of feedback could be developed for each category.
The results suggest that computer machines can be taught to recognize the onset, and possibly predict the duration of uncertainty in humans performing complex tasks. The ability of machines to recognize neurodynamic correlates of uncertainty provide the potential for developing real-time feedback and scaffolding for teams and team members performing in complex task environments.
For more information Email: Info@TeamNeuroDynamics.com
JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING
Teaching Machines to Recognize Neurodynamic Correlates of Team and Team Member Uncertainty
Ronald H. Stevens and Trysha L. Galloway
We describe efforts to make humans more transparent to machines by focusing on uncertainty, a concept with roots in neuronal populations that scales through social interactions. To be effective team partners, machines will need to learn why uncertainty happens, how it happens, how long it will last, and possible mitigations the machine can supply. Electroencephalography-derived measures of team neurodynamic organization were used to identify times of uncertainty in military, health care, and high school problem-solving teams. A set of neurodynamic sequences was assembled that differed in the magnitudes and durations of uncertainty with the goal of training machines to detect the onset of prolonged periods of high level uncertainty, that is, when a team might require support. Variations in uncertainty onset were identified by classifying the first 70 s of the exemplars using self-organizing maps (SOM), a machine architecture that develops a topology during training that separates closely related from desperate data. Clusters developed during training that distinguished patterns of no uncertainty, low-level and quickly resolved uncertainty, and prolonged high-level uncertainty, creating opportunities for neurodynamic-based systems that can interpret the ebbs and flows in team uncertainty and provide recommendations to the trainer or team in near real time when needed.
For more information Email: Info@TeamNeuroDynamics.com
FRONTIERS IN PSYCHOLOGY
Advancing our Understandings of Healthcare Team Dynamics from the Simulation Room to the Operating Room
Ronald H. Stevens, Trysha L. Galloway & Ann Willemsen-Dunlap
The initial models of team and team member dynamics using biometric data in healthcare will likely come from simulations. But how confident are we that the simulation-derived high resolution dynamics will reflect those of teams working with live patients?
We have developed neurodynamic models of a neurosurgery team while they performed a peroneal nerve decompression surgery on a patient to approach this question. The models were constructed from EEG-derived measures that provided second by second estimates of the neurodynamic responses of the team and team members to task uncertainty.
The anesthesiologist, and two neurosurgeons developed peaks, often coordinated, of elevated neurodynamic organization during the patient preparation and surgery which were similar to those seen during simulation training, and which occurred near important episodes of the patient preparation and surgery.
As the analyses moved down the neurodynamic hierarchy, and the simulation and live patient neurodynamics occurring during the intubation procedure were compared at progressively smaller time scales, differences emerged across scalp locations and EEG frequencies. The most significant was the pronounced suppression of gamma rhythms detected by the frontal scalp sensors during the live patient intubation which was absent in simulation trials of the intubation procedure.
These results indicate that while profiles of the second-by-second neurodynamics of teams were similar in both the simulation and live patient environments, a deeper analysis revealed differences in the EEG frequencies and scalp locations of the signals responsible for those team dynamics.
As measures of individual and team performance become more micro-scale and dynamic, and simulations become extended into virtual environments, these results argue for the need for parallel studies in live environments to validate the dynamic of cognition being observed.
For more information Email: Info@TeamNeuroDynamics.com
THE JOURNAL OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY
Measuring Real-Time Team Cognition During Team Training
Jamie C. Gorman, David A. Grimm, Ronald H. Stevens, Trysha L. Galloway, Ann Willemsen-Dunlap & Donald J. Halpin
Abstract:
Objective: A method for detecting real-time changes in team cognition in the form of significant communication reorganizations is described. We demonstrate the method in the context of scenario-based simulation training.
Background: We present the dynamical view that individual- and team-level aspects of team cognition are temporally intertwined in a team’s real-time response to challenging events. We suggest that this real-time response represents a fundamental team cognitive skill regarding the rapidity and appropriateness of the response, and methods and metrics are needed to track this skill.
Method: Communication data from medical teams (Study 1) and submarine crews (Study 2) were analyzed for significant communication reorganization in response to training events. Mutual information between team members informed post hoc filtering to identify which team members contributed to reorganization.
Results: Significant communication reorganizations corresponding to challenging training events were detected for all teams. Less experienced teams tended to show delayed and sometimes ineffective responses that more experienced teams did not. Mutual information and post hoc filtering identified the individual-level inputs driving reorganization and potential mechanisms (e.g., leadership emergence, role restructuring) underlying reorganization.
Conclusion: The ability of teams to rapidly and effectively reorganize coordination patterns as the situation demands is a team cognitive skill that can be measured and tracked.
Application: Potential applications include team monitoring and assessment that would allow for visualization of a team’s real-time response and provide individualized feedback based on team member’s contributions to the team response.
For more information Email: Info@TeamNeuroDynamics.com
JOURNAL of BIOMEDICAL INFORMATICS
Physiological Synchronization and Entropy as Measures of Team Cognitive Load
Roger D. Dias, Marco A. Zenati, Ronald H. Stevens, Jennifer M. Gabany & Steven J. Yule
Abstract:
The operating room (OR) is a high-risk and complex environment, where multiple specialized professionals work as a team to effectively care for patients in need of surgical interventions. Surgical tasks impose high cognitive demands on OR staff and cognitive overload may have deleterious effects on team performance and patient safety. The aim of the present study was to investigate the feasibility and describe a novel methodological approach to characterize dynamic changes in team cognitive load by measuring synchronization and entropy of heart rate variability parameters during real-life cardiac surgery. Cognitive load was measured by capturing interbeat intervals (IBI) from three team members (surgeon, anesthesiologist and perfusionist) using an unobtrusive wearable heart rate sensor and transmitted in real-time to a smartphone application. Clinical data and operating room audio/video recordings were also collected to provide behavioral and contextual information. We developed symbolic representations of the transient cognitive state of individual team members (Individual Cognitive State – ICS), and overall team (Team Cognitive State – TCS) by comparing IBI data from each team member with themselves and with others. The distribution of TCS symbols during surgery enabled us to display and analyze temporal states and dynamic changes of team cognitive load. Shannon’s entropy was calculated to estimate the changing levels of team organization and to detect fluctuations resulting from a variety of cognitive demands and/or specific situations (e.g. medical error, emergency, flow disruptions). An illustrative example from a real cardiac surgery team shows how cognitive load patterns shifted rapidly after an actual near-miss medication event, leading the team to a more organized and synchronized state. The methodological approach described in this study provides a measurement technique for the assessment of team physiological synchronization, which can be applied to many other team-based environments. Future research should gather additional validity evidence to support the proposed methods for team cognitive load measurement.
For more information Email: Info@TeamNeuroDynamics.com
NEUROERGONOMICS
Approaches for Inserting Neurodynamics into the Training of Healthcare Teams
Ronald H. Stevens, Trysha L. Galloway and Ann Willemsen-Dunlap
Every human decision has its origins in uncertainty. Despite its ubiquity, and theoretical understandings, there are few ways of dynamically tracking moment-by-moment uncertainties. Knowing when a team or one of its members was beginning to experience uncertainty would provide a basis for assessment-intervention loops enabling machines to better support human activities. In this paper we describe efforts to train machines to recognize neural correlates of team and team member uncertainty.
Second-by-second symbolic representations of EEG power were created from each team member and quantitative estimates of their neurodynamic information were calculated from the Shannon entropy of the symbol streams. Neurodynamic information was isolated from thirty-one 70-127s segments where speech indicated surprise or uncertainty by team members. The first 70s of these segments were classified by self-organizing artificial neural networks to provide profiles of the onset of uncertainty.
The thirty-one segments were classified into six artificial neural network categories based on dynamic profiles and the levels of neurodynamic information. The categories were sufficiently distinct to suggest that alternative forms of feedback could be developed for each category.
The results suggest that computer machines can be taught to recognize the onset, and possibly predict the duration of uncertainty in humans performing complex tasks. The ability of machines to recognize neurodynamic correlates of uncertainty provide the potential for developing real-time feedback and scaffolding for teams and team members performing in complex task environments.
For more information Email: Info@TeamNeuroDynamics.com
JOURNAL OF SURGICAL EDUCATION
Analysis of Mirrored Psychophysiological Change of Cardiac Surgery Team Members During Open Surgery
Lauren Kennedy-Metz, Roger Dias, Ronald H. Stevens, Steven Yule and Marco Zenati
Objective
Mirrored psychophysiological change in cognitive workload indices may reflect shared mental models and effective healthcare team dynamics. In this exploratory analysis, we investigated the frequency of mirrored changes, defined as concurrent peaks in heart rate variability (HRV) across team members, during cardiac surgery.
Design
Objective cognitive workload was evaluated via HRV collected from the primary surgical team during cardiac surgery cases (N = 15). Root mean square of the successive differences (RMSSD) was calculated as the primary HRV measure. Procedures were divided into consecutive nonoverlapping 5-minute segments, and RMSSD along with deviations from RMSSD were calculated for each segment. Segments with positive deflections represent above-average cognitive workload. Positive deflections and peaks across dyads within the same segment were counted.
Setting
Data collection for this study took place in the cardiovascular operating room during live surgeries.
Participants
Physiological data were collected and analyzed from the attending surgeon, attending anesthesiologist, and primary perfusionist involved with the recorded cases.
Results
Of the 641 five-minute segments analyzed, 325 (50.7%) were positive deflections above average, concurrently across at least 2 team members. Within the 325 positive deflections, 26 (8%) represented concurrent peaks in HRV across at least 2 active team members. Mirrored peaks across team members were observed most commonly during the coronary anastomoses or valve replacement phase (N = 12).
Conclusions
In this pilot study, mirrored physiological responses representing peaks in cognitive workload were observed uncommonly across dyads of cardiac surgery team members (1.73 peaks/case on average). Almost half of these occurred during the most technically demanding phases of cardiac surgery, which may underpin teamwork quality. Future work should investigate interactions between technical and nontechnical performance surrounding times of mirrored peaks and expand the sample size.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS SOCIETY
The Gap Between The Micro And Macro Scales of Teamwork is Spanned By Neural Information But Not Neural Band Power
Ronald H. Stevens and Trysha L. Galloway
Abstract
One of the more intriguing questions about teamwork is how macro-scale behaviors arise from the micro-scale neural dynamics of each team member. In this paper we show that the low-level dynamics of EEG band power, which themselves link poorly with behavioral teamwork measures can be transformed into information-based units of neurodynamic organization that link with macro-level constructs like experience and uncertainty. We suggest it is the frequency, magnitude and durations of the temporal organizations within the EEG band power that are important for linking to macro behaviors, and not exclusively EEG power levels. These studies provide an avenue for understanding how complex organizations arise from the dynamics of underlying micro-scale variables. The study also has practical implications for how micro-scale variables might be better represented, both conceptually and in terms of parsimony, for training machines to recognize human behaviors that span scales of teamwork
For more information Email: Info@TeamNeuroDynamics.com
FRONTIERS IN SYSTEMS NEUROSCIENCE
Parsing Neurodynamic Information Streams to Estimate the Frequency, Magnitude and Duration of Team Uncertainty
Ronald H. Stevens and Trysha L. Galloway
Abstract
Neurodynamic organizations are information-based abstractions, expressed in bits, of the structure of long duration EEG amplitude levels. Neurodynamic information (NI, the variable of neurodynamic organization) is thought to continually accumulate as EEG amplitudes cycle through periods of persistent activation and deactivation in response to the activities and uncertainties of teamwork. Here we show that (1) Neurodynamic information levels were a better predictor of uncertainty and novice and expert behaviors than were the EEG power levels from which NI was derived. (2) Spatial and temporal parsing of team NI from experienced submarine navigation and healthcare teams showed that it was composed of discrete peaks with durations up to 20–60 s, and identified the involvement of activated delta waves when precise motor control was needed. (3) The relationship between NI and EEG power was complex varying by brain regions, EEG frequencies, and global vs. local brain interactions. The presence of an organizational system of information that parallels the amplitude of EEG rhythms is important as it provides a greatly reduced data dimension while retaining the essential system features, i.e., linkages to higher scale behaviors that span temporal and spatial scales of teamwork. In this way the combinatorial explosion of EEG rhythmic variables at micro levels become compressed into an intermediate system of information and organization which links to macro-scale team and team member behaviors. These studies provide an avenue for understanding how complex organizations arise from the dynamics of underlying micro-scale variables. The study also has practical implications for how micro-scale variables might be better represented, both conceptually and in terms of parsimony, for training machines to recognize human behaviors that span scales of teams.
For more information Email: Info@TeamNeuroDynamics.com
The Journal of Defense Modeling and Simulation
Can Machine Learning be Used to Forecast the Future Uncertainty of Military Teams?
Ronald H. Stevens and Trysha L. Galloway
Abstract
Uncertainty is a fundamental property of neural computation that becomes amplified when sensory information does not match a person’s expectations of the world. Uncertainty and hesitation are often early indicators of potential disruption, and the ability to rapidly measure uncertainty would have implications for future educational and training efforts by targeting reflective discussions about past actions, supporting in-progress corrections, and generating forecasts about future disruptions.
An approach is described combining neurodynamics and machine learning to provide quantitative measures of uncertainty. Models of neurodynamic information derived from electroencephalogram (EEG) brainwaves have provided detailed neurodynamic histories of US Navy submarine navigation team members. Persistent periods (25–30 s) of neurodynamic information were seen as discrete peaks when establishing the submarine’s position and were identified as periods of uncertainty by an artificial intelligence (AI) system previously trained to recognize the frequency, magnitude, and duration of different patterns of uncertainty in healthcare and student teams. Transition matrices of neural network states closely predicted the future uncertainty of the navigation team during the three minutes prior to a grounding event.
These studies suggest that the dynamics of uncertainty may have common characteristics across teams and tasks and that forecasts of their short-term evolution can be estimated.
For more information Email: Info@TeamNeuroDynamics.com
FRONTIERS IN HUMAN NEUROSCIENCE
Exploring how healthcare teams balance the neurodynamics of autonomous and collaborative behaviors: a proof of concept
Ronald H. Stevens and Trysha L. Galloway
Abstract
Team members co-regulate their activities and move together at the collective level of behavior while coordinating their actions toward shared goals. In parallel with team processes, team members need to resolve uncertainties arising from the changing task and environment. In this exploratory study we have measured the differential neurodynamics of seven two-person healthcare teams across time and brain regions during autonomous (taskwork) and collaborative (teamwork) segments of simulation training. The questions posed were: (1) whether these abstract and mostly integrated constructs could be separated neurodynamically; and, (2) what could be learned about taskwork and teamwork by trying to do so? The taskwork and teamwork frameworks used were Neurodynamic Information (NI), an electroencephalography (EEG) derived measure shown to be a neurodynamic proxy for the pauses and hesitations associated with individual uncertainty, and inter-brain EEG coherence (IBC) which is a required component of social interactions. No interdependency was observed between NI and IBC, and second-by-second dynamic comparisons suggested mutual exclusivity. These studies show that proxies for fundamental properties of teamwork and taskwork can be separated neurodynamically during team performances of ecologically valid tasks. The persistent expression of NI and IBC were not simultaneous suggesting that it may be difficult for team members to maintain inter-brain coherence while simultaneously reducing their individual uncertainties. Lastly, these separate dynamics occur over time frames of 15–30 s providing time for real-time detection and mitigation of individual and collaborative complications during training or live patient encounter.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS
Team Members Show Decreased Inter-brain Coupling When Resolving Uncertainty
Ronald H. Stevens and Trysha L. Galloway
Abstract
Team members regulate their activities and move together at the collective level of behavior while coordinating their actions toward shared goals. In parallel with team processes, team members need to resolve uncertainties arising from their changing task work and a shifting environment. We explored the neurodynamic tension between resolving individual uncertainty and participating in collaborative processes during high fidelity team training.
Electroencephalography (EEG) was collected from five two-person medical flight teams and following pre-processing to remove non-brain signals, the inter-brain coherence (IBC) were estimated by wavelet coherence and compared with the neurodynamic information (NI) of each individual, a measure that maps closely with human uncertainty.
Analysis of the second-by-second IBC and NI showed that the expressions of NI and IBC were not simultaneous and may be mutually exclusive, suggesting that the factors elevating and resolving NI levels are single person processes and that it may be difficult for team members to maintain IBC while reducing their uncertainties. Although preliminary, these studies provide a first step towards neurodynamically quantifying and modifying teamwork and task work processes.
For more information Email: Info@TeamNeuroDynamics.com
DESIGN RECOMMENDATIONS FOR INTELLIGENT TUTORING SYSTEMS
VISUALIZING THE MOMENTARY NEURODYNAMICS OF TEAM UNCERTAINTY
Ron Stevens, Ryan Mullins, Xiangen Hu, Diego Zapata-Rivera and Trysha Galloway
Abstract
Every human decision, whether conscious or not, has its origins in uncertainty. Quantitatively, uncertainty has many definitions, as a property of information, as a property of cognitive processes, or as a property of the electrochemical interactions of neurons. Operationally, uncertainty inhibits a decision-maker’s ability to distinguish between and select options.
There is a rich history of using visualization techniques to represent uncertainty in various fields. These include literature reviews on visualization techniques for uncertainty, frameworks for understanding and evaluating the use of these visualization techniques on affecting human behavior, and work on depicting and supporting teachers’ understanding measuring error.
This work has sought to depict the characteristics of uncertainty such that decision-makers are able to effectively and efficiently compare alternatives. Some examples include the cone of uncertainty, quantile dot plots, and bivariate classification. These visualization techniques have mostly been static, and the temporal resolution of the uncertainty was seldom seen as being mission critical. The emerging use of heart rate and neurophysiologic sensors during surgery points to the need for more dynamic representations of uncertainty to match the speeds of real-time environments.
Functionally, uncertainty arises when outcomes do not match our expectations. At the millisecond level this occurs all the time as we make small adjustments to our fingers when typing or to our eyes as we scan text, but most of the time these small adjustments go unnoticed. More complex decisions like those of a surgeon require more cognitive activity than rapid implicit responses.
As the hierarchy of uncertainty is ascended from the neuronal level, the multiple dimensions of its effects begin to be seen. When it becomes observable and can be deliberately acted on, it is termed hesitation; hesitation is thinking about what you do with uncertainty. While the hesitation to shoot of law enforcement agents, i.e. cautious hesitation, is perhaps the most visible example of controlled uncertainty, hesitation can be experienced anytime there is uncertainty.
While uncertainty might be observed as a pause, it is not always clear what this pause might mean. For instance, hesitation in surgical residents might manifest during operations as a pause while they try to search for more information, or as they try to disguise their uncertainty and hesitation in fear of looking incompetent. Expert surgeons experiencing uncertainty might deliberately pause while they ‘slow the pace down’ as part of reflective awareness, while novices might freeze or lose interest. In the extreme, chronic uncertainty may evolve into the disease entity anxiety.
These data point to the hierarchical structure of the brain, decision making, and uncertainty. If uncertainty cannot be resolved at a particular (temporal and spatial) level(s) of the brain, the prediction errors drive the adjustment of the mental models or sensory inputs to higher levels by drawing on more complex representations of environmental states and richer cognitive models. This allows access to, and accumulation of, a broader range of evidence over extended temporal scales to find the best explanation for the evidence. Engaging each additional level, however, incurs a ‘cost of control’ and is equivalent to inference under a more complex model or a model that includes more variables.
Despite its ubiquity and our ability to define it, uncertainty has been difficult to track during real-world teamwork. This is due, in part, to uncertainty being based on each person’s perceptions where sensory information is organized, identified, and interpreted to represent and understand the environment; what might be highly uncertain for one individual may be unimportant or not even perceived by another. Perceptions are intangible and personal but the neurodynamics of uncertainty that is raised by them will involve some form of persistent mental states where evidence is weighed, and mental models refined; these persistent states are signs of uncertainty.
We have been refining EEG-based analytics for the spatial and temporal characterization of neurodynamic organizations that parallel periods of team uncertainty. Of the myriad of time frames between the implicit firing of neurons and periods of anxiety we have chosen to develop solutions for quantitatively measuring uncertainty on a second-by-second basis using 60s moving average windows. This time frame is greater than the 100-300 ms neurodynamics associated with everyday processes like conversations and non-verbal interactions, and is optimized to identify periods of persistent uncertainty that could be mitigated if detected early.
These persistent neurodynamic states, which are close proxies for situational and verbal uncertainty, are present in team members as well as teams. They occur during submarine navigation and healthcare training and are also present during live patient surgery. They can be quantitatively reported as brain-wide averages and used for comparing across individuals, teams, or training proto-cols, and systematically mapped to different brain regions and frequencies to identify cognitive elements involved in resolving the uncertainty.
In this chapter we provide a hierarchical framework for visualizing neurodynamic uncertainty to determine what might make sense to instructors and teams in terms of actionable understanding of the frequency, magnitude, and duration of uncertainty, and what this might mean for training and theory.
For more information Email: Info@TeamNeuroDynamics.com
HUMAN FACTORS AND ERGONOMICS IN HEALTH CARE
Let’s pause for a second: Neurodynamic evidence for rapid and coordinated team pauses during simulated patient encounters.
Ronald H. Stevens and Trysha L. Galloway
Abstract
In this study we explored neurodynamic candidates for coordinated periods of wakeful rest across team members while they performed healthcare simulations. Wakeful rest occurs sporadically when a person pauses task-related behavior at goal areas or choice points and is thought to be associated with memory replay. Analysis of the second-by-second EEG-derived neurodynamics of Emergency Medical Flight dyads identified periods of inter-brain coordination that surrounded periods of individual team member uncertainty but were negatively correlated with them (r = -.3 to - .81). The brain region expression and inter-brain network connectivity of the shared information had properties consistent with the default mode network (DMN), an important effector of wakeful rest in animals and humans. This shared information was present in the 70-110 Hz electroencephalogram (EEG) spectrum which may represent bursts of memory replay. Going forward, our hypothesis is that these periods of wakeful rest (pauses) associated with increased inter-brain coordination may represent self-imposed or opportunistic ‘time-outs’ for team members to ‘gather their thoughts’ and mentally replay recent events before mentally projecting their plans forward.
For more information Email: Info@TeamNeuroDynamics.com