Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Jaelyn_Johnson_Thesis.pdf (14.61 MB)

ETD Abstract Container

Abstract Header

Big Brother Meets the Wizard of Oz: The Unlikely Pair that Revealed Insights into Human-Machine Teaming Effectiveness in the Presence of Mismatches

Johnson, Jaelyn A
http://orcid.org/0000-0003-4886-5815
http://rave.ohiolink.edu/etdc/view?acc_num=osu1669893915933584

Abstract Details

2022, Master of Science, Ohio State University, Industrial and Systems Engineering.
Decades of cognitive systems engineering research has revealed that implementing human-machine teams into complex environments can consequently result in challenges that negatively impact human-machine teams. Such challenges and conflicts amongst team members can readily be observed in human-machine teams where agents are assigned heterogeneous tasks because the agents’ individual goals may have a tendency to conflict and compete with one another in their shared environment. This conflict may also be magnified if the agents of our heterogeneously tasked human-machine team do not share a common goal and are not equipped with the resources to manage their differences. In our study, we set out to determine how the performance of our heterogeneously tasked agents in our simulated human-machine team was impacted in our full-motion video and intelligence analysis. By using joint-performance activity graphs, various statistical analyses, constant comparative analysis, and human-machine teaming heuristic analysis, we were able to determine that the performance of our human-machine team was not significantly different from the performance of our participants who worked alone. This led us to the conclusion that the machine agent insufficiently aided their human agent’s decision making during the full motion video analysis and the design of the machine failed to adhere to known Human-Machine Teaming heuristics. Lastly, this holistic analysis revealed that the machine agent acted as if it did not have any knowledge of the ultimate goal of their human agent, and due to its limited capabilities, the machine was unable to contribute information in relation to the overarching goal. Even though the architecture of the human-machine team in this study failed to adhere to various human-machine teaming heuristics, failing to adhere to and implement the team so that both the agents’ individual tasks meaningfully contributed the shared goal was determined to be the most critical violation because this heuristic would have ensured that our agents’ efforts aligned with one another. Therefore, when designing human-machine teams whose agents are assigned heterogeneous tasks, it is critical to ensure that the agents maintain a shared goal.
Michael Rayo (Advisor)
Samantha Krening (Committee Member)
Michael Rayo (Committee Member)
93 p.
Design; Engineering; Industrial Engineering; Systems Science
human-machine teaming; heterogeneous tasking; human factors; human machine teaming design; study design; usability study; intelligence analysis; joint-activity; joint-performance; autonomous systems; human-computer interaction; cognitive systems engineering

Recommended Citations

Citations

  • Johnson, J. A. (2022). Big Brother Meets the Wizard of Oz: The Unlikely Pair that Revealed Insights into Human-Machine Teaming Effectiveness in the Presence of Mismatches [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1669893915933584

    APA Style (7th edition)

  • Johnson, Jaelyn. Big Brother Meets the Wizard of Oz: The Unlikely Pair that Revealed Insights into Human-Machine Teaming Effectiveness in the Presence of Mismatches. 2022. Ohio State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1669893915933584.

    MLA Style (8th edition)

  • Johnson, Jaelyn. "Big Brother Meets the Wizard of Oz: The Unlikely Pair that Revealed Insights into Human-Machine Teaming Effectiveness in the Presence of Mismatches." Master's thesis, Ohio State University, 2022. http://rave.ohiolink.edu/etdc/view?acc_num=osu1669893915933584

    Chicago Manual of Style (17th edition)

osu1669893915933584
88
© 2022, all rights reserved.
This open access ETD is published by The Ohio State University and OhioLINK.