Master of Science, University of Akron, 2018, Computer Science

Human-Computer Interaction (HCI) is the study that focuses on implementing technology enabling a means for humans to interact with computers. The primary goal of HCI is to create a seamless, effective interaction experience. For the past decades, HCI has evolved from Command Line Interaction (CLI) to Graphical User Interface (GUI). Recently, however, Natural User Interface (NUI) technologies have been introduced and there has been a movement to evolve toward these technologies. NUI allows users to interact with the computer in natural ways. Examples of NUI include using gestures or voice commands. One challenge that exists is the method in which a person can control computing devices effectively with NUI. The goal of this thesis is to design and implement a system to evaluate the performance of NUI solutions and compare it with that of CLI and GUI solutions. The focal point of this thesis creates a system that allows users to interact with and control different features of computing devices by using hand gestures. The underlying technologies of the implemented gesture-based solutions include Kinect and LeapMotion. A group of testers were asked to use this system with the goal of controlling computers and video games using NUI devices. The same group of testers were then asked to control computers and video games using a mouse. The response time and accuracy of operations using the two interaction methods were compared against each other. Our study shows that users can operate NUI with better ease and efficiency than the compared alternative mouse solution. We found that users who play a game yield 4% higher score while using gesture-based interaction with Kinect than with the mouse. Additionally, users who have minimal computing device knowledge score much better with the NUI devices than with a mouse. This study further illustrates the benefits of LeapMotion and Kinect gesture-based interaction solutions when compared to GUI-based interacti (open full item for complete abstract)

Committee: Xiao Yingcai Dr (Advisor); Duan Zhong-Hui Dr (Committee Member); Cheng En Dr (Committee Member) Subjects: Computer Science; Information Technology