Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Hamada_Dissertation_Final.pdf (692.53 KB)

Digital Accessibility Report

File List


Dissertation_Final.pdf.accreport.html (7.86 KB)

ETD Abstract Container

Abstract Header

USING EYE TRACKING AND PUPILLOMETRY TO UNDERSTAND THE IMPACT OF AUDITORY AND VISUAL NOISE ON SPEECH PERCEPTION

Alzoubi, Hamada
http://rave.ohiolink.edu/etdc/view?acc_num=kent1690427789768385

Abstract Details

2023, PHD, Kent State University, College of Education, Health and Human Services / School of Health Sciences.
Although speech recognition is often experienced as relatively effortless, there are a number of common challenges that can make speech perception more difficult and may greatly impact speech intelligibility (e.g., environmental noise). However, there is some indication that visual cues can be also used to improve speech recognition (Baratchu et al., 2008) — especially when the visual information is congruent with the speech signal (e.g., talking faces; Massaro, 2002). However, it is less clear how noisy visual environments may impact speech perception when the visual signal is not congruous with the speech signal. In fact, adding incongruous visual information will likely detract precious cognitive resources away from the auditory process, making speech perception in noise a more cognitively difficult task. Therefore, the purpose of this dissertation was to examine cognitive processing effort by measuring changes in pupillary response during the processing of speech in noise paired with incongruous visual noise. The primary hypothesis was that noisy visual information would negatively impact the processing of speech in noisy environments and that would result in a greater pupil diameter. To test this I used a common eye-tracking measure (i.e., pupillometry) to assess the cognitive processing effort needed to process speech in the presence of congruent and incongruous visual noise. The results indicated that visual noise recruits cognitive processing effort away from the auditory signal. Results also indicated that different combinations of auditory and visual noise have a significant impact on cognitive processing effort, which led to an increase in pupil dilation response during speech perception.
JENNIFER ROCHE (Advisor)
BRADLEY MORRIS (Committee Member)
BRUNA MUSSOI (Committee Member)
JOCELYN FOLK (Other)
79 p.
Audiology; Cognitive Psychology; Neurosciences
Scene Perception, Pupillometry, Speech Perception, Neuroscience, Eye-tracking, Multimodality

Recommended Citations

Citations

  • Alzoubi, H. (2023). USING EYE TRACKING AND PUPILLOMETRY TO UNDERSTAND THE IMPACT OF AUDITORY AND VISUAL NOISE ON SPEECH PERCEPTION [Doctoral dissertation, Kent State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=kent1690427789768385

    APA Style (7th edition)

  • Alzoubi, Hamada. USING EYE TRACKING AND PUPILLOMETRY TO UNDERSTAND THE IMPACT OF AUDITORY AND VISUAL NOISE ON SPEECH PERCEPTION . 2023. Kent State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=kent1690427789768385.

    MLA Style (8th edition)

  • Alzoubi, Hamada. "USING EYE TRACKING AND PUPILLOMETRY TO UNDERSTAND THE IMPACT OF AUDITORY AND VISUAL NOISE ON SPEECH PERCEPTION ." Doctoral dissertation, Kent State University, 2023. http://rave.ohiolink.edu/etdc/view?acc_num=kent1690427789768385

    Chicago Manual of Style (17th edition)

kent1690427789768385
257
© 2023, all rights reserved.
This open access ETD is published by Kent State University and OhioLINK.