Doctor of Philosophy, The Ohio State University, 2015, Electrical and Computer Engineering
American Sign Language (ASL) is a multichannel communication system that involves manual components such as hand-shape and movement, and nonmanual components as body posture, head motion and facial expressions. While significant progress has been made to understand the features defining ASL manuals, after years of research, much still needs to be done to understand its nonmanual components. ASL nonmanual linguistic research has been typically addressed by manually annotating facial events (e.g., brow raising, mouth opening, among others), and comparing the frequency of such events to find some grammatical clues about a given event in a sentence or as linguist called them construction. This tedious process is difficult to scale, especially when the number of facial events and the number of samples grow. Additionally, another major obstacle to achieve this goal is the difficulty in finding correlations between facial features and linguistic features, especially since these correlations may be temporally defined. For example, a facial feature (e.g., head moves down) occurring at the end of the movement of another facial feature (e.g., brows moves up), may specify a Hypothetical conditional, but only if this time relationship is maintained. It is however unknown for many grammatical constructions the facial features that define these dynamical facial expressions of grammar. In this work, we introduce a computational approach to efficiently carry out analysis of nonmanuals. First, a computational linguistic model of the face is defined to characterize the basic components used in ASL facial and head nonmanuals. Our results verify several components of the standard model of ASL nonmanuals and, most importantly, identify several previously unreported features and their temporal relationship. Notably, our results uncovered a complex interaction between head position and mouth shape. These findings define some temporal structures of ASL nonmanuals not previously identified b (open full item for complete abstract)
Committee: Aleix Martinez (Advisor); Kevin Passino (Committee Member); Yuan Zheng (Committee Member)
Subjects: Computer Science; Electrical Engineering; Linguistics