Asymmetries in unimodal visual vowel perception: The roles of oral-facial kinematics, orientation, and configuration

J Exp Psychol Hum Percept Perform. 2018 Jul;44(7):1103-1118. doi: 10.1037/xhp0000518. Epub 2018 Mar 8.

Abstract

Masapollo, Polka, and Ménard (2017) recently reported a robust directional asymmetry in unimodal visual vowel perception: Adult perceivers discriminate a change from an English /u/ viseme to a French /u/ viseme significantly better than a change in the reverse direction. This asymmetry replicates a frequent pattern found in unimodal auditory vowel perception that points to a universal bias favoring more extreme vocalic articulations, which lead to acoustic signals with increased formant convergence. In the present article, the authors report 5 experiments designed to investigate whether this asymmetry in the visual realm reflects a speech-specific or general processing bias. They successfully replicated the directional effect using Masapollo et al.'s dynamically articulating faces but failed to replicate the effect when the faces were shown under static conditions. Asymmetries also emerged during discrimination of canonically oriented point-light stimuli that retained the kinematics and configuration of the articulating mouth. In contrast, no asymmetries emerged during discrimination of rotated point-light stimuli or Lissajou patterns that retained the kinematics, but not the canonical orientation or spatial configuration, of the labial gestures. These findings suggest that the perceptual processes underlying asymmetries in unimodal visual vowel discrimination are sensitive to speech-specific motion and configural properties and raise foundational questions concerning the role of specialized and general processes in vowel perception. (PsycINFO Database Record

MeSH terms

  • Adult
  • Eye Movement Measurements
  • Female
  • Humans
  • Male
  • Mouth / physiology*
  • Psycholinguistics
  • Speech / physiology*
  • Speech Perception / physiology*
  • Visual Perception / physiology*
  • Young Adult