Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Watch and listen : A cross-cultural study of audio-visual-matching behavior in 4.5-month-old infants in German and Swedish talking faces

Publication

Watch and listen : A cross-cultural study of audio-visual-matching behavior in 4.5-month-old infants in German and Swedish talking faces

Dorn, Katharina; Weinert, Sabine; Falck-Ytter, Terje (2018): Watch and listen : A cross-cultural study of audio-visual-matching behavior in 4.5-month-old infants in German and Swedish talking faces, in: Infant behavior and development : an international & interdisciplinary journal, Amsterdam [u.a.]: Elsevier Science, Jg. 52, Nr. August, S. 121–129, doi: 10.1016/j.infbeh.2018.05.003.

Details

Faculty/Chair
Author
Dorn, Katharina
Falck-Ytter, Terje
Title of the Journal
Infant behavior and development : an international & interdisciplinary journal
ISSN
1934-8800
Publisher Information
Elsevier Science : Amsterdam [u.a.]
Year of publication
2018
Volume
52
Issue
August
Language
English
DOI
Abstract

Investigating infants’ ability to match visual and auditory speech segments presented sequentially allows us to understand more about the type of information they encode in each domain, as well as their ability to relate the information. One previous study found that 4.5- month-old infants’ preference for visual French or German speech depended on whether they had previously heard the respective language, suggesting a remarkable ability to encode and relate audio-visual speech cues and to use these to guide their looking behavior. However, French and German differ in their prosody, meaning that perhaps, the infants did not base their matching on phonological or phonetic cues, but on prosody patterns. The present study aimed to address this issue by tracking the eye gaze of 4.5-month-old German and Swedish infants cross-culturally in an intersensory matching procedure, comparing German and Swedish, two same-rhythm-class languages differing in phonetic and phonological attributes but not in prosody. Looking times indicated that even when distinctive prosodic cues were eliminated, 4.5- month-olds were able to extract subtle language properties and sequentially match visual and heard fluent speech. This outcome was the same for different individual speakers for the two modalities, ruling out the possibility that the infants matched speech patterns specific to one individual. This study confirms a remarkably early emerging ability of infants to match auditory and visual information. The fact that the types of information were matched despite sequential presentation demonstrates that the information is retained in short term memory, and thus goes beyond purely perceptual – here-and-now processing.

Keywords
Speech perception, Audio-visual matching, Phonological/phonetic cues, Cross-cultural study, Eye-tracking
Peer Reviewed
yes
International Distribution
yes
Type
Article
URI
Activation date
2018-08-09, 2018-08-09

Permalink: https://fis.uni-bamberg.de/handle/uniba/44279 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.