RILLIARD, Albert; SHOCHI, Takaaki; MARTIN, Jean-Claude; ERICKSON, Donna; AUBERGÉ, Véronique

doi:10.1177/0023830909103171

Métadonnées

Afficher la notice complète

Licence d’utilisation du document

RILLIARD, Albert
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]

SHOCHI, Takaaki
Kumamoto University

MARTIN, Jean-Claude
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]

Langue

Article de revue

Ce document a été publié dans

Language and Speech. 2009, vol. 52, n° 2&3, p. 223-243

SAGE Publications (UK and US)

Résumé en anglais

Whereas several studies have explored the expression of emotions, little is known on how the visual and audio channels are combined during production of what we call the more controlled social affects, for example, “attitudinal” expressions. This article presents a perception study of the audovisual expression of 12 Japanese and 6 French attitudes in order to understand the contribution of audio and visual modalities for affective communication. The relative importance of each modality in the perceptual decoding of the expressions of four speakers is analyzed as a first step towards a deeper comprehension of their influence on the expression of social affects. Then, the audovisual productions of two speakers (one for each language) are acoustically (F0, duration and intensity) and visually (in terms of Action Units) analyzed, in order to match the relation between objective parameters and listeners' perception of these social affects. The most pertinent objective features, either acoustic or visual, are then discussed, in a bilingual perspective: for example, the relative influence of fundamental frequency for attitudinal expression in both languages is discussed, and the importance of a certain aspect of the voice quality dimension in Japanese is underlined.< Réduire

Mots clés en espagnol

Perception

French

Japanese

audio-visual prosody

attitudes

Métadonnées

Partager cette publication !

Licence d’utilisation du document

Multimodal Indices To Japanese And French Prosodically Expressed Social Affects

Langue

Ce document a été publié dans

Résumé en anglais

Mots clés en espagnol

URI

DOI

Origine

Unités de recherche