Multimodal Indices To Japanese And French Prosodically Expressed Social Affects
RILLIARD, Albert
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
MARTIN, Jean-Claude
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
Leer más >
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
RILLIARD, Albert
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
MARTIN, Jean-Claude
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
< Leer menos
Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
Idioma
en
Article de revue
Este ítem está publicado en
Language and Speech. 2009, vol. 52, n° 2&3, p. 223-243
SAGE Publications (UK and US)
Resumen en inglés
Whereas several studies have explored the expression of emotions, little is known on how the visual and audio channels are combined during production of what we call the more controlled social affects, for example, ...Leer más >
Whereas several studies have explored the expression of emotions, little is known on how the visual and audio channels are combined during production of what we call the more controlled social affects, for example, “attitudinal” expressions. This article presents a perception study of the audovisual expression of 12 Japanese and 6 French attitudes in order to understand the contribution of audio and visual modalities for affective communication. The relative importance of each modality in the perceptual decoding of the expressions of four speakers is analyzed as a first step towards a deeper comprehension of their influence on the expression of social affects. Then, the audovisual productions of two speakers (one for each language) are acoustically (F0, duration and intensity) and visually (in terms of Action Units) analyzed, in order to match the relation between objective parameters and listeners' perception of these social affects. The most pertinent objective features, either acoustic or visual, are then discussed, in a bilingual perspective: for example, the relative influence of fundamental frequency for attitudinal expression in both languages is discussed, and the importance of a certain aspect of the voice quality dimension in Japanese is underlined.< Leer menos
Palabras clave en español
Perception
French
Japanese
audio-visual prosody
attitudes
Orígen
Importado de HalCentros de investigación