Afficher la notice abrégée

Multimodal Indices To Japanese And French Prosodically Expressed Social Affects

hal.structure.identifierLaboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
dc.contributor.authorRILLIARD, Albert
hal.structure.identifierKumamoto University
dc.contributor.authorSHOCHI, Takaaki
hal.structure.identifierLaboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur [LIMSI]
dc.contributor.authorMARTIN, Jean-Claude
hal.structure.identifierShowa Music University
dc.contributor.authorERICKSON, Donna
hal.structure.identifierGIPSA - Systèmes Linguistiques et Dialectologie [GIPSA-SLD]
dc.contributor.authorAUBERGÉ, Véronique
dc.date.accessioned2022-03-07T14:29:48Z
dc.date.available2022-03-07T14:29:48Z
dc.date.issued2009
dc.identifier.issn0023-8309
dc.identifier.urihttps://oskar-bordeaux.fr/handle/20.500.12278/130193
dc.description.abstractEnWhereas several studies have explored the expression of emotions, little is known on how the visual and audio channels are combined during production of what we call the more controlled social affects, for example, “attitudinal” expressions. This article presents a perception study of the audovisual expression of 12 Japanese and 6 French attitudes in order to understand the contribution of audio and visual modalities for affective communication. The relative importance of each modality in the perceptual decoding of the expressions of four speakers is analyzed as a first step towards a deeper comprehension of their influence on the expression of social affects. Then, the audovisual productions of two speakers (one for each language) are acoustically (F0, duration and intensity) and visually (in terms of Action Units) analyzed, in order to match the relation between objective parameters and listeners' perception of these social affects. The most pertinent objective features, either acoustic or visual, are then discussed, in a bilingual perspective: for example, the relative influence of fundamental frequency for attitudinal expression in both languages is discussed, and the importance of a certain aspect of the voice quality dimension in Japanese is underlined.
dc.language.isoen
dc.publisherSAGE Publications (UK and US)
dc.title.enMultimodal Indices To Japanese And French Prosodically Expressed Social Affects
dc.typeArticle de revue
dc.identifier.doi10.1177/0023830909103171
dc.subject.halSciences de l'Homme et Société/Linguistique
dc.subject.halSciences cognitives/Linguistique
dc.subject.halInformatique [cs]/Informatique et langage [cs.CL]
bordeaux.journalLanguage and Speech
bordeaux.page223-243
bordeaux.volume52
bordeaux.hal.laboratoriesCLLE Montaigne : Cognition, langues, Langages, Ergonomie - UMR 5263*
bordeaux.issue2&3
bordeaux.institutionUniversité Bordeaux Montaigne
bordeaux.peerReviewedoui
hal.identifierhal-00444381
hal.version1
dc.subject.esPerception
dc.subject.esFrench
dc.subject.esJapanese
dc.subject.esaudio-visual prosody
dc.subject.esattitudes
hal.origin.linkhttps://hal.archives-ouvertes.fr//hal-00444381v1
bordeaux.COinSctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=Language%20and%20Speech&rft.date=2009&rft.volume=52&rft.issue=2&3&rft.spage=223-243&rft.epage=223-243&rft.eissn=0023-8309&rft.issn=0023-8309&rft.au=RILLIARD,%20Albert&SHOCHI,%20Takaaki&MARTIN,%20Jean-Claude&ERICKSON,%20Donna&AUBERG%C3%89,%20V%C3%A9ronique&rft.genre=article


Fichier(s) constituant ce document

FichiersTailleFormatVue

Il n'y a pas de fichiers associés à ce document.

Ce document figure dans la(les) collection(s) suivante(s)

Afficher la notice abrégée