EMMI – Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations
| dc.rights.license | open | en_US |
| hal.structure.identifier | Institut des Systèmes Intelligents et de Robotique [ISIR] | |
| dc.contributor.author | GALLAND, Lucie | |
| hal.structure.identifier | Institut des Systèmes Intelligents et de Robotique [ISIR] | |
| dc.contributor.author | PELACHAUD, Catherine | |
| hal.structure.identifier | Sommeil, Addiction et Neuropsychiatrie [Bordeaux] [SANPSY] | |
| dc.contributor.author | PECUNE, Florian | |
| dc.date.accessioned | 2025-03-25T12:49:25Z | |
| dc.date.available | 2025-03-25T12:49:25Z | |
| dc.date.created | 2024 | |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/205663 | |
| dc.description.abstractEn | The study of multimodal interaction in therapy can yield a comprehensive understanding of therapist and patient behavior that can be used to develop a multimodal virtual agent supporting therapy. This investigation aims to uncover how therapists skillfully blend therapy's task goal (employing classical steps of Motivational Interviewing) with the social goal (building a trusting relationship and expressing empathy). Furthermore, we seek to categorize patients into various ``types'' requiring tailored therapeutic approaches. To this intent, we present multimodal annotations of a corpus consisting of simulated motivational interviewing conversations, wherein actors portray the roles of patients and therapists. We introduce EMMI, composed of two publicly available MI corpora, AnnoMI and the Motivational Interviewing Dataset, for which we add multimodal annotations. We analyze these annotations to characterize functional behavior for developing a virtual agent performing motivational interviews emphasizing social and empathic behaviors. Our analysis found three clusters of patients expressing significant differences in behavior and adaptation of the therapist's behavior to those types. This shows the importance of a therapist being able to adapt their behavior depending on the current situation within the dialog and the type of user. | |
| dc.description.sponsorship | adaPtAtion de l'iNtelligence artificielle pOur l'inteRActiOn homme-MAchine - ANR-20-IADJ-0008 | en_US |
| dc.description.sponsorship | Entrainement d'aptitudes sociales affectives personnalisées et adaptées avec des agents culturels virtuels - ANR-19-JSTS-0001 | en_US |
| dc.language.iso | EN | en_US |
| dc.subject.en | Fos: Computer And Information Sciences | |
| dc.subject.en | Computation And Language (Cs.Cl) | |
| dc.subject.en | Empathic Behaviors | |
| dc.subject.en | Motivational Interviewing | |
| dc.subject.en | Multimodal Behaviors | |
| dc.title.en | EMMI – Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations | |
| dc.type | Document de travail - Pré-publication | en_US |
| dc.identifier.doi | 10.48550/arXiv.2406.16478 | en_US |
| dc.subject.hal | Sciences du Vivant [q-bio]/Neurosciences [q-bio.NC] | en_US |
| dc.identifier.arxiv | 2406.16478 | en_US |
| bordeaux.hal.laboratories | SANPSY (Sommeil, Addiction, Neuropsychiatrie) - UMR 6033 | en_US |
| bordeaux.institution | Université de Bordeaux | en_US |
| bordeaux.institution | CNRS | en_US |
| hal.popular | non | en_US |
| hal.audience | Internationale | en_US |
| hal.export | false | |
| dc.rights.cc | Pas de Licence CC | en_US |
| bordeaux.subtype | Prepublication/Preprint | en_US |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.au=GALLAND,%20Lucie&PELACHAUD,%20Catherine&PECUNE,%20Florian&rft.genre=preprint |