CLAY, Alexis; COUTURE, Nadine; DECARSIN, Elodie; DESAINTE-CATHERINE, Myriam; VULLIARD, Pierre Henri; LARRALDE, Joseph

Voir/Ouvrir

MovementToEmotionsToMusicForHAL.pdf (661.4Ko)

Métadonnées

Afficher la notice complète

Licence d’utilisation du document

CLAY, Alexis
ESTIA INSTITUTE OF TECHNOLOGY

COUTURE, Nadine

ESTIA INSTITUTE OF TECHNOLOGY

DECARSIN, Elodie
ESTIA INSTITUTE OF TECHNOLOGY

Langue

Communication dans un congrès

Ce document a été publié dans

Proceedings of the 12th International Conference on New Interfaces for Musical Expression (NIME'12), New Interfaces for Musical Expression, 2012-05-21, Ann Arbor. 2012-05-21

Résumé en anglais

The augmented ballet project aims at gathering research from several fields and directing them towards a same application case: adding virtual elements (visual and acoustic) to a dance live performance, and allowing the dancer to interact with them. In this paper, we describe a novel interaction that we used in the frame of this project: using the dancer's movements to recognize the emotions he expresses, and use these emotions to generate musical audio flows evolving in real-time. The originality of this interaction is threefold. First, it covers the whole interaction cycle from the input (the dancer's movements) to the output (the generated music). Second, this interaction isn't direct but goes through a high level of abstraction: dancer's emotional expression is recognized and is the source of music generation. Third, this interaction has been designed and validated through constant collaboration with a choreographer, culminating in an augmented ballet performance in front of a live audience.< Réduire

Mots clés en anglais

Interactive sonification

motion

gesture and music

interaction

live performance

musical human-computer interaction

URI

https://oskar-bordeaux.fr/handle/20.500.12278/204043

Project ANR

Cultural experience: Augmented Reality and Emotion - ANR-07-RIAM-0002

Unités de recherche

ESTIA - Recherche