GOMEZ, David; DONGO, Irvin; COUTURE, Nadine

doi:10.5281/zenodo.3672866

ESTIA - Institute of technology [ESTIA]

DONGO, Irvin
ESTIA - Institute of technology [ESTIA]

COUTURE, Nadine

ESTIA - Institute of technology [ESTIA]

Langue

Communication dans un congrès

Ce document a été publié dans

Proceedings of the International Conference on New Interfaces for Musical Expression, NIME 2019 - The International Conference on New Interfaces for Musical Expression, 2019-06-03, Porto Alegre. 2019p. 59-64

Résumé en anglais

This work aims to explore the use of a new gesture-based interaction built on automatic recognition of Soundpainting structured gestural language. In the proposed approach, a composer (called Soundpainter) performs Soundpainting gestures facing a Kinect sensor (Microsoft). Then, a gesture recognition system captures gestures that are sent to a sound generator software. The proposed method was used to stage an artistic show in which a Soundpainter had to improvise with 6 different gestures to generate a musical composition from different sounds in real time. The accuracy of the gesture recognition system was evaluated as well as Soundpainter's user experience. In addition, a user evaluation study for using our proposed system in a learning context was also conducted. Current results open up perspectives for the design of new artistic expressions based on the use of automatic gestural recognition supported by Soundpainting language.< Réduire

Mots clés en anglais

Interactive system

Gesture recognition

Smart and Empowering Interfaces

Soundpainting

Music

URI

https://oskar-bordeaux.fr/handle/20.500.12278/173165

DOI

http://dx.doi.org/10.5281/zenodo.3672866

Unités de recherche

ESTIA - Recherche

Voir/Ouvrir

Métadonnées

Partager cette publication !

Licence d’utilisation du document

Automatic recognition of Soundpainting for the Generation of Electronic Music Sounds

Langue

Ce document a été publié dans

Résumé en anglais

Mots clés en anglais

URI

DOI

Unités de recherche