Hostname: page-component-84b7d79bbc-2l2gl Total loading time: 0 Render date: 2024-07-30T16:09:03.337Z Has data issue: false hasContentIssue false

Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces

Published online by Cambridge University Press:  17 January 2003

D. Arfib
Affiliation:
Laboratoire de Mécanique et d'Acoustique (LMA), CNRS, 31 chemin Joseph Aiguier, 13402 Marseille, Cedex 20, France E-mail: arfib@lma.cnrs-mrs.fr, couturier@lma.cnrs-mrs.fr, kessous@lma.cnrs-mrs.fr, verfaille@lma.cnrs-mrs.fr
J. M. Couturier
Affiliation:
Laboratoire de Mécanique et d'Acoustique (LMA), CNRS, 31 chemin Joseph Aiguier, 13402 Marseille, Cedex 20, France E-mail: arfib@lma.cnrs-mrs.fr, couturier@lma.cnrs-mrs.fr, kessous@lma.cnrs-mrs.fr, verfaille@lma.cnrs-mrs.fr
L. Kessous
Affiliation:
Laboratoire de Mécanique et d'Acoustique (LMA), CNRS, 31 chemin Joseph Aiguier, 13402 Marseille, Cedex 20, France E-mail: arfib@lma.cnrs-mrs.fr, couturier@lma.cnrs-mrs.fr, kessous@lma.cnrs-mrs.fr, verfaille@lma.cnrs-mrs.fr
V. Verfaille
Affiliation:
Laboratoire de Mécanique et d'Acoustique (LMA), CNRS, 31 chemin Joseph Aiguier, 13402 Marseille, Cedex 20, France E-mail: arfib@lma.cnrs-mrs.fr, couturier@lma.cnrs-mrs.fr, kessous@lma.cnrs-mrs.fr, verfaille@lma.cnrs-mrs.fr

Abstract

This paper is about mapping strategies between gesture data and synthesis model parameters by means of perceptual spaces. We define three layers in the mapping chain: from gesture data to gesture perceptual space, from sound perceptual space to synthesis model parameters, and between the two perceptual spaces. This approach makes the implementation highly modular. Both perceptual spaces are developed and depicted with their features. To get a simple mapping between the gesture perceptual subspace and the sound perceptual subspace, we need to focus our attention on the two other mappings. We explain the mapping types: explicit/implicit, static/dynamic. We also present the technical and aesthetical limits introduced by mapping. Some practical examples are given of the use of perceptual spaces in experiments done at LMA in a musical context. Finally, we discuss several implications of the mapping strategies: the influence of chosen mapping limits onto performers' virtuosity, and the incidence of mapping on the learning process with virtual instruments and on improvisation possibilities.

Type
Research Article
Copyright
© 2002 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)