en
Scientific article
Open access
English

Expressive non-verbal interaction in a string quartet: an analysis through head movements

Published inJournal on Multimodal User Interfaces, vol. 9, no. 1, p. 55-68
Publication date2015
First online date2014-05-14
Abstract

The present study investigates expressive non-verbal interaction in the musical context starting from behavioral features extracted at individual and group levels. Four groups of features are defined, which are related to head movement and direction, and may help gaining insight on the expressivity and cohesion of the performance, discriminating between different performance conditions. Then, the features are evaluated both at a global scale and at a local scale. The findings obtained from the analysis of a string quartet recorded in an ecological setting show that using these features alone or in their combination may help in distinguishing between two types of performance: (a) a concert-like condition, where all musicians aim at performing at best, (b) a perturbed one, where the 1st violinist devises alternative interpretations of the music score without discussing them with the other musicians. In the global data analysis, the discriminative power of the features is investigated through statistical tests. Then, in the local data analysis, a larger amount of data is used to exploit more sophisticated machine learning techniques to select suitable subsets of the features, which are then used to train an SVM classifier to perform binary classification. Interestingly, the features whose discriminative power is evaluated as large (respectively, small) in the global analysis are also evaluated in a similar way in the local analysis. When used together, the 22 features that have been defined in the paper demonstrate to be efficient for classification, leading to a percentage of about 90 % successfully classified examples among the ones not used in the training phase. Similar results are obtained considering only a subset of 15 features.

eng
Funding
  • European Commission - Social Interaction and Entrainment using Music PeRformance Experimentation [250026]
Citation (ISO format)
GLOWINSKI, Donald et al. Expressive non-verbal interaction in a string quartet: an analysis through head movements. In: Journal on Multimodal User Interfaces, 2015, vol. 9, n° 1, p. 55–68. doi: 10.1007/s12193-014-0154-3
Main files (1)
Article (Published version)
Identifiers
ISSN of the journal1783-7677
16views
2downloads

Technical informations

Creation06/20/2024 9:47:13 AM
First validation07/25/2024 2:17:34 PM
Update time07/25/2024 2:17:34 PM
Status update07/25/2024 2:17:34 PM
Last indexation07/25/2024 2:17:55 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack