The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.

Manfrè, A., Infantino, I., Vella, F., Gaglio, S. (2016). An automatic system for humanoid dance creation. BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, 15, 1-9 [10.1016/j.bica.2015.09.009].

An automatic system for humanoid dance creation

INFANTINO, Ignazio;VELLA, Filippo;GAGLIO, Salvatore
2016-01-01

Abstract

The paper describes a novel approach to allow a robot to dance following musical rhythm. The proposed system generates a dance for a humanoid robot through the combination of basic movements synchronized with the music. The system made up of three parts: the extraction of features from audio file, estimation of movements through the Hidden Markov Models and, finally, the generation of dance. Starting from a set of given movements, the robot choices sequence of movements a suitable Hidden Markov Model, and synchronize them processing musical input. The proposed approach has the advantage that movement execution probabilities could be changed according evaluation of the dance execution in order to have an artificial creative system. In the same way, a choreographer could give more importance to some movements and/or exclude others, using the system as a co-creation tool. The approach has been tested on Aldebaran NAO humanoid using different genres of music, and experimentations was conduct at presence of real human dancers to have feedback of the goodness of the robot execution. Three professional judges expressed their evaluations about the following points: appropriateness of movements for a given musical genre; the precision to track the rhythm; the aesthetic impact of the whole sequence of movements; and the overall judgment of the robot performance. All the evaluations are very satisfying, and confirm that robot dance is realistic and aesthetically acceptable. The robustness and flexibility of the system allow us to embed the system in artificial creative system in future work. In the discussion we introduce some issues to pursuit this aim, using a previous proposed cognitive architecture based on needs and motivations.
2016
Settore ING-INF/05 - Sistemi Di Elaborazione Delle Informazioni
Manfrè, A., Infantino, I., Vella, F., Gaglio, S. (2016). An automatic system for humanoid dance creation. BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, 15, 1-9 [10.1016/j.bica.2015.09.009].
File in questo prodotto:
File Dimensione Formato  
An automatic system for humanoid dance creation.pdf

Solo gestori archvio

Descrizione: Articolo principale
Dimensione 1.65 MB
Formato Adobe PDF
1.65 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/191058
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 37
  • ???jsp.display-item.citation.isi??? 28
social impact