We propose a hierarchical neural architecture able to recognise observed human actions. Each layer in the architecture represents increasingly complex human activity features. The first layer consists of a SOM which performs dimensionality reduction and clustering of the feature space. It represents the dynamics of the stream of posture frames in action sequences as activity trajectories over time. The second layer in the hierarchy consists of another SOM which clusters the activity trajectories of the first-layer SOM and thus it learns to represent action prototypes independent of how long the activity trajectories last. The third layer of the hierarchy consists of a neural network that learns to label action prototypes of the second-layer SOM and is independent - to certain extent - of the camera's angle and relative distance to the actor. The experiments were carried out with encouraging results with action movies taken from the INRIA 4D repository. The architecture correctly recognised 100% of the actions it was trained on, while it exhibited 53% recognition rate when presented with similar actions interpreted and performed by a different actor.

Buonamente M, Dindo H, Johnsson M (2014). Action Recognition based on Hierarchical Self-Organizing Maps. In Proceedings of the Second International Workshop on Artificial Intelligence and Cognition (AIC 2014) (pp.86-97).

Action Recognition based on Hierarchical Self-Organizing Maps

BUONAMENTE, Miriam;DINDO, Haris;
2014-01-01

Abstract

We propose a hierarchical neural architecture able to recognise observed human actions. Each layer in the architecture represents increasingly complex human activity features. The first layer consists of a SOM which performs dimensionality reduction and clustering of the feature space. It represents the dynamics of the stream of posture frames in action sequences as activity trajectories over time. The second layer in the hierarchy consists of another SOM which clusters the activity trajectories of the first-layer SOM and thus it learns to represent action prototypes independent of how long the activity trajectories last. The third layer of the hierarchy consists of a neural network that learns to label action prototypes of the second-layer SOM and is independent - to certain extent - of the camera's angle and relative distance to the actor. The experiments were carried out with encouraging results with action movies taken from the INRIA 4D repository. The architecture correctly recognised 100% of the actions it was trained on, while it exhibited 53% recognition rate when presented with similar actions interpreted and performed by a different actor.
27-nov-2014
International Workshop on Artificial Intelligence and Cognition (AIC 2014)
Torino
2014
2014
12
http://ceur-ws.org/Vol-1315/paper7.pdf
Buonamente M, Dindo H, Johnsson M (2014). Action Recognition based on Hierarchical Self-Organizing Maps. In Proceedings of the Second International Workshop on Artificial Intelligence and Cognition (AIC 2014) (pp.86-97).
Proceedings (atti dei congressi)
Buonamente M; Dindo H; Johnsson M
File in questo prodotto:
File Dimensione Formato  
2014-AIC.pdf

Solo gestori archvio

Descrizione: Articolo principale
Dimensione 2.02 MB
Formato Adobe PDF
2.02 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/103819
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact