A technique for detection of facial gestures from low resolution video sequences is presented. The technique builds upon the automatic 3D head tracker formulation of [11]. The tracker is based on registration of a texture -mapped cylindrical model. Facial gesture analysis is performed in the texture map by assuming that the residual registration error can be modeled as a linear combination of facial motion templates. Two formulations are proposed and tested. In one formulation head and facial motion are estimated in a single, combined linear system. In the other formulation, head motion and then facial motion are estimated in a two-step process. The two-step approach yields significantly better accuracy in facial gesture analysis. The system is demonstrated in detecting two types of facial gestures: “mouth opening” and “eyebrows raising.” On a dataset with lots of head motion the two-step algorithm achieved a recognition accuracy of 70% for the “mouth opening” and accuracy of 66% for “eyebrows raising” gestures. The algorithm can reliably track and classify facial gestures without any user intervention and runs in real -time.
LA CASCIA, M., Valenti, L., & Sclaroff, S. (2004). Fully Automatic, Real-Time Detection of Facial Gestures from Generic Video. In IEEE 6th Workshop on Multimedia Signal Processing [10.1109/MMSP.2004.1436520].
Autori: | LA CASCIA, M.; Valenti, L.; Sclaroff, S. | |
Titolo: | Fully Automatic, Real-Time Detection of Facial Gestures from Generic Video | |
Nome del convegno: | IEEE International Workshop on Multimedia Signal Processing | |
Luogo del convegno: | Siena | |
Anno del convegno: | 29 settembre-1 ottobre 2004 | |
Numero del convegno: | 6 | |
Data di pubblicazione: | 2004 | |
Digital Object Identifier (DOI): | http://dx.doi.org/10.1109/MMSP.2004.1436520 | |
Citazione: | LA CASCIA, M., Valenti, L., & Sclaroff, S. (2004). Fully Automatic, Real-Time Detection of Facial Gestures from Generic Video. In IEEE 6th Workshop on Multimedia Signal Processing [10.1109/MMSP.2004.1436520]. | |
Tipologia: | 0 - Proceedings (TIPOLOGIA NON ATTIVA) | |
Appare nelle tipologie: | 0 - Proceedings (TIPOLOGIA NON ATTIVA) |
File in questo prodotto:
File | Descrizione | Tipologia | Licenza | |
---|---|---|---|---|
2004 mmsp.pdf | N/A | Open Access Visualizza/Apri |