Advances in the Modelling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques
MetadataShow full item record
This item's downloads: 1911 (view details)
Advances are presented in the modeling of facial sub-regions, in the use of enhanced whole face-models, and based on these sub-region models, in the determination of facial expressions. Models are derived using techniques from the field of active appearance modelling (AAM). A technical description and review of such techniques and a number of additional state-of-art techniques for face detection and face region analysis are provided. A detailed literature review covering a range of topics relating to facial expression analysis is provided. In particular the prior use of AAM techniques for facial feature extraction is reviewed. A range of methodologies for classifying facial expressions are also reviewed. Improved eye-region and lips region models are presented. These models employ the concept of overlapping landmark points, enabling the resulting models to handle eye-gaze, different degrees of closure of the eye, and texture variations in the lips due to the appearance of teeth when the mouth opens in a smile. The eye model is further improved by providing a component-AAM implementation enabling independent modelling of the state of each eye. Initialisation of the lips model is improved using a hue-based pre-filter. A whole-face component-AAM model is provided, combining the improved eye and lips models in an overall framework which significantly increases the accuracy of fitting of the AAM to facial expressions. A range of experiments are performed to tune and test this model for the purpose of the accurate classification of facial expressions in unseen images. Both nearest neighbour (NN) and support vector machine (SVM) classification methodologies are used. Testing of the system to classify the six universal emotions and the neutral face state shows that an accuracy of 83% can be achieved when using SVM classification. Preliminary investigations on additional enhancements to improve on this performance are provided, including the use of (i) pre-filters for gender, race, and age, (ii) person-specific AAM models, and (iii) expression tracking across multiple images in a video sequence. All of these techniques are shown to have potential to further enhance the accuracy of expression recognition of the underlying component-AAM face model with eye and lips subregional models.
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. Please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.
The following license files are associated with this item:
Showing items related by title, author, creator and subject.
Mehdi, Muntazir; Khan, Yasar; Freitas, Andre; Jares, Joao; Raza, Saleem; Hasapis, Panagiotis; Sahay, Ratnesh (IEEE, 2016-02-04)Biosimulation models are used to understand the multiple or different causative factors that cause impairment in human organs. Finite Element Method (FEM) provide a mathematical framework to simulate dynamic biological ...
Mehdi, Muntazir; Khan, Yasar; Freitas, Andre; Jares, Joao; Raza, Saleem; Hasapis, Panagiotis; Sahay, Ratnesh (IEEE, 2016-02-04)Healthcare experts have recently turned towards the use of Biosimulation models to understand the multiple or different causative factors that cause impairment in human organs. The applications of biosimulations have been ...
Reiss, H.; Birchenough, S.; Borja, A.; Buhl-Mortensen, L.; Craeymeersch, J.; Dannheim, J.; Darr, A.; Galparsoro, I.; Gogina, M.; Neumann, H.; Populus, J.; Rengstorf, A. M.; Valle, M.; van Hoey, G.; Zettler, M. L.; Degraer, S. (Oxford University Press (OUP), 2014-06-19)Marine benthic ecosystems are difficult to monitor and assess, which is in contrast to modern ecosystem-based management requiring detailed information at all important ecological and anthropogenic impact levels. Ecosystem ...