A Review of Multimodal Approach for Gesture Recognition of Human Behavior

Amit Purushottam Pimpalkar


A gesture is a form of non verbal or non vocal communication in which visible bodily actions communicate particular messages. Gestures include movement of the face, hands or other parts of the body.  Gestures allow persons to speak a variety of feelings and thoughts, from condescension and hostility to approval and affection, often together with body language in addition to words when they speak.  An emotion plays a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. Human expression is used to interact with the computers. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user’s emotional expressions we present an approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand gesture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. 


Multimodal approach, Face Detection, Facial expression recognition system, Hand gesture recognition system, PCA, Cam Shift Algorithm

Full Text:



  • There are currently no refbacks.

Subscribe to Print Journals

 IJAIKD is currently Indexed By   

 http://rgjournals.com/public/site/images/mittalberi/scholar_logo_lg_2011.gif  Journal Seek