AFFECTIVE COMPUTING
Detecting Emotional State of a User
Facial Expressions
Facial expression can convey the underlying emotional state of a user.
Detecting facial muscle movements from a video clip is done by tracking feature points on each video frame. In the system introduced, this is followed by recognizing human facial gestures from muscle movement sequences, and infering the user's mental state from sets of gestures.
Imagine a system where the security cameras can detect if train conductors/ security guards are not paying attention in their jobs, or even a learning system where we can detect if a student understands the materials in class and can provide feedback without the student having to ask. Gesture recognition can play a big part where others cannot.
Body Gestures
Speech
The subject of recognising the emotion in speech has become more relevant in the modern world due to the development of natural interfaces of human and machine communication. The ability to recognise emotion in speech accurately would bring about many benefits to the world, one of which is it would result in better responds from machines to human.
