Computer learning to read lips to detect emotions
September 12, 2012
Scientists in Malaysia are teaching a computer to interpret human emotions based on lip patterns.
The system could improve the way we interact with computers and perhaps allow disabled people to use computer-based communications devices, such as voice synthesizers, more effectively and more efficiently, says Karthigayan Muthukaruppan of Manipal International University.
The system uses a genetic algorithm that gets better and better with each iteration to match irregular ellipse-fitting equations to the shape of a human mouth displaying different emotions.
They have used photos of individuals from Southeast Asia and Japan to train a computer to recognize the six commonly accepted human emotions — happiness, sadness, fear, angry, disgust, surprise — and a neutral expression. The upper and lower lip is each analyzed as two separate ellipses by the algorithm.
The team’s algorithm can successfully classify the seven emotions and a neutral expression described, the scientists say.
No word if the system will be deployed on the manned mission to Mars.

Comments (12)
by TFC
Great! We can have managers, coworkers, and now your computer looking for emotional leakage when they talk at you.
by NakedApe
Those lips are OBVIOUSLY greatly sexually interested in me.
by Bri
Brings out your inner bonobo huh! Either she is making a “W”sound or she is making a kiss.
by rob falgiano
The sovereignty of the mind is being eroded, and there’s no way around it or going back. Electrodes that sense thoughts, minute lip reading patterns, etc. These technologies will lead to the end of the sovereign human mind. Keep this in “MIND” (HAHA) and enjoy the last 20 or 30 years of days of keeping your thoughts to yourself, or however long…
by Jonathan Cole
Malaysia….Great! What is going vertical on the exponential graph is the number of creative people and places that are working hard on solutions that will greatly enhance my life and everyones.
by Pervert
Am I the only one too busy staring at those lips to care much about the news? Mmm.
by Bob Vasquez
I think that the first George Bush could be the spokesperson; “Read my lips”.
by Bri
In the current round of politics, they don’t want to say anything. Can’t read their lips. There not moving!!!
by stephen p
The terminator is a step closer…just give it another 15 years and we could have a robometropolis
by JFH
Open the pod bay doors please, HAL.
by Bri
Dave was a little more emphatic. He didn’t say please. Amara quotes him at the top under the headline.
by Gorden Russell
I’m sorry Dave, I can’t do that.