Featured Research

from universities, journals, and other organizations

Computer Program Trained To Read Faces Developed By Salk Team

Date:
March 22, 1999
Source:
The Salk Institute For Biological Studies
Summary:
A computer program developed by a Salk-led team has been trained to distinguish among a number of facial cues, helping to sort false from genuine expressions. What's more, the program performs as well as a psychologist trained to read faces and markedly better than human non-experts.

LA JOLLA, CALIF. March 17, 1999 -- A computer program developed by a Salk-led team has been trained to distinguish among a number of facial cues, helping to sort false from genuine expressions. What's more, the program performs as well as a psychologist trained to read faces and markedly better than human non-experts.

"Computers have a difficult time analyzing expressions on faces, something we can do without even thinking," said Terrence Sejnowski, Salk professor and senior author of the study, which appears in the current issue of Psychophysiology.

"But by mimicking the ability of humans to learn by experience, computers have now broken through this barrier," he said.

Investigators hope that their program will prove helpful to law enforcement officials and mental health professionals.

"When someone is lying, their true feelings often flicker across their face in what we call a micro-expression, which is quickly covered up by a posed expression," said Paul Ekman, professor of psychology at the University of California, San Francisco and co-author of the study. "These signals may be too brief for professionals to detect in an interview setting, but they can be picked up if the conversation is videotaped and reviewed."

The problem is that human analysis is labor-intensive and painstakingly slow. "It takes about one hour to score one minute of tape," explained Marian S. Bartlett, Salk postdoctoral researcher and first author of the study. "Our program, on the other hand, can do a minute of tape in about five minutes, and once we optimize the program it will run in near real-time."

So, exactly what is being measured by the computer program? In the 1970s, a team of psychologists led by Ekman developed a code that breaks down facial expressions into component movements by individual facial muscles. For example, the crinkling of the eyes that causes crow's feet is produced by contraction of the orbicularis oculi muscle, an action that in a spontaneous smile is coordinated with movement of the zygomaticus major muscle, which lifts up the corners of the mouth. Each of these movements has a designated action unit number. "So you could describe a smile as AU6 + AU12," said Bartlett.

People not well versed in the subtleties of facial movements have a very difficult time "faking" expressions. For example, sadness has a characteristic set of gestures, one of the most distinctive being the contraction of the central frontalis muscle that raises the inner corners of the brows, producing wrinkles in the central forehead.

"That's a really difficult one to pull off if it's not spontaneous," said Bartlett. For that reason, law enforcement officials are interested in programs that can analyze suspects being questioned and raise red flags when it perceives insincere emotions.

The automated program is also of interest to mental health professionals. For example, Ekman was involved in a case in which a woman had convinced her team of doctors that she was ready for discharge from a psychiatric hospital. Shortly before her release however, she confessed that she, in fact, planned to commit suicide.

When Ekman, an expert in facial expression analysis, analyzed a videotape of her interview frame-by-frame, he detected a clue to her deception. When she was asked, 'What are your plans for the future?' a look of despair flitted across the woman's face, which was quickly covered up by a smile.

"Fortunately," said Ekman, "in this case, the patient had admitted her deception and accepted further treatment. Ideally, psychiatrists would like to have a tool to flag such potentially dangerous situations, but they don't have the time to score hours of videotape manually."

The program works by comparing images of faces to 60 filters, or templates, each of which looks for independent components of facial movement in different regions. For instance, raising the left inner brow would increase a face's match to filter no. 1, whereas raising the left outer brow would increase the match to filter no. 2. The computer analyzes the information from all 60 filters and match to filter no. 1, whereas raising the left outer brow would increase the match to filter no. 2. The computer analyzes the information from all 60 filters and decides whether the collective output matches AU1 or AU2 and so on.

In the current study, the program was trained to recognize six of 46 individual muscle actions described by Ekman. For all six actions, it out-performed human non-experts and performed as well as highly trained human experts. The investigators plan next to teach it the remaining actions and then tackle combinations of these actions.

"Although we have a proof of principle that computers can be taught to recognize facial expressions," said Sejnowski, "there is still a long way to go before we have practical systems that are as flexible as humans over a wide range of head positions and lighting conditions. The next step is to integrate what we have done with work by other groups on solving these problems."

Joseph C. Hager at the Network Information Research Corp in Salt Lake City is a co-author of the study, titled "Measuring Facial Expressions by Computer Image Analysis." The work was supported by the National Science Foundation, the Howard Hughes Medical Institute, and a Lawrence Livermore National Laboratories Intra-University Agreement.

The Salk Institute for Biological Studies, located in La Jolla, Calif., is an independent nonprofit institution dedicated to fundamental discoveries in the life sciences, the improvement of human health and conditions, and the training of future generations of researchers. The Institute was founded in 1960 by Jonas Salk, M.D., with a gift of land from the City of San Diego and the financial support of the March of Dimes Birth Defects Foundation.


Story Source:

The above story is based on materials provided by The Salk Institute For Biological Studies. Note: Materials may be edited for content and length.


Cite This Page:

The Salk Institute For Biological Studies. "Computer Program Trained To Read Faces Developed By Salk Team." ScienceDaily. ScienceDaily, 22 March 1999. <www.sciencedaily.com/releases/1999/03/990322061419.htm>.
The Salk Institute For Biological Studies. (1999, March 22). Computer Program Trained To Read Faces Developed By Salk Team. ScienceDaily. Retrieved October 21, 2014 from www.sciencedaily.com/releases/1999/03/990322061419.htm
The Salk Institute For Biological Studies. "Computer Program Trained To Read Faces Developed By Salk Team." ScienceDaily. www.sciencedaily.com/releases/1999/03/990322061419.htm (accessed October 21, 2014).

Share This



More Computers & Math News

Tuesday, October 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Newsy (Oct. 21, 2014) If you've ever watched "Back to the Future Part II" and wanted to get your hands on a hoverboard, well, you might soon be in luck. Video provided by Newsy
Powered by NewsLook.com
Robots to Fly Planes Where Humans Can't

Robots to Fly Planes Where Humans Can't

Reuters - Innovations Video Online (Oct. 21, 2014) Researchers in South Korea are developing a robotic pilot that could potentially replace humans in the cockpit. Unlike drones and autopilot programs which are configured for specific aircraft, the robots' humanoid design will allow it to fly any type of plane with no additional sensors. Ben Gruber reports. Video provided by Reuters
Powered by NewsLook.com
Japanese Scientists Unveil Floating 3D Projection

Japanese Scientists Unveil Floating 3D Projection

Reuters - Innovations Video Online (Oct. 20, 2014) Scientists in Tokyo have demonstrated what they say is the world's first 3D projection that floats in mid air. A laser that fires a pulse up to a thousand times a second superheats molecules in the air, creating a spark which can be guided to certain points in the air to shape what the human eye perceives as an image. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Apple Enters Mobile Payment Business

Apple Enters Mobile Payment Business

AP (Oct. 20, 2014) Apple is making a strategic bet with the launch of Apple Pay, the mobile pay service aimed at turning your iPhone into your wallet. (Oct. 20) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins