Featured Research

from universities, journals, and other organizations

Automated 'coach' could help with social interactions

Date:
June 14, 2013
Source:
Massachusetts Institute of Technology
Summary:
A new software system could help people improve their conversational and interview skills.

Social phobias affect about 15 million adults in the United States, according to the National Institute of Mental Health, and surveys show that public speaking is high on the list of such phobias. For some people, these fears of social situations can be especially acute: For example, individuals with Asperger's syndrome often have difficulty making eye contact and reacting appropriately to social cues. But with appropriate training, such difficulties can often be overcome.

Related Articles


Now, new software developed at MIT can be used to help people practice their interpersonal skills until they feel more comfortable with situations such as a job interview or a first date. The software, called MACH (short for My Automated Conversation coacH), uses a computer-generated onscreen face, along with facial, speech, and behavior analysis and synthesis software, to simulate face-to-face conversations. It then provides users with feedback on their interactions.

The research was led by MIT Media Lab doctoral student M. Ehsan Hoque, who says the work could be helpful to a wide range of people. A paper documenting the software's development and testing has been accepted for presentation at the 2013 International Joint Conference on Pervasive and Ubiquitous Computing, known as UbiComp, to be held in September.

"Interpersonal skills are the key to being successful at work and at home," Hoque says. "How we appear and how we convey our feelings to others define us. But there isn't much help out there to improve on that segment of interaction."

Many people with social phobias, Hoque says, want "the possibility of having some kind of automated system so that they can practice social interactions in their own environment. … They desire to control the pace of the interaction, practice as many times as they wish, and own their data."

The MACH software offers all those features, Hoque says. In fact, in randomized tests with 90 MIT juniors who volunteered for the research, the software showed its value.

First, the test subjects -- all of whom were native speakers of English -- were randomly divided into three groups. Each group participated in two simulated job interviews, a week apart, with MIT career counselors.

But between the two interviews, unbeknownst to the counselors, the students received help: One group watched videos of interview advice, while a second group had a practice session with the MACH simulated interviewer, but received no feedback other than a video of their own performance. Finally, a third group used MACH and then saw videos of themselves accompanied by an analysis of such measures as how much they smiled, how well they maintained eye contact, how well they modulated their voices, and how often they used filler words such as "like," "basically" and "umm."

Evaluations by another group of career counselors showed statistically significant improvement by members of the third group on measures including "appears excited about the job," "overall performance," and "would you recommend hiring this person?" In all of these categories, by comparison, there was no significant change for the other two groups.

The software behind these improvements was developed over two years as part of Hoque's doctoral thesis work with help from his advisor, professor of media arts and sciences Rosalind Picard, as well as Matthieu Courgeon and Jean-Claude Martin from LIMSI-CNRS in France, Bilge Mutlu from the University of Wisconsin, and MIT undergraduate Sumit Gogia.

Designed to run on an ordinary laptop, the system uses the computer's webcam to monitor a user's facial expressions and movements, and its microphone to capture the subject's speech. The MACH system then analyzes the user's smiles, head gestures, speech volume and speed, and use of filler words, among other things. The automated interviewer -- a life-size, three-dimensional simulated face -- can smile and nod in response to the subject's speech and motions, ask questions and give responses.

While this initial implementation was focused on helping job candidates, Hoque says training with the software could be helpful in many kinds of social interactions.

After finishing his doctorate in media arts and sciences this summer, Hoque will become an assistant professor of computer science at the University of Rochester in the fall.


Story Source:

The above story is based on materials provided by Massachusetts Institute of Technology. The original article was written by David L. Chandler. Note: Materials may be edited for content and length.


Cite This Page:

Massachusetts Institute of Technology. "Automated 'coach' could help with social interactions." ScienceDaily. ScienceDaily, 14 June 2013. <www.sciencedaily.com/releases/2013/06/130614125637.htm>.
Massachusetts Institute of Technology. (2013, June 14). Automated 'coach' could help with social interactions. ScienceDaily. Retrieved October 24, 2014 from www.sciencedaily.com/releases/2013/06/130614125637.htm
Massachusetts Institute of Technology. "Automated 'coach' could help with social interactions." ScienceDaily. www.sciencedaily.com/releases/2013/06/130614125637.htm (accessed October 24, 2014).

Share This



More Computers & Math News

Friday, October 24, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Microsoft Riding High On Strong Surface, Cloud Performance

Microsoft Riding High On Strong Surface, Cloud Performance

Newsy (Oct. 24, 2014) — Microsoft's Q3 earnings showed its tablets and cloud services are really hitting their stride. Video provided by Newsy
Powered by NewsLook.com
The Best Apps to Organize Your Life

The Best Apps to Organize Your Life

Buzz60 (Oct. 23, 2014) — Need help organizing your bills, schedules and other things? Ko Im (@konakafe) has the best apps to help you stay on top of it all! Video provided by Buzz60
Powered by NewsLook.com
Nike And Apple Team Up To Create Wearable ... Something

Nike And Apple Team Up To Create Wearable ... Something

Newsy (Oct. 23, 2014) — For those looking for wearable tech that's significantly less nerdy than Google Glass, Nike CEO Mark Parker says don't worry, It's on the way. Video provided by Newsy
Powered by NewsLook.com
Chameleon Camouflage to Give Tanks Cloaking Capabilities

Chameleon Camouflage to Give Tanks Cloaking Capabilities

Reuters - Innovations Video Online (Oct. 22, 2014) — Inspired by the way a chameleon changes its colour to disguise itself; scientists in Poland want to replace traditional camouflage paint with thousands of electrochromic plates that will continuously change colour to blend with its surroundings. The first PL-01 concept tank prototype will be tested within a few years, with scientists predicting that a similar technology could even be woven into the fabric of a soldiers' clothing making them virtually invisible to the naked eye. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins