Featured Research

from universities, journals, and other organizations

Let’s Get Non-verbal, Electronically

April 20, 2009
ICT Results
Researchers have developed a suite of tools to add non-verbal cues to email, phone calls, chats and other channels of electronic communication. It is fascinating work, and the real-world applications are even more compelling.

European researchers have developed a suite of tools to add non-verbal cues to email, phone calls, chats and other channels of electronic communication. It is fascinating work, and the real-world applications are even more compelling.

Related Articles

Digital communication hasn’t the richness of face-to-face conversation because it cannot communicate the non-verbal cues and contextual information that are so important to us all.

But that will not be a problem for much longer. The PASION project, an EU-funded research effort, has developed a suite of tools to communicate precisely this kind of information.

And even more remarkable than the technological advance are the applications that the technology enables, including new kinds of online gaming, new forms of groupware, even tele-psychiatry.

One of the most compelling applications is “augmented social networking”. Over the last couple of years, services like Facebook or MySpace have been growing enormously but there are still things they can’t do. The tools PASION is developing offer new ways of showing your friends where you are, what you’re doing, how you feel; new ways of looking at your friends list, new ways of communicating.

Non-verbal office

But PASION is not just for play. “Many problems in collaborative work derive not from the need to communicate and share explicit information, already met by current groupware and communication tools, but from higher-level problems in coordinating these processes,” explains Richard Walker, chief dissemination officer of the PASION project.

“For example, misunderstandings, or the erroneous attribution of intentions can cause problems for groups.” PASION believes that augmented communication will limit or reduce this sort of problem.

The project has developed a prototype that runs on a mobile phone and provides information that users can exploit to coordinate their work. It can show information like user availability, or indicators and visualisations that illustrate the social position of a user in the group.

It also offers information on user mood. Currently, this works via self-reporting, but soon it will be generated automatically. It can even tell you what the user is doing at a particular moment.

PASION has already incorporated augmentation in many desktop tools, typically used by knowledge workers, such as MS Outlook, iGoogle, Skype, and Thunderbird. More are on the way.

Games people play

Gaming, too, is a rich area for exploitation, with non-verbal cues augmenting games in the same way as the successful Nintendo Wii uses motion sensors to turn video games into a social event.

For example, the Familiars game developed within the project tracks user status within a social network and gives them a score for each improvement in their status. This could be really big. Already people on social networking websites like Facebook and MySpace suffer from artificial ‘friendship inflation’ as they add contacts pell-mell to their friends list.

But few of those friends are ‘real’ – many may be people the user never really meets. Often users gain prestige because of the quantity of friends they have, not the quality. Familiars tracks the quality. For example, is the user a significant node for many others? Do members in the group contact the user regularly? These are the factors used to calculate the final score.

Facial communication and the tele-shrink

There are vertical applications, too. One of the most compelling is tele-psychiatry. Using special software to analyse facial expressions, and a voice link, psychiatrists could work with their patients at a distance, helping them to deal with their problems.

This is not the only vertical application, either. Non-verbal cues about learners’ arousal or about the way a group is interacting could be enormously useful to online moderators or teachers in e-learning applications.

The range and variety of applications are impressive, but when will we see them on the high street?

“There are, of course, [parts] that could use more work, but we have developed elements of all these systems, and different partners will take them forward in different ways,” explains Walker.

For example, simple sensors that indicate physiological state, like the heart rate, are simple, cost little to produce, are well accepted among younger users, and could be deployed cheaply and easily for social networking or gaming applications; these are tools we could see deployed in the near term.

Similarly, there are software modules almost ready to deploy in groupware, and that is an area that could be exploited relatively quickly. PASION’s telecom partner is considering deploying some of the research for mobile gaming, and this work could also appear quickly.

Other applications will take longer, or be reserved for specialist applications. PASION’s facial recognition system, for example, is currently very expensive but there are already applications where it could be applied – such as the tele-psychiatry one.

In all, we should soon see the sound of silence become part of our digital life.

The PASION project received funding from the Future and Emerging Technologies (FET) strand of the Sixth Framework Programme for research.

This is the second of a two-part special feature on the PASION project.

Story Source:

The above story is based on materials provided by ICT Results. Note: Materials may be edited for content and length.

Cite This Page:

ICT Results. "Let’s Get Non-verbal, Electronically." ScienceDaily. ScienceDaily, 20 April 2009. <www.sciencedaily.com/releases/2009/04/090417083856.htm>.
ICT Results. (2009, April 20). Let’s Get Non-verbal, Electronically. ScienceDaily. Retrieved March 6, 2015 from www.sciencedaily.com/releases/2009/04/090417083856.htm
ICT Results. "Let’s Get Non-verbal, Electronically." ScienceDaily. www.sciencedaily.com/releases/2009/04/090417083856.htm (accessed March 6, 2015).

Share This

More From ScienceDaily

More Computers & Math News

Friday, March 6, 2015

Featured Research

from universities, journals, and other organizations

Featured Videos

from AP, Reuters, AFP, and other news services

Star Wars Inspires Mobile Holograms

Star Wars Inspires Mobile Holograms

Reuters - Business Video Online (Mar. 6, 2015) 3D holograms could soon be coming to your mobile phone. Inspired by the famous Princess Leia hologram from Star Wars, a U.S. company is showcasing a prototype display at the Mobile World Congress at Barcelona and says it could be used for real-time video calls. Ivor Bennett reports Video provided by Reuters
Powered by NewsLook.com
Video Game Makers Grapple With Need for Diversity

Video Game Makers Grapple With Need for Diversity

AFP (Mar. 6, 2015) An increasingly diverse fan base is challenging the video game industry to shake off its "boys only" image and better reflect the demographics of its exploding ranks of players. Duration: 00:55 Video provided by AFP
Powered by NewsLook.com
What to Expect from the Apple Watch Event

What to Expect from the Apple Watch Event

Buzz60 (Mar. 6, 2015) The Apple Watch made headlines when it was announced, but beyond looks, little was known. Brett Larson rounds up the latest information before the March 9th event. Video provided by Buzz60
Powered by NewsLook.com
Game Makers Lured Into Virtual Worlds

Game Makers Lured Into Virtual Worlds

AFP (Mar. 6, 2015) Some 25,000 people have descended upon San Francisco to show off the latest technologies and video games at the Game Developers Conference. Developers here discuss the future of the industry. Duration: 02:20. Video provided by AFP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.


Breaking News:

Strange & Offbeat Stories

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News


Free Subscriptions

Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile

Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?

Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins