Featured Research

from universities, journals, and other organizations

Avatars make the Internet sign to deaf people

Date:
August 28, 2014
Source:
University Saarland
Summary:
It is challenging for deaf people to learn a sound-based language, since they are physically not able to hear those sounds. Hence, most of them struggle with written language as well as with text reading and comprehension. Therefore, most website content remains inaccessible for them. Computer scientists want to change the situation by means of a method they developed: animated online characters display content in sign language. In the long term, deaf people would be able to use the technique to communicate on online platforms via sign language.

Computer scientists from Saarbrücken in Germany have developed an approach where animated online characters display content in sign language. They collaborate with Peter Schaar (picture) who is deaf and is a lecturer for sign language.
Credit: AG Heloir

It is challenging for deaf people to learn a sound-based language, since they are physically not able to hear those sounds. Hence, most of them struggle with written language as well as with text reading and comprehension. Therefore, most website content remains inaccessible for them. Computer scientists from Saarbrücken, Germany, want to change the situation by means of a method they developed: animated online characters display content in sign language. In the long term, deaf people would be able to use the technique to communicate on online platforms via sign language. To realize the technique, users would only need readily available devices.

Sign language was first acknowledged as a separate language in the sixties, which is quite recent. Similar to spoken language, it evolved from different cultural backgrounds. Every country has its own sign language with various dialects, which are based on different rules than the spoken language. For the deaf, sign language is their native language. Therefore, it is not easy for them to learn spoken language, which is why they may struggle with text reading and comprehension even after their graduation. Although several websites provide video clips in which sign language interpreters translate the text, much Internet content remains cryptic for the deaf community. To inform deaf people quickly in cases where there is no interpreter on hand, researchers are working on a novel approach to provide content. Their idea: avatars. These animated characters could be used in the context of announcements at train stations, or on websites.

"We have already gained initial experiences with avatars," explains Alexis Heloir, who is the leader of the research group "Sign Language Synthesis and Interaction" at the Cluster of Excellence "Multimodal Computing and Interaction" and also a researcher at the German Center for Artificial Intelligence. "If we try to animate them like human beings, deaf people have issues with understanding the avatars." The researcher assumes that this is caused by the greater variety of emotional expressions of humans compared to avatars. To deal with that problem, Alexis Heloir and Fabrizio Nunnari create avatars that make more accentuated movements. The researchers are closely cooperating with Peter Schaar, who is deaf and is a lecturer for German sign language at the Saarland University Language Center and the College of Engineering and Commerce in Saarbrücken.

"Our method should be inexpensive and easy to use so that every member of the deaf community will be able to use it," says Fabrizio Nunnari. To capture the motions of deaf people, the scientists make use of affordable cameras and sensors that are typically used by teenagers for computer games. A computing method transfers the movements of the entire body onto the avatar. In the long term, the researchers want to create a collection of short sign language sequences that can be used by the deaf to interact on the web.


Story Source:

The above story is based on materials provided by University Saarland. Note: Materials may be edited for content and length.


Cite This Page:

University Saarland. "Avatars make the Internet sign to deaf people." ScienceDaily. ScienceDaily, 28 August 2014. <www.sciencedaily.com/releases/2014/08/140828091247.htm>.
University Saarland. (2014, August 28). Avatars make the Internet sign to deaf people. ScienceDaily. Retrieved October 22, 2014 from www.sciencedaily.com/releases/2014/08/140828091247.htm
University Saarland. "Avatars make the Internet sign to deaf people." ScienceDaily. www.sciencedaily.com/releases/2014/08/140828091247.htm (accessed October 22, 2014).

Share This



More Mind & Brain News

Wednesday, October 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Working Mother Getaway: Beaches Turks & Caicos

Working Mother Getaway: Beaches Turks & Caicos

Working Mother (Oct. 22, 2014) — Feast your eyes on this gorgeous family-friendly resort. Video provided by Working Mother
Powered by NewsLook.com
First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

Newsy (Oct. 21, 2014) — A medical team has for the first time given a man the ability to walk again after transplanting cells from his brain onto his severed spinal cord. Video provided by Newsy
Powered by NewsLook.com
Portable Breathalyzer Gets You Home Safely

Portable Breathalyzer Gets You Home Safely

Buzz60 (Oct. 21, 2014) — Breeze, a portable breathalyzer, gets you home safely by instantly showing your blood alcohol content, and with one tap, lets you call an Uber, a cab or a friend from your contact list to pick you up. Sean Dowling (@SeanDowlingTV) has the details. Video provided by Buzz60
Powered by NewsLook.com
Your Birth Season Might Determine Your Temperament

Your Birth Season Might Determine Your Temperament

Newsy (Oct. 20, 2014) — A new study says the season you're born in can determine your temperament — and one season has a surprising outcome. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins