Featured Research

from universities, journals, and other organizations

Visual system interprets sign languages

Date:
June 2, 2010
Source:
Universitat Auṭnoma de Barcelona
Summary:
Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. Researchers selected over 20 of these signs to develop a new visual interpretation system which allows deaf people to carry out consultations in the language they commonly use.

Spanish sign language is used by over 100,000 people with hearing impairments and is made up of hundreds of signs. CVC-UAB researchers Sergio Escalera, Petia Radeva and Jordi Vitrià selected over twenty of these signs to develop a new visual interpretation system which allows deaf people to carry out consultations in the language they commonly use.

Signs can vary slightly depending on each user. Project researchers took this into account during the trials carried out with different people to help the system "become familiarised" with this variability. The signs recognised by the system were programmed to allow deaf people to maintain a basic conversation, including asking for help or directions. "For them it is a non artificial way of communicating and at the same time they can engage with people who do not speak sign language since the system translates the symbols into words in real time," Sergio Escalera said.

The hardware includes a video camera which records image sequences when it detects the presence of a user wanting to make a consultation. A computer vision and automatic learning system detects face, hand and arm movements, as well as any screen scrolling, and incorporates these into a classification system which identifies each movement with the word associated with the sign.

One of the aspects worth highlighting is the ability to adapt the system to any other sign language, since the methodology used is general. The system would only need to be reprogrammed with the signs used in that specific language. The amount of signs the system can recognise is also scalable, although researchers do admit that new data will increase the difficulty in differentiating them.

Applications such as the one developed by CVC-UAB researchers require extreme precision in the identification phase and are very difficult to configure given that the surroundings in which they will be used include changes in light and shadow, different physiognomies and speeds at which the signs are formed.

Other similar projects have been developed in the past. However, most of them failed or were not reliable enough because of the high complexity of variabilities in uncontrolled surroundings. For this project to succeed it was necessary to establish a fixed point in which individuals formed the signs and avoid having different focus points when recording.

The system was recently presented as a prototype in the final phase of a European project and researchers are already working on new project phases, such as using two cameras with the aim of recognising even more complex signs and complementing information with facial characteristics. To carry this out researchers worked in close collaboration with several members of the Catalan Federation of Deaf People, FECOSA.


Story Source:

The above story is based on materials provided by Universitat Auṭnoma de Barcelona. Note: Materials may be edited for content and length.


Cite This Page:

Universitat Auṭnoma de Barcelona. "Visual system interprets sign languages." ScienceDaily. ScienceDaily, 2 June 2010. <www.sciencedaily.com/releases/2010/06/100602091317.htm>.
Universitat Auṭnoma de Barcelona. (2010, June 2). Visual system interprets sign languages. ScienceDaily. Retrieved September 16, 2014 from www.sciencedaily.com/releases/2010/06/100602091317.htm
Universitat Auṭnoma de Barcelona. "Visual system interprets sign languages." ScienceDaily. www.sciencedaily.com/releases/2010/06/100602091317.htm (accessed September 16, 2014).

Share This



More Computers & Math News

Tuesday, September 16, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Microsoft to Buy 'Minecraft' Maker for $2.5B

Microsoft to Buy 'Minecraft' Maker for $2.5B

AP (Sep. 15, 2014) — Microsoft will acquire the maker of the long-running hit game Minecraft for $2.5 billion as the company continues to invest in its Xbox gaming platform and looks to grab attention on mobile phones. (Sept. 15) Video provided by AP
Powered by NewsLook.com
Manufacturer Prints 3-D Car In Record Time

Manufacturer Prints 3-D Car In Record Time

Newsy (Sep. 15, 2014) — Automobile manufacturer Local Motors created a drivable electric car using a 3-D printer. Printing the body only took 44 hours. Video provided by Newsy
Powered by NewsLook.com
What $2.5B Deal Could Mean For Microsoft, 'Minecraft'

What $2.5B Deal Could Mean For Microsoft, 'Minecraft'

Newsy (Sep. 15, 2014) — While Microsoft looks to be expanding its mobile business, the creators of "Minecraft" are stepping aside. Video provided by Newsy
Powered by NewsLook.com
Frustration As Drone Industry Outpaces Regulation In U.S.

Frustration As Drone Industry Outpaces Regulation In U.S.

Newsy (Sep. 14, 2014) — U.S. firms worry they’re falling behind in the marketplace as the FAA considers how to regulate commercial drones. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins