Science News
from research organizations

Computer Helps Deaf Children To Learn Sign Language

Date:
October 14, 2009
Source:
Delft University of Technology
Summary:
A computer which automatically recognizes sign language enables children who are deaf or hard of hearing to expand their sign language vocabulary more quickly.
Share:
       
FULL STORY

An Electronic Learning Environment (ELo) for children who are deaf or hard of hearing.
Credit: Image courtesy of Delft University of Technology

Three PhD candidates have spent the last few years at TU Delft simultaneously working on sign language. One of these is Jeroen Arendsen: “Very little is known about the perception of sign language. The aim of this research was to expand our knowledge of human observation of signing. For instance, it turns out that sign language users only need to see a small part of a hand movement to know it is a sign and what it means.”

Automatic recognition

The insights obtained into human perception can subsequently be used for developing the technology for automatic sign language recognition by cameras and computers. In the TU Delft study, this led to a remarkable application of automatic sign language recognition: an Electronic Learning Environment (ELo) for children who are deaf or hard of hearing.

Pictures

In conjunction with the NSDSK (Dutch foundation for children who are deaf or hard of hearing), the TU Delft researchers developed a computer which can recognise sign language in real time and can therefore be used to teach children who are deaf and hard of hearing new signs more quickly.

When shown a picture, the children aged three to six were asked to make the correct sign. The computer then had to assess the sign. Arendsen: “And that is quite difficult, because a computer is more easily confused than people by irrelevant fidgeting.”

Comprehensible

The task of fellow PhD candidate Jeroen Lichtenauer (EEMCS faculty) was to convert the signs into information which is comprehensible to a computer. As an Industrial Design Engineering student, Arendsen was more involved in the human aspects. Gineke Ten Holt was the third PhD candidate, who worked as a bridge between the two disciplines.

Sign language vocabulary

Further research showed that the Electronic Learning Environment really does work. The sign language vocabulary of those children who had practised with it increased compared to that of a control group. This only applied to the slightly older children however.

Whether the ELo will indeed be applied in practice is still uncertain, Arendsen says. “It depends on aspects such as finance and organisational issues.”


Story Source:

The above post is reprinted from materials provided by Delft University of Technology. Note: Materials may be edited for content and length.


Cite This Page:

Delft University of Technology. "Computer Helps Deaf Children To Learn Sign Language." ScienceDaily. ScienceDaily, 14 October 2009. <www.sciencedaily.com/releases/2009/10/091013210329.htm>.
Delft University of Technology. (2009, October 14). Computer Helps Deaf Children To Learn Sign Language. ScienceDaily. Retrieved July 3, 2015 from www.sciencedaily.com/releases/2009/10/091013210329.htm
Delft University of Technology. "Computer Helps Deaf Children To Learn Sign Language." ScienceDaily. www.sciencedaily.com/releases/2009/10/091013210329.htm (accessed July 3, 2015).

Share This Page: