Featured Research

from universities, journals, and other organizations

Crime Fighting Potential For Computerized Lip-reading

Date:
February 22, 2007
Source:
University of East Anglia
Summary:
Researchers at the University of East Anglia are about to embark on an innovative new project to develop computer lip-reading systems that could be used for fighting crime.

Researchers at the University of East Anglia are about to embark on an innovative new project to develop computer lip-reading systems that could be used for fighting crime.

Related Articles


The three-year project, which starts next month, will collect data for lip-reading and use it to create machines that automatically convert videos of lip-motions into text. It builds on work already carried out at UEA to develop state-of-the-art speech reading systems.

The university is teaming up with the Centre for Vision, Speech & Signal Processing at Surrey University, who have built accurate and reliable face and lip trackers, and the Home Office Scientific Development Branch, who want to investigate the feasibility of using the technology for crime fighting.

The team also hope to carry out computerised lip-reading of other languages.

While it is known that humans can and do lip-read, not much is known about exactly what visual information is needed for effective lip-reading. Human lip-reading can be unreliable, even using trained lip-readers.

Dr Richard Harvey, senior lecturer at UEA's School of Computing Sciences, is leading the project, which has been awarded 391,814 by the Engineering and Physical Sciences Research Council.

"We all lip read, for example in noisy situations like a bar or party, but even the performance of expert lip readers can be very poor," he said. "It appears that the best lip-readers are the ones who learned to speak a language before they lost their hearing and who have been taught lip-reading intensively. It is a very desirable skill."

Dr Harvey added: "The Home Office Scientific Development Branch is interested in anything that helps the police gather information about criminals or gather evidence."

As well as crime fighting there could be other potential uses for the technology, such as installing a camera in a mobile phone, or on the dash board for in-car speech recognition systems.

Another reason for developing computerised lip-reading is that the number of trained lip-readers is falling, mainly because people tend to be taught to sign instead.

Dr Harvey said: "To be effective the systems must accurately track the head over a variety of poses, extract numbers, or features, that describe the lips and then learn what features correspond to what text.

"To tackle the problem we will need to use information collected from audio speech. So this project will also investigate how to use the extensive information known about audio speech to recognise visual speech.

"The work will be highly experimental. We hope to have produced a system that will demonstrate the ability to lip-read in more general situations than we have done so far."


Story Source:

The above story is based on materials provided by University of East Anglia. Note: Materials may be edited for content and length.


Cite This Page:

University of East Anglia. "Crime Fighting Potential For Computerized Lip-reading." ScienceDaily. ScienceDaily, 22 February 2007. <www.sciencedaily.com/releases/2007/02/070221101332.htm>.
University of East Anglia. (2007, February 22). Crime Fighting Potential For Computerized Lip-reading. ScienceDaily. Retrieved January 28, 2015 from www.sciencedaily.com/releases/2007/02/070221101332.htm
University of East Anglia. "Crime Fighting Potential For Computerized Lip-reading." ScienceDaily. www.sciencedaily.com/releases/2007/02/070221101332.htm (accessed January 28, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Wednesday, January 28, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

PlayStation Now Smart TV App

PlayStation Now Smart TV App

Rumble (Jan. 27, 2015) PlayStation Now Smart TV app is coming soon and will be available on both Sony and Samsung HDTV, allowing you to play games without even a counsel! Check out the video for more info. Credit to &apos;booredatwork&apos;. Video provided by Rumble
Powered by NewsLook.com
WikiLeaks Accuses Google of Handing Over Emails to US

WikiLeaks Accuses Google of Handing Over Emails to US

AFP (Jan. 27, 2015) Whistleblowing site WikiLeaks accused Google of handing over the emails and electronic data of its senior staff to the US authorities without providing notification until almost three years later. Duration: 01:09 Video provided by AFP
Powered by NewsLook.com
Shark Bite Victim Making Amazing Recovery

Shark Bite Victim Making Amazing Recovery

AP (Jan. 27, 2015) A Texas woman who lost more than five pounds of flesh to a shark in the Bahamas earlier this month could be released from a Florida hospital soon. Experts believe she was bitten by a bull shark while snorkeling. (Jan. 27) Video provided by AP
Powered by NewsLook.com
Cablevision Enters Wi-Fi Phone Fray

Cablevision Enters Wi-Fi Phone Fray

Reuters - Business Video Online (Jan. 26, 2015) The entry by Cablevision and Google could intensify the already heated price wars for mobile phone service. Fred Katayama reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins