Featured Research

from universities, journals, and other organizations

New translator app makes sense of foreign-language food menus

Date:
September 8, 2011
Source:
Purdue University
Summary:
Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

This composite image shows iPod snapshots of the menu translator.
Credit: Mireille Boutin

Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

"You type in the menu listing and the application translates it automatically without talking to a server," said Mireille "Mimi" Boutin, an associate professor in Purdue University's School of Electrical and Computer Engineering. "It only takes a fraction of a second, you don't need connection to the Internet and it won't empty your battery."

Before entering a foreign country, the user would download a region- and language-specific configuration and database. From then on, the system can operate without a network connection.

"The problem with menus is that even if you know the language you may still have to ask questions to clarify what a dish contains," Boutin said. "For example, in German, "Schinken" means ham, but it can be raw ham or cooked ham. If you are going to eat the ham, you might want to know which."

The user types the desired dish into a prompt field in the graphical user interface. The text is translated, and the best possible translations are then listed, along with other information, including pictures and ingredients. The user can then browse the multimedia database to obtain more information about the dish or the ingredients. When appropriate, information and questions for the waiter are suggested.

"With Albert Parra Pozo, a graduate student who is fluent in Spanish, we were able to develop and implement this system on the iPod Touch for English speakers traveling in Spain," said Boutin, who specializes in signal and image processing. "Our tests indicate that our system yields a correct translation more often than general-purpose translation engines. Moreover, it does so almost instantaneously. The memory requirements of the application, including the database of pictures, are also well within the limits of the device."

The researchers used a method called n-gram consolidation that improves the translation accuracy and dramatically reduces the size of the database while increasing search speed.

"As a result, our application can be used in a real-time, network-independent environment and produce highly accurate results," Boutin said. "We have a prototype in Spanish and have demonstrated the translation can be done in real time within a fraction of a second.

Findings were detailed in a paper presented in July at the IEEE International Conference on Multimedia and Expo in Barcelona, Spain. The paper was written by Parra, graduate student Andrew W. Haddad, Boutin and Edward J. Delp, the Charles William Harrison Distinguished Professor of Electrical and Computer Engineering.

"We believe the approach we are taking in this project is extendable to other types of mobile devices, including iPads and also the Android mobile phones," Delp said. "The results have been extremely good."

The researchers developed "lightweight algorithms" that operate quickly, have low-energy consumption and require low memory. The real-time translation is nine-hundreds of a second on average, and the application has a memory size of 9.56 megabytes, including its multimedia database, compared to several gigabytes for conventional translation systems, Boutin said.

The method could be further developed as a tool for people who have special diets by adding a database of nutritional information.

"People who must follow a medical diet are often reluctant to travel for fear of putting their health at risk," Boutin said. "Without the ability to understand menus, it is impossible to make informed food choices. In some extreme cases, for example peanut allergies, the consumption of even a minute quantity of certain nutrients can be fatal. In other cases, such as diabetes or congenital metabolic conditions like PKU, the consumption of certain nutrients must be carefully monitored and limited in order to maintain an individual's health."

The system warns people when certain ingredients or nutrients are contained in a dish. When there is doubt about an ingredient's safety, a warning symbol is displayed next to the dish and the device suggests questions and answers, written in both languages, so the user and the restaurant staff can discuss the content of the dish and possible alternatives.

The translator displays a sentence for the patron to read to the server.

"It could be something like, 'Excuse me sir, I have an allergy and was wondering if it's possible to remove the croutons from the salad,'" Boutin said.

The researchers are sometimes able to modify existing translation algorithms.

"It would be easier if we could simply use existing language translation tools," Boutin said. "But these have mostly been developed for desktops, which are directly connected to an outlet and have a large amount of memory and CPU available. In order to make the app work on a cellular phone, we need to rethink everything and develop our own custom-designed methods."


Story Source:

The above story is based on materials provided by Purdue University. The original article was written by Mireille Boutin. Note: Materials may be edited for content and length.


Cite This Page:

Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. ScienceDaily, 8 September 2011. <www.sciencedaily.com/releases/2011/09/110908152842.htm>.
Purdue University. (2011, September 8). New translator app makes sense of foreign-language food menus. ScienceDaily. Retrieved April 20, 2014 from www.sciencedaily.com/releases/2011/09/110908152842.htm
Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. www.sciencedaily.com/releases/2011/09/110908152842.htm (accessed April 20, 2014).

Share This



More Computers & Math News

Sunday, April 20, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

AFP (Apr. 19, 2014) The Nintendo Game Boy celebrates its 25th anniversary Monday and game expert Stephen Upstone says the console can be credited with creating a trend towards handheld gaming devices. Duration: 01:21 Video provided by AFP
Powered by NewsLook.com
Why Did Nike Fire Most Of Its Nike FuelBand Team?

Why Did Nike Fire Most Of Its Nike FuelBand Team?

Newsy (Apr. 19, 2014) Nike fired most of its Digital Sport hardware team, the group behind Nike's FuelBand device. Could Apple or an overcrowded market be behind layoffs? Video provided by Newsy
Powered by NewsLook.com
Nearly Two Weeks On, The Internet Copes With Heartbleed

Nearly Two Weeks On, The Internet Copes With Heartbleed

Newsy (Apr. 19, 2014) The Internet is taking important steps in patching the vulnerabilities Heartbleed highlighted, but those preventive measures carry their own costs. Video provided by Newsy
Powered by NewsLook.com
Facebook To Share Nearby Friends Data With Advertisers

Facebook To Share Nearby Friends Data With Advertisers

Newsy (Apr. 19, 2014) A Facebook spokesperson has confirmed the company will use GPS data from the new Nearby Friends feature for advertising sometime in the future. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins