Featured Research

from universities, journals, and other organizations

New translator app makes sense of foreign-language food menus

Date:
September 8, 2011
Source:
Purdue University
Summary:
Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

This composite image shows iPod snapshots of the menu translator.
Credit: Mireille Boutin

Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

"You type in the menu listing and the application translates it automatically without talking to a server," said Mireille "Mimi" Boutin, an associate professor in Purdue University's School of Electrical and Computer Engineering. "It only takes a fraction of a second, you don't need connection to the Internet and it won't empty your battery."

Before entering a foreign country, the user would download a region- and language-specific configuration and database. From then on, the system can operate without a network connection.

"The problem with menus is that even if you know the language you may still have to ask questions to clarify what a dish contains," Boutin said. "For example, in German, "Schinken" means ham, but it can be raw ham or cooked ham. If you are going to eat the ham, you might want to know which."

The user types the desired dish into a prompt field in the graphical user interface. The text is translated, and the best possible translations are then listed, along with other information, including pictures and ingredients. The user can then browse the multimedia database to obtain more information about the dish or the ingredients. When appropriate, information and questions for the waiter are suggested.

"With Albert Parra Pozo, a graduate student who is fluent in Spanish, we were able to develop and implement this system on the iPod Touch for English speakers traveling in Spain," said Boutin, who specializes in signal and image processing. "Our tests indicate that our system yields a correct translation more often than general-purpose translation engines. Moreover, it does so almost instantaneously. The memory requirements of the application, including the database of pictures, are also well within the limits of the device."

The researchers used a method called n-gram consolidation that improves the translation accuracy and dramatically reduces the size of the database while increasing search speed.

"As a result, our application can be used in a real-time, network-independent environment and produce highly accurate results," Boutin said. "We have a prototype in Spanish and have demonstrated the translation can be done in real time within a fraction of a second.

Findings were detailed in a paper presented in July at the IEEE International Conference on Multimedia and Expo in Barcelona, Spain. The paper was written by Parra, graduate student Andrew W. Haddad, Boutin and Edward J. Delp, the Charles William Harrison Distinguished Professor of Electrical and Computer Engineering.

"We believe the approach we are taking in this project is extendable to other types of mobile devices, including iPads and also the Android mobile phones," Delp said. "The results have been extremely good."

The researchers developed "lightweight algorithms" that operate quickly, have low-energy consumption and require low memory. The real-time translation is nine-hundreds of a second on average, and the application has a memory size of 9.56 megabytes, including its multimedia database, compared to several gigabytes for conventional translation systems, Boutin said.

The method could be further developed as a tool for people who have special diets by adding a database of nutritional information.

"People who must follow a medical diet are often reluctant to travel for fear of putting their health at risk," Boutin said. "Without the ability to understand menus, it is impossible to make informed food choices. In some extreme cases, for example peanut allergies, the consumption of even a minute quantity of certain nutrients can be fatal. In other cases, such as diabetes or congenital metabolic conditions like PKU, the consumption of certain nutrients must be carefully monitored and limited in order to maintain an individual's health."

The system warns people when certain ingredients or nutrients are contained in a dish. When there is doubt about an ingredient's safety, a warning symbol is displayed next to the dish and the device suggests questions and answers, written in both languages, so the user and the restaurant staff can discuss the content of the dish and possible alternatives.

The translator displays a sentence for the patron to read to the server.

"It could be something like, 'Excuse me sir, I have an allergy and was wondering if it's possible to remove the croutons from the salad,'" Boutin said.

The researchers are sometimes able to modify existing translation algorithms.

"It would be easier if we could simply use existing language translation tools," Boutin said. "But these have mostly been developed for desktops, which are directly connected to an outlet and have a large amount of memory and CPU available. In order to make the app work on a cellular phone, we need to rethink everything and develop our own custom-designed methods."


Story Source:

The above story is based on materials provided by Purdue University. The original article was written by Mireille Boutin. Note: Materials may be edited for content and length.


Cite This Page:

Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. ScienceDaily, 8 September 2011. <www.sciencedaily.com/releases/2011/09/110908152842.htm>.
Purdue University. (2011, September 8). New translator app makes sense of foreign-language food menus. ScienceDaily. Retrieved October 21, 2014 from www.sciencedaily.com/releases/2011/09/110908152842.htm
Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. www.sciencedaily.com/releases/2011/09/110908152842.htm (accessed October 21, 2014).

Share This



More Computers & Math News

Tuesday, October 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Japanese Scientists Unveil Floating 3D Projection

Japanese Scientists Unveil Floating 3D Projection

Reuters - Innovations Video Online (Oct. 20, 2014) Scientists in Tokyo have demonstrated what they say is the world's first 3D projection that floats in mid air. A laser that fires a pulse up to a thousand times a second superheats molecules in the air, creating a spark which can be guided to certain points in the air to shape what the human eye perceives as an image. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Apple Enters Mobile Payment Business

Apple Enters Mobile Payment Business

AP (Oct. 20, 2014) Apple is making a strategic bet with the launch of Apple Pay, the mobile pay service aimed at turning your iPhone into your wallet. (Oct. 20) Video provided by AP
Powered by NewsLook.com
Google To Protect Against Piracy ... At A Cost

Google To Protect Against Piracy ... At A Cost

Newsy (Oct. 20, 2014) Google is changing its search-engine results to protect content producers from piracy — for a price. Video provided by Newsy
Powered by NewsLook.com
What We Know About Microsoft's Rumored Smartwatch

What We Know About Microsoft's Rumored Smartwatch

Newsy (Oct. 20, 2014) Microsoft will reportedly release a smartwatch that works across different mobile platforms, has a two-day battery life and tracks heart rate. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins