Featured Research

from universities, journals, and other organizations

New translator app makes sense of foreign-language food menus

Date:
September 8, 2011
Source:
Purdue University
Summary:
Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

This composite image shows iPod snapshots of the menu translator.
Credit: Mireille Boutin

Researchers have created an application that enables cell phones and other portable devices to translate foreign-language food menus for English speakers and could be used for people who must follow restricted diets for medical reasons.

"You type in the menu listing and the application translates it automatically without talking to a server," said Mireille "Mimi" Boutin, an associate professor in Purdue University's School of Electrical and Computer Engineering. "It only takes a fraction of a second, you don't need connection to the Internet and it won't empty your battery."

Before entering a foreign country, the user would download a region- and language-specific configuration and database. From then on, the system can operate without a network connection.

"The problem with menus is that even if you know the language you may still have to ask questions to clarify what a dish contains," Boutin said. "For example, in German, "Schinken" means ham, but it can be raw ham or cooked ham. If you are going to eat the ham, you might want to know which."

The user types the desired dish into a prompt field in the graphical user interface. The text is translated, and the best possible translations are then listed, along with other information, including pictures and ingredients. The user can then browse the multimedia database to obtain more information about the dish or the ingredients. When appropriate, information and questions for the waiter are suggested.

"With Albert Parra Pozo, a graduate student who is fluent in Spanish, we were able to develop and implement this system on the iPod Touch for English speakers traveling in Spain," said Boutin, who specializes in signal and image processing. "Our tests indicate that our system yields a correct translation more often than general-purpose translation engines. Moreover, it does so almost instantaneously. The memory requirements of the application, including the database of pictures, are also well within the limits of the device."

The researchers used a method called n-gram consolidation that improves the translation accuracy and dramatically reduces the size of the database while increasing search speed.

"As a result, our application can be used in a real-time, network-independent environment and produce highly accurate results," Boutin said. "We have a prototype in Spanish and have demonstrated the translation can be done in real time within a fraction of a second.

Findings were detailed in a paper presented in July at the IEEE International Conference on Multimedia and Expo in Barcelona, Spain. The paper was written by Parra, graduate student Andrew W. Haddad, Boutin and Edward J. Delp, the Charles William Harrison Distinguished Professor of Electrical and Computer Engineering.

"We believe the approach we are taking in this project is extendable to other types of mobile devices, including iPads and also the Android mobile phones," Delp said. "The results have been extremely good."

The researchers developed "lightweight algorithms" that operate quickly, have low-energy consumption and require low memory. The real-time translation is nine-hundreds of a second on average, and the application has a memory size of 9.56 megabytes, including its multimedia database, compared to several gigabytes for conventional translation systems, Boutin said.

The method could be further developed as a tool for people who have special diets by adding a database of nutritional information.

"People who must follow a medical diet are often reluctant to travel for fear of putting their health at risk," Boutin said. "Without the ability to understand menus, it is impossible to make informed food choices. In some extreme cases, for example peanut allergies, the consumption of even a minute quantity of certain nutrients can be fatal. In other cases, such as diabetes or congenital metabolic conditions like PKU, the consumption of certain nutrients must be carefully monitored and limited in order to maintain an individual's health."

The system warns people when certain ingredients or nutrients are contained in a dish. When there is doubt about an ingredient's safety, a warning symbol is displayed next to the dish and the device suggests questions and answers, written in both languages, so the user and the restaurant staff can discuss the content of the dish and possible alternatives.

The translator displays a sentence for the patron to read to the server.

"It could be something like, 'Excuse me sir, I have an allergy and was wondering if it's possible to remove the croutons from the salad,'" Boutin said.

The researchers are sometimes able to modify existing translation algorithms.

"It would be easier if we could simply use existing language translation tools," Boutin said. "But these have mostly been developed for desktops, which are directly connected to an outlet and have a large amount of memory and CPU available. In order to make the app work on a cellular phone, we need to rethink everything and develop our own custom-designed methods."


Story Source:

The above story is based on materials provided by Purdue University. The original article was written by Mireille Boutin. Note: Materials may be edited for content and length.


Cite This Page:

Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. ScienceDaily, 8 September 2011. <www.sciencedaily.com/releases/2011/09/110908152842.htm>.
Purdue University. (2011, September 8). New translator app makes sense of foreign-language food menus. ScienceDaily. Retrieved August 21, 2014 from www.sciencedaily.com/releases/2011/09/110908152842.htm
Purdue University. "New translator app makes sense of foreign-language food menus." ScienceDaily. www.sciencedaily.com/releases/2011/09/110908152842.htm (accessed August 21, 2014).

Share This




More Computers & Math News

Thursday, August 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Families Can Now Ask Twitter To Remove Photos Of Deceased

Families Can Now Ask Twitter To Remove Photos Of Deceased

Newsy (Aug. 20, 2014) In the wake of a high-profile harassment case, Twitter says family members can ask for photos of dying or dead relatives to be taken down. Video provided by Newsy
Powered by NewsLook.com
Ballmer Leaves Microsoft's Board, Has Advice For Nadella

Ballmer Leaves Microsoft's Board, Has Advice For Nadella

Newsy (Aug. 19, 2014) In a letter to Microsoft CEO Satya Nadella, Ballmer said he's leaving the board of directors and offered tips on how the company can be successful. Video provided by Newsy
Powered by NewsLook.com
What Google Can Gain From Special Accounts For Children

What Google Can Gain From Special Accounts For Children

Newsy (Aug. 19, 2014) Google will reportedly offer official accounts for children younger than 13 years old. Video provided by Newsy
Powered by NewsLook.com
Breakingviews: Ebola's Economic Impact Could Eclipse SARS

Breakingviews: Ebola's Economic Impact Could Eclipse SARS

Reuters - Business Video Online (Aug. 18, 2014) The virus ravaging Africa has yet to spread elsewhere. Yet Asia’s SARS crisis in 2003 showed how changes to behaviour can hurt the economy more than the actual disease, says Breakingviews' Una Galani. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins