Featured Research

from universities, journals, and other organizations

Knowledge transfer between computers: Computers teach each other Pac-Man

Date:
April 1, 2014
Source:
Washington State University
Summary:
Researchers have developed a method to allow a computer to give advice and teach skills to another computer in a way that mimics how a real teacher and student might interact. Researchers had the agents -- as the virtual robots are called -- act like true student and teacher pairs: student agents struggled to learn Pac-Man and a version of the StarCraft video game. The researchers were able to show that the student agent learned the games and, in fact, surpassed the teacher.

Researchers had agents -- virtual robots -- act like true student and teacher pairs: student agents struggled to learn Pac-Man and a version of the StarCraft video game. The researchers were able to show that the student agent learned the games and, in fact, surpassed the teacher.
Credit: Image courtesy of Washington State University

Researchers in Washington State University's School of Electrical Engineering and Computer Science have developed a method to allow a computer to give advice and teach skills to another computer in a way that mimics how a real teacher and student might interact.

Related Articles


The paper by Matthew E. Taylor, WSU's Allred Distinguished Professor in Artificial Intelligence, was published online in the journal Connection Science.

Researchers had the agents -- as the virtual robots are called -- act like true student and teacher pairs: student agents struggled to learn Pac-Man and a version of the StarCraft video game. The researchers were able to show that the student agent learned the games and, in fact, surpassed the teacher.

While it may sound like fun and games, helping robots teach each other to play computer games is an important area of research in robotics -- and it's not easy. If robots could teach each other tasks, then people wouldn't need to; for instance, a housecleaning robot could teach its replacement the job.

If you're worried about robots taking over the world, though, don't be.

"They're very dumb,'' says Taylor, an expert on robots, agents and helping them to learn.

Even the most advanced robots are easily confused, he says. And when they get confused, they stop working. He says it often takes two or three times longer than he thinks it will to get a robot to work at all.

The easiest way to successfully teach a robot new skills is to remove the "brains" of the old one and put them in the new one, says Taylor. Problems occur, though, when hardware and software don't work in the new model.

Furthermore, one long-term goal in robotics is for robots to teach skills to humans. But we can't simply insert their hard drives.

In their study, the researchers programmed their teaching agent to focus on action advice, or telling a student when to act.

As anyone with teenagers knows, the trick is in knowing when the robot should give advice. If it gives no advice, the robot is not teaching. But if it always gives advice, the student gets annoyed and doesn't learn to outperform the teacher.

"We designed algorithms for advice giving, and we are trying to figure out when our advice makes the biggest difference,'' Taylor says.

He aims to develop a curriculum for the agents that starts with simple work and builds to more complex.

He also recently received an NSF grant to use ideas from dog training to train robotic agents. Eventually, he hopes to develop a better way for people to teach their robotic agents, as well as for robots to teach people.

The work was funded in part by the National Science Foundation (NSF).


Story Source:

The above story is based on materials provided by Washington State University. Note: Materials may be edited for content and length.


Journal Reference:

  1. Matthew E. Taylor, Nicholas Carboni, Anestis Fachantidis, Ioannis Vlahavas, Lisa Torrey. Reinforcement learning agents providing advice in complex video games. Connection Science, 2014; 26 (1): 45 DOI: 10.1080/09540091.2014.885279

Cite This Page:

Washington State University. "Knowledge transfer between computers: Computers teach each other Pac-Man." ScienceDaily. ScienceDaily, 1 April 2014. <www.sciencedaily.com/releases/2014/04/140401102707.htm>.
Washington State University. (2014, April 1). Knowledge transfer between computers: Computers teach each other Pac-Man. ScienceDaily. Retrieved October 26, 2014 from www.sciencedaily.com/releases/2014/04/140401102707.htm
Washington State University. "Knowledge transfer between computers: Computers teach each other Pac-Man." ScienceDaily. www.sciencedaily.com/releases/2014/04/140401102707.htm (accessed October 26, 2014).

Share This



More Computers & Math News

Sunday, October 26, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Real-Life Transformer Robot Walks, Then Folds Into a Car

Real-Life Transformer Robot Walks, Then Folds Into a Car

Buzz60 (Oct. 24, 2014) — Brave Robotics and Asratec teamed with original Transformers toy company Tomy to create a functional 5-foot-tall humanoid robot that can march and fold itself into a 3-foot-long sports car. Jen Markham has the story. Video provided by Buzz60
Powered by NewsLook.com
Microsoft Riding High On Strong Surface, Cloud Performance

Microsoft Riding High On Strong Surface, Cloud Performance

Newsy (Oct. 24, 2014) — Microsoft's Q3 earnings showed its tablets and cloud services are really hitting their stride. Video provided by Newsy
Powered by NewsLook.com
The Best Apps to Organize Your Life

The Best Apps to Organize Your Life

Buzz60 (Oct. 23, 2014) — Need help organizing your bills, schedules and other things? Ko Im (@konakafe) has the best apps to help you stay on top of it all! Video provided by Buzz60
Powered by NewsLook.com
Nike And Apple Team Up To Create Wearable ... Something

Nike And Apple Team Up To Create Wearable ... Something

Newsy (Oct. 23, 2014) — For those looking for wearable tech that's significantly less nerdy than Google Glass, Nike CEO Mark Parker says don't worry, It's on the way. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins