Featured Research

from universities, journals, and other organizations

'Autonomous' Helicopters Teach Themselves To Fly

Date:
September 3, 2008
Source:
Stanford University
Summary:
Stanford computer scientists have developed an artificial intelligence system that enables robotic helicopters to teach themselves to fly difficult stunts by watching other helicopters. The result is an autonomous helicopter than can perform a complete airshow of complex tricks on its own. The airshow is an important demonstration of "apprenticeship learning," in which robots learn by observing an expert, rather than by having software engineers write instructions from scratch.

Computer Science Professor Andrew Ng (center) and his graduate students Pieter Abbeel (left) and Adam Coates have developed an artificial intelligence system that enables these helicopters to perform difficult aerobatic stunts on the their own. The "autonomous" helicopters teach themselves to fly by watching the maneuvers of a radio control helicopter flown by a human pilot.
Credit: Image courtesy of Stanford University

Stanford computer scientists have developed an artificial intelligence system that enables robotic helicopters to teach themselves to fly difficult stunts by watching other helicopters perform the same maneuvers.

The result is an autonomous helicopter than can perform a complete airshow of complex tricks on its own.

The stunts are "by far the most difficult aerobatic maneuvers flown by any computer controlled helicopter," said Andrew Ng, the professor directing the research of graduate students Pieter Abbeel, Adam Coates, Timothy Hunter and Morgan Quigley.

The dazzling airshow is an important demonstration of "apprenticeship learning," in which robots learn by observing an expert, rather than by having software engineers peck away at their keyboards in an attempt to write instructions from scratch.

Stanford's artificial intelligence system learned how to fly by "watching" the four-foot-long helicopters flown by expert radio control pilot Garett Oku. "Garett can pick up any helicopter, even ones he's never seen, and go fly amazing aerobatics. So the question for us is always, why can't computers do things like this?" Coates said.

Computers can, it turns out. On a recent morning in an empty field at the edge of campus, Abbeel and Coates sent up one of their helicopters to demonstrate autonomous flight. The aircraft, brightly painted Stanford red, is an off-the-shelf radio control helicopter, with instrumentation added by the researchers.

For five minutes, the chopper, on its own, ran through a dizzying series of stunts beyond the capabilities of a full-scale piloted helicopter and other autonomous remote control helicopters. The artificial-intelligence helicopter performed a smorgasbord of difficult maneuvers: traveling flips, rolls, loops with pirouettes, stall-turns with pirouettes, a knife-edge, an Immelmann, a slapper, an inverted tail slide and a hurricane, described as a "fast backward funnel."

The piθce de rιsistance may have been the "tic toc," in which the helicopter, while pointed straight up, hovers with a side-to-side motion as if it were the pendulum of an upside down clock.

"I think the range of maneuvers they can do is by far the largest" in the autonomous helicopter field, said Eric Feron, a Georgia Tech aeronautics and astronautics professor who worked on autonomous helicopters while at MIT. "But what's more impressive is the technology that underlies this work. In a way, the machine teaches itself how to do this by watching an expert pilot fly. This is amazing."

Writing software for robotic helicopters is a daunting task, in part because the craft itself, unlike an airplane, is inherently unstable. "The helicopter doesn't want to fly. It always wants to just tip over and crash," said Oku, the pilot.

To scientists, a helicopter in flight is an "unstable system" that comes unglued without constant input. Abbeel compares flying a helicopter to balancing a long pole in the palm of your hand: "If you don't provide feedback, it will crash."

Early on in their research, Abbeel and Coates attempted to write computer code that would specify the commands for the desired trajectory of a helicopter flying a specific maneuver. While this hand-coded approach succeeded with novice-level flips and rolls, it flopped with the complex tic-toc."

It might seem that an autonomous helicopter could fly stunts by simply replaying the exact finger movements of an expert pilot using the joy sticks on the helicopter's remote controller. That approach, however, is doomed to failure because of uncontrollable variables such as gusting winds.

When the Stanford researchers decided their autonomous helicopter should be capable of flying airshow stunts, they realized that even defining their goal was difficult. What's the formal specification for "flying well?" The answer, it turned out, was that "flying well" is whatever an expert radio control pilot does at an airshow.

So the researchers had Oku and other pilots fly entire airshow routines while every movement of the helicopter was recorded. As Oku repeated a maneuver several times, the trajectory of the helicopter inevitably varied slightly with each flight. But the learning algorithms created by Ng's team were able to discern the ideal trajectory the pilot was seeking. Thus the autonomous helicopter learned to fly the routine better—and more consistently—than Oku himself.

During a flight, some of the necessary instrumentation is mounted on the helicopter, some on the ground. Together, they continuously monitor the position, direction, orientation, velocity, acceleration and spin of the helicopter in several dimensions. A ground-based computer crunches the data, makes quick calculations and beams new flight directions to the helicopter via radio 20 times per second.

The helicopter carries accelerometers, gyroscopes and magnetometers, the latter of which use the Earth's magnetic field to figure out which way the helicopter is pointed. The exact location of the craft is tracked either by a GPS receiver on the helicopter or by cameras on the ground. (With a larger helicopter, the entire navigation package could be airborne.)

There is interest in using autonomous helicopters to search for land mines in war-torn areas or to map out the hot spots of California wildfires in real time, allowing firefighters to quickly move toward or away from them. Firefighters now must often act on information that is several hours old, Abbeel said.

"In order for us to trust helicopters in these sort of mission-critical applications, it's important that we have very robust, very reliable helicopter controllers that can fly maybe as well as the best human pilots in the world can," Ng said. Stanford's autonomous helicopters have taken a large step in that direction, he said.


Story Source:

The above story is based on materials provided by Stanford University. Note: Materials may be edited for content and length.


Cite This Page:

Stanford University. "'Autonomous' Helicopters Teach Themselves To Fly." ScienceDaily. ScienceDaily, 3 September 2008. <www.sciencedaily.com/releases/2008/09/080902171117.htm>.
Stanford University. (2008, September 3). 'Autonomous' Helicopters Teach Themselves To Fly. ScienceDaily. Retrieved July 30, 2014 from www.sciencedaily.com/releases/2008/09/080902171117.htm
Stanford University. "'Autonomous' Helicopters Teach Themselves To Fly." ScienceDaily. www.sciencedaily.com/releases/2008/09/080902171117.htm (accessed July 30, 2014).

Share This




More Matter & Energy News

Wednesday, July 30, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Climate Change Could Cost Billions, According To White House

Climate Change Could Cost Billions, According To White House

Newsy (July 29, 2014) — A report from the White House warns not curbing greenhouse gas emissions could cost the U.S. billions. Video provided by Newsy
Powered by NewsLook.com
Stranded Whale Watching Boat Returns to Boston

Stranded Whale Watching Boat Returns to Boston

Reuters - US Online Video (July 29, 2014) — Passengers stuck overnight on a whale watching boat return safely to Boston. Linda So reports. Video provided by Reuters
Powered by NewsLook.com
Baluchistan Mining Eyes an Uncertain Future

Baluchistan Mining Eyes an Uncertain Future

AFP (July 29, 2014) — Coal mining is one of the major industries in Baluchistan but a lack of infrastructure and frequent accidents mean that the area has yet to hit its potential. Duration: 01:58 Video provided by AFP
Powered by NewsLook.com
Easier Nuclear Construction Promises Fall Short

Easier Nuclear Construction Promises Fall Short

AP (July 29, 2014) — The U.S. nuclear industry started building its first new plants using prefabricated Lego-like blocks meant to save time and prevent the cost overruns that crippled the sector decades ago. So far, it's not working. (July 29) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins