Featured Research

from universities, journals, and other organizations

Teenager Moves Video Icons Just By Imagination

Date:
October 11, 2006
Source:
Washington University School of Medicine
Summary:
Teenage boys and computer games go hand-in-hand. Now a St. Louis-area teenage boy and a computer game have gone hands-off, thanks to a unique experiment conducted by a team of neurosurgeons, neurologists, and engineers at Washington University in St. Louis. The boy, a 14-year-old who suffers from epilepsy, is the first teenager to play a two-dimensional video game, Space Invaders, using only the signals from his brain to make movements.

The doctors with joysticks (Eric Leuthardt, seated, and Mathew Smyth, standing) engage in a game of Space Invaders while biomedical engineer Daniel Moran looks on behind the computer sc reen. Computer science and engineering graduate student Tim Blakely (behind Leuthardt) and biomedical engineering graduate student Nick Anderson (to Smyth's left) are amused. This team, with Dr. John Zempel of the WUSTL Medical School, enabled a 14-year-old to play a two-dimensional video game without using his hands, rather the signals from his brain.
Credit: Photo by David Kilper / WUSTL Photo

Teenage boys and computer games go hand-in-hand.

Now, a St. Louis-area teenage boy and a computer game have gone hands-off, thanks to a unique experiment conducted by a team of neurosurgeons, neurologists, and engineers at Washington University in St. Louis.

The boy, a 14-year-old who suffers from epilepsy, is the first teenager to play a two-dimensional video game, Space Invaders, using only the signals from his brain to make movements.

Getting subjects to move objects using only their brains has implications toward someday building biomedical devices that can control artificial limbs, for instance, enabling the disabled to move a prosthetic arm or leg by thinking about it.

Many gamers think fondly of Atari's Space Invaders, one of the most popular breakthrough video games of the late '70s. The player controls the motions of a movable laser cannon that moves back and forth across the bottom of the video screen. Row upon row of video aliens march back and forth across the screen, slowly coming down from the top to the bottom of the screen. The objective is to prevent any one of the aliens from landing on the bottom of the screen, which ends the game. The player has an unlimited ammunition supply.

The aliens can shoot back at the player, who has to evade, moving left and right. There are lots of levels of play, reflecting the speed at which the aliens descend. The Washington University subject mastered the first two levels of play, using just his imagination.

Here's how:

The teenager had a grid atop his brain to record brain surface signals, a brain-machine interface technique that uses electrocorticographic (ECoG) activity - data taken invasively right from the brain surface. It is an alternative to a frequently used technique to study humans called electroencephalographic activity (EEG) - data taken non-invasively by electrodes outside the brain on the scalp. Engineers programmed the Atari software to interface with the brain-machine interface system.

Eric C. Leuthardt, M.D., an assistant professor of neurological surgery at the School of Medicine, and Daniel Moran, Ph.D., assistant professor of biomedical engineering, performed their research on the boy who had the grids implanted so that neurologists and neurosurgeons can find the area in the brain serving as the focus for an epileptic seizure, with hopes of removing it to avoid future seizures. To do this, the boy and his doctors, Dr Mathew Smyth and Dr John Zempel, had to wait for a seizure.

Usin' the noggin

With approval of the patient and his parents and the Washington University School of Medicine Institutional Review Board, Leuthardt and Moran connected the patient to a sophisticated computer running a special program known as BCI2000 (developed by their collaborator Gerwin Schalk at the Wadsworth Center, New York State Department of Health in Albany) which involves a video game that is linked to the ECoG grid. They then asked the boy to do various motor and speech tasks, moving his hands various ways, talking, and imagining. The team could see from the data which parts of the brain and what brain signals correlate to these movements. They then asked the boy to play a simple, two-dimensional Space Invaders game by actually moving his tongue and hand. He was then asked to imagine the same movements, but not to actually perform them with his hands or tongue. When he saw the cursor in the video game, he then controlled it with his brain.

"He cleared out the whole level one basically on brain control," said Leuthardt. "He learned almost instantaneously. We then gave him a more challenging version in two-dimensions and he mastered two levels there playing only with his imagination."

In 2004, Leuthardt and Moran led a team who were the first to perform this research on four adult patients. They were anxious to get data from a teenager to see if there are any differences between how teens and adults operate.

"It's exciting to be able to look at age differences and see what that tells us about the brain," said Moran, who said the team plans to test more pediatric subjects. "No one has ever seen if brain signals from children are different. We'll try to determine if teenagers have different frequency distributions when their cortex becomes active. We might question if the frequency alterations are different, will that make a difference in performance?"

Leuthardt said it is too early to make comparisons between adults and teenagers because they have only one set of teenage data.

"But we observed much quicker reaction times in the boy and he had a higher level of detail of control - for instance, he wasn't moving just left and right, but just a little bit left, a little bit right," he said.

Teamwork

Graduate students in the Washington University School of Engineering and Applied Science played major roles in the accomplishment. Nick Anderson, a Ph.D. student in biomedical engineering, came up with the idea of using the Space Invaders game to both help the patients pass the time away and garner some very useful, pioneering data. Computer science and engineering master's degree candidate Tim Blakely pulled several all-nighters to program the game into the ECoG system. "Doing this is a win-win situation , both for science and the child," Leuthardt said. "We devised this to be enjoyable and entertaining while we get groundbreaking information on the brain."

The clinical team also played a significant role in the planning and orchestration of this research. It was of critical importance that these experiments be safe and not interfere with clinical care. The clinical pediatric portion of the team was led by Mathew Smyth, MD, assistant professor of neurosurgery, and John Zempel, M.D., Ph.D., associate professor of neurology. "This really was a symphony of expertise ranging from neurosurgery, neurology, neuroscience, engineering, and computer science which was years in the making. The end result is something we can really be proud of," Leuthardt said.


Story Source:

The above story is based on materials provided by Washington University School of Medicine. Note: Materials may be edited for content and length.


Cite This Page:

Washington University School of Medicine. "Teenager Moves Video Icons Just By Imagination." ScienceDaily. ScienceDaily, 11 October 2006. <www.sciencedaily.com/releases/2006/10/061011121830.htm>.
Washington University School of Medicine. (2006, October 11). Teenager Moves Video Icons Just By Imagination. ScienceDaily. Retrieved August 2, 2014 from www.sciencedaily.com/releases/2006/10/061011121830.htm
Washington University School of Medicine. "Teenager Moves Video Icons Just By Imagination." ScienceDaily. www.sciencedaily.com/releases/2006/10/061011121830.htm (accessed August 2, 2014).

Share This




More Computers & Math News

Saturday, August 2, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Google Mystery Barge Headed For The Scrap Yard

Google Mystery Barge Headed For The Scrap Yard

Newsy (Aug. 1, 2014) We may never know what was going on inside one of Google's mystery barges in Portland, Maine as it's now headed for the scrap yard. Video provided by Newsy
Powered by NewsLook.com
Escaping Email: Inspired Vision or Pipe Dream?

Escaping Email: Inspired Vision or Pipe Dream?

AP (Aug. 1, 2014) Dustin Moskovitz is plotting an escape from email, using his communications expertise in an attempt to change the way people connect at work, where the incessant drumbeat of email has become an excruciating annoyance. (Aug. 1) Video provided by AP
Powered by NewsLook.com
Google (Kind Of) Complies With 'Right To Be Forgotten Law'

Google (Kind Of) Complies With 'Right To Be Forgotten Law'

Newsy (July 31, 2014) Google says it is following Europe's new "Right To Be Forgotten Law," which eliminates user information upon request, but only to a certain degree. Video provided by Newsy
Powered by NewsLook.com
Tesla, Panasonic Ink Deal To Make Huge Battery 'Gigafactory'

Tesla, Panasonic Ink Deal To Make Huge Battery 'Gigafactory'

Newsy (July 31, 2014) The deal will help build a massive battery factory that Tesla says will produce 500,000 lithium batteries by 2020. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins