Featured Research

from universities, journals, and other organizations

Car steered with eyes, computer scientists demonstrate

Date:
April 24, 2010
Source:
Freie Universitaet Berlin
Summary:
"Keep your eyes on the road!" Scientists in Germany have given a completely new meaning to this standard rule for drivers: Using software they developed, they can steer a car with their eyes.

Scientists in Germany recently demonstrated how they can steer the vehicle that is equipped with complex electronics just by eye.
Credit: Courtesy of Spirit of Berlin / Artificial Intelligence Group / Freie Universität Berlin

"Keep your eyes on the road!" Scientists at Freie Universität working under the computer science professor Raúl Rojas have given a completely new meaning to this standard rule for drivers: Using software they developed, they can steer a car with their eyes.

On the site of the former Berlin Tempelhof Airport, the head of the project, Raul Rojas, and his team from the Artificial Intelligence Group recently demonstrated how they can steer the vehicle that is equipped with complex electronics just by eye. More than 60 journalists from around the world were there to watch.

Information about the Software: EyeDriver

The eyeDriver software is a prototype application for steering the research vehicle Spirit of Berlin using eye movements. The software was designed by computer scientists at Freie Universität Berlin in collaboration with the company, SMI (SensoMotoric Instruments). The eye movements of the driver are collected and converted into control signals for the steering wheel. The speed is controlled separately and is not included in eyeDriver. The software shows that you can drive a vehicle alone with eye movements.

The HED4 solution by SMI is used for detecting and tracking the eye movements. It is a converted bicycle helmet equipped with two cameras and an infrared LED, as well as a laptop computer with special software. One of the cameras is pointed to the front in the same direction as the person wearing the helmet (scene camera), while the other camera films one eye of the wearer (eye camera). The infrared light supports the eye camera and is pointed to the eye under observation. A transparent mirror that reflects only the infrared light is used to allow a reasonable viewing angle for the eye camera, without limiting the wearer's ability to see. After a brief calibration the software on the laptop of the HED4 is not only able to capture the position of the pupil in the eye camera, but can also calculate the position in the scene camera that the wearer is looking at. These coordinates in the image of the scene camera (viewing position) are transmitted via an ordinary LAN to the onboard computer in the Spirit of Berlin. The eyeDriver software in the onboard computer in the Spirit of Berlin receives the viewing positions at regular intervals over the LAN in the vehicle and uses it to control the steering wheel. The driver can choose between two modes: "free ride" and "routing."

In the "free ride" mode the viewing positions are linked directly with the steering wheel motor. That means that the x-coordinates of the viewing position are used to calculate the desired position of the steering wheel. The further the driver looks to the left or right, the further the steering wheel is turned in that direction. The speed of the vehicle is set in advance and kept constant, as long as the position of the gaze is recognized. In case it is not possible to detect which direction the driver is looking in, for example, if the driver's eyes are closed, the vehicle brakes automatically.

In the "routing" mode, the Spirit of Berlin steers autonomously most of the time. Only where there is a fork in the road, or an intersection, the car stops and asks the driver to select the next route. This requires the wearer of the helmet to look to the left or right for three seconds. If the driver's gaze lingers long enough in one direction, the eyeDriver software confirms acoustically that the choice has been accepted. The decision is communicated to the planner in the vehicle. Then the artificial intelligence in the Spirit of Berlin can plan the route accordingly and continue to run independently.

The Autonomous Vehicle Project

Prof. Dr. Raúl Rojas is a professor of artificial intelligence at the Institute of Computer Science at Freie Universität Berlin. He gained international success with his soccer robots, the "FU-Fighters." They were world champions twice in the small-size league. Since 2006 Prof. Rojas and his team have been designing technologies related to autonomous vehicles. As part of this project, they developed the research vehicle Spirit of Berlin, making it to the semifinals in the DARPA Urban Challenge in California in 2007.

In the fall of 2009, in the innovative vehicle steering series, based on the test vehicle, the computer scientists Tinosch Ganjineh and Miao Wang developed iDriver, with which it is possible to steer the research car using an iPhone. This series is now complemented with the EyeDriver software. It was developed primarily by Miao Wang and David Latotzky in cooperation with the firm SMI. These two developments are simply sub-projects. The core of the research continues to be the autonomous driving.

The AutoNOMOS Project

Since November 2010 the team around Prof. Rojas has been working on the further development of autonomous or semi-autonomous cars in the AutoNOMOS project headed by Tinosch Ganjineh. The project is being funded by the German Ministry of Education and Research (BMBF) in its ForMaT (Forschung für den Markt im Team) program. The funding is for two years. The project will make a significant contribution to the development of accident-free, efficient, and environmentally friendly mobility. AutoNOMOS is a modular system for the operation of autonomous or semi-autonomous cars. Using AutoNomos, it will be possible to detect impending dangers on roads, highways, and crossings (lane change, traffic jams, rights of way) at an early stage and accidents can be prevented. Once the technology is ready, it will be introduced at first on private property and, finally, in public traffic.

The Spirit of Berlin

The Spirit of Berlin is an autonomous vehicle that was designed and built by the Artificial Intelligence Group at Freie Universität Berlin as of 2007. It is a car that can be driven without a driver. A conventional car (Dodge Grand Caravan, 2000) was equipped with sensors, computers, and actuators. The sensors collect information about the immediate environment. Using this information, the software on the computers selects what to do. The resulting action is then implemented with the help of mechanical actuators.


Story Source:

The above story is based on materials provided by Freie Universitaet Berlin. Note: Materials may be edited for content and length.


Cite This Page:

Freie Universitaet Berlin. "Car steered with eyes, computer scientists demonstrate." ScienceDaily. ScienceDaily, 24 April 2010. <www.sciencedaily.com/releases/2010/04/100423215028.htm>.
Freie Universitaet Berlin. (2010, April 24). Car steered with eyes, computer scientists demonstrate. ScienceDaily. Retrieved October 1, 2014 from www.sciencedaily.com/releases/2010/04/100423215028.htm
Freie Universitaet Berlin. "Car steered with eyes, computer scientists demonstrate." ScienceDaily. www.sciencedaily.com/releases/2010/04/100423215028.htm (accessed October 1, 2014).

Share This



More Matter & Energy News

Wednesday, October 1, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

US Police Put Body Cameras to the Test

US Police Put Body Cameras to the Test

AFP (Oct. 1, 2014) — Police body cameras are gradually being rolled out across the US, with interest surging after the fatal police shooting in August of an unarmed black teenager. Duration: 02:18 Video provided by AFP
Powered by NewsLook.com
Argentina's Tax Evaders Detected, Hunted Down by Drones

Argentina's Tax Evaders Detected, Hunted Down by Drones

AFP (Sep. 30, 2014) — Argentina doesn't only have Lionel Messi the footballer, it has now also acquired "Mesi" the drone system which monitors undeclared mansions, swimming pools and soy fields to curb tax evasion in the country. Duration: 01:18 Video provided by AFP
Powered by NewsLook.com
Do Video Games Trump Brain Training For Cognitive Boosts?

Do Video Games Trump Brain Training For Cognitive Boosts?

Newsy (Sep. 29, 2014) — More and more studies are showing positive benefits to playing video games, but the jury is still out on brain training programs. Video provided by Newsy
Powered by NewsLook.com
CERN Celebrates 60 Years of Science

CERN Celebrates 60 Years of Science

Reuters - Business Video Online (Sep. 29, 2014) — CERN, the European Organisation for Nuclear Research, celebrates 60 years of bringing nations together through science. As Joanna Partridge reports from inside the famous science centre it's also planning to turn the Large Hadron Collider particle accelerator back on after an upgrade. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins