Featured Research

from universities, journals, and other organizations

New Image Sensor Will Show What The Eyes See, And A Camera Cannot

Date:
January 21, 2005
Source:
National Science Foundation
Summary:
Researchers are developing new technologies that may give robots the visual-sensing edge they need to monitor dimly lit airports, pilot vehicles in extreme weather and direct unmanned combat vehicles.

Intrigue Technologies are developing an image sensor that will approach the adaptive capabilities of the human eye. The chip in this photo is a product of the team's related research at Carnegie Mellon. Like the proposed chip, it is a computational image sensor that pre-processes an image before sending it to a computer, video screen or other outlet.
Credit: Vladimir Brajovic, Carnegie Mellon University and Intrigue Technologies

ARLINGTON, Va.— Researchers are developing new technologies that may give robots the visual-sensing edge they need to monitor dimly lit airports, pilot vehicles in extreme weather and direct unmanned combat vehicles.

Related Articles


The researchers intend to create an imaging chip that defeats the harmful effects of arbitrary illumination, allowing robotic vision to leave the controlled lighting of a laboratory and enter the erratic lighting of the natural world. In a first step, the researchers have now developed software that simulates the chip circuitry, a program that alone is capable of uncovering hidden detail in existing images.

Designed by robot-vision expert, Vladimir Brajovic, and his colleagues at Intrigue Technologies, Inc.—a spin-off of the team’s Carnegie Mellon University research—the new optical device will work more like a retina than a standard imaging sensor.

Just as neurons in the eye process information before sending signals to the brain, the pixels of the new device will "talk" to each other about what they see. The pixels will use the information to modify their behavior and adapt to lighting, ultimately gathering visual information even under adverse conditions.

Through an online demonstration, the simulator software plug-in, dubbed Shadow Illuminator , has processed more than 80,000 pictures from around the world. By balancing exposure across images, clearing away "noise" and improving contrast, the software revealed missing textures, exposed concealed individuals and even uncovered obscured features in medical x-ray film.

This new approach counters a persistent problem for computer-vision cameras – when capturing naturally lit scenes, a camera can be as much of an obstacle as it is a tool. Despite careful attention to shutter speeds and other settings, the brightly illuminated parts of the image are often washed out, and shadowy parts of the image are completely black.

The mathematical churning behind that process will allow pixels to "perceive" reflectance—a surface property that determines how much incoming light reflects off an object, light that a camera can capture.

Light illuminating an object helps reveal reflectance to a camera or an eye. However, illumination is a necessary evil, says Brajovic.

"Most of the problems in robotic imaging can be traced back to having too much light in some parts of the image and too little in others," he says, "and yet we need light to reveal the objects in a field of view."

To produce images that appear uniformly illuminated, the researchers created a system that widens the range of light intensities a sensor can accommodate.

According to Brajovic, limitations in standard imaging sensors have hindered many vision applications, such as security and surveillance, intelligent transportation systems, and defense systems – not to mention ruining a few cherished family photos.

The researchers hope the new technology will yield high-quality image data, despite natural lighting, and ultimately improve the reliability of machine-vision systems, such as those for biometric identification, enhanced X-ray diagnostics and space exploration imagers.

Additional comments from the researcher:

"The washed out and underexposed images captured by today’s digital cameras are simply too confusing for machines to interpret, ultimately leading to failure of their vision systems in many critical applications." – Vladimir Brajovic, Carnegie Mellon University and Intrigue Technologies, Inc.

"Often, when we take a picture with a digital or film camera, we are disappointed that many details we remember seeing appear in the image buried in deep shadows or washed out in overexposed regions. This is because our eyes have a built-in mechanism to adapt to local illumination conditions, while our cameras don't. Because of this camera deficiency, robot vision often fails." – Vladimir Brajovic


Story Source:

The above story is based on materials provided by National Science Foundation. Note: Materials may be edited for content and length.


Cite This Page:

National Science Foundation. "New Image Sensor Will Show What The Eyes See, And A Camera Cannot." ScienceDaily. ScienceDaily, 21 January 2005. <www.sciencedaily.com/releases/2005/01/050121092854.htm>.
National Science Foundation. (2005, January 21). New Image Sensor Will Show What The Eyes See, And A Camera Cannot. ScienceDaily. Retrieved October 25, 2014 from www.sciencedaily.com/releases/2005/01/050121092854.htm
National Science Foundation. "New Image Sensor Will Show What The Eyes See, And A Camera Cannot." ScienceDaily. www.sciencedaily.com/releases/2005/01/050121092854.htm (accessed October 25, 2014).

Share This



More Matter & Energy News

Saturday, October 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

IKEA Desk Converts From Standing to Sitting With One Button

IKEA Desk Converts From Standing to Sitting With One Button

Buzz60 (Oct. 24, 2014) IKEA is out with a new convertible desk that can convert from a sitting desk to a standing one with just the push of a button. Jen Markham explains. Video provided by Buzz60
Powered by NewsLook.com
Ebola Protective Suits Being Made in China

Ebola Protective Suits Being Made in China

AFP (Oct. 24, 2014) A factory in China is busy making Ebola protective suits for healthcare workers and others fighting the spread of the virus. Duration: 00:38 Video provided by AFP
Powered by NewsLook.com
Real-Life Transformer Robot Walks, Then Folds Into a Car

Real-Life Transformer Robot Walks, Then Folds Into a Car

Buzz60 (Oct. 24, 2014) Brave Robotics and Asratec teamed with original Transformers toy company Tomy to create a functional 5-foot-tall humanoid robot that can march and fold itself into a 3-foot-long sports car. Jen Markham has the story. Video provided by Buzz60
Powered by NewsLook.com
Police Testing New Gunfire Tracking Technology

Police Testing New Gunfire Tracking Technology

AP (Oct. 24, 2014) A California-based startup has designed new law enforcement technology that aims to automatically alert dispatch when an officer's gun is unholstered and fired. Two law enforcement agencies are currently testing the technology. (Oct. 24) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins