Featured Research

from universities, journals, and other organizations

Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos

Date:
November 14, 2005
Source:
Stanford University
Summary:
We've all done it. Lost that priceless Kodak moment by snapping a photo that was grainy, dark, overexposed or out of focus. While user ineptitude is often at the root of our blurry snapshots, the limits of conventional cameras can be to blame as well. But Stanford computer scientists are now making strides to combat the fuzzy photo by bringing photographic technology into sharp focus.

Images of Rodin's Burghers of Calais, which grace Stanford's Memorial Court, have been digitally refocused using the light field camera. Focus in these three images shifts from the nearest to the furthest statue, ultimately bringing both bronze figures into sharp clarity.
Credit: Ren Ng / Image courtesy of Stanford University

We've all done it. Lost that priceless Kodak moment by snapping a photo that was grainy, dark, overexposed or out of focus. While user ineptitude is often at the root of our blurry snapshots, the limits of conventional cameras can be to blame as well. But Stanford computer scientists are now making strides to combat the fuzzy photo by bringing photographic technology into sharp focus.

Ren Ng, a computer science graduate student in the lab of Pat Hanrahan, the Canon USA Professor in the School of Engineering, has developed a "light field camera" capable of producing photographs in which subjects at every depth appear in finely tuned focus. Adapted from a conventional camera, the light field camera overcomes low-light and high-speed conditions that plague photography and foreshadows potential improvements to current scientific microscopy, security surveillance and sports and commercial photography.

"Currently, cameras have to make decisions about the focus before taking the exposure, which engineering-wise can be very difficult," said Ng. "With the light field camera, you can take one exposure, capture a lot more information about the light and make focusing decisions after you've already taken the shot. It is more flexible."

The light field camera, sometimes referred to as a "plenoptic camera," looks and operates exactly like an ordinary handheld digital camera. The difference lies inside. In a conventional camera, rays of light are corralled through the camera's main lens and converge on the film or digital photosensor directly behind it. Each point on the resulting two-dimensional photo is the sum of all the light rays striking that location.

The light field camera adds an additional element—a microlens array—inserted between the main lens and the photosensor. Resembling the multi-faceted compound eye of an insect, the microlens array is a square panel composed of nearly 90,000 miniature lenses. Each lenslet separates back out the converged light rays received from the main lens before they hit the photosensor and changes the way the light information is digitally recorded. Custom processing software manipulates this "expanded light field" and traces where each ray would have landed if the camera had been focused at many different depths. The final output is a synthetic image in which the subjects have been digitally refocused.

Tweaking tradition

Expanding the light field demands that the rules of traditional photography be tweaked. Ordinarily, a tradeoff exists between aperture size, which determines the amount of light reaching the film or photosensor, and depth of field, which determines which objects in an image will be sharp and which will be fuzzy. As the aperture size increases, more light passes through the lens and the depth of field shallows—bringing into focus only the nearest objects and severely blurring the surrounding subjects.

The light field camera decouples aperture size and depth of field. The microlens array harnesses the additional light to reveal the depth of each object in the image and project tiny, sharp subimages onto the photosensor. The blurry halo typically surrounding the centrally focused subject is "un-blurred." In this way, the benefits of large apertures—increased light, shorter exposure time, reduced graininess—can be exploited without sacrificing the depth of field or sharpness of the image.

Extending the depth of field while maintaining a wide aperture may provide significant benefits to several industries, such as security surveillance. Often mounted in crowded or dimly lit areas, such as congested airport security lines and backdoor exits, monitoring cameras notoriously produce grainy, indiscernible images.

"Let's say it's nighttime and the security camera is trying to focus on something," said Ng. "If someone comes and they are moving around, the camera will have trouble tracking them. Or if there are two people, whom does it choose to track? The typical camera will close down its aperture to try capturing a sharp image of both people, but the small aperture will produce video that is dark and grainy."

The idea behind the light field camera is not new. With the roots of its conception dating back nearly a century, several variants of the light field camera have been devised over the years, each with slight variations in its optical system. Other models that rely on refocusing light fields have been slow and bulky and have generated gaps in the light fields, known as aliasing. Ng's camera—compact and portable with drastically reduced aliasing—displays greater commercial utility.

Marc Levoy, professor of computer science and electrical engineering; Mark Horowitz, the Yahoo! Founders Professor in the School of Engineering; Mathieu Bredif, M.S. '05 in computer science; and Gene Duval, B.S. '75, M.S. '78 in mechanical engineering and founder of Duval Design, also contributed to this work.

The research was supported by the Office of Technology Licensing Birdseed Fund, which provides small grants for the prototype development of unlicensed technologies. A manuscript detailing the theoretic performance of the light field camera appeared in Transactions on Graphics, published by the Association for Computing Machinery in July, and subsequently was presented at the 2005 ACM SIGGRAPH (Special Interest Group on Computer Graphics and Interactive Techniques) conference in August in Los Angeles.


Story Source:

The above story is based on materials provided by Stanford University. Note: Materials may be edited for content and length.


Cite This Page:

Stanford University. "Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos." ScienceDaily. ScienceDaily, 14 November 2005. <www.sciencedaily.com/releases/2005/11/051114111431.htm>.
Stanford University. (2005, November 14). Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos. ScienceDaily. Retrieved October 1, 2014 from www.sciencedaily.com/releases/2005/11/051114111431.htm
Stanford University. "Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos." ScienceDaily. www.sciencedaily.com/releases/2005/11/051114111431.htm (accessed October 1, 2014).

Share This



More Matter & Energy News

Wednesday, October 1, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Argentina's Tax Evaders Detected, Hunted Down by Drones

Argentina's Tax Evaders Detected, Hunted Down by Drones

AFP (Sep. 30, 2014) Argentina doesn't only have Lionel Messi the footballer, it has now also acquired "Mesi" the drone system which monitors undeclared mansions, swimming pools and soy fields to curb tax evasion in the country. Duration: 01:18 Video provided by AFP
Powered by NewsLook.com
Do Video Games Trump Brain Training For Cognitive Boosts?

Do Video Games Trump Brain Training For Cognitive Boosts?

Newsy (Sep. 29, 2014) More and more studies are showing positive benefits to playing video games, but the jury is still out on brain training programs. Video provided by Newsy
Powered by NewsLook.com
CERN Celebrates 60 Years of Science

CERN Celebrates 60 Years of Science

Reuters - Business Video Online (Sep. 29, 2014) CERN, the European Organisation for Nuclear Research, celebrates 60 years of bringing nations together through science. As Joanna Partridge reports from inside the famous science centre it's also planning to turn the Large Hadron Collider particle accelerator back on after an upgrade. Video provided by Reuters
Powered by NewsLook.com
This 'Invisibility Cloak' Is Simpler Than Most

This 'Invisibility Cloak' Is Simpler Than Most

Newsy (Sep. 28, 2014) Researchers from the University of Rochester have created a type of invisibility cloak with simple focal lenses. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins