Featured Research

from universities, journals, and other organizations

Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos

Date:
November 14, 2005
Source:
Stanford University
Summary:
We've all done it. Lost that priceless Kodak moment by snapping a photo that was grainy, dark, overexposed or out of focus. While user ineptitude is often at the root of our blurry snapshots, the limits of conventional cameras can be to blame as well. But Stanford computer scientists are now making strides to combat the fuzzy photo by bringing photographic technology into sharp focus.

Images of Rodin's Burghers of Calais, which grace Stanford's Memorial Court, have been digitally refocused using the light field camera. Focus in these three images shifts from the nearest to the furthest statue, ultimately bringing both bronze figures into sharp clarity.
Credit: Ren Ng / Image courtesy of Stanford University

We've all done it. Lost that priceless Kodak moment by snapping a photo that was grainy, dark, overexposed or out of focus. While user ineptitude is often at the root of our blurry snapshots, the limits of conventional cameras can be to blame as well. But Stanford computer scientists are now making strides to combat the fuzzy photo by bringing photographic technology into sharp focus.

Ren Ng, a computer science graduate student in the lab of Pat Hanrahan, the Canon USA Professor in the School of Engineering, has developed a "light field camera" capable of producing photographs in which subjects at every depth appear in finely tuned focus. Adapted from a conventional camera, the light field camera overcomes low-light and high-speed conditions that plague photography and foreshadows potential improvements to current scientific microscopy, security surveillance and sports and commercial photography.

"Currently, cameras have to make decisions about the focus before taking the exposure, which engineering-wise can be very difficult," said Ng. "With the light field camera, you can take one exposure, capture a lot more information about the light and make focusing decisions after you've already taken the shot. It is more flexible."

The light field camera, sometimes referred to as a "plenoptic camera," looks and operates exactly like an ordinary handheld digital camera. The difference lies inside. In a conventional camera, rays of light are corralled through the camera's main lens and converge on the film or digital photosensor directly behind it. Each point on the resulting two-dimensional photo is the sum of all the light rays striking that location.

The light field camera adds an additional element—a microlens array—inserted between the main lens and the photosensor. Resembling the multi-faceted compound eye of an insect, the microlens array is a square panel composed of nearly 90,000 miniature lenses. Each lenslet separates back out the converged light rays received from the main lens before they hit the photosensor and changes the way the light information is digitally recorded. Custom processing software manipulates this "expanded light field" and traces where each ray would have landed if the camera had been focused at many different depths. The final output is a synthetic image in which the subjects have been digitally refocused.

Tweaking tradition

Expanding the light field demands that the rules of traditional photography be tweaked. Ordinarily, a tradeoff exists between aperture size, which determines the amount of light reaching the film or photosensor, and depth of field, which determines which objects in an image will be sharp and which will be fuzzy. As the aperture size increases, more light passes through the lens and the depth of field shallows—bringing into focus only the nearest objects and severely blurring the surrounding subjects.

The light field camera decouples aperture size and depth of field. The microlens array harnesses the additional light to reveal the depth of each object in the image and project tiny, sharp subimages onto the photosensor. The blurry halo typically surrounding the centrally focused subject is "un-blurred." In this way, the benefits of large apertures—increased light, shorter exposure time, reduced graininess—can be exploited without sacrificing the depth of field or sharpness of the image.

Extending the depth of field while maintaining a wide aperture may provide significant benefits to several industries, such as security surveillance. Often mounted in crowded or dimly lit areas, such as congested airport security lines and backdoor exits, monitoring cameras notoriously produce grainy, indiscernible images.

"Let's say it's nighttime and the security camera is trying to focus on something," said Ng. "If someone comes and they are moving around, the camera will have trouble tracking them. Or if there are two people, whom does it choose to track? The typical camera will close down its aperture to try capturing a sharp image of both people, but the small aperture will produce video that is dark and grainy."

The idea behind the light field camera is not new. With the roots of its conception dating back nearly a century, several variants of the light field camera have been devised over the years, each with slight variations in its optical system. Other models that rely on refocusing light fields have been slow and bulky and have generated gaps in the light fields, known as aliasing. Ng's camera—compact and portable with drastically reduced aliasing—displays greater commercial utility.

Marc Levoy, professor of computer science and electrical engineering; Mark Horowitz, the Yahoo! Founders Professor in the School of Engineering; Mathieu Bredif, M.S. '05 in computer science; and Gene Duval, B.S. '75, M.S. '78 in mechanical engineering and founder of Duval Design, also contributed to this work.

The research was supported by the Office of Technology Licensing Birdseed Fund, which provides small grants for the prototype development of unlicensed technologies. A manuscript detailing the theoretic performance of the light field camera appeared in Transactions on Graphics, published by the Association for Computing Machinery in July, and subsequently was presented at the 2005 ACM SIGGRAPH (Special Interest Group on Computer Graphics and Interactive Techniques) conference in August in Los Angeles.


Story Source:

The above story is based on materials provided by Stanford University. Note: Materials may be edited for content and length.


Cite This Page:

Stanford University. "Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos." ScienceDaily. ScienceDaily, 14 November 2005. <www.sciencedaily.com/releases/2005/11/051114111431.htm>.
Stanford University. (2005, November 14). Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos. ScienceDaily. Retrieved July 25, 2014 from www.sciencedaily.com/releases/2005/11/051114111431.htm
Stanford University. "Computer Scientists Create 'light Field Camera' Banishing Fuzzy Photos." ScienceDaily. www.sciencedaily.com/releases/2005/11/051114111431.htm (accessed July 25, 2014).

Share This




More Matter & Energy News

Friday, July 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

TSA Administrator on Politics and Flight Bans

TSA Administrator on Politics and Flight Bans

AP (July 24, 2014) TSA administrator, John Pistole's took part in the Aspen Security Forum 2014, where he answered questions on lifting of the ban on flights into Israel's Tel Aviv airport and whether politics played a role in lifting the ban. (July 24) Video provided by AP
Powered by NewsLook.com
Creative Makeovers for Ugly Cellphone Towers

Creative Makeovers for Ugly Cellphone Towers

AP (July 24, 2014) Mobile phone companies and communities across the country are going to new lengths to disguise those unsightly cellphone towers. From a church bell tower to a flagpole, even a pencil, some towers are trying to make a point. (July 24) Video provided by AP
Powered by NewsLook.com
Algonquin Power Goes Activist on Its Target Gas Natural

Algonquin Power Goes Activist on Its Target Gas Natural

TheStreet (July 23, 2014) When The Deal's Amanda Levin exclusively reported that Gas Natural had been talking to potential suitors, the Ohio company responded with a flat denial, claiming its board had not talked to anyone about a possible sale. Lo and behold, Canadian utility Algonquin Power and Utilities not only had approached the company, but it did it three times. Its last offer was for $13 per share as Gas Natural's was trading at a 60-day moving average of about $12.50 per share. Now Algonquin, which has a 4.9% stake in Gas Natural, has taken its case to shareholders, calling on them to back its proposals or, possibly, a change in the target's board. Video provided by TheStreet
Powered by NewsLook.com
Robot Parking Valet Creates Stress-Free Travel

Robot Parking Valet Creates Stress-Free Travel

AP (July 23, 2014) 'Ray' the robotic parking valet at Dusseldorf Airport in Germany lets travelers to avoid the hassle of finding a parking spot before heading to the check-in desk. (July 23) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

    Health News

      Environment News

        Technology News



          Save/Print:
          Share:

          Free Subscriptions


          Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

          Get Social & Mobile


          Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

          Have Feedback?


          Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
          Mobile: iPhone Android Web
          Follow: Facebook Twitter Google+
          Subscribe: RSS Feeds Email Newsletters
          Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins