Featured Research

from universities, journals, and other organizations

Seamless photography: Using mathematical models for image stitching

Date:
October 2, 2013
Source:
Society for Industrial and Applied Mathematics
Summary:
Panoramic photographs were invented to capture large objects or scenes that could not otherwise fit within the constraints of a single photo. Panoramic photography is achieved through image stitching, a process that combines two or more photographs, seamlessly blending input images with overlapping regions into one picture.

Two input images (from left) stitched together using the proposed method (right).
Credit: Photo credit for original image: Blanka M. Lukes, Prague Private Guides; Photo credit for modified image: Wei Wang and Michael Ng.

A photo captures only as much as the camera in use will allow, and is therefore limited by the field of view of the camera's lens. In the case of smartphones and many advanced cameras, the view from the lens is much smaller than the view from your own eyes.

Panoramic photographs were invented to capture large objects or scenes that could not otherwise fit within the constraints of a single photo. Panoramic photography is achieved through image stitching, a process that combines two or more photographs, seamlessly blending input images with overlapping regions into one picture. A paper published by Wei Wang and Michael Ng in the SIAM Journal on Imaging Sciences this summer aims to develop an algorithm for image stitching.

Image stitching involves two steps: image alignment and image blending. Image alignment finds point pairs in the overlapping region of two images that correspond to one another. Image blending combines the two aligned images seamlessly. This step is important if the pixel intensities in the different images vary enough to produce artifacts such as varying lighting conditions and different exposure settings. In this paper, the authors focus on image blending, assuming that the images have been aligned.

Many different approaches for image blending are seen in the literature. "The traditional method is to search for a curve in the overlapping area in which the differences among the input images are minimal," explains author Michael Ng. "However, the curve may not be determined accurately because of light intensity, color inconsistency, parallax, occlusion, etc."

The approach used in this paper instead minimizes seam artifacts by smoothing the transition between the images. The mosaic image here is a weighted combination of the input images. This means the pixel values from the two overlapping images are combined using a weighted average for qualities such as exposure, local contrast, saturation, etc.

How is this achieved?

Many systems, both natural and human-made, seek out the lowest energy state, such as, a ball rolling down a hill, or a snow-laden tree branch bending to maintain the lowest possible energy in the system. The concept of minimizing the energy of a given system is also used in image processing. For a given image, an energy function is defined and minimized to get a better image (i.e. less noise, better sharpness, higher contrast, etc.). This is the approach the authors use in the paper. Seamless combination of images is achieved by minimizing an energy function based on intensity or gradient differences of the two images.

"According to the model, we construct a weighting function over the overlapping area so that a panoramic image can be generated," says Ng. "The optimal weighting function can be obtained by minimizing the overall energy of the mathematical model." Thus, in the proposed model, both the weighting function and the final blending in the overlapping region are based on solving an energy minimizing problem. The authors show how to define an energy function and develop an algorithm to minimize it.

This variational method -- based on achieving the lowest energy or ground state -- is seen to produce a more visually appealing photo in comparison to other existing methods.

Future work may extend the scope of this research beyond two-dimensional images. "It is interesting to consider extending the current variational approach to tackle the problem of three-dimensional image stitching in medical imaging applications and stitching video in computer applications," Ng says.


Story Source:

The above story is based on materials provided by Society for Industrial and Applied Mathematics. Note: Materials may be edited for content and length.


Journal References:

  1. Wei Wang, Michael K. Ng. A Variational Approach for Image Stitching I. SIAM Journal on Imaging Sciences, 2013; 6 (3): 1318 DOI: 10.1137/110819871
  2. Michael K. Ng, Wei Wang. A Variational Approach for Image Stitching II: Using Image Gradients. SIAM Journal on Imaging Sciences, 2013; 6 (3): 1345 DOI: 10.1137/120872140

Cite This Page:

Society for Industrial and Applied Mathematics. "Seamless photography: Using mathematical models for image stitching." ScienceDaily. ScienceDaily, 2 October 2013. <www.sciencedaily.com/releases/2013/10/131002125512.htm>.
Society for Industrial and Applied Mathematics. (2013, October 2). Seamless photography: Using mathematical models for image stitching. ScienceDaily. Retrieved October 21, 2014 from www.sciencedaily.com/releases/2013/10/131002125512.htm
Society for Industrial and Applied Mathematics. "Seamless photography: Using mathematical models for image stitching." ScienceDaily. www.sciencedaily.com/releases/2013/10/131002125512.htm (accessed October 21, 2014).

Share This



More Computers & Math News

Tuesday, October 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Newsy (Oct. 21, 2014) If you've ever watched "Back to the Future Part II" and wanted to get your hands on a hoverboard, well, you might soon be in luck. Video provided by Newsy
Powered by NewsLook.com
Robots to Fly Planes Where Humans Can't

Robots to Fly Planes Where Humans Can't

Reuters - Innovations Video Online (Oct. 21, 2014) Researchers in South Korea are developing a robotic pilot that could potentially replace humans in the cockpit. Unlike drones and autopilot programs which are configured for specific aircraft, the robots' humanoid design will allow it to fly any type of plane with no additional sensors. Ben Gruber reports. Video provided by Reuters
Powered by NewsLook.com
Japanese Scientists Unveil Floating 3D Projection

Japanese Scientists Unveil Floating 3D Projection

Reuters - Innovations Video Online (Oct. 20, 2014) Scientists in Tokyo have demonstrated what they say is the world's first 3D projection that floats in mid air. A laser that fires a pulse up to a thousand times a second superheats molecules in the air, creating a spark which can be guided to certain points in the air to shape what the human eye perceives as an image. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Apple Enters Mobile Payment Business

Apple Enters Mobile Payment Business

AP (Oct. 20, 2014) Apple is making a strategic bet with the launch of Apple Pay, the mobile pay service aimed at turning your iPhone into your wallet. (Oct. 20) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins