Featured Research

from universities, journals, and other organizations

Body-mounted cameras turn motion capture inside out

Date:
August 9, 2011
Source:
Carnegie Mellon University
Summary:
Traditional motion capture techniques use cameras to meticulously record the movements of actors inside studios, enabling those movements to be translated into digital models. But by turning the cameras around -- mounting almost two dozen, outward-facing cameras on the actors themselves -- scientists have shown that motion capture can occur almost anywhere -- in natural environments, over large areas and outdoors.

By turning the cameras around -- mounting almost two dozen, outward-facing cameras on the actors themselves -- scientists have shown that motion capture can occur almost anywhere -- in natural environments, over large areas and outdoors.
Credit: Image courtesy of Carnegie Mellon University

Traditional motion capture techniques use cameras to meticulously record the movements of actors inside studios, enabling those movements to be translated into digital models. But by turning the cameras around -- mounting almost two dozen, outward-facing cameras on the actors themselves -- scientists at Disney Research, Pittsburgh (DRP), and Carnegie Mellon University (CMU) have shown that motion capture can occur almost anywhere -- in natural environments, over large areas and outdoors.

Related Articles


Motion capture makes possible scenes such as those in "Pirates of the Caribbean: Dead Man's Chest," where the movements of actor Bill Nighy were translated into a digitally created Davy Jones with octopus-like tentacles forming his beard. But body-mounted cameras enable capture of motions, such as running outside or swinging on monkey bars, that would be difficult -- if not impossible -- otherwise, said Takaaki Shiratori, a post-doctoral associate at DRP.

"This could be the future of motion capture," said Shiratori, who will make a presentation about the new technique today (Aug. 8) at SIGGRAPH 2011, the International Conference on Computer Graphics and Interactive Techniques in Vancouver. As video cameras become ever smaller and cheaper, "I think anyone will be able to do motion capture in the not-so-distant future," he said.

Other researchers on the project include Jessica Hodgins, DRP director and a CMU professor of robotics and computer science; Hyun Soo Park, a Ph.D. student in mechanical engineering at CMU; Leonid Sigal, DRP researcher; and Yaser Sheikh, assistant research professor in CMU's Robotics Institute.

The wearable camera system makes it possible to reconstruct the relative and global motions of an actor thanks to a process called structure from motion (SfM). Takeo Kanade, a CMU professor of computer science and robotics and a pioneer in computer vision, developed SfM 20 years ago as a means of determining the three-dimensional structure of an object by analyzing the images from a camera as it moves around the object, or as the object moves past the camera.

In this application, SfM is not used primarily to analyze objects in a person's surroundings, but to estimate the pose of the cameras on the person. Researchers used Velcro to mount 20 lightweight cameras on the limbs, and trunk of each subject. Each camera was calibrated with respect to a reference structure. Each person then performed a range-of-motion exercise that allowed the system to automatically build a digital skeleton and estimate positions of cameras with respect to that skeleton.

SfM is used to estimate rough position and orientation of limbs as the actor moves through an environment and to collect sparse 3D information about the environment that can provide context for the captured motion. The rough position and orientation of limbs serves as an initial guess for a refinement step that optimizes the configuration of the body and its location in the environment, resulting in the final motion capture result.

The quality of motion capture from body-mounted cameras does not yet match the fidelity of traditional motion capture, Shiratori said, but will improve as the resolution of small video cameras continues to improve.

The technique requires a significant amount of computational power; a minute of motion capture now can require an entire day to process. Future work will include efforts to find computational shortcuts, such as performing many of the steps simultaneously through parallel processing.

For more information and to see a video, visit the project website at: http://drp.disneyresearch.com/projects/mocap/


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Body-mounted cameras turn motion capture inside out." ScienceDaily. ScienceDaily, 9 August 2011. <www.sciencedaily.com/releases/2011/08/110808143001.htm>.
Carnegie Mellon University. (2011, August 9). Body-mounted cameras turn motion capture inside out. ScienceDaily. Retrieved February 1, 2015 from www.sciencedaily.com/releases/2011/08/110808143001.htm
Carnegie Mellon University. "Body-mounted cameras turn motion capture inside out." ScienceDaily. www.sciencedaily.com/releases/2011/08/110808143001.htm (accessed February 1, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Sunday, February 1, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Smart Glasses Augment Reality to Help Visually Impaired

Smart Glasses Augment Reality to Help Visually Impaired

Reuters - Innovations Video Online (Feb. 1, 2015) — New augmented reality smart glasses developed by researchers at Oxford University can help people with visual impairments improve their vision by providing depth-based feedback, allowing users to "see" better. Joel Flynn reports. Video provided by Reuters
Powered by NewsLook.com
Verizon Will Let Users Opt Out Of 'Supercookies'

Verizon Will Let Users Opt Out Of 'Supercookies'

Newsy (Jan. 31, 2015) — Verizon says users can remove its ad targeting software from their phones completely. Video provided by Newsy
Powered by NewsLook.com
China's "Great Firewall" Frustrates Internet Users

China's "Great Firewall" Frustrates Internet Users

Reuters - News Video Online (Jan. 31, 2015) — The Chinese government moves to tighten regulations for virtual private network (VPN) services that are used to access websites and services normally blocked in China. That&apos;s affected many internet users in the country. Yiming Woo reports. Video provided by Reuters
Powered by NewsLook.com
Google Forced To Obey Law, Changes U.K. Privacy Policy

Google Forced To Obey Law, Changes U.K. Privacy Policy

Newsy (Jan. 30, 2015) — Google has agreed to make its privacy policy more transparent in compliance with a U.K. law. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins