Featured Research

from universities, journals, and other organizations

New interactive system detects touch and gestures on any surface

Date:
October 9, 2012
Source:
Purdue University
Summary:
People can let their fingers -- and hands -- do the talking with a new touch-activated system that projects onto walls and other surfaces and allows users to interact with their environment and each other. The system identifies the fingers of a person's hand while touching any plain surface. It also recognizes hand posture and gestures, revealing individual users by their unique traits.

This composite image shows how fingers and hands are computed in a new touch-activated system that projects onto walls and other surfaces and allows people to interact with their environment and each other.
Credit: Purdue University image

People can let their fingers -- and hands -- do the talking with a new touch-activated system that projects onto walls and other surfaces and allows users to interact with their environment and each other.

The system identifies the fingers of a person's hand while touching any plain surface. It also recognizes hand posture and gestures, revealing individual users by their unique traits.

"Imagine having giant iPads everywhere, on any wall in your house or office, every kitchen counter, without using expensive technology," said Niklas Elmqvist, an assistant professor of electrical and computer engineering at Purdue University. "You can use any surface, even a dumb physical surface like wood. You don't need to install expensive LED displays and touch-sensitive screens."

The new "extended multitouch" system allows more than one person to use a surface at the same time and also enables people to use both hands, distinguishing between the right and left hand.

Research indicates the system is 98 percent accurate in determining hand posture, which is critical to recognizing gestures and carrying out commands. The technology has many possible applications, said Karthik Ramani, Purdue's Donald W. Feddersen Professor of Mechanical Engineering.

"Basically, it might be used for any interior surface to interact virtually with a computer," he said. "You could use it for living environments, to turn appliances on, in a design studio to work on a concept or in a laboratory, where a student and instructor interact."

Findings are detailed in a research paper being presented this week during the Association for Computing Machinery Symposium on User Interface Software and Technology (ACM UIST 2012) in Cambridge, Mass. The paper was written by doctoral students Sundar Murugappan and Vinayak, who uses only one name, Elmqvist and Ramani.

The system uses the Microsoft Kinect camera, which senses three-dimensional space.

"We project a computer screen on any surface, just a normal table covered with white paper," Ramani said. "The camera sees where your hands are, which fingers you are pressing on the surface, tracks hand gestures and recognizes whether there is more than one person working at the same time."

The Kinect camera senses depth, making it possible to see how far each 3-D pixel is from the camera. The researchers married the camera with a new computer model for the hand.

"So we can isolate different parts of a hand or finger to show how far they are from the surface," Elmqvist said. "We can see which fingers are touching the surface. With this technology, you could potentially call up a menu by positioning your hand just above the surface."

That camera coupled with the hand model allows the system to locate the center of each hand, which is necessary for determining gestures and distinguishing between left and right hands.

Researchers explored possible applications, including one that allows the user to draw a sketch with a pen and then modify it with their hands.

"We can detect gestural interactions between more than one hand and more than one user," Ramani said. "You could do precision things, like writing with a pen, with your dominant hand and more general things, such as selecting colors, using the non-dominant hand."

Researchers tested the concept in two user studies, one with 14 volunteers and the other with nine. Findings from one study indicated display features should be no smaller than 18 millimeters, or about an inch, to be efficient.

"While new and more precise cameras will improve accuracy, we have established the necessary hand models and principles for the system," Ramani said.

The other user study showed the system can effectively determine hand posture and whether the right or left hand is being used.

"We wanted to see how accurate we could be while figuring out different configurations, such as touching with all 10 fingers, which hand is being used and so on," Elmqvist said.

Patents are pending on the concept.

The research has been supported by the National Science Foundation and the Donald W. Feddersen Chaired Professorship at Purdue School of Mechanical Engineering.

(A video about the system can be viewed at https://Engineering.Purdue.edu/cdesign/wp/?p=1423).


Story Source:

The above story is based on materials provided by Purdue University. The original article was written by Emil Venere. Note: Materials may be edited for content and length.


Cite This Page:

Purdue University. "New interactive system detects touch and gestures on any surface." ScienceDaily. ScienceDaily, 9 October 2012. <www.sciencedaily.com/releases/2012/10/121009171500.htm>.
Purdue University. (2012, October 9). New interactive system detects touch and gestures on any surface. ScienceDaily. Retrieved August 22, 2014 from www.sciencedaily.com/releases/2012/10/121009171500.htm
Purdue University. "New interactive system detects touch and gestures on any surface." ScienceDaily. www.sciencedaily.com/releases/2012/10/121009171500.htm (accessed August 22, 2014).

Share This




More Matter & Energy News

Friday, August 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Former TSA X-Ray Scanners Easily Tricked To Miss Weapons

Former TSA X-Ray Scanners Easily Tricked To Miss Weapons

Newsy (Aug. 21, 2014) Researchers found the scanners could be duped simply by placing a weapon off to the side of the body or encasing it under a plastic shield. Video provided by Newsy
Powered by NewsLook.com
Flower Power! Dandelions Make Car Tires?

Flower Power! Dandelions Make Car Tires?

Reuters - Business Video Online (Aug. 20, 2014) Forget rolling on rubber, could car drivers soon be traveling on tires made from dandelions? Teams of scientists are racing to breed a type of the yellow flower whose taproot has a milky fluid with tire-grade rubber particles in it. As Joanna Partridge reports, global tire makers are investing millions in research into a new tire source. Video provided by Reuters
Powered by NewsLook.com
Awesome New Camouflage Sheet Was Inspired By Octopus Skin

Awesome New Camouflage Sheet Was Inspired By Octopus Skin

Newsy (Aug. 19, 2014) Scientists have developed a new device that mimics the way octopuses blend in with their surroundings to hide from dangerous predators. Video provided by Newsy
Powered by NewsLook.com
Researcher Testing on-Field Concussion Scanners

Researcher Testing on-Field Concussion Scanners

AP (Aug. 19, 2014) Four Texas high school football programs are trying out an experimental system designed to diagnose concussions on the field. The technology is in response to growing concern over head trauma in America's most watched sport. (Aug. 19) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins