Featured Research

from universities, journals, and other organizations

With wave of the hand, researchers create touch-based interfaces

Date:
April 25, 2013
Source:
Carnegie Mellon University
Summary:
Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. Now researchers have demonstrated how these touch-based interfaces can be created almost at will, with the wave of a hand. For instance, the new system enables someone to rub the arm of a sofa to "paint" a remote control for her TV.

Researchers have developed a depth camera/projector system that enables people to create computer interfaces on everyday surface using hand gestures.
Credit: Chris Harrison/Carnegie Mellon University

Researchers previously have shown that a depth camera system, such as Kinect, can be combined with a projector to turn almost any surface into a touchscreen. But now researchers at Carnegie Mellon University have demonstrated how these touch-based interfaces can be created almost at will, with the wave of a hand.

Related Articles


CMU's WorldKit system enables someone to rub the arm of a sofa to "paint" a remote control for her TV or swipe a hand across an office door to post his calendar from which subsequent users can "pull down" an extended version. These ad hoc interfaces can be moved, modified or deleted with similar gestures, making them highly personalized.

Researchers at Carnegie Mellon's Human-Computer Interaction Institute (HCII) used a ceiling-mounted camera and projector to record room geometries, sense hand gestures and project images on desired surfaces.

But Robert Xiao, an HCII doctoral student, said WorldKit does not require such an elaborate installation. "Depth sensors are getting better and projectors just keep getting smaller," he said. "We envision an interactive 'light bulb' -- a miniaturized device that could be screwed into an ordinary light fixture and pointed or moved to wherever an interface is needed."

The system does not require prior calibration, automatically adjusting its sensing and image projection to the orientation of the chosen surface. Users can summon switches, message boards, indicator lights and a variety of other interface designs from a menu. Ultimately, the WorldKit team anticipates that users will be able to custom design interfaces with gestures.

Xiao developed WorldKit with Scott Hudson, an HCII professor, and Chris Harrison, a Ph.D. student. They will present their findings April 30 at CHI 2013, the Conference on Human Factors in Computing Systems, in Paris.

"People have talked about creating smart environments, where sensors, displays and computers are interwoven," said Harrison, who will join the HCII faculty this summer. "But usually, that doesn't amount to much besides mounting a camera up on the ceiling. The room may be smart, but it has no outlet for that smartness. With WorldKit, we say forget touchscreens and go straight to projectors, which can make the room truly interactive."

Though WorldKit now focuses on interacting with surfaces, the researchers anticipate future work may enable users to interact with the system in free space. Likewise, higher resolution depth cameras may someday enable the system to sense detailed finger gestures. In addition to gestures, the system also could be designed to respond to voice commands.

"We're only just getting to the point where we're considering the larger questions," Harrison said, noting a multitude of applications in the home, office, hospitals, nursing homes and schools have yet to be explored.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "With wave of the hand, researchers create touch-based interfaces." ScienceDaily. ScienceDaily, 25 April 2013. <www.sciencedaily.com/releases/2013/04/130425132808.htm>.
Carnegie Mellon University. (2013, April 25). With wave of the hand, researchers create touch-based interfaces. ScienceDaily. Retrieved March 6, 2015 from www.sciencedaily.com/releases/2013/04/130425132808.htm
Carnegie Mellon University. "With wave of the hand, researchers create touch-based interfaces." ScienceDaily. www.sciencedaily.com/releases/2013/04/130425132808.htm (accessed March 6, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Friday, March 6, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Star Wars Inspires Mobile Holograms

Star Wars Inspires Mobile Holograms

Reuters - Business Video Online (Mar. 6, 2015) 3D holograms could soon be coming to your mobile phone. Inspired by the famous Princess Leia hologram from Star Wars, a U.S. company is showcasing a prototype display at the Mobile World Congress at Barcelona and says it could be used for real-time video calls. Ivor Bennett reports Video provided by Reuters
Powered by NewsLook.com
Game Makers Lured Into Virtual Worlds

Game Makers Lured Into Virtual Worlds

AFP (Mar. 6, 2015) Some 25,000 people have descended upon San Francisco to show off the latest technologies and video games at the Game Developers Conference. Developers here discuss the future of the industry. Duration: 02:20. Video provided by AFP
Powered by NewsLook.com
Star Wars-Inspired Prototype Creates Holographic Display

Star Wars-Inspired Prototype Creates Holographic Display

Reuters - Innovations Video Online (Mar. 5, 2015) A prototype holographic display named Leia - after the Star Wars princess who appeared in holographic form asking Obi-Wan Kenobu for help - is demonstrated at the Mobile World Congress in Barcelona. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
IKEA and Samsung Launch Embedded Wireless Charging Range

IKEA and Samsung Launch Embedded Wireless Charging Range

Reuters - Innovations Video Online (Mar. 5, 2015) Samsung and IKEA hope their new embedded wireless charging products, launched at Barcelona&apos;s Mobile World Congress, will tempt consumers eager for plugless power. Jim Drury reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins