Featured Research

from universities, journals, and other organizations

'Duet of one' possible with hand-controlled voice synthesizer

Date:
February 19, 2012
Source:
University of British Columbia
Summary:
New technology makes it possible for a person to speak or sing just by using their hands to control a speech synthesizer. The new gesture-to-voice-synthesizer technology mirrors processes that human use when they control their own vocal apparatus.

New technology at the University of British Columbia makes it possible for a person to speak or sing just by using their hands to control a speech synthesizer.

Related Articles


UBC researcher Sidney Fels says the gesture-to-voice-synthesizer technology mirrors processes that human use when they control their own vocal apparatus.

"It's like playing a musical instrument that plays voice. Applications could include new forms of musical expression and aids for people with speaking disabilities," says Fels, professor of electrical and computer engineering at the Faculty of Applied Science and director of the Media and Graphics Interdisciplinary Centre (MAGIC).

Fels presented the technology at the annual meeting of the American Association for the Advancement of Science in Vancouver on February 18.

Fels and his team used special gloves equipped with 3-D position sensors that locate the hand in space. Certain glove postures are associated with certain areas in the audio spectrum.

The right-hand glove has sensors to detect bending so when a user closes her hand, it creates consonant sounds. Opening the right hand produces vowel sounds in the same fashion as a vocal tract does when the tongue moves. The left glove controls stop sounds -- like the consonant "B."

The researchers developed a set collection of gestures that are mapped to consonant sounds. The right glove controls vowels by its location in space horizontally and also controls pitch by its location in space vertically.

"Other possible applications for this discovery are interfaces to make certain tasks easier such as controlling cranes or other heavy machinery," says Fels, whose research interests include human-computer interaction, biomechanical modeling of the upper airway, speech synthesis, and neural networks.

Co-investigators for this project are UBC School of Music Asst. Prof. Robert Pritchard and Johnty Wang, a UBC electrical and computer engineering masters student and concert pianist.

To date, there have been seven international performances with musicians playing a set of pieces written specifically for the expressive capacities of this particular instrument. "It takes about 100 hours for a performer to learn how to speak and use the system," says Fels.


Story Source:

The above story is based on materials provided by University of British Columbia. Note: Materials may be edited for content and length.


Cite This Page:

University of British Columbia. "'Duet of one' possible with hand-controlled voice synthesizer." ScienceDaily. ScienceDaily, 19 February 2012. <www.sciencedaily.com/releases/2012/02/120219135344.htm>.
University of British Columbia. (2012, February 19). 'Duet of one' possible with hand-controlled voice synthesizer. ScienceDaily. Retrieved April 24, 2015 from www.sciencedaily.com/releases/2012/02/120219135344.htm
University of British Columbia. "'Duet of one' possible with hand-controlled voice synthesizer." ScienceDaily. www.sciencedaily.com/releases/2012/02/120219135344.htm (accessed April 24, 2015).

Share This


More From ScienceDaily



More Matter & Energy News

Friday, April 24, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

3D Food Printing: The Meal of the Future?

3D Food Printing: The Meal of the Future?

AP (Apr. 23, 2015) — Developers of 3D food printing hope the culinary technology will revolutionize the way we cook and eat. (April 23) Video provided by AP
Powered by NewsLook.com
'Safest Bike Ever' Devised by British Entrepreneur

'Safest Bike Ever' Devised by British Entrepreneur

Reuters - Innovations Video Online (Apr. 23, 2015) — A British inventor says his Babel bike is the safest bicycle ever produced. Crispin Sinclair - son of famous British inventor Sir Clive Sinclair - hopes the bike&apos;s safety cage, double seatbelt, and host of other measures will inspire non-cyclists to get in the saddle. Jim Drury went to see it in action. Video provided by Reuters
Powered by NewsLook.com
First Successful Aerial Refueling of a Drone

First Successful Aerial Refueling of a Drone

Reuters - Innovations Video Online (Apr. 23, 2015) — The bat-wing U.S. Navy drone that became the first autonomous airplane to take off and land on an aircraft carrier accomplished yet another milestone on Wednesday, becoming the first unmanned aircraft to undergo aerial refueling. Ben Gruber reports. Video provided by Reuters
Powered by NewsLook.com
Human or Robot You Decide

Human or Robot You Decide

Reuters - Business Video Online (Apr. 23, 2015) — An ultra-realistic humanoid robot called &apos;Han&apos; recognises and interprets people&apos;s facial expressions and can even hold simple conversations. Developers Hanson Robotics hope androids like Han could have uses in hospitality and health care industries where face-to-face communication is vital. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins