Featured Research

from universities, journals, and other organizations

Computers sing to a better tune

Date:
May 7, 2011
Source:
Inderscience Publishers
Summary:
Would you dance to a synthetic song? Scientists are reporting on a new approach to making computer-generated vocals more human sounding.

Music producers have for decades had electronics tricks at their disposal for improving a recorded vocal performance. They can add a little reverb or echo to bolster a weak rendition, use effects such as phasing and delay to add color to the vocal, fix duff notes with auto-tuning or even reprogram a whole melody line in software. In recent years, voice synthesis for converting text to spoken word has improved considerably but combining that technology with auto-tuning capability allows computers to "sing."

Related Articles


Software, such as Vocaloid, can successfully create lead vocals and harmony parts from an input of lyrics and musical score. Careful tweaking of the "frequency curve" can make the vocals sound almost natural by adding tremolo, vibrato and note overshoot.

Researchers in the Graduate School of Engineering, at The University of Tokyo, point out that it is the tweaking of the frequency curve that is critical to success but this process is labor intensive and prone to human error that means a vocal rendition always retains artifacts of the synthetic process used to produce it. Other researchers have developed tools such as VocaListener, which can tune frequency curves and make some features of singing voice like vibrato. However, this system requires an original version of the vocal sung by a human from which to work. The SingBySpeaking system "sings" text input, but uses only one frequency curve and so is insufficient for a realistic synthetic vocal with all the nuance of a human performance.

Now, Akio Watanabe and Hitoshi Iba have turned to evolution to help them devise a novel algorithm that compares the frequency curves from real human performances and uses them to home in on a more realistic curve to apply to the synthetic song. The team has simplified the optimization process for creating vocal frequency curves and have developed a frequency model that can emulate human expression in a synthetic vocal.

There are four steps to the evolutionary process for creating a realistic frequency curve, explain Iba and colleagues:

First, production of the first generation involves making eight individual curves with random parameters and feeding them into Vocaloid. The second step is for the music producer to listen to the effect of each curve on their synthetic vocal and to move slider bars in the software interface to reflect how well each curve works. In the third stage, the best curves are used as the "parents" to create a new generation of curves. Finally, the second generation curves undergo crossover and random mutation and the process repeated from step 2. Eventually, the fittest frequency curves will emerge that endow the synthetic vocal with the most realistic characteristics of human singing.

For anyone who is bored with the so-called real-life characters that present themselves to TV "talent" shows, an optimized frequency curve and a synthetic vocal could be the new sensation they are looking for, but without the baggage of bad teeth, terrible hair extensions and fictionalized family tragedies.


Story Source:

The above story is based on materials provided by Inderscience Publishers. Note: Materials may be edited for content and length.


Journal Reference:

  1. Akio Watanabe, Hitoshi Iba. Creating singing vocal expressions by means of interactive evolutionary computation. International Journal of Knowledge Engineering and Soft Data Paradigms, 2011; 3 (1): 40 DOI: 10.1504/IJKESDP.2011.039877

Cite This Page:

Inderscience Publishers. "Computers sing to a better tune." ScienceDaily. ScienceDaily, 7 May 2011. <www.sciencedaily.com/releases/2011/05/110506101104.htm>.
Inderscience Publishers. (2011, May 7). Computers sing to a better tune. ScienceDaily. Retrieved December 21, 2014 from www.sciencedaily.com/releases/2011/05/110506101104.htm
Inderscience Publishers. "Computers sing to a better tune." ScienceDaily. www.sciencedaily.com/releases/2011/05/110506101104.htm (accessed December 21, 2014).

Share This


More From ScienceDaily



More Computers & Math News

Sunday, December 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Building Google Into Cars

Building Google Into Cars

Reuters - Business Video Online (Dec. 19, 2014) — Google's next Android version could become the standard that'll power your vehicle's entertainment and navigation features, Reuters has learned. Fred Katayama reports. Video provided by Reuters
Powered by NewsLook.com
After Sony Hack, What's Next?

After Sony Hack, What's Next?

Reuters - US Online Video (Dec. 19, 2014) — The hacking attack on Sony Pictures has U.S. government officials weighing their response to the cyber-attack. Linda So reports. Video provided by Reuters
Powered by NewsLook.com
Navy Unveils Robot Fish

Navy Unveils Robot Fish

Reuters - Light News Video Online (Dec. 18, 2014) — The U.S. Navy unveils an underwater device that mimics the movement of a fish. Tara Cleary reports. Video provided by Reuters
Powered by NewsLook.com
How 2014 Shaped The Future Of The Internet

How 2014 Shaped The Future Of The Internet

Newsy (Dec. 18, 2014) — It has been a long, busy year for Net Neutrality. The stage is set for an expected landmark FCC decision sometime in 2015. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins