Featured Research

from universities, journals, and other organizations

From A Queen Song To A Better Music Search Engine

Date:
May 21, 2009
Source:
University of California - San Diego
Summary:
Electrical engineers presented a solution to their problem with the song "Bohemian Rhapsody" -- and it's not that they don't like this hit from the band Queen. The engineers' issue with "Bohemian Rhapsody" is that it is too heterogeneous.

A screen shot from Herd It, the new music discovery game on Facebook created by electrical engineers at UC San Diego.
Credit: UC San Diego Jacobs School of Engineering

At a recent IEEE technology conference, UC San Diego electrical engineers presented a solution to their problem with the song "Bohemian Rhapsody"—and it's not that they don't like this hit from the band Queen. The electrical engineers' issue with "Bohemian Rhapsody" is that it is too heterogeneous.

With its mellow piano, falsetto vocals, rock opera sections and crazy guitar solos, Bohemian Rhapsody is so internally varied that machine learning algorithms at the heart of their experimental music search engine have trouble labeling the song. The solution presented at the 2009 International Conference on Acoustics, Speech, and Signal Processing (ICASSP) in Taiwan could lead to improvements in the electrical engineers' song labeling and search engine system.

The system "listens" to songs it has never heard before, labels them based on the actual sounds in the song, and then retrieves songs, as appropriate, when people type descriptive words—like "mellow jazz"—into the team's experimental search engine.

At ICASSP, UC San Diego electrical engineering Ph.D. student Luke Barrington presented a new model for music segmentation that can capture both the sound of a song and how this sound changes over time. By modeling music in this way, Barrington showed how to automatically segment songs such as Bohemian Rhapsody into homogenous sections such as verses, choruses and bridges. This new approach to training computers to dissect songs into heterogeneous segments and then accurately label each chunk could improve the accuracy of the new music search engine built by engineers from the Jacobs School of Engineering at UC San Diego.

The team's nickname for their experimental music search engine is "Google for music". Users type descriptive words—rather than song titles, album names or artist names—and the search engine returns specific song suggestions. The engine currently works for more than 100 words that cover music genres, emotions and instruments. The Jacobs School engineers are working to expand the search engine's "vocabulary" before opening it up to the public later this year.

Teaching Computers to Label Songs

In order to "teach" the search engine new words, the engineers need to show it many different examples of songs that fit that description. Initially, the engineers paid UC San Diego undergraduates to manually label songs that would serve as training materials for machine learning algorithms. But instead of continuing to rely on this expensive option, the engineers built online music games that encourage people connected via the Internet to do the song labeling while listening to music online.

In April, the electrical engineers launched their games on Facebook as an application called Herd It. http://apps.facebook.com/herd-it

To play Herd It, log in to Facebook, open the Herd It app, select a genre of music, and start listening to song clips and playing the games. Some games ask users to identify instruments, while others focus on music genres, artist names, emotions triggered by the song, and activities you might do while listening to a song. The more your answers align with the rest of the online crowd playing the game at the same time, the more points you score.

"The Facebook games are a lot of fun and a great way to discover new music. At the same time, the games deliver the data we need to teach our computer audition system to listen to and describe music like humans do," said Gert Lanckriet, the electrical engineering professor and machine learning expert from the Jacobs School of Engineering steering the project. Lanckriet also leads UC San Diego's Computer Audition Laboratory, housed at the UC San Diego division of Calit2.

For the system to "listen and describe music like a human," it must find patterns in the songs using the tools of machine learning. For example, for the system to learn to identify and label romantic songs, it must be exposed to many different romantic songs during the training period.

This exposure enables the machine learning algorithms find patterns in the wave forms of the songs that make the songs romantic. Once trained, the system can identify romantic songs that it has never before encountered, offering the tantalizing possibility of amassing a huge database of songs that can be tagged and retrieved based on text-based searches with no human intervention.

"The more examples of romantic songs our search engine is exposed to, the more accurately it will be able to identify romantic songs it has never heard before," explained Barrington.

Part of Barrington's Ph.D. dissertation will involve demonstrating that data collected from the Facebook games reliably improves the accuracy of the search engine.

"Once enough people play our new music discovery games on Facebook, I'll have the data I need to both improve our search engine and finish my Ph.D.," said Barrington.

The song-word combinations collected by the Facebook games will also enable the researchers to grow their music search engine's vocabulary and increase its coverage in genres and classes of music.

2009 ICASSP (IEEE International Conference on Acoustics, Speech, and Signal Processing): "Dynamic Texture Models of Music," by Luke Barrington, Antoni Chan and Gert Lanckriet from the Electrical and Computer Engineering Department at UC San Diego's Jacobs School of Engineering. To appear in ICASSP 2009.


Story Source:

The above story is based on materials provided by University of California - San Diego. Note: Materials may be edited for content and length.


Cite This Page:

University of California - San Diego. "From A Queen Song To A Better Music Search Engine." ScienceDaily. ScienceDaily, 21 May 2009. <www.sciencedaily.com/releases/2009/05/090515093236.htm>.
University of California - San Diego. (2009, May 21). From A Queen Song To A Better Music Search Engine. ScienceDaily. Retrieved October 21, 2014 from www.sciencedaily.com/releases/2009/05/090515093236.htm
University of California - San Diego. "From A Queen Song To A Better Music Search Engine." ScienceDaily. www.sciencedaily.com/releases/2009/05/090515093236.htm (accessed October 21, 2014).

Share This



More Matter & Energy News

Tuesday, October 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Gulfstream G500, G600 Unveiling

Gulfstream G500, G600 Unveiling

Flying (Oct. 20, 2014) Watch Gulfstream's public launch of the G500 and G600 at their headquarters in Savannah, Ga., along with a surprise unveiling of the G500, which taxied up under its own power. Video provided by Flying
Powered by NewsLook.com
Japanese Scientists Unveil Floating 3D Projection

Japanese Scientists Unveil Floating 3D Projection

Reuters - Innovations Video Online (Oct. 20, 2014) Scientists in Tokyo have demonstrated what they say is the world's first 3D projection that floats in mid air. A laser that fires a pulse up to a thousand times a second superheats molecules in the air, creating a spark which can be guided to certain points in the air to shape what the human eye perceives as an image. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Hey, Doc! Sewage, Beer and Food Scraps Can Power Chevrolet’s Bi-Fuel Impala

Hey, Doc! Sewage, Beer and Food Scraps Can Power Chevrolet’s Bi-Fuel Impala

3BL Media (Oct. 20, 2014) Hey, Doc! Sewage, Beer and Food Scraps Can Power Chevrolet’s Bi-fuel Impala Video provided by 3BL
Powered by NewsLook.com
What We Know About Microsoft's Rumored Smartwatch

What We Know About Microsoft's Rumored Smartwatch

Newsy (Oct. 20, 2014) Microsoft will reportedly release a smartwatch that works across different mobile platforms, has a two-day battery life and tracks heart rate. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins