Featured Research

from universities, journals, and other organizations

'Game-powered machine learning' opens door to Google for music

Date:
May 4, 2012
Source:
University of California - San Diego
Summary:
Engineers have shown that a computer can be taught to automatically label every song on the Internet using sets of examples provided by unpaid music fans. The researchers report that their solution, "game-powered machine learning," would enable music lovers to search every song on the web.

A screen-shot of the Facebook-based game Herd It.
Credit: Jacobs School of Engineering

Can a computer be taught to automatically label every song on the Internet using sets of examples provided by unpaid music fans? University of California, San Diego engineers have found that the answer is yes, and the results are as accurate as using paid music experts to provide the examples, saving considerable time and money. In results published in the April 24 issue of the Proceedings of the National Academy of Sciences, the researchers report that their solution, called "game-powered machine learning," would enable music lovers to search every song on the web well beyond popular hits, with a simple text search using key words like "funky" or "spooky electronica."

Searching for specific multimedia content, including music, is a challenge because of the need to use text to search images, video and audio. The researchers, led by Gert Lanckriet, a professor of electrical engineering at the UC San Diego Jacobs School of Engineering, hope to create a text-based multimedia search engine that will make it far easier to access the explosion of multimedia content online. That's because humans working round the clock labeling songs with descriptive text could never keep up with the volume of content being uploaded to the Internet. For example, YouTube users upload 60 hours of video content per minute, according to the company.

In Lanckriet's solution, computers study the examples of music that have been provided by the music fans and labeled in categories such as "romantic," "jazz," "saxophone," or "happy." The computer then analyzes waveforms of recorded songs in these categories looking for acoustic patterns common to each. It can then automatically label millions of songs by recognizing these patterns. Training computers in this way is referred to as machine learning. "Game-powered" refers to the millions of people who are already online that Lanckriet's team is enticing to provide the sets of examples by labeling music through a Facebook-based online game called Herd It (http://apps.facebook.com/herd-it).

"This is a very promising mechanism to address large-scale music search in the future," said Lanckriet, whose research earned him a spot on MIT Technology Review's list of the world's top young innovators in 2011.

Another significant finding in the paper is that the machine can use what it has learned to design new games that elicit the most effective training data from the humans in the loop. "The question is if you have only extracted a little bit of knowledge from people and you only have a rudimentary machine learning system, can the computer use that rudimentary version to determine the most effective next questions to ask the people?" said Lanckriet. "It's like a baby. You teach it a little bit and the baby comes back and asks more questions." For example, the machine may be great at recognizing the music patterns in rock music but struggle with jazz. In that case, it might ask for more examples of jazz music to study.

It's the active feedback loop that combines human knowledge about music and the scalability of automated music tagging through machine learning that makes "Google for music" a real possibility. Although human knowledge about music is essential to the process, Lanckriet's solution requires relatively little human effort to achieve great gains. Through the active feedback loop, the computer automatically creates new Herd It games to collect the specific human input it needs to most effectively improve the auto-tagging algorithms, said Lanckriet. The game goes well beyond the two primary methods of categorizing music used today: paying experts in music theory to analyze songs -- the method used by Internet radio sites like Pandora -- and collaborative filtering, which online book and music sellers now use to recommend products by comparing a buyer's past purchases with those of people who made similar choices.

Both methods are effective up to a point. But paid music experts are expensive and can't possibly keep up with the vast expanse of music available online. Pandora has just 900,000 songs in its catalog after 12 years in operation. Meanwhile, collaborative filtering only really works with books and music that are already popular and selling well.

The big picture: Personalized radio

Lanckriet foresees a time when -- thanks to this massive database of cataloged music -- cell phone sensors will track the activities and moods of individual cell phone users and use that data to provide a personalized radio service -- the kind that matches music to one's activity and mood, without repeating the same songs over and over again.

"What I would like long-term is just one single radio station that starts in the morning and it adapts to you throughout the day. By that I mean the user doesn't have to tell the system, "Hey, it's afternoon now, I prefer to listen to hip hop in the afternoon. The system knows because it has learned the cell phone user's preferences."

This kind of personalized cell phone radio can only be made possible if the cell phone has a large database of accurately labeled songs from which to choose. That's where efforts to develop a music search engine are ultimately heading. The first step is figuring out how to label all the music online well beyond the most popular hits. As Lanckriet's team demonstrated in PNAS, game-powered machine learning is making that a real possibility.

Lanckriet's research is funded by the National Science Foundation, National Institutes of Health, the Alfred P. Sloan Foundation, Google, Yahoo!, Qualcomm, IBM and eHarmony. You can watch a video about the research and Lanckriet's auto-tagging algorithms to learn more.


Story Source:

The above story is based on materials provided by University of California - San Diego. Note: Materials may be edited for content and length.


Journal Reference:

  1. L. Barrington, D. Turnbull, G. Lanckriet. Game-powered machine learning. Proceedings of the National Academy of Sciences, 2012; 109 (17): 6411 DOI: 10.1073/pnas.1014748109

Cite This Page:

University of California - San Diego. "'Game-powered machine learning' opens door to Google for music." ScienceDaily. ScienceDaily, 4 May 2012. <www.sciencedaily.com/releases/2012/05/120504135927.htm>.
University of California - San Diego. (2012, May 4). 'Game-powered machine learning' opens door to Google for music. ScienceDaily. Retrieved October 21, 2014 from www.sciencedaily.com/releases/2012/05/120504135927.htm
University of California - San Diego. "'Game-powered machine learning' opens door to Google for music." ScienceDaily. www.sciencedaily.com/releases/2012/05/120504135927.htm (accessed October 21, 2014).

Share This



More Computers & Math News

Tuesday, October 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Thanks, Marty McFly! Hoverboards Could Be Coming In 2015

Newsy (Oct. 21, 2014) If you've ever watched "Back to the Future Part II" and wanted to get your hands on a hoverboard, well, you might soon be in luck. Video provided by Newsy
Powered by NewsLook.com
Robots to Fly Planes Where Humans Can't

Robots to Fly Planes Where Humans Can't

Reuters - Innovations Video Online (Oct. 21, 2014) Researchers in South Korea are developing a robotic pilot that could potentially replace humans in the cockpit. Unlike drones and autopilot programs which are configured for specific aircraft, the robots' humanoid design will allow it to fly any type of plane with no additional sensors. Ben Gruber reports. Video provided by Reuters
Powered by NewsLook.com
Japanese Scientists Unveil Floating 3D Projection

Japanese Scientists Unveil Floating 3D Projection

Reuters - Innovations Video Online (Oct. 20, 2014) Scientists in Tokyo have demonstrated what they say is the world's first 3D projection that floats in mid air. A laser that fires a pulse up to a thousand times a second superheats molecules in the air, creating a spark which can be guided to certain points in the air to shape what the human eye perceives as an image. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Apple Enters Mobile Payment Business

Apple Enters Mobile Payment Business

AP (Oct. 20, 2014) Apple is making a strategic bet with the launch of Apple Pay, the mobile pay service aimed at turning your iPhone into your wallet. (Oct. 20) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins