Featured Research

from universities, journals, and other organizations

Computer analysis of Twitter sentiments yields results similar to public opinion polls

Date:
May 11, 2010
Source:
Carnegie Mellon University
Summary:
Computer analysis of sentiments expressed in a billion Twitter messages during 2008-2009 yielded measures of consumer confidence and of presidential job approval similar to those of well-established public opinion polls, researchers report.

Computer analysis of sentiments expressed in a billion Twitter messages during 2008-2009 yielded measures of consumer confidence and of presidential job approval similar to those of well-established public opinion polls, Carnegie Mellon University researchers report.

Related Articles


The findings suggest that analyzing the text found in streams of tweets could become a cheap, rapid means of gauging public opinion on at least some subjects, said Noah Smith, assistant professor of language technologies and machine learning in the School of Computer Science. But tools for extracting public opinion from social media text are still crude and social media remain in their infancy, he cautioned, so the extent to which these methods could replace or supplement traditional polling is still unknown.

"With seven million or more messages being tweeted each day, this data stream potentially allows us to take the temperature of the population very quickly," Smith said. "The results are noisy, as are the results of polls. Opinion pollsters have learned to compensate for these distortions, while we're still trying to identify and understand the noise in our data. Given that, I'm excited that we get any signal at all from social media that correlates with the polls."

The study findings will be presented May 25 at the Association for the Advancement of Artificial Intelligence's International Conference on Weblogs and Social Media in Washington, D.C.

In the study, Smith and his colleagues collected a billion microblog messages -- averaging about 11 words each -- posted to Twitter during 2008 and 2009. They used simple text analysis techniques to identify messages that pertained to the economy or to politics and then found words within the text that indicated if the writer expressed positive or negative sentiments.

Results regarding consumer confidence were compared with the Index of Consumer Sentiment (ICS) from Reuters/University of Michigan Surveys of Consumers and the Gallup Organization's Economic Confidence Index. Political sentiments regarding President Obama were compared with Gallup's daily tracking poll on presidential job approval and views regarding the 2008 U.S. presidential election were compared with a compilation of 46 different polls prepared by Pollster.com. The ICS, Gallup and Pollster.com measurements were all obtained from telephone surveys using traditional polling techniques.

The Twitter-derived sentiment measurements were much more volatile day-to-day than the polling data, but when the researchers "smoothed" the results by averaging them over a period of days, the results often correlated closely with the polling data, said Brendan O'Connor, a graduate student in Carnegie Mellon's Language Technologies Institute and first author of the study. Consumer confidence, for instance, followed the same general slide through 2008 and the same rebound in February/March of 2009 as was seen in the poll data. The researchers noted that the ICS and Gallup data had a correlation of 86 percent over the period; the Twitter-derived sentiments had between 72 percent and 79 percent correlation with the Gallup data, depending on the number of days averaged to smooth the data.

Likewise, both the Twitter-derived sentiments and the traditional polls reflected declining approval of President Obama's job performance during 2009, with a 72 percent correlation between them.

But the researchers found that their sentiment analysis did not correlate as well with election polling during 2008. For instance, increased mentions of "Obama" tended to correlate with rises in Barack Obama's polling numbers, but increased mentions of "McCain" also correlated with rises in Obama's popularity. Improved computational methods for understanding natural language, particularly the unusual lexicon of microblogs, will be necessary before Twitter feeds can be reliably mined to predict elections, the researchers concluded.

"The Web is so mainstream now that there's no question that the Web is representative somehow of the population," O'Connor said. But pinning down Web demographics is still difficult, he acknowledged, noting that Twitter traffic alone increased by a factor of 50 during the two-year span of the study.

Using computer programs to judge the sentiments of microblogs is fraught with potential error, but even with the crude tools used in this exploratory research, the accuracy is better than can be achieved by chance, O'Connor said. "The massive amount of data was crucial in making this work," he explained. "We don't need to get the sentiment of every individual right to understand sentiments in aggregate."

Improved natural language processing tools, as well as query-driven analysis and use of demographic and time stamp data available on some social media sites, could increase the sophistication and reliability of microblog analysis.

In addition to Smith and O'Connor, authors of the study include Bryan R. Routledge, associate professor of finance, and Ramnath Balasubramanyan, a Ph.D. student in language technologies. Download a copy of the paper here, http://www.cs.cmu.edu/~nasmith/.

Follow the School of Computer Science on Twitter @SCSatCMU.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Computer analysis of Twitter sentiments yields results similar to public opinion polls." ScienceDaily. ScienceDaily, 11 May 2010. <www.sciencedaily.com/releases/2010/05/100511102117.htm>.
Carnegie Mellon University. (2010, May 11). Computer analysis of Twitter sentiments yields results similar to public opinion polls. ScienceDaily. Retrieved April 21, 2015 from www.sciencedaily.com/releases/2010/05/100511102117.htm
Carnegie Mellon University. "Computer analysis of Twitter sentiments yields results similar to public opinion polls." ScienceDaily. www.sciencedaily.com/releases/2010/05/100511102117.htm (accessed April 21, 2015).

Share This


More From ScienceDaily



More Science & Society News

Tuesday, April 21, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Yemen Doctors at Breaking Point

Yemen Doctors at Breaking Point

Reuters - News Video Online (Apr. 21, 2015) — A Sanaa hospital struggles to cope with the high number of casualties with severe injuries, after an air strike left at least 25 dead and hundreds wounded. Deborah Lutterbeck reports. Video provided by Reuters
Powered by NewsLook.com
Labour Party Warns Britain's Health Service 'on Life Support'

Labour Party Warns Britain's Health Service 'on Life Support'

AFP (Apr. 20, 2015) — Britain&apos;s opposition Labour Party Monday claimed the National Health Service (NHS) was &apos;on life support&apos; as it turned its attention to the state-run service, which is a key issue for the UK&apos;s May 7 general election. Video provided by AFP
Powered by NewsLook.com
Pending Comcast-Time Warner Merger Has DOJ, FCC Concerned

Pending Comcast-Time Warner Merger Has DOJ, FCC Concerned

Newsy (Apr. 20, 2015) — The Department of Justice reportedly has concerns a Time Warner-Comcast merger would create an entity too large in the cable and broadband markets. Video provided by Newsy
Powered by NewsLook.com
Five Years Later, the BP Oil Spill Is Still Taking Its Toll

Five Years Later, the BP Oil Spill Is Still Taking Its Toll

AFP (Apr. 20, 2015) — On April 20, 2010, an explosion and fire on the Deepwater Horizon rig in the Gulf of Mexico started the biggest oil spill in US history. BP recently reported the Gulf is recovering well, but scientists paint a different picture. Duration: 02:36 Video provided by AFP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Science & Society

Business & Industry

Education & Learning

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins