Featured Research

from universities, journals, and other organizations

Pundits predict no more accurately than a coin toss, students find

Date:
May 6, 2011
Source:
Hamilton College
Summary:
Op-ed columnists and TV's talking heads build followings by making bold, confident predictions about politics and the economy. But rarely are their predictions analyzed for accuracy. Now, a public policy class has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.

Op-ed columnists and TV's talking heads build followings by making bold, confident predictions about politics and the economy. But rarely are their predictions analyzed for accuracy.

Now, a class at Hamilton College led by public policy professor P. Gary Wyckoff has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.

Their research paper, "Are Talking Heads Blowing Hot Air? An Analysis of the Accuracy of Forecasts in the Political Media" was presented via webcast May 2 at www.hamilton.edu/pundit.

The Hamilton students sampled the predictions of 26 individuals who wrote columns in major print media and who appeared on the three major Sunday news shows -- Face the Nation, Meet the Press, and This Week -- and evaluated the accuracy of 472 predictions made during the 16-month period. They used a scale of 1 to 5 (1 being "will not happen, 5 being "will absolutely happen") to rate the accuracy of each, and then divided them into three categories: The Good, The Bad, and The Ugly.

The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.

The top prognosticators -- led by New York Times columnist Paul Krugman -- scored above five points and were labeled "Good," while those scoring between zero and five were "Bad." Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into "The Ugly" category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.

Even when the students eliminated political predictions and looked only at predictions for the economy and social issues, they found that liberals still do better than conservatives at prediction. After Krugman, the most accurate pundits were Maureen Dowd of The New York Times, former Pennsylvania Governor Ed Rendell, U.S. Senator Chuck Schumer (D-NY), and former House Speaker Nancy Pelosi -- all Democrats and/or liberals. Also landing in the "Good" category, however, were conservative columnists Kathleen Parker and David Brooks, along with Bush Administration Treasury Secretary Hank Paulson. Left-leaning columnist Eugene Robinson of The Washington Post rounded out the "good" list.

Those scoring lowest -- "The Ugly" -- with negative tallies were conservative columnist Cal Thomas; U.S. Senator Lindsey Graham (R-SC); U.S. Senator Carl Levin (D-MI); U.S. Senator Joe Lieberman, a McCain supporter and Democrat-turned-Independent from Connecticut; Sam Donaldson of ABC; and conservative columnist George Will.

Landing between the two extremes -- "The Bad" -- were Howard Wolfson, communications director for Hillary Clinton's 2008 campaign; former Arkansas Governor Mike Huckabee, a hopeful in the 2008 Republican primary; former House Speaker Newt Gingrich, a Republican; Sen. John Kerry of Massachusetts, the Democratic nominee for president in 2004; liberal columnist Bob Herbert of The New York Times; Andrea Mitchell of NBC; New York Times columnist Tom Friedman; the late David Broder, former columnist for The Washington Post; Chicago Tribune columnist Clarence Page; New York Times columnist Nicholas Kristof; and Hillary Clinton.

The group also found a link between conditional predictions and accuracy, that is, a prediction that was conditional ("If A, then B") was less likely to be accurate. Finally, those prognosticators with a law degree were more likely to be wrong.


Story Source:

The above story is based on materials provided by Hamilton College. The original article was written by Vige Barrie. Note: Materials may be edited for content and length.


Cite This Page:

Hamilton College. "Pundits predict no more accurately than a coin toss, students find." ScienceDaily. ScienceDaily, 6 May 2011. <www.sciencedaily.com/releases/2011/05/110505171416.htm>.
Hamilton College. (2011, May 6). Pundits predict no more accurately than a coin toss, students find. ScienceDaily. Retrieved July 28, 2014 from www.sciencedaily.com/releases/2011/05/110505171416.htm
Hamilton College. "Pundits predict no more accurately than a coin toss, students find." ScienceDaily. www.sciencedaily.com/releases/2011/05/110505171416.htm (accessed July 28, 2014).

Share This




More Science & Society News

Monday, July 28, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Losing Sleep Leaves You Vulnerable To 'False Memories'

Losing Sleep Leaves You Vulnerable To 'False Memories'

Newsy (July 27, 2014) A new study shows sleep deprivation can make it harder for people to remember specific details of an event. Video provided by Newsy
Powered by NewsLook.com
The New York Times Backs Pot Legalization

The New York Times Backs Pot Legalization

Newsy (July 27, 2014) The New York Times has officially endorsed the legalization of marijuana, but why now, and to what end? Video provided by Newsy
Powered by NewsLook.com
Congress OKs Unlocking Phones From Carriers

Congress OKs Unlocking Phones From Carriers

Newsy (July 26, 2014) A bill legalizing "unlocking," or untethering a phone from its default wireless carrier, has passed Congress and is expected to be signed into law. Video provided by Newsy
Powered by NewsLook.com
Wikipedia Puts Congress in Time Out, Blocks Editing

Wikipedia Puts Congress in Time Out, Blocks Editing

Newsy (July 26, 2014) An IP address within the House of Representatives was banned from editing Wikipedia articles for 10 days after it made some questionable changes. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins