Featured Research

from universities, journals, and other organizations

Don't know much about charter schools

January 12, 2012
University of California - San Diego
Researchers say the best studies reflect only the best charter schools and must be boosted with "value-added" approaches for all the rest.

UC San Diego researchers say the best studies reflect only the best schools and must be boosted with 'value-added' approaches for all the rest.

Related Articles

Some two decades into the grand national experiment with charter schools, how much do we really know about them? Not all that much. And not nearly as much as we easily could, say researchers from the University of California, San Diego Division of Social Sciences.

Writing in the journal Science, UC San Diego educational economist JuIian Betts and Richard Atkinson, president emeritus of the University of California and former director of the National Science Foundation, find that most studies of charter schools "use unsophisticated methods that tell us little about causal effects."

The Clinton, Bush and Obama administrations, as well as many members of the general public (not to mention the makers of the popular 2010 education documentary "Waiting for Superman") have embraced charter schools as the saviors of a broken educational system. But does going to a charter school improve student outcomes? We don't really know, argue Atkinson and Betts. Which charter schools, or even types of charter schools, are more effective than others? We don't really know.

Ideally, charter schools -- which are funded publicly but are granted charters by school districts or other authorizing bodies to operate outside many of the strictures of regular neighborhood schools -- would be hotbeds of innovation. They could try out different curricula, different teaching methods, different training or reward systems for the teachers. The best and most effective schools would inspire imitation. The worst would have their charters revoked and would go away.

"But most policymakers don't have sufficient data on charter schools to decide whether they're successes to be replicated or disasters to be shut down," said Betts, who, in addition to being an economics professor at UC San Diego, is also executive director of The San Diego Education Research Alliance at the university, a Bren Fellow at the Public Policy Institute of California and a research associate at the National Bureau of Economic Research.

Most studies take a simple snapshot of achievement at a charter school, reading and math scores in the spring, say, and compare these to scores at a nearby traditional public school. A study of this sort, Betts said, is "naοve and essentially meaningless."

Self-selection is the problem. A snapshot study might give you a picture of the students who selected a particular charter but says little about that school's effectiveness. In a recent meta-analysis of the available literature on charter schools, coauthored by Betts (with UC San Diego economist Emily Tang) and published by the University of Washington's National Charter School Research Project, 75 percent of studies were discarded because they failed to account for differences in the backgrounds and academic histories of traditional public-school students and those who chose to go to a charter.

Some of the best, most rigorous studies are based on analyses of charter-school lottery winners and losers, write Betts and Atkinson. Charter schools that are popular enough to be oversubscribed are usually compelled by law to hold lotteries. As dramatized by the documentary "Waiting for Superman," lottery winners differ from losers only by the luck of the draw. That is to say, students who lose a lottery are an ideal control group, and comparing outcomes for lottery winners and losers is the closest we can get to a randomized controlled experiment.

Lottery-based studies suggest that charters do as well as or better than traditional public schools. But, write Betts and Atkinson, these studies have, to date, only examined about 90 charter schools -- or just 2 percent of charter schools nationally.

As good as lottery-based studies are, they contain some major impediments. One is that most charter schools don't hold lotteries. They're not oversubscribed. A recent and major nationwide U.S. Department of Education study of charter middle schools found that only 130 out of 492 held lotteries. (And of these, only 77 agreed to share their lottery data so researchers could study them.)

It also very likely, Betts said, according to evidence from Texas and elsewhere, that the oversubscribed, lottery-holding schools are better than average to begin with. Put another way, parents are smart and there's a reason some charter schools are popular.

The lottery-based studies, Betts and Atkinson conclude, are not very representative.

So how to study all the other charter schools, the majority, that don't hold lotteries? Atkinson and Betts propose that "value-added" research -- research that follows individual students' trajectories, comparing how they test before/after entering or leaving a charter -- is a close second-best to lottery-based research. For that, though, researchers need access to individual student test-score data over time. This access is not easy to come by and is often fiercely contested.

Betts and Atkinson add that for the fullest account of educational impacts it would also be important to look at and supplement testing data with measures of higher-order learning and behavior as well as such longer-term outcomes as graduation rates and college attendance.

The way forward is clear, Betts said, but whether there's political will is another matter: "We need more lottery-based studies and we need to be able to do longitudinal work," he said.

Researchers need routine access to individual student data. And charter laws should be overhauled so that charters schools have to share their lottery data with authorizing bodies and with state departments of education. (To do good research, researchers would also need to know how wait lists are administered.) This last wouldn't be costly, Betts said, and could be accomplished by simple fiat.

It might be a tall order for all 51 states to implement the suggested reforms at once, the researchers write, but federal initiatives like the No Child Left Behind Act and the Race to the Top fund could make financial support to schools contingent on these requirements.

"Taking these steps," Betts said, "would improve research, not only on charter schools but on all public education."

Story Source:

The above story is based on materials provided by University of California - San Diego. Note: Materials may be edited for content and length.

Journal Reference:

  1. J. R. Betts, R. C. Atkinson. Better Research Needed on the Impact of Charter Schools. Science, 2012; 335 (6065): 171 DOI: 10.1126/science.1205418

Cite This Page:

University of California - San Diego. "Don't know much about charter schools." ScienceDaily. ScienceDaily, 12 January 2012. <www.sciencedaily.com/releases/2012/01/120112142230.htm>.
University of California - San Diego. (2012, January 12). Don't know much about charter schools. ScienceDaily. Retrieved April 19, 2015 from www.sciencedaily.com/releases/2012/01/120112142230.htm
University of California - San Diego. "Don't know much about charter schools." ScienceDaily. www.sciencedaily.com/releases/2012/01/120112142230.htm (accessed April 19, 2015).

Share This

More From ScienceDaily

More Science & Society News

Sunday, April 19, 2015

Featured Research

from universities, journals, and other organizations

Featured Videos

from AP, Reuters, AFP, and other news services

L.A. Water Cops Remind Residents of Water Conservation

L.A. Water Cops Remind Residents of Water Conservation

Reuters - US Online Video (Apr. 18, 2015) — "Water cops" in Los Angeles remind the public about water conservation methods amid California&apos;s prolonged drought. Julie Noce reports. Video provided by Reuters
Powered by NewsLook.com
Dr. Oz Under Fire For 'Quack Treatments' Yet Again

Dr. Oz Under Fire For 'Quack Treatments' Yet Again

Newsy (Apr. 17, 2015) — Ten doctors signed a letter urging Columbia University to drop Dr. Oz as vice chair of its department of surgery, saying he plugs "quack" treatments. Video provided by Newsy
Powered by NewsLook.com
WikiLeaks Refuses To Let Sony Hack Die, Posts Database

WikiLeaks Refuses To Let Sony Hack Die, Posts Database

Newsy (Apr. 17, 2015) — WikiLeaks&apos; Julian Assange says the hacked emails and documents "belong in the public domain." Video provided by Newsy
Powered by NewsLook.com
Cybercrime Could Cost $400 Bln

Cybercrime Could Cost $400 Bln

Reuters - Business Video Online (Apr. 16, 2015) — Representatives from around 160 countries gather at the Hague to discuss cyber space and cyber security, including the dilemmas and challenges regarding the evolution of the internet. Ciara Lee reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.


Breaking News:

Strange & Offbeat Stories


Science & Society

Business & Industry

Education & Learning

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News


Free Subscriptions

Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile

Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?

Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins