Featured Research

from universities, journals, and other organizations

Current test-based incentive programs have not consistently raised student achievement in U.S., report finds

Date:
May 26, 2011
Source:
National Academy of Sciences
Summary:
Despite being used for several decades, test-based incentives have not consistently generated positive effects on student achievement, according to a new US report. The report examines evidence on incentive programs, which impose sanctions or offer rewards for students, teachers, or schools on the basis of students' test performance. Federal and state governments have increasingly relied on incentives in recent decades as a way to raise accountability in public education and in the hope of driving improvements in achievement.

Despite being used for several decades, test-based incentives have not consistently generated positive effects on student achievement, says a new report from the National Research Council. The report examines evidence on incentive programs, which impose sanctions or offer rewards for students, teachers, or schools on the basis of students' test performance. Federal and state governments have increasingly relied on incentives in recent decades as a way to raise accountability in public education and in the hope of driving improvements in achievement.

School-level incentives -- like those of No Child Left Behind -- produce some of the larger effects among the programs studied, but the gains are concentrated in elementary grade mathematics and are small in comparison with the improvements the nation hopes to achieve, the report says. Evidence also suggests that high school exit exam programs, as currently implemented in many states, decrease the rate of high school graduation without increasing student achievement.

Policymakers should support the development and evaluation of promising new models that use test-based incentives in more sophisticated ways as one aspect of a richer accountability and improvement process, said the committee that wrote the report.

Incentives' Effects on Student Achievement

Attaching incentives to test scores can encourage teachers to focus narrowly on the material tested -- in other words, to "teach to the test" -- the report says. As a result, students' knowledge of the part of the subject matter that appears on the test may increase while their understanding of the untested portion may stay the same or even decrease, and the test scores may give an inflated picture of what students actually know with respect to the full range of content standards.

To control for any score inflation caused by teaching to the test, it is important to evaluate the effects of incentive programs not by looking at changes in the test scores tied to the incentives, but by looking at students' scores on "low stakes" tests -- such as the National Assessment of Educational Progress -- that are not linked to incentives and are therefore less likely to be inflated, the report says.

When evaluated using low-stakes tests, the overall effects on achievement tend to be small and are effectively zero for a number of incentives programs, the committee concluded. Even when evaluated using the tests attached to the incentives, a number of programs show only small effects.

Some incentives hold teachers or students accountable, while others affect whole schools. School-level incentives like those used in No Child Left Behind produce some of the larger achievement gains, the report says, but even these have an effect size of only around .08 standard deviations -- the equivalent of moving a student currently performing at the 50th percentile to the 53rd percentile. For comparison, raising student performance in the U.S. to the level of the highest-performing nations would require a gain equivalent to a student climbing from the 50th to the 84th percentile. The committee noted, however, that although a .08 effect size is small, few other education interventions have shown greater gains.

Effects of High School Exit Exams

The study also examined evidence on the effects of high school exit exams, which are currently used by 25 states and typically involve tests in multiple subjects, all of which students must pass in order to graduate. This research suggests that such exams decrease the rate of high school graduation without improvements in student achievement as measured by low-stakes tests.

Broader Measures of Performance Needed

It is unreasonable to implement incentives tied to tests on a narrow range of content and then criticize teachers for narrowing their instruction to match the tests, said the committee. When incentives are used, the performance measures need to be broad enough to align with desired student outcomes. This means not only expanding the range of content covered by tests but also considering other student outcomes beyond a single test.

Policymakers and researchers should design and evaluate alternate approaches using test-based incentives, the committee said. Among the approaches proposed during current policy debates are those that would deny tenure to teachers whose students fail to meet a minimal level of test performance. Another proposal is to use the narrow information from tests to trigger a more intensive school evaluation that would consider a broader range of information and then provide support to help schools improve. The modest and variable benefits shown by incentive programs so far, however, means that all use of incentives should be rigorously evaluated to determine what works and what does not, said the committee.

In addition, it is important that research on and development of new incentive-based approaches does not displace investment in the development of other aspects of the education system -- such as improvements in curricula and instructional methods -- that are important complements to the incentives themselves, the report cautions.

The study was sponsored by Carnegie Corporation of New York and the William and Flora Hewlett Foundation. The National Academy of Sciences, National Academy of Engineering, Institute of Medicine, and National Research Council make up the National Academies. They are private, nonprofit institutions that provide science, technology, and health policy advice under a congressional charter. The Research Council is the principal operating agency of the National Academy of Sciences and the National Academy of Engineering.


Story Source:

The above story is based on materials provided by National Academy of Sciences. Note: Materials may be edited for content and length.


Cite This Page:

National Academy of Sciences. "Current test-based incentive programs have not consistently raised student achievement in U.S., report finds." ScienceDaily. ScienceDaily, 26 May 2011. <www.sciencedaily.com/releases/2011/05/110526141507.htm>.
National Academy of Sciences. (2011, May 26). Current test-based incentive programs have not consistently raised student achievement in U.S., report finds. ScienceDaily. Retrieved September 30, 2014 from www.sciencedaily.com/releases/2011/05/110526141507.htm
National Academy of Sciences. "Current test-based incentive programs have not consistently raised student achievement in U.S., report finds." ScienceDaily. www.sciencedaily.com/releases/2011/05/110526141507.htm (accessed September 30, 2014).

Share This



More Science & Society News

Tuesday, September 30, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Argentina's Tax Evaders Detected, Hunted Down by Drones

Argentina's Tax Evaders Detected, Hunted Down by Drones

AFP (Sep. 30, 2014) Argentina doesn't only have Lionel Messi the footballer, it has now also acquired "Mesi" the drone system which monitors undeclared mansions, swimming pools and soy fields to curb tax evasion in the country. Duration: 01:18 Video provided by AFP
Powered by NewsLook.com
How 'Yes Means Yes' Defines Sexual Assault

How 'Yes Means Yes' Defines Sexual Assault

Newsy (Sep. 29, 2014) Aimed at reducing sexual assaults on college campuses, California has adopted a new law changing the standard of consent for sexual activity. Video provided by Newsy
Powered by NewsLook.com
Why Is Big Tobacco Voluntarily Warning You About E-Cigs?

Why Is Big Tobacco Voluntarily Warning You About E-Cigs?

Newsy (Sep. 29, 2014) Big tobacco companies are voluntarily printing health warnings on their e-cigarette packages — a move some are calling part of a PR strategy. Video provided by Newsy
Powered by NewsLook.com
Why Pediatricians Endorse IUDs, Implants For Teens

Why Pediatricians Endorse IUDs, Implants For Teens

Newsy (Sep. 29, 2014) New recommendations from the American Academy of Pediatrics point to intrauterine devices and implants as good forms of birth control for teens. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Science & Society

Business & Industry

Education & Learning

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins