Campbell's Law, Standardized Testing, Accountability, Atlanta

I've mentioned Campbell's law on this blog before. As Wikipedia says, Campbell's law

is an adage developed by Donald T. Campbell:

"The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor."

The social science principle of Campbell's law is sometimes used to point out the negative consequences of high-stakes testing in U.S. classrooms. This may take the form of teaching to the test or outright cheating.

This week SlashDot reports Prosecutors Get an 'A' On Convictions of Atlanta Ed-Reform-Gone-Bad Test Cheats - Slashdot

in early 2010, the Atlanta Business Chronicle reported on how Hall and the Bill & Melinda Gates Foundation were bringing a "fair and transparent evaluation and support mechanism" to the Atlanta Public Schools. "We are excited to continue our [$23.6 million] partnership with APS and Dr. Hall," said Gates Foundation director of education Vicki L. Phillips. Five years earlier, in a 2005 Gates Foundation press release, Hall said, "We look forward to partnering with the Bill & Melinda Gates Foundation to take our reform efforts to the next level."

And now they're in jail -- well, Hall was facing 45 years in prison, but died before the end of the trial. Eleven are in jail. And it's hard to argue that this isn't a foreseeable consequence of excessive reliance on measurables -- i.e., on standardized testing. As the Atlantic puts it, Eleven Atlanta Educators Have Been Convicted for Cheating Conspiracy, Revealing the Dangers of Standardized Testing — The Atlantic

The scandal shows the dangers of hyper-testing and bureaucracy in a school district serving a particularly disadvantaged population of students. Unfortunately, although what happened in Atlanta is especially egregious, these educators' actions are not unusual...

People do respond to incentives.

That doesn't mean that testing is bad...testing is good, every teacher uses it. High-stakes testing creates strong incentives which will distort results and hurt some kids. The kind of low-stakes testing built into Khan Academy or Ted-Ed lessons is pretty safe because no individual score is worth gaming. But the Big Test Day idea, where scores mean money, strikes me as fundamentally flawed.