Burton Weisbrod and Evelyn Asche have an entirely sensible oped in yesterday’s IHE on the fuss about Clemson University’s shocking attempts to game the US News and World Report rankings:
Watt, according to reports, literally drew gasps from her audience when she revealed that when Clemson administrators fill out U.S. News reputational rankings survey, they rate other universities lower than Clemson across the board. Why not? Reputation accounts for fully 25 percent of a school’s ranking score. Watt’s statement that she was confident that other colleges do the same is perfectly plausible.
Inside Higher Ed reported Monday that the University of Southern California inflated the number of National Academy of Engineering members on its full-time, tenure-track faculty. Because the number of NAE faculty is a criterion for U.S. News rankings, USC has good reason to include NAE faculty who are not full-time or tenure-track.
If we step back from higher education, we will see the same dynamic of gaming a performance measurement system in many other spheres. Hospitals receive “report cards” that measure their performance in many areas, including their mortality rates. A little thought reveals the easiest way to improve the mortality rate is to keep terminally ill patients from being admitted to the hospital in the first place or discharge them prior to death. In fact these events do occur. Nonprofit hospitals receive large tax exemptions but are expected to provide charity care to indigent patients in return. Their substantial tax benefits are currently being scrutinized in the courts and in Congress, so hospitals are certainly scrambling to alter their accounting procedures to increase their charity care levels
Academics based in the UK can correct me, but it seemed to me when I was there that both the RAE process and the system of for evaluation the quality of quality control of teaching were designed to be gamed; US News and World Report has to be aware of the many ways that Universities and some of their component parts (those I’m especially aware of are Business and Law Schools), game their rankings: a narrative account of the ways they suspect the rankings are being gamed might go some way to discouraging the most egregious and visible tricks. (I don’t really see how to eliminate the incentive artificially to undermine one’s close rivals when ranking them).