Playing nice

“Anmik,” commenting on Kieran’s “post”:https://crookedtimber.org/2007/10/04/what-goes-around/ below writes:

But then, what about the very real, very reasonable impulse to softpedal book reviews, to write overly generous tenure evaluations, and on and on? I only ask because the whole idea of peer review, and the review process more broadly, has begun to feel a bit, how to say this, corrupt of late. I noted yesterday some very minor flap in which Chris Matthews, the political “journalist,” admitted that it’s hard to cover the people he sees at cocktail parties. The same is true for scholars, no? And blogs only compound the problem, I suppose.

This is a real problem, albeit not one of recent vintage; mutual backscratching is especially endemic in academic book reviews. But it isn’t one that is very easy to fix. Some months ago, I wrote a quite negative review of a book that seemed lazy to me; I thought it only fair to signal this to potential buyers. But precisely because there’s a kind of pooling equilibrium going on here I worried a bit about whether or not I was sending out _too_ negative a signal to readers and colleagues about the book’s quality. If everyone says nice things about everyone else’s books, then a negative review will likely be overinterpreted as saying that this book _really_ stinks to high heaven, its author should be denied tenure etc. In this case, it wasn’t a major issue, because the book was written by a seniorish figure, who presumably wouldn’t be damaged too much by an asst. prof’s evaluation of his work. However, I would worry if I were writing a review of a more junior person’s work, to try to be sure that whatever signal I was sending out wasn’t misinterpreted.

I suspect that this is even more of an issue in tenure review letters, where, I understand, negative comments will receive far more attention than positive ones on the assumption that their informational content is much higher. Given this, someone who wants to give an honest assessment that is critical but basically favorable is going to have to choose her words very carefully indeed so that she says only what she wants to say and isn’t interpreted as saying more. So the problem isn’t simply one of corruption – it’s also one of signalling conventions that are quite hard to overturn once they become established. Anonymous peer review is different in my experience – negative signals by and large don’t receive undue weight, because there aren’t any obvious pressures to converge on an equilibrium where we say nice things about each other even though we don’t mean them.