<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Playing nice</title>
	<atom:link href="http://crookedtimber.org/2007/10/04/playing-nice/feed/" rel="self" type="application/rss+xml" />
	<link>http://crookedtimber.org/2007/10/04/playing-nice/</link>
	<description>Out of the crooked timber of humanity, no straight thing was ever made</description>
	<lastBuildDate>Sun, 21 Mar 2010 02:39:51 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Witt</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212974</link>
		<dc:creator>Witt</dc:creator>
		<pubDate>Fri, 05 Oct 2007 16:32:14 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212974</guid>
		<description>The overwhelmingly important thing to me in a book review or personnel review is how specific the comments are. Generic praise - bah, nearly meaningless. Generic criticism (even if strongly worded) - okay, so the writer feels strongly, but unless I know them quite well I have very little context for gauging how seriously to take their strong feelings. 

When I write reviews I try to be extremely specific. Praise particular activities, describe projects, etc. Likewise with criticism. 

This has the happy side effect of making it very hard to write a dishonest review.</description>
		<content:encoded><![CDATA[	<p>The overwhelmingly important thing to me in a book review or personnel review is how specific the comments are. Generic praise &#8211; bah, nearly meaningless. Generic criticism (even if strongly worded) &#8211; okay, so the writer feels strongly, but unless I know them quite well I have very little context for gauging how seriously to take their strong feelings.</p>

	<p>When I write reviews I try to be extremely specific. Praise particular activities, describe projects, etc. Likewise with criticism.</p>

	<p>This has the happy side effect of making it very hard to write a dishonest review.</p>
 ]]></content:encoded>
	</item>
	<item>
		<title>By: Kenny Easwaran</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212933</link>
		<dc:creator>Kenny Easwaran</dc:creator>
		<pubDate>Fri, 05 Oct 2007 03:42:39 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212933</guid>
		<description>I would think the problem with negative reviews is that readers just judge the author of the review more than the author of the book.</description>
		<content:encoded><![CDATA[	<p>I would think the problem with negative reviews is that readers just judge the author of the review more than the author of the book.</p>
 ]]></content:encoded>
	</item>
	<item>
		<title>By: slolernr</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212905</link>
		<dc:creator>slolernr</dc:creator>
		<pubDate>Thu, 04 Oct 2007 19:58:09 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212905</guid>
		<description>&lt;em&gt;Anonymous peer review is different in my experience – negative signals by and large don’t receive undue weight&lt;/em&gt;

Indeed, perhaps the opposite.  After all, anonymous peer refereeing creates incentives for a different set of abuses, one of which is the ill-founded but strongly phrased report that boils down to &quot;you didn&#039;t cite my article/book!&quot; or, if you did, &quot;you didn&#039;t fawningly parrot my argument!&quot;  IME editors know this, and treat such reports accordingly.</description>
		<content:encoded><![CDATA[	<p><em>Anonymous peer review is different in my experience &#8211; negative signals by and large don&#8217;t receive undue weight</em></p>

	<p>Indeed, perhaps the opposite.  After all, anonymous peer refereeing creates incentives for a different set of abuses, one of which is the ill-founded but strongly phrased report that boils down to &#8220;you didn&#8217;t cite my article/book!&#8221; or, if you did, &#8220;you didn&#8217;t fawningly parrot my argument!&#8221;  <span class="caps">IME</span> editors know this, and treat such reports accordingly.</p>
 ]]></content:encoded>
	</item>
	<item>
		<title>By: terence</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212904</link>
		<dc:creator>terence</dc:creator>
		<pubDate>Thu, 04 Oct 2007 19:56:58 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212904</guid>
		<description>&lt;i&gt;I suspect that this is even more of an issue in tenure review letters, where, I understand, negative comments will receive far more attention than positive ones on the assumption that their informational content is much higher.&lt;/i&gt;

But isn&#039;t this also the case in life in general. For example, if someone asks me what I think about Person X, if I like Person X I will usually just limit my comments to that point alone. This because the moment I add caveats it is the caveats that stick in the listener&#039;s head - not the actual overall assessment.</description>
		<content:encoded><![CDATA[	<p><i>I suspect that this is even more of an issue in tenure review letters, where, I understand, negative comments will receive far more attention than positive ones on the assumption that their informational content is much higher.</i></p>

	<p>But isn&#8217;t this also the case in life in general. For example, if someone asks me what I think about Person X, if I like Person <span class="caps">X I</span> will usually just limit my comments to that point alone. This because the moment I add caveats it is the caveats that stick in the listener&#8217;s head &#8211; not the actual overall assessment.</p>
 ]]></content:encoded>
	</item>
	<item>
		<title>By: Paul J. Reber</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212899</link>
		<dc:creator>Paul J. Reber</dc:creator>
		<pubDate>Thu, 04 Oct 2007 19:23:48 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212899</guid>
		<description>I don&#039;t disagree about the academic benefit of mutual back-scratching in peer review, but feel obliged to point out some counter-pressure.

First, I think it&#039;s pretty well understood to be a good way to get famous as a young scientist to pick a public fight.  Ideally with a senior person (preferred due to increased visibility) or another junior person if there&#039;s a suitable ideological divide.  This could be a feature of my field (psychology, neuroscience) in which either there isn&#039;t really a dominant old guard or maybe that the old guard leaves a lot of room for other people to fight over.  I don&#039;t think it&#039;s unique to my field, though.

Second, tenure decisions at my university are heavily based on external letters (perhaps more than some others), but a negative letter is not a killer.  The culture of this process is that not only is it ok to get a &quot;bad&quot; letter, but that it&#039;s a sign of impact.  If somebody writes that &quot;so-and-so is wrong about everything and this is hugely annoying!&quot; then that&#039;s a sign that so-and-so is a player.  The killers are letters that damn by faint praise or worse, &quot;never heard of so-and-so.&quot;

I&#039;m not recommending running out and picking fights or making colleagues mad (via blogs or any other way) as your field or department may be different.  I&#039;m just saying that there&#039;s at least some small incentive towards being negative, perhaps enough to get honest appraisals now and then.</description>
		<content:encoded><![CDATA[	<p>I don&#8217;t disagree about the academic benefit of mutual back-scratching in peer review, but feel obliged to point out some counter-pressure.</p>

	<p>First, I think it&#8217;s pretty well understood to be a good way to get famous as a young scientist to pick a public fight.  Ideally with a senior person (preferred due to increased visibility) or another junior person if there&#8217;s a suitable ideological divide.  This could be a feature of my field (psychology, neuroscience) in which either there isn&#8217;t really a dominant old guard or maybe that the old guard leaves a lot of room for other people to fight over.  I don&#8217;t think it&#8217;s unique to my field, though.</p>

	<p>Second, tenure decisions at my university are heavily based on external letters (perhaps more than some others), but a negative letter is not a killer.  The culture of this process is that not only is it ok to get a &#8220;bad&#8221; letter, but that it&#8217;s a sign of impact.  If somebody writes that &#8220;so-and-so is wrong about everything and this is hugely annoying!&#8221; then that&#8217;s a sign that so-and-so is a player.  The killers are letters that damn by faint praise or worse, &#8220;never heard of so-and-so.&#8221;</p>

	<p>I&#8217;m not recommending running out and picking fights or making colleagues mad (via blogs or any other way) as your field or department may be different.  I&#8217;m just saying that there&#8217;s at least some small incentive towards being negative, perhaps enough to get honest appraisals now and then.</p>
 ]]></content:encoded>
	</item>
	<item>
		<title>By: Michael D</title>
		<link>http://crookedtimber.org/2007/10/04/playing-nice/comment-page-1/#comment-212898</link>
		<dc:creator>Michael D</dc:creator>
		<pubDate>Thu, 04 Oct 2007 19:12:28 +0000</pubDate>
		<guid isPermaLink="false">http://crookedtimber.org/2007/10/04/playing-nice/#comment-212898</guid>
		<description>I wonder how peer review inflation differs meaningfully from grade inflation.

One, I suppose the grader does not normally get to choose words carefully, and must depend on the highly coded B+ to register criticism.  Two, instead of having review committees (and, to a lesser extent, collegiality) to blame for the practice, grade inflation seems (in the popular(?) anti-education-establishment tradition) set at the feet of lazy students and the educators unwilling to stand up to them.

It is interesting to hear this dynamic described without the twin presumptions of worthlessness and fecklessness.</description>
		<content:encoded><![CDATA[	<p>I wonder how peer review inflation differs meaningfully from grade inflation.</p>

	<p>One, I suppose the grader does not normally get to choose words carefully, and must depend on the highly coded B+ to register criticism.  Two, instead of having review committees (and, to a lesser extent, collegiality) to blame for the practice, grade inflation seems (in the popular(?) anti-education-establishment tradition) set at the feet of lazy students and the educators unwilling to stand up to them.</p>

	<p>It is interesting to hear this dynamic described without the twin presumptions of worthlessness and fecklessness.</p>
 ]]></content:encoded>
	</item>
</channel>
</rss>
