Over at the Volokhs, Jim Lindgren gets “upset”:http://www.volokh.com/archives/archive_2005_07_17-2005_07_23.shtml#1121820182 “twice”:http://www.volokh.com/archives/archive_2005_07_17-2005_07_23.shtml#1121843543 at co-blogger Orin Kerr for “claiming”:http://www.volokh.com/archives/archive_2005_07_17-2005_07_23.shtml#1121819891 and “repeating the claim”:http://www.volokh.com/archives/archive_2005_07_17-2005_07_23.shtml#1121843543 that prediction markets did a bad job of prediction the Roberts nomination. For Jim, the issue is whether markets are in general better than experts at aggregating publicly available information; he believes that “markets (however “good” or bad they are in absolute terms) should be better than experts on balance, or at least better than experts who lack actual first-hand knowledge of the forthcoming decision.” For Orin, Tradesports seems to be no more than a “way of monitoring what a few newspapers and blogs are saying,” and, on the whole, it “seems easier to just scan the headlines at How Appealing.”There’s an obvious alternative hypothesis which neither considers. Roberts futures shot up in value from 1% to near-certainty in the few hours before the decision was “officially” leaked. One highly plausible interpretation of this is that word had already leaked to a privileged few with good contacts in the Administration. Then, some of those people with insider knowledge took advantage of their privileged position by betting Roberts and fleecing the rubes. As Steve Bainbridge has “noted”:http://www.professorbainbridge.com/2005/07/inside_informat.html, Tradesports doesn’t seem to have any rules against insider trading. On this interpretation, Lindgren is right in saying that markets like Tradesports can provide more information on executive decisions than scanning the blogs – but only because they’re being used by those who have insider information to take advantage of the less-informed (who naively assume that they’re playing a fair game). In other words, there’s strong reason to suspect that this case doesn’t support Lindgren’s more general claims about the superiority of prediction markets vis-a-vis experts; in this case the markets are arguably being manipulated by people with insider knowledge that isn’t available to the experts. The reason that markets are doing better than experts “without first-hand knowledge” is most likely that they’re being used by experts _with_ first hand knowledge to make money from those who don’t have such knowledge. This is a very bad case to test the efficacy (or lack of same) of prediction markets in aggregating dispersed public knowledge into a usable metric; it seems to me rather unlikely that this sort of aggregation is what is in fact happening here.
Update: Orin Kerr says in comments. “You claim in your post that “Roberts futures shot up in value from 1% to near-certainty in the few hours before the decision was “officially” leaked.” That is incorrect. As best I can tell, Roberts futures shot up to near certainty only after every news website started posting that Bush had picked Roberts.” In which case, it seems to me that Kerr is right on this, and Lindgren and I are wrong, for different reasons.
Update 2: “Brayden King”:http://pubsociology.typepad.com/pub/2005/07/bad_versus_good.html has a very good post on the topic.