Archive for the 'Statistics' Category


The collapsing American middle class

Posted by Chris Bertram

Surfing over to Charles Dodgson’s site yesterday, I happened upon Elizabeth Warren’s lecture on the squeeze on the American middle class since the 1970s. Then you could bring up a family on one income; now you can’t. Then non-discretionary spending made up a smaller proportion of household spending; now, it dominates. Result: if a parent loses their job or gets sick, bankruptcy looms. I didn’t expect to sit watching a YouTube video for whole hour but I was riveted by the story Warren tells with the consumption statistics.

I was kind of reluctant to blog this too. After all, there are others at CT who do sociology or economics or family policy and I don’t do those things. And I’m not an American resident either. Still, it struck me as pretty compelling. I wonder how similar the change has been in the other OECD countries?


The one per cent doctrine

Posted by Chris Bertram

Jeremy Waldron has a great piece in the latest LRB reviewing a recent book by Cass Sunstein. He has a nice discussion of the Cheney doctrine that even a one-percent probability of a catastrophic event should be treated as a certainty for policy purposes, where the class of catastrophic events is limited to those with a military, security or terrorist dimension. Reasoning like this interacts neatly with “ticking-bomb” scenarios: now a 1 per cent chance that the there’s a ticking bomb the terrorist knows about is sufficient in to justify waterboarding or worse. Of course other potentially catastrophic developments—such as climate change—haven’t generated a “treat as if certain” policy response from the US government, even thought even the most determined denialists must evaluate the probability that anthropogenic global warming is happening at greater than one in a hundred.

Waldron is also pretty acid about Sunstein’s treatment of global warming and distributive justice, noting some of the shortcomings of the idea that poor people’s lives should be valued according to what they’re prepared to pay to avoid the risk of death. But read the whole thing, as they say.


Seeing Like “Seeing Like a State”

Posted by Henry

My long post from a couple of months ago on James Scott’s Seeing Like a State and Brad DeLong’s review of it enjoyed a temporary revival when Brad republished it in his ‘DeLong Smackdown’ series. But I got a bit of grief from one reader, who thought that I had given Scott far too easy a ride. Which is probably true – while I admire the book, I do have many disagreements with it, which I would have gotten into if I had been reviewing the book proper, rather than arguing against Brad’s interpretation. One such disagreement popped up when I was reading it again for class a couple of weeks ago, together with John Brewer’s The Sinews of Power.1
Continue reading “Seeing Like “Seeing Like a State””


Post-Invasion Deaths in Iraq

Posted by Kieran Healy

A new study estimates violence-related mortality in Iraq between 2003 and 2006:

Background Estimates of the death toll in Iraq from the time of the U.S.-led invasion in March 2003 until June 2006 have ranged from 47,668 (from the Iraq Body Count) to 601,027 (from a national survey). Results from the Iraq Family Health Survey (IFHS), which was conducted in 2006 and 2007, provide new evidence on mortality in Iraq.

Methods The IFHS is a nationally representative survey of 9345 households that collected information on deaths in the household since June 2001. We used multiple methods for estimating the level of underreporting and compared reported rates of death with those from other sources.

Results Interviewers visited 89.4% of 1086 household clusters during the study period; the household response rate was 96.2%. From January 2002 through June 2006, there were 1325 reported deaths. After adjustment for missing clusters, the overall rate of death per 1000 person-years was 5.31 (95% confidence interval [CI], 4.89 to 5.77); the estimated rate of violence-related death was 1.09 (95% CI, 0.81 to 1.50). When underreporting was taken into account, the rate of violence-related death was estimated to be 1.67 (95% uncertainty range, 1.24 to 2.30). This rate translates into an estimated number of violent deaths of 151,000 (95% uncertainty range, 104,000 to 223,000) from March 2003 through June 2006.

Conclusions Violence is a leading cause of death for Iraqi adults and was the main cause of death in men between the ages of 15 and 59 years during the first 3 years after the 2003 invasion. Although the estimated range is substantially lower than a recent survey-based estimate, it nonetheless points to a massive death toll, only one of the many health and human consequences of an ongoing humanitarian crisis.

150,000 violent deaths in three years is a lot. You’ll recall that the Lancet study estimated about 655,000 excess deaths, which is a lot more. The two numbers aren’t directly comparable because excess deaths due to violence are only one component of all excess deaths (e.g., from preventable disease or other causes attributable to the war). Deaths due to violence rose from a very small 0.1 per 1000 person years in the pre-invasion period to about 1.1 per 1000py afterwards, or 1.67 adjusting for estimated underreporting. This is where the authors get their 151,000 number. The overall death rate rose from about 3.2 per 1000 person years to about 6, an increase of just over 2.8. Depending on whether you use the raw or adjusted estimated rate of violent death this would work out to an overall excess death total of just under 400,000 or just over 250,000. (But this is just a back-of-the-envelope calculation, as the overall death rate isn’t reported.)

Continue reading “Post-Invasion Deaths in Iraq”


For capability fans only

Posted by Ingrid Robeyns

Here’s some information for fans of the capability approach: the Dutch Environmental Assessment Agency released a report that I co-wrote on how to conceptualise the quality of life for national policy purposes in affluent countries – we argue for a capability metric and are rather critical of the happiness metrics. I should add, though, that the proof is in the eating of the pudding, and we don’t have any funding to collect the necessary data that a capabilities-based index of the quality of life would require; our work remains at the conceptual level only. It may well turn out that we would need a very long questionnaire in order to collect all data, which in turn might jeopardize the viability of a capability-index of quality of life (since the non-response-rate would be higher). And there are more problems to solve before we would arrive at a capability index, certainly one as (relatively) easy to measure as either GDP per capita or happiness indicators. Anyway, if anyone has more money and more time and thinks this is a fun project to pursue, let me know what comes out of it.


A little rich

Posted by Henry

The Financial Times, for reasons best known to itself, serves up this steaming heap of buffalo dung from Heritage Foundation Vice-President for Governmental Affairs, Michael Franc, on its op-ed page.

A legislative proposal that was once on the fast track is suddenly dead. The Senate will not consider a plan to extract billions in extra taxes from mega-millionaire hedge fund managers. … Far from embarrassing, this episode may reflect a dawning Democratic awareness of whom they really represent. For the demographic reality is that, in America, the Democratic party is the new “party of the rich”. More and more Democrats represent areas with a high concentration of wealthy households. Using Internal Revenue Service data, the Heritage Foundation identified two categories of taxpayers – single filers with incomes of more than $100,000 and married filers with incomes of more than $200,000 – and combined them to discern where the wealthiest Americans live and who represents them. …Democrats now control the majority of the nation’s wealthiest congressional jurisdictions. More than half of the wealthiest households are concentrated in the 18 states where Democrats control both Senate seats. …

Soon this new political demographic may give traditional purveyors of class warfare the yips. To comply with new budget rules, liberal Democrats on Capitol Hill are readying a tax increase of at least $1,000bn over the next decade. Ms Pelosi says she wants to extract all of this from “the wealthy”. When has a party ever championed a policy that would inflict so much pain on its own constituency? At what point will affluent Democrats crack and mount a Blue State tax rebellion?

A hint to the people at the Financial Times (a group whom I usually hold in considerable esteem): when an op-ed’s argument rests on a statistical fallacy so howlingly awful that it’s obvious to someone like me, it’s not a good idea at all to publish it. More generally, when a Heritage Foundation vice-president proposes a piece to you, et numeri ferentes, especial attention to the basis of those figures is not only warranted but necessary. If it is true that Democrats tend to represent richer districts, both basic logic and an elementary grasp of statistics should tell you that this does not imply that they represent richer voters. Indeed, not only does it not imply this, we know that it isn’t true. See further Andrew Gelman et al.

Do richer voters still support Republicans? If so, how can we understand the pattern that the Democratic do best in the richer “blue states” of the Northeast and West, while the Republicans dominate in the poorer “red states” in the South and between the coasts? … The Republicans have the support of the richer voters within any given state but have more overall support in the poorer states. Thus, the identification of rich states with rich voters, or more generally, the “personification” of so-called red and blue states, is misleading. For example, in the context of the Brooks quotes above, within an “upscale” area that supports the Democrats, the more “upscale” voters are still likely to vote Republican. … The pattern that richer states support the Democrats is not a simple aggregation of rich voters supporting the Democrats.

And so on. I have a lot of respect for the Financial Times – they do a better job in my estimation than any other newspaper of preserving a high quality of debate and are usually quite scrupulous about factual detail. This makes it all the more odd that a piece like this, which is better suited for publication in an introductory statistical textbook as a particularly egregious cautionary example of the fallacy of aggregation, could have made it in. Better filters please.


Facebook profiling

Posted by Henry

Republican Internet consultant Patrick Ruffini points to this fascinating resource for figuring out the raw numbers of liberal, moderate and conservative Facebook users interested in a specific issue. Don’t try to create a flyer or whatever – just go to the “targetting” section, type the topic that you are interested in into the keywords section, and see how the numbers change whether you click Liberal, Moderate and Conservative (there’s further microtargeting of cities etc available too). For example, about 2,520 self-declared liberal Facebook users declare blogging as one of their interests, as opposed to 1,320 moderates and 1,100 conservatives. 5,180 liberals show the good taste to declare My Bloody Valentine as one of their favourite bands, as opposed to 1,120 moderates, and only 340 conservatives. Less obviously, the number of liberals (7,300) and conservatives (7,580) who like bluegrass music is about the same1. Obviously, treat these numbers with extreme caution; there is no way that Facebook users are a random sample of the population 2, but still, this promises much idle entertainment.

1 It occurs to me on re-reading this post that I’ve phrased this in a misleading way – obviously, if you wanted to make a serious point about this, you’d weight the absolute numbers or provide the odds ratios or whatever.
2 For one, the liberal-conservative ratio is skewed to liberals among Facebook users as compared to the ratio in the general population – there are just over 2.8 million self-identified liberal Facebook users and 2.18 million conservatives. Most survey evidence that I am aware of suggests that there are considerably more self-identified conservative Americans than liberal Americans (although the numbers of self-identified conservatives is dropping).


Hilarity

Posted by Kieran Healy

Ow, ow, ow. Comment 2 is also pretty funny. Actually, the whole thread is hilarious.


Another post on dating strategies

Posted by Henry

Megan of From the archives won’t be surprised that this NYT article, claiming that:

One survey, recently reported by the federal government, concluded that men had a median of seven female sex partners. Women had a median of four male sex partners. Another study, by British researchers, stated that men had 12.7 heterosexual partners in their lifetimes and women had 6.5. But there is just one problem, mathematicians say. It is logically impossible for heterosexual men to have more partners on average than heterosexual women. Those survey results cannot be correct.

is already getting play in the blogosphere. The only thing is that it isn’t logically impossible, at least as the author presents it. Ask Andrew Gelman

Jeff’s response: MEDIANS??!! Indeed, there’s no reason the two distributions should have the same median. I gotta say, it’s disappointing that the reporter talked to mathematicians rather than statisticians. (Next time, I’d recommend asking David Dunson for a quote on this sort of thing.) I’m also surprised that they considered that respondents might be lying but not that they might be using different definitions of sex partner. Finally, it’s amusing that the Brits report more sex partners than Americans, contrary to stereotypes.


Pixels and Pies

Posted by Kieran Healy

Via John Gruber I see Anil Dash wondering about the trend toward “square blocks of color … being used to represent percentage-based statistics instead of the traditional pie chart.” Like this.

Squares

I’d seen the one on the left—from a New York Times story about beliefs in the afterlife, and wondered about it, too. The white block in the middle of the Times graphic presumably represents “Don’t Knows” but it is not labeled. This is especially odd in the context of belief in the afterlife, as agnosticism is a recognized point of view and so not equivalent to “Don’t know” answers on other survey questions.

The main problem with this style of presentation is that it uses two dimensions to display unidimensional data. As the graphic on the right, especially, makes clear, the layout of the subcomponents of the graph is arbitrary. Maybe laying out responses on a line is impractical in a newspaper column. This is one reason pie charts are popular, but their problems are well known. (Word to the wise: don’t use them.)

Mosaic plots superficially resemble the ones pictured here, and they are sometimes used to very good effect. But the whole point of a mosaic plot is that it visually represents several categorical variables at once. It’s a picture of an n x n table, in other words, where the sizes of the blocks reflect the cell values in the table. Here’s an example. Even here you have to be careful interpreting the results. But the boxes above take this kind of picture but use it with only one variable, which doesn’t make any sense at all.


Alice in Wonderland and the Lancet study

Posted by Daniel

(Initial bad temper warning: I am a little bit cross as I write this, because I think that the distribution of the paper on the Michelle Malkin website was both silly (because the paper has huge flaws that a mass audience can’t possibly be expected to understand) and rude (because at the time when he gave permission for it to be distributed, David was soliciting comments, seemingly in good faith, from the Deltoid community, aimed at improving it before distribution). The Malkin link has meant that this paper has metastatised and I will therefore presumably be dealing with cargo-cult versions of it by people who don’t understand what they’re talking about from now to the end of time. I see that Shannon Love of the Chicago Boyz website is claiming to have been “sweetly vindicated”, FFS. Ah well, the truth has now got its boots on, and big clumpy steel toe-capped boots they are too. C’mon boots, let’s get walking.)
Continue reading “Alice in Wonderland and the Lancet study”


Worst job ever?

Posted by Eszter

Unclear why exactly:), Michael Froomkin asks the question:

What would be the most unattractive job in the regular economy? I’m not talking about the objectively least-well paid or statistically most dangerous, or most unpopular (car salesman?). I mean, what job would you least like to have. No fair saying subsistence farmer in Darfur either — I mean in the US (or other developed economy).

His response: toll booth attendant.

Continue reading “Worst job ever?”