SubscribeAnother criticism of the method is that your survey suffers from what's called a main street bias, that in selecting households your teams move outwards from the centre of towns where the majority of violence is likely to occur, and so it's therefore an unrepresentative sample.Counting the dead in Iraq
Les Roberts: Yes, I heard this, it's coming from a couple of physicists at Oxford, and I just simply think it's not true. Every time you do a survey like this, there is the possibility that biases creep in, but this one almost certainly isn't possible. And I say that for a couple of reasons. First of all when we picked a house on a randomly picked street, we almost always ended up two or three blocks away to get to the 40th house. So the one that was picked was not the majority of houses in any given cluster, that's No. 1.
No. 2, we had an equal chance of picking a main street and a back street, and No.3 the vast majority of deaths are violence, the vast majority are adult males, and it seems, we didn't actually collect this information, but when bouncing this main street bias idea off of the doctors who did the work, they said that the vast majority of the deaths happened when people were away from their homes. In markets, standing in queues, walking on the streets going back home. So it just doesn't fly.
You've also come in for criticism from a group called Iraq Body Counts. Now Iraq Body Counts are very much opposed to the war in Iraq, and they're a group of volunteers who keep a record based on public sources of reported deaths in Iraq. Their figure of the current number of deaths is around 50,000; in other words it's less than 10% of your figure. How do you explain that discrepancy?
Les Roberts: So they started out by culling through newspaper reports and trying to record all of those events that appeared in two different media reaped sources. And after a while they managed to get some reporters to intentionally go visit the morgue in Baghdad and other places. But first of all, that sort of passive surveillance process is never complete in a time of war. In Bosnia the best estimate is about 30% to 40% of deaths were captured by hospitals, plus morgues, plus all the governmental reporting systems. But usually in times of war, it's far, far lower. So that's thought No. 1.
Thought No. 2 is if Iraq was the healthiest country in the world, just no violence, no troubles at all, there have to have been by this point, about 500,000 deaths from natural causes, since the US-led invasion, in March of 2003. So if there's been half a million deaths from natural causes what fraction of those have been reported by the Ministry of Health and are captured by hospitals and morgues? And it's not a tenth, it's a tiny fraction. And this actually leads in my mind to the most interesting thing about our study. This is probably of any major scientific study in recent history, whether it's whether Dolly the Sheep was cloned, or whether there was cold fusion, this is the easiest one for the press to either debunk or verify, because if Iraqi body count is correct, if you go out to the graveyards and morgues across Iraq, only one in ten bodies coming in must be from violence, and 90% must be from natural causes. If we're right, the majority of bodies over the last three years that have come in, must have been from violence. And it would be pretty darn easy to go to four or five or six places across Iraq and get a quick pulse on whether or not it's a tenth of all deaths that are from violence, or most of all deaths that are from violence.
The Iraq body count also points to another bit of research done by the United Nations, which surveyed more than 20,000 households, now they too came up with much lower figures for violent deaths than your smaller survey.
Les Roberts: So let's back up, you know virtually all of the criticisms you've just mentioned coming from various groups in and around Oxford, are actually the same group criticising, and this one is by far the most disingenuous because that survey that you cite was done by a great researcher out of Norway, and it wasn't a survey about mortality, it was a survey about living conditions, and they asked a whole host of questions, the average interview I believe took 82 minutes. There was one question about deaths; if someone had died, then there were a couple of follow-on questions. And they found in the first 13 months of occupation, that 20-something-thousand people had died, and they said 'Look, it's so out of whack with what these two Lancet studies are saying.' And that's just not true, they're not very far out of whack. First of all, it was Iraq governmental employees from Saddam's era that was doing the interviewing, and we're pretty sure they didn't get complete reporting of deaths. We're sure of that for two reasons: 1) the overall death rate they came up with was about half the overall death rate we came up with before the invasion, and at the end of this study, the UNDP study site, the lead researcher, Jan Patterson, was sceptical about this mortality data, so he sent the interviewers back to the exact same houses and had them just ask about deaths under five. And lo and behold, when people met these interviewers for the second time when they were a little more comfortable, they reported 50% more deaths on the second interview than they did the first. So the researchers know their death estimate was a gross underestimate. And in the first year of the occupation, the death rate was very low compared to the second year. In fact in our study that came out in 2004, there were twice as many violent deaths in the last six months of the occupation that we studied, as there were in the first 12 months. So the two studies actually only differ by a factor of about 2, and the UNDP study which was not about mortality, knows that it was a gross underestimate of deaths.
To its credit, the BBC website has tried harder than most mainstream media to report the issue honestly. In particular, BBC world affairs correspondent Paul Reynolds - who has frequently engaged with Media Lens readers - responded to complaints by agreeing to invite questions from members of the public and to forward them to the authors of the Lancet report. On October 30, the BBC posted an edited version of answers from Les Roberts... Below, we are publishing Roberts' unedited answers. We have also added Roberts' response to an editorial by Steven Moore in the Wall Street Journal.MediaLens: Lancet Report Co-Author Responds To Questions
I was shocked myself when I saw the figure of 650,000. It seemed huge, much larger than I had imagined possible. It is approximately four times the Iraqi Health Ministry's recent estimate, and twice the figure of 300,000 that is often given as an estimate of the number of people killed by Saddam Hussein during his 23 years of brutal rule...Center For Media And Democracy: At Long Last, Can We Please Start Counting the Dead ?
Are these numbers credible? I looked at reactions to the Lancet study from several groups: American political pundits, scientists with expertise in health and mortality research, and Iraqis (as reflected in the views of Iraqis with English-language weblogs). Many of the political pundits (even those with anti-war views) either rejected the study or questioned its conclusions and methodology. The scientists, however, gave it high marks, and most of the Iraqis thought the number sounded like it was in the right ballpark...
It is rather striking, moreover, that critics of this research have mostly avoided calling for additional, independent studies that could provide a scientific basis for either confirming or refuting its alarming findings.
« Older The flightless kiwi,... | Fans of Flight Simulators and ... Newer »
This thread has been archived and is closed to new comments
posted by Brandon Blatcher at 7:52 PM on November 12, 2006