"Creative" use of data by death penalty proponents

The academic debate on the death penalty is heating up again. Three decades ago, Isaac Ehrlich went head to head with a dozen critics. In the end, most unbiased observers concluded that the results were too sensitive to minor changes in specifications to draw any strong conclusions.

More recently, a host of authors have once again been arguing that the death penalty is an effective homicide deterrent. For instance, in recent testimony in front of the U.S. Senate, economist Paul Rubin began his comments by saying, “Recent research on the relationship between capital punishment and homicide has created a consensus among most economists who have studied the issue that capital punishment deters murder.”

That struck me as a strange thing to argue given what I know about the situation.

I have a paper with Larry Katz and Ellen Shustorovich in 2003. We conclude that “…there is little systematic evidence that the execution rate influences crime ratese…” Of 20 different specifications we examine, in only three cases do we find a statistically significant reduction in homicide from the death penalty. In one case, we find a statistically significant increase. (In contrast to the findings on executions, we find that bad prison conditions do seem to reduce crime.)

Here is how Rubin describes my paper’s results in his testimony:

“Another recent paper by Lawrence Katz, Steven D. Levitt, and Ellen Shustorovich uses state-level panel data covering the period 1950 to 1990 to measure the relationship between prison conditions, capital punishment, and crime rates….In several estimations, both the prison death rate and the execution rate are found to have significant, negative relationships with murder rates…”

What about the other 17 specifications?

More damaging to the case in favor of a death penalty is an exhaustive new study by John Donohue (my co-author on the abortion-crime stuff) and Justin Wolfers (an economist at Wharton). In the paper, Donohue and Wolfers provide a devastating critique of the existing studies, including the ones cited by Rubin in his testimony.

Rubin’s testimony on the Donohue and Wolfers paper is as follows:

“A recent paper in the Stanford Law Review questions some of these studies. This paper purports to show that the estimates of a deterrent effect are “fragile” and can be changed by statistical manipulation. The results of this paper have not been evaluated by competent scholars; the Stanford Law Review, like all law reviews, is edited by students who have no particular competence in econometrics. Moreover, Professors Wolfers and Donohue chose not to make their paper available online through a service such as SSRN or the BE Press, so that the scholarly community did not have access to their analysis before it was published.”

While in the abstract I agree that it is preferable to publish work in peer reviewed journals, it is worth remembering that peer-review is nothing like a guarantee of quality. At best, one hopes that peer review culls out the truly bad research. But there are enough journals that all but the worst work can eventually be published in a peer reviewed journal. And when two top scholars like Donohue and Wolfers publish something, peer reviewed or not, it is worth taking note.

But, this is the kicker. If you have the patience to download a paper from the Social Science Research Network, click here and download this paper. If you compare Rubin’s testimony, you will find that in most parts it follows word for word what is in this paper (published, I should add, in a non peer reviewed journal).

Which wouldn’t be a big deal, except the paper that exactly matches Rubin’s testimony isn’t even written by Paul Rubin, it is written by his sometimes co-author Joanna Shepherd.

TAGS:

Leave A Comment

Comments are moderated and generally will be posted if they are on-topic and not abusive.

 

COMMENTS: 40

  1. Ben Golub says:

    That *is* pretty disturbing — especially considering the slight reordering here and there.

    Rubin’s testimony: Cross-sectional studies also suffer serious problems. Most importantly, they preclude any consideration of what happens to crime, law enforcement, and judicial processes over time. Cross-section data also prevent researchers from controlling for jurisdiction-specific characteristics that could be related to murder, such as greater urban density in some states.

    Shepherd’s paper: Cross-sectional studies also suffer serious problems. Most importantly, they prevent researchers from using so-called fixed-effects estimation to control for jurisdiction-specific characteristics that could be related to murder. For example, with cross-sectional data, a researcher cannot control for fundamental but immeasurable variables, such as a violent culture in southern states. Cross-section data also preclude any consideration of what happens to crime, law enforcement, and judicial processes over time.

    Thumb up 0 Thumb down 0

  2. Ben Golub says:

    That *is* pretty disturbing — especially considering the slight reordering here and there.

    Rubin’s testimony: Cross-sectional studies also suffer serious problems. Most importantly, they preclude any consideration of what happens to crime, law enforcement, and judicial processes over time. Cross-section data also prevent researchers from controlling for jurisdiction-specific characteristics that could be related to murder, such as greater urban density in some states.

    Shepherd’s paper: Cross-sectional studies also suffer serious problems. Most importantly, they prevent researchers from using so-called fixed-effects estimation to control for jurisdiction-specific characteristics that could be related to murder. For example, with cross-sectional data, a researcher cannot control for fundamental but immeasurable variables, such as a violent culture in southern states. Cross-section data also preclude any consideration of what happens to crime, law enforcement, and judicial processes over time.

    Thumb up 0 Thumb down 0

  3. smili says:

    Sadly, political decisions are made first, and then they go out to find the necessary facts/”science” to justify the decision.

    Science seems less likely to inform nowadays, and seems more likely to be perverted for reasons of justification of a decision that’s already been made. If each side has their “science” experts and only listens to who they agree with without acknowledgement of concensus, what are we left with?

    Thumb up 0 Thumb down 0

  4. smili says:

    Sadly, political decisions are made first, and then they go out to find the necessary facts/”science” to justify the decision.

    Science seems less likely to inform nowadays, and seems more likely to be perverted for reasons of justification of a decision that’s already been made. If each side has their “science” experts and only listens to who they agree with without acknowledgement of concensus, what are we left with?

    Thumb up 0 Thumb down 0

  5. Kirit says:

    Coincidentaly I put something up on my web site about US death penalties (from an outsider’s perspective). My argument (or should that be hope?) was that it seemed to be dieing it’s own death through repeated eight amendment appeals – probably no news to those of you who have spent more time looking at this than I have.

    The article is at http://www.kirit.com/Death%20penalties%20in%20the%20US

    (I’ll be adding in the references from here once I’ve read them myself)

    Thumb up 0 Thumb down 0

  6. Kirit says:

    Coincidentaly I put something up on my web site about US death penalties (from an outsider’s perspective). My argument (or should that be hope?) was that it seemed to be dieing it’s own death through repeated eight amendment appeals – probably no news to those of you who have spent more time looking at this than I have.

    The article is at http://www.kirit.com/Death%20penalties%20in%20the%20US

    (I’ll be adding in the references from here once I’ve read them myself)

    Thumb up 0 Thumb down 0

  7. JGUNS says:

    Here is the thing I wonder about these studies on the deterrent factor: Has anyone ever looked at Singapore? They have the death penalty for simple drug possession and there is almost no drugs there. According to those that believe that the Death Penalty is not a deterrent, how would they explain this?

    Secondly, those against capital punishment seem always to focus on the “detterent factor” argument. Almost no one that I know that is for the death penalty is for it because they believe it is a deterrent. They are for it because they think that there are some crimes and some criminals that forfeit their right to live due to the heinousness of their crimes. Therefore, these studies are unlikely to sway most people that are for capital punishment.

    Thumb up 0 Thumb down 0

  8. JGUNS says:

    Here is the thing I wonder about these studies on the deterrent factor: Has anyone ever looked at Singapore? They have the death penalty for simple drug possession and there is almost no drugs there. According to those that believe that the Death Penalty is not a deterrent, how would they explain this?

    Secondly, those against capital punishment seem always to focus on the “detterent factor” argument. Almost no one that I know that is for the death penalty is for it because they believe it is a deterrent. They are for it because they think that there are some crimes and some criminals that forfeit their right to live due to the heinousness of their crimes. Therefore, these studies are unlikely to sway most people that are for capital punishment.

    Thumb up 0 Thumb down 0