Friday, August 08, 2008

Crime and punishment in the lab
[This is the uncut version of my latest Muse article for Nature’s online news.]

Before we ask whether scientific conduct is dealt with harshly enough, we need to be clear about what punishment is meant to achieve.

Is science too soft on its miscreants? That could be read as the implication of a study published in Science, which shows that 43 percent of a small sample of scientists found guilty of misconduct remained employed subsequently in academia, and half of them continued to turn out a paper a year [1].

Scientists have been doing a lot of hand-wringing recently about misconduct in their ranks. A commentary in Nature [2] proposed that many such incidents go unreported, and suggested ways to improve that woeful state of affairs, such as adopting a ‘zero-tolerance culture’. This prompted several respondents to maintain that matters are even worse, for example because junior researchers see senior colleagues benefiting from ‘calculated, cautious dishonesty’ or because some countries lack regulatory bodies to police ethical breaches [3-5].

All this dismay is justified to the extent that misconduct potentially tarnishes the whole community, damaging the credibility of science in the eyes of the public. Whether the integrity of the scientific literature suffers seriously is less clear – the more important the false claim, the more likely it is to be uncovered quickly as others scrutinize the results or fail to reproduce them. This has been the case, for example, with the high-profile scandals and controversies over the work of Jan Hendrik Schön in nanotechnology, Hwang Woo-suk in cloning and Rusi Taleyarkhan in bench-top nuclear fusion.

But the discussion needs to move beyond these expressions of stern disapproval. For one thing, it isn’t clear what ‘zero tolerance’ should mean when misconduct is such a grey area. Everyone can agree that fabrication of data is beyond the pale; but as a study three years ago revealed [6], huge numbers of scientists routinely engage in practices that are questionable without being blatantly improper: using another’s ideas without credit, say, or overlooking others’ use of flawed data. Papers that inflate their apparent novelty by failing to acknowledge the extent of previous research are tiresomely common.

And it is remarkable how many austere calls for penalizing scientific misconduct omit any indication of what such penalties are meant to achieve. Such a situation is inconceivable in conventional criminology. Although there is no consensus on the objectives of a penal system – the relative weights that should be accorded to punishment, public protection, deterrence and rehabilitation – these are at least universally recognized as the components of the debate. In comparison, discussions of scientific misconduct seem all too often to stop at the primitive notion that it is a bad thing.

For example, the US Office of Research Integrity (ORI) provides ample explanation of its commendable procedures for handling allegations of misconduct, while the Office of Science and Technology Policy outlines the responsibilities of federal agencies and research institutions to conduct their own investigations. But where is the discussion of desired outcomes, beyond establishing the facts in a fair, efficient and transparent way?

This is why Redman and Merz’s study is useful. As they say, ‘little is known about the consequences of being found guilty of misconduct’. The common presumption, they say, is that such a verdict effectively spells the end of the perpetrator’s career.

Their conclusions, based on studies of 43 individuals deemed guilty by the ORI between 1994 and 2001, reveal a quite different picture. Of the 28 scientists Redman and Merz could trace, 10 were still working in academic positions. Those who agreed to be interviewed – just 7 of the 28 – were publishing an average 1.3 papers a year, while 19 of the 37 for which publication data were available published at least a paper a year.

Is this good or bad? Redman and Merz feel that the opportunity for redemption is important, not just from a liberal but also a pragmatic perspective. ‘The fact that some of these people retain useful scientific careers is sensible, given that they are trained as scientists’, says Merz. ‘They just slipped up in some fundamental way, and many can rebuild a scientific career or at least use the skills they developed as scientists.’ Besides, he adds, everyone they spoke to ‘paid a substantial price’. All reported financial and personal hardships, and some became physically ill.

But on another level, says Merz, these data ‘could be seen as undermining the deterrent effect of the perception that punishment is banishment, from academia, at least.’ Does the punishment fit the crime?

The scientific community has so far lacked much enthusiasm for confronting these questions – perhaps because misconduct, while a trait found in all fields of human activity, is felt to be uniquely embarrassing to an enterprise that considers itself in pursuit of objective truths. But the time has surely come to face the issue, ideally with more data to hand. In formulating civic penal policy, for example, one would like to know how the severity of sentencing affects crime rates (which might indicate the effectiveness of deterrence), and how different prison regimes (punitive versus educative, say) influence recidivism. And one needs to have a view on whether sanctions such as imprisonment are primarily for the sake of public protection or to mete out punishment.

The same sorts of considerations apply with scientific misconduct, because the result otherwise has a dangerously ad hoc flavour. Just a week ago, the South Korean national committee on bioethics rejected an application by Hwang Woo-suk to resume research on stem cells. Why? Because ‘he engaged in unethical and wrongful acts in the past’, according to one source. But that’s not a reason, it is simply a statement of fact. Does the committee fear that Hwang would do it again (despite the intense scrutiny that would be given to his every move)? Do they think he hasn’t been sufficiently punished yet? Or perhaps that approval would have raised doubts about the rigour of the country’s bioethics procedures? Each of these reasons might be defensible – but there’s no telling which, if any, applies.

One reason why it matters is that by all accounts Hwang is an extremely capable scientist. If he and others like him are to be excluded from making further contributions to their fields because of past transgressions, we need to be clear about why that is being done. We need a rational debate on the motivations and objectives of a scientific penal code.

References

1. Redman, B. K. & Merz, J. F., Science 321, 775 (2008).
2. Titus, S. L. et al., Nature 453, 980-982 (2008).
3. Bosch, X. Nature 454, 574 (2008).
4. Feder, N. & Stewart, W. W. Nature 454, 574 (2008).
5. Nussenzveig, P. A. & Funchal, Z. Nature 454, 574 (2008).
6. Martinson, B. C. et al., Nature 435, 737-738 (2008).

3 comments:

JimmyGiro said...

"Prepare the wicker Professor"

The frauds and parvenues that perpetrate these deeds, do so to enhance their 'status'. It's therefore this status that needs to be addressed.

If every scientist was entered on a giant database, and all agreed on a universal system of measuring their individual status, such as some citation index for example, then every transgression that is proven can result in negative 'citation' points, determined by the extent of that transgression.

Such a system might also curb the silly habit of all and sundry of a particular research group, putting their names to each and every publication from the group; since if found guilty of something, not only would the first author be penalised, but also those 'supervisors' chasing unearned kudos and DSc dissertation, who hitched their names parasitically.

How many Professors do you know who wrote less than 10% of 'their' publications and DSc dissertation?

JimmyGiro said...

Speaking of frauds; I'm not sure whether to laugh or cry at:

THIS

Look at the quote at the bottom of the article.

JimmyGiro said...

Wow, there's more, feast your scepticisms on the main gold seem:

Shen Clinic

Take a peek at "Photon Resonance Therapy" from the link on the page.