王汉森的博客分享 http://blog.sciencenet.cn/u/王汉森 Welcome to my blog!

博文

《自然》:要重新定义学术不端

已有 3269 次阅读 2013-2-14 05:15 |个人分类:学术园地|系统分类:论文交流| 文章, 杂志, 有效

     《自然》杂志2月13日发表评论文章,认为为了更有效遏制学术不端行为,应该将学术不端重新定义为“歪曲报道”(distorted reporting)。
 
 
Redefine misconduct as distorted reporting
 
13 February 2013
 

Against an epidemic of false, biased and falsified findings, the scientific community’s defences are weak. Only the most egregious cases of misconduct are discovered and punished. Subtler forms slip through the net, and there is no protection from publication bias.

Delegates from around the world will discuss solutions to these problems at the 3rd World Conference on Research Integrity (wcri2013.org) in Montreal, Canada, on 5–8 May. Common proposals, debated in Nature and elsewhere, include improving mentorship and training, publishing negative results, reducing the pressure to publish, pre-registering studies, teaching ethics and ensuring harsh punishments.

 

These are important but they overestimate the benefits of correcting scientists’ minds. We often forget that scientific knowledge is reliable not because scientists are more clever, objective or honest than other people, but because their claims are exposed to criticism and replication.

The key to protecting science, therefore, is to strengthen self-correction. Publication, peer-review and misconduct investigations should focus less on what scientists do, and more on what they communicate.

 

What is wrong with current approaches? By defining misconduct in terms of behaviours, as all countries do at present, we have to rely on whistle-blowers to discover it, unless the fabrication is so obvious as to be apparent from papers. It is rare for misconduct to have witnesses; and surveys suggest that when people do know about a colleagues’ misbehaviour, they rarely report it. Investigators, then, face the arduous task of reconstructing what a scientist did, establishing that the behaviour deviated from accepted practices and determining whether such deviation expressed an intention to deceive. Only the most clear-cut cases are ever exposed.

Take the scandal of Diederik Stapel, the Dutch star psychologist who last year was revealed to have been fabricating papers for almost 20 years. How was this possible? First, Stapel insisted on collecting data by himself, which kept away potential whistle-blowers. Second, researchers had no incentive to replicate his experiments, and when they did, they lacked sufficient information to explain discrepancies. This was mainly because, third, Stapel was free to omit from papers details that would have revealed lies and statistical flaws.

In tackling these issues, a good start would be to redefine misconduct as distorted reporting: ‘any omission or misrepresentation of the information necessary and sufficient to evaluate the validity and significance of research, at the level appropriate to the context in which the research is communicated’.

Some might consider this too broad. But it is no more so than the definition of falsification used by the US Office of Science and Technology Policy: “manipulating research materials, equipment, or processes, or changing or omitting data or results such that the research is not accurately represented in the research record”. Unlike this definition, however, mine points unambiguously to misconduct whenever there is a mismatch between what was reported and what was done.

Authors should be held accountable for what they write, and for recording what they did. But who decides what information is necessary and sufficient? That would be experts in each field, who should prepare and update guidelines. This might seem daunting, but such guidelines are already being published for many biomedical techniques, thanks to initiatives such as the EQUATOR Network (equator-network.org) or Minimum Information for Biological and Biomedical Investigations (mibbi.sourceforge.net).

The main task of journal editors and referees would then be to ensure that researchers comply with reporting requirements. They would point authors to the appropriate guidelines, perhaps before the study had started, and make sure that all the requisite details were included. If authors refused or were unable to comply, their paper (or grant application or talk) would be rejected. The publication would indicate which set or sets of guidelines were followed.

By focusing on reporting practices, the community would respect scientific autonomy but impose fairness. A scientist should be free to decide, for example, that ‘fishing’ for statistical significance is necessary. However, guidelines would require a list of every test used, allowing others to infer the risk of false positives.

Carefully crafted guidelines could make fabrication and plagiarism more difficult, by requiring the publication of verifiable details. And they could help to uncover questionable practices such as ghost authorship, exploiting subordinates, post hoc hypotheses or dropping outliers.

Graduate students could, in addition to learning the guidelines, train by replicating published studies. Special research funds could be reserved for independent replications of unchallenged claims.

The current defence against misconduct is prepared for the wrong sort of attack: the community tries to regulate research like any other profession, but it is different. The reliability of scientific ‘products’ is ensured not by individual practice, but by collective dialogue.

 

Nature Volume: 494, Pages: 149

Date published: (14 February 2013)
DOI: doi:10.1038/494149a


https://wap.sciencenet.cn/blog-5414-661677.html

上一篇:《自然》谈开放获取期刊
下一篇:俄罗斯:流星划过天空
收藏 IP: 128.100.204.*| 热度|

9 曹聪 孙学军 许培扬 吕喆 姚远 苏力宏 陈冬生 杨正瓴 yunmu

该博文允许注册用户评论 请点击登录 评论 (1 个评论)

数据加载中...
扫一扫,分享此博文

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-4-28 20:25

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部