• 中国科学学与科技政策研究会
  • 中国科学院科技政策与管理科学研究所
  • 清华大学科学技术与社会研究中心
ISSN 1003-2053 CN 11-1805/G3

科学学研究 ›› 2022, Vol. 40 ›› Issue (4): 594-601.

• 科学学理论与方法 • 上一篇    下一篇

论控制偏见的编辑制度革命———关于预注册遏制可重复性危机的机理研究

王阳1,肖昆2,2   

  1. 1. 华侨大学哲学与社会发展学院
    2.
  • 收稿日期:2021-01-26 修回日期:2021-03-30 出版日期:2022-04-15 发布日期:2022-04-15
  • 通讯作者: 王阳

The Editing System Revolution to Control Bias:The Mechanism Research of Pre-registration to keep down the Reproducibility crisis

  • Received:2021-01-26 Revised:2021-03-30 Online:2022-04-15 Published:2022-04-15

摘要: 预注册的新型编辑制度革命能够控制可重复性危机,关键是承认偏见、注册偏见和能够重复偏见,并建构从科研想法到论文发表的全数据链。预注册制度遏制如下四个科研流程的偏见:一,注册上传试点数据和实验计划,构建保存和揭示确证偏见的数据基础;正式发表论文要求包括试点数据,提升了正式实验前的数据可重复性;二,增量注册所有事后发现能够控制后见之明偏见,提供重复事后发现的数据基础;三,第二次同行评议还须评估执行先前注册的数据统计方法程度,以控制地板效应、P值效应等选择性报告偏见;四,预注册制度允许发表无效结果,控制了发表偏见。

Abstract: The keys of pre-registration for solving the reproducibility crisis are to admit bias, register bias and reproduce bias, as well as the construction of a whole data-chain from idea to publication. The system of pre-registration could control the following four bias in the research process: Firstly, registration of pilot data provide the data basis for preservation and disclosure of confirmation bias. Pilot data should be published, so as to improving data reproducibility of experiment design. Secondly, incremental discoveries should be unloaded to control hindsight bias, as well as provide database for reproduce hindsight findings. Thirdly, second peer-review should also evaluate the implementation degree of registered data-analysis methods, in order to control selective reporting bias such as floor effects, ceiling effects, p-value effect etc. Fourthly, pre-registration must publish null results to control publication bias.