Open Peer Review
Although peer review in science is plagued by elitism, bias, and abuse, it is deemed by many as essential to scientific process. Ironically, peer review has no valid scientific base. The few studies done on peer review suggest that reviewers -- also known as referees -- vary markedly in their opinions. Moreover, peer review does not prevent scientific fraud, hardly detects errors, and only modestly improves scientific quality (Smith, 1999; van Rooyen et al., 1999; Rothwell and Martyn, 2000). Importantly, peer review continues to be a conservative, risk-adverse process that smothers innovative and unconventional ideas (O'Reilly, 2002), particularly in controversial fields like, for example, my own field of aging research.
In some fields, such as astronomy, a large body of research communication already takes place through preprints deposited in archives such as arXiv.org. Nonetheless, anonymous peer review is the trademark of most scientific journals, at least in the life sciences. Since the Internet has made the peer review process faster and cheaper, it appears peer review will remain in the foreseeable future, and hence the benefits and disadvantages of peer review will not be further discussed herein. The aim of this essay is to make the case in favor of open peer review.
Open peer review consists of signed reviews that can be posted on the Internet together with accepted and refused manuscripts and grant proposals. The idea is to have a more transparent process not only in scientific journals but, most of all, in granting organizations. (After all, anyone with enough tenacity can have a paper accepted given the dozens of scientific journals nowadays, but in most countries there are only a few granting agencies.) I defend that transparency and openness must be implemented in scientific journals, granting agencies, job applications, and every single step of the academia. Secrecy forges despotism. Transparency is always the best protection against abuse.
Anonymity is based on the principle that anonymous reviewers will be more honest and objective. For example, open peer review may hinder junior scientists from rejecting works by more senior colleagues. This coward behavior is nearly exclusive of science. In the arts and even in politics criticism is open and serves an important role in making ideas stronger (Brown, 2003). All fields in science have suffered revolutionary schisms because of new ideas that overtake the establishment. Consequently, reviewers must be prevented from smothering creativity and originality.
Overall, authors are largely in favor of open peer review (van Rooyen et al., 1999). The quality of anonymous reviews has been deemed as slightly inferior to non-anonymous reviews but this has not been always statistically significant (Godlee, 2002). What is important is that abuse by reviewers is mitigated by eliminating anonymity. Open peer review also brings accountability and credit to reviewers.
Mostly for ethical reasons, the British Medical Journal already has an open peer review system. Reviewers are asked to sign their reviews and declare any competing financial interests. This is an important step in the right direction. The major difficulty in open peer review is that some reviewers are unwilling to cooperate: a smaller percentage of reviewers are willing to act as reviewers in an open, transparent system than otherwise (Smith, 1999). While this may pose a problem to editors, the decision by the BMJ is hopefully the beginning of a larger cultural change in the life sciences leading to a more transparent and honest system. Scientific progress, not stagnation, is the purpose of science. In fact, most scientific revolutions occur when scientists are beginning their academic careers (Table 1). "Scientists tend to make their major contributions within ten years of the end of their professional educations after which their creative contributions to science tends to decline," wrote Charles F. Longino, Jr. The average age of authors at which the most significant scientific breakthroughs occurred is 32 years-old (Table 1).
If you are a reviewer, please help support open peer review by disclosing your identity to authors. Personally, I sign papers I review, though ultimately it is up to editors to decide whether to disclose my identity or not.
Brown, H. M. (2003). "Peer review should not be anonymous." BMJ 326:824. Available online.
Godlee, F. (2002). "Making reviewers visible: openness, accountability, and credit." JAMA 287:2762-2765. Available online.
Horvitz, L. A. (2001). "Eureka!: Scientific Breakthroughs that Changed the World." New York: Wiley. Available online.
O'Reilly, J. (2002). "Risk, adventure and the tyranny of peer review." Engineering Science and Education Journal December: 251-253. Available online.
Rothwell, P. M. and Martyn, C. N. (2000). "Reproducibility of peer review in clinical neuroscience: Is agreement between reviewers any greater than would be expected by chance alone?" Brain 123:1964-1969. Available online.
Smith, R. (1999). "Opening up BMJ peer review." BMJ 318:4-5. Available online.
van Rooyen, S. et al. (1999). "Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomized trial." BMJ 318:23-27. Available online
Thank you for visiting my website. Please feel free to contact me if you have any questions, ideas, comments or suggestions.
Copyright © 2004, 2006, 2011, 2012 by João Pedro de Magalhães. All rights reserved.