Send us a link
Saint Matthew Strikes Again: An Agent-based Model of Peer Review and the Scientific Community Structure
Saint Matthew Strikes Again: An Agent-based Model of Peer Review and the Scientific Community Structure
This paper investigates the impact of referee reliability on the quality and efficiency of peer review. We modeled peer review as a process based on knowledge asymmetries and subject to evaluation bias.
Does Incentive Provision Increase the Quality of Peer Review? An Experimental Study
Does Incentive Provision Increase the Quality of Peer Review? An Experimental Study
Although peer review is crucial for innovation and experimental discoveries in science, it is poorly understood in scientific terms. Discovering its true dynamics and exploring adjustments which improve the commitment of everyone involved could benefit scientific development for all disciplines and consequently increase innovation in the economy and the society.
Opening the Black-Box of Peer Review
This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused on the importance of reciprocity motives in ensuring cooperation between all involved parties. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios in which we tested different interaction conditions and author and referee behaviour. We found that reciprocity cannot always have per se a positive effect on the quality of peer review, as it may tend to increase evaluation bias. It can have a positive effect only when reciprocity motives are inspired by disinterested standards of fairness.
Assessing Peer Review by Gauging the Fate of Rejected Manuscripts: the Case of the Journal of Artificial Societies and Social Simulation
Assessing Peer Review by Gauging the Fate of Rejected Manuscripts: the Case of the Journal of Artificial Societies and Social Simulation
This paper investigates the fate of manuscripts that were rejected from JASSS- The Journal of Artificial Societies and Social Simulation, the flagship journal of social simulation. We tracked 456 manuscripts that were rejected from 1997 to 2011 and traced their subsequent publication as journal articles, conference papers or working papers.
The Peer Review Game: an Agent-based Model of Scientists Facing Resource Constraints and Institutional Pressures
The Peer Review Game: an Agent-based Model of Scientists Facing Resource Constraints and Institutional Pressures
This paper looks at peer review as a cooperation dilemma through a game-theory framework. We built an agent-based model to estimate how much the quality of peer review is influenced by different resource allocation strategies followed by scientists dealing with multiple tasks, i.e., publishing and reviewing.
The F3-index. Valuing Reviewers for Scholarly Journals
This paper presents an index that measures reviewer contribution to editorial processes of scholarly journals. Following a metaphor of ranking algorit…
The "invisible Hand" of Peer Review: The Implications of Author-referee Networks on Peer Review in a Scholarly Journal
The "invisible Hand" of Peer Review: The Implications of Author-referee Networks on Peer Review in a Scholarly Journal
Peer review is not only a quality screening mechanism for scholarly journals. It also connects authors and referees either directly or indirectly. Thi…
Libero Reviewer: The Making of a User-friendly Submission and Peer-review Platform
Libero Reviewer: The Making of a User-friendly Submission and Peer-review Platform
A review of the challenges and lessons learned in managing the development of Libero Reviewer.
Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-Making Mechanisms for Allocation of Research Grants
Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-Making Mechanisms for Allocation of Research Grants
By forming a pool of funding applicants who have minimal qualification levels and then selecting randomly within that pool, funding agencies could avoid biases, disagreement and other limitations of peer review.
How Digital Technologies Can Improve Scientific Research: The Case of Peer Review
Visible progress has been made in publishing - researchers are no longer bound by the limits of geography or the contents of their local library - but is the potential being truly maximised?
Scientific Autonomy, Public Accountability, and the Rise of “Peer Review” in the Cold War United States
Scientific Autonomy, Public Accountability, and the Rise of “Peer Review” in the Cold War United States
This essay traces the history of refereeing at specialist scientific journals and at funding bodies and shows that it was only in the late twentieth century that peer review came to be seen as a process central to scientific practice
Combating Plagiarism: Apograf + Unicheck
One of the latest creations to emerge from the Research Institute's lab, Apograf is an interactive platform that houses an extensive collection of scientific publications and is building a mechanism for incentivising peer review.
Potential Bias in Peer Review of Grant Applications at the Swiss National Science Foundation
Potential Bias in Peer Review of Grant Applications at the Swiss National Science Foundation
Study shows that peer review of grant applications at the SNSF may be prone to biases stemming from different applicant and reviewer characteristics. Based on this study, the SNSF abandoned nomination of reviewers by applicants, and made members of panels aware of the other systematic differences in scores.
Perking Up Peer Review: Hindawi Partners with Publons
Hindawi partners with Publons to improve and speed up the peer review process.
Gender Bias in Peer Review - Opening Up the Black Box
Gender bias in peer review has been much discussed in the wider research community. However, there have been few attempts to analyse the issue within the social sciences. This post highlights research undertaken by the Regional Studies Association to investigate the effect of gender on peer review outcomes.
Tracker is a Boon for Innovation in Peer Review
Nature welcomes a registry that supports experiments to improve refereeing.
Peer-review Experiments Tracked in Online Repository
ReimagineReview records trials that are probing the pros and cons of different approaches to review.
Guidelines for Open Peer Review Implementation
Open peer review (OPR) is moving into the mainstream, but it is often poorly understood and surveys of researcher attitudes show important barriers to implementation. There is a clear need for best practice guidelines for implementation.
Boon, Bias or Bane? The Potential Influence of Reviewer Recommendations on Editorial Decision-making : Journal: European Science Editing
Boon, Bias or Bane? The Potential Influence of Reviewer Recommendations on Editorial Decision-making : Journal: European Science Editing
No formal investigations have been conducted into the efficacy or potential influence of reviewer recommendations on editorial decisions, and the impact of this on the expectations and behaviour of authors, reviewers and journal editors. This article addresses key questions about this critical aspect of the peer review submission process.
Rare Trial of Open Peer Review Allays Common Concerns
A new study suggests that making reviewers' reports freely readable doesn't compromise the peer-review process.
Is Journal Peer-Review Now Just a Game?
Milton Packer wonders if the time has come for instant replay.
Progressing Towards Transparency - More Journals Join Wiley's Transparent Peer Review Pilot
Progressing Towards Transparency - More Journals Join Wiley's Transparent Peer Review Pilot
Wiley claim they are committed to moving towards greater openness and reproducibility of research, including increasing transparency in peer review
Talent Identification at the Limits of Peer Review: an Analysis of the EMBO Postdoctoral Fellowships Selection Process
Talent Identification at the Limits of Peer Review: an Analysis of the EMBO Postdoctoral Fellowships Selection Process
The EMBO Postdoctoral Fellowships selection process undergoes analysis.
The Effect of Publishing Peer Review Reports on Referee Behavior in Five Scholarly Journals
The Effect of Publishing Peer Review Reports on Referee Behavior in Five Scholarly Journals
To increase transparency in science, some scholarly journals have begun publishing peer review reports. Here, the authors show how this policy shift affects reviewer behavior by analyzing data from five journals piloting open peer review.
What's New with Peer Review on ORCID
ORCID has provided peer review functionality for going on three years. Peer review recognition is part of our broader commitment to improve recognition for all research contributions. It’s something that reviewers feel strongly about too.
Global State of Peer Review
The Global State of Peer Review is one of the largest ever studies into the practice of scholarly peer review around the world. Discover the findings here.
Peer Review: First Results from a Trial at ELife
New approach to peer review proves popular with authors, with very similar acceptance rates for male and female last authors, but with higher acceptance rates for late-career researchers compared to their early- and mid-career colleagues.
AI-enhanced Peer Review: Frontiers Launches Next Generation of Efficient, High-quality Peer Review
AI-enhanced Peer Review: Frontiers Launches Next Generation of Efficient, High-quality Peer Review
The integration of AIRA - Artificial Intelligence Review Assistant - into Frontiers' digital peer-review platform enables faster, more efficient quality control and manuscript handling.
Journal Shares Peer Reviews of Rejected Papers with Rival Titles
BMC Biology's 'portable peer review' policy aims to save editors and researchers time and effort, but academics question whether authors will want to share details of past rejections.