Send us a link
Robot Pen Pals: a Systematic Analysis of Recent Trends in Scientific Correspondence
Robot Pen Pals: a Systematic Analysis of Recent Trends in Scientific Correspondence
This study identifies unusual growth in scientific correspondence after the widespread adoption of generative AI and suggests that AI may be contributing to publication inflation in a format that is citable, lightly regulated and often not peer reviewed.
Universities Measure Almost Everything - Except Leadership
Universities Measure Almost Everything - Except Leadership
Research Quality Metrics As a Complement to Bibliometrics: an Opinion Paper
Research Quality Metrics As a Complement to Bibliometrics: an Opinion Paper
Current assessment systems rely heavily on bibliometric indicators such as publication counts, co-authorship, and citation metrics, which do not reliably reflect research quality or scientific rigor.
Seeing Like an Evaluation System - How Governance Limits Research Assessment Reforms
Seeing Like an Evaluation System - How Governance Limits Research Assessment Reforms
Applicants As Reviewers: a Mixed Methods Evaluation of the Risks, Benefits, and Potential of Distributed Peer Review for Grant Funding Allocations
Applicants As Reviewers: a Mixed Methods Evaluation of the Risks, Benefits, and Potential of Distributed Peer Review for Grant Funding Allocations
Background Peer review-based funding evaluation systems are under increasing pressure. To help alleviate this, innovative approaches like Distributed Peer Review (DPR) are being explored.
NIH Proposes Major Revamp of How It Scores Research Grant Proposals
NIH Proposes Major Revamp of How It Scores Research Grant Proposals
A Successful Open Access Book Mandate Requires Infrastructure Not Compliance
A Successful Open Access Book Mandate Requires Infrastructure Not Compliance
An open access book mandate is one Research Excellence Framework (REF) cycle away. If implemented, research funders should focus on enabling infrastructure rather than compliance.
We Should Focus Less on Research Impact and More on Research Value
We Should Focus Less on Research Impact and More on Research Value
Institutional definitions of research impact align poorly with the practices and values of staff. Could a focus on research value lead to better outcomes?
AI Agents Are 'aeroplanes for the Mind': Five Ways to Ensure That Scientists Are Responsible Pilots
AI Agents Are 'aeroplanes for the Mind': Five Ways to Ensure That Scientists Are Responsible Pilots
The Peer Review System is Breaking Down
AI Could Make Scientific Overload Worse
Artificial intelligence is helping to advance science, but it could also add to stress on the research system by generating ever more papers and grant applications, an AI expert at the Organisation for Economic Co-operation and Development (OECD) has warned.
Report Reveals Potential of AI to Help Assess Research More Efficiently
Report Reveals Potential of AI to Help Assess Research More Efficiently
Generative AI is already being used by some universities to assess the quality of their research - and it could be scaled up to help all higher education institutions save huge amounts of time and money.
The REF Helps Make Research Open, Transparent, and Credible - Let's Not Lose That
The REF Helps Make Research Open, Transparent, and Credible - Let's Not Lose That
REF should be central to solving the collective action problems around openness, transparency, and accountability in research.
Narrative CVs Are Rewriting Academic Stories and Identities
A new study explores how narrative CVs are reshaping research evaluation and academic representation.
Indian Researchers Call for Balanced and Responsible Research Assessments
Indian Researchers Call for Balanced and Responsible Research Assessments
Narrative CVs risk worsening the biases they aim to redress
One-size-fits-all approach gives fluent writing an outsize role in research success.
Open Science Has Spawned a New Wave of Metric-Driven Evaluation
Open Science Has Spawned a New Wave of Metric-Driven Evaluation
Measures intended to encourage openness are clashing with efforts to reform assessment
Unanswered Questions in Research Assessment - Whose Values Lead Value-led Approaches?
Unanswered Questions in Research Assessment - Whose Values Lead Value-led Approaches?
Reform efforts may need to reconsider the usefulness of value-led strategies.
Research Assessment Has Always Been Controversial, Yet It Necessarily Persists
Research Assessment Has Always Been Controversial, Yet It Necessarily Persists
Arguing about research assessment has been a central feature of seventy-five years of higher education policy.
The Impact of Winning Funding on Researcher Productivity, Results from a Randomized Trial
The Impact of Winning Funding on Researcher Productivity, Results from a Randomized Trial
In this small randomized trial, research funding did not have a clear impact on researcher productivity. However, the expanded use of modified lotteries in the allocation of grant funding has the potential to revolutionize the measurement of research productivity.
Randomisation Can Resolve the Uncertainty at the Heart of Peer Review
Randomisation Can Resolve the Uncertainty at the Heart of Peer Review
Embracing uncertainty could improve peer review processes.
Assessments of Research Culture Should Be Open About Failure
Research assessments regularly focus on outstanding and unique achievements, rather than the everyday failures and disappointments associated with academic work. Discussing a recent self-assessment and annual research report at Maastricht University that took a more candid approach to failure, Sally Wyatt suggests that research culture can benefit from a more realistic appraisal of failure.
Coara Hosts First Dialogue Between National Chapters
Fifteen national groups coordinating researcher assessment reform hold first meeting in Portugal
I Couldn’t Move For A Postdoc. Fellowship Reviewers Shouldn’t Have Penalized Me For It
I Couldn’t Move For A Postdoc. Fellowship Reviewers Shouldn’t Have Penalized Me For It
I wasn’t surprised to learn I hadn’t been selected for a prestigious postdoc fellowship. I had applied mostly hoping for feedback that would improve my application the following year. But comments from two reviewers made me rethink my plan to apply again—and even whether to continue in academia.
Removing Numerical Scoring When Evaluating Grant Proposals Found to Have No Effect on Outcomes
Removing Numerical Scoring When Evaluating Grant Proposals Found to Have No Effect on Outcomes
Gender Bias in Funding Evaluation: A Randomized Experiment
Gender Bias in Funding Evaluation: A Randomized Experiment
Gender differences in research funding exist but bias evidence is elusive and findings are contradictory. Contrary to some previous research, a new study found no evidence that male or female PIs received significantly different scores.
Highlight or Hide - What Role Should Peer Review Have in Researcher Development?
Highlight or Hide - What Role Should Peer Review Have in Researcher Development?
Peer review is, at heart, a process of validation - but how do you learn to peer review?
Is 'Wokeism' Slowly Killing Scientific Merit? Look to the Latter for the Real Threat to Science
Is 'Wokeism' Slowly Killing Scientific Merit? Look to the Latter for the Real Threat to Science
While some worry "wokeist" ideology could corrupt scientific merit, it could be our problematic understanding of the latter that poses an even greater threat to science, two philosophers argue.
Although Hard to Define, Narrative CVs Are Changing How We Think About Researcher Assessment
Although Hard to Define, Narrative CVs Are Changing How We Think About Researcher Assessment
Narrative academic CVs present a means to bypass aspects of a research evaluation culture that is focused on the volume and venue of publications. Drawing on work promoting this format, researchers show how these texts more often foreground the problems they are meant to address, than how the format works in practice.