Send us a link
The Peer Review System is Breaking Down
AI Could Make Scientific Overload Worse
Artificial intelligence is helping to advance science, but it could also add to stress on the research system by generating ever more papers and grant applications, an AI expert at the Organisation for Economic Co-operation and Development (OECD) has warned.
Report Reveals Potential of AI to Help Assess Research More Efficiently
Report Reveals Potential of AI to Help Assess Research More Efficiently
Generative AI is already being used by some universities to assess the quality of their research - and it could be scaled up to help all higher education institutions save huge amounts of time and money.
The REF Helps Make Research Open, Transparent, and Credible - Let's Not Lose That
The REF Helps Make Research Open, Transparent, and Credible - Let's Not Lose That
REF should be central to solving the collective action problems around openness, transparency, and accountability in research.
Narrative CVs Are Rewriting Academic Stories and Identities
A new study explores how narrative CVs are reshaping research evaluation and academic representation.
Indian Researchers Call for Balanced and Responsible Research Assessments
Indian Researchers Call for Balanced and Responsible Research Assessments
Narrative CVs risk worsening the biases they aim to redress
One-size-fits-all approach gives fluent writing an outsize role in research success.
Open Science Has Spawned a New Wave of Metric-Driven Evaluation
Open Science Has Spawned a New Wave of Metric-Driven Evaluation
Measures intended to encourage openness are clashing with efforts to reform assessment
Unanswered Questions in Research Assessment - Whose Values Lead Value-led Approaches?
Unanswered Questions in Research Assessment - Whose Values Lead Value-led Approaches?
Reform efforts may need to reconsider the usefulness of value-led strategies.
Research Assessment Has Always Been Controversial, Yet It Necessarily Persists
Research Assessment Has Always Been Controversial, Yet It Necessarily Persists
Arguing about research assessment has been a central feature of seventy-five years of higher education policy.
The Impact of Winning Funding on Researcher Productivity, Results from a Randomized Trial
The Impact of Winning Funding on Researcher Productivity, Results from a Randomized Trial
In this small randomized trial, research funding did not have a clear impact on researcher productivity. However, the expanded use of modified lotteries in the allocation of grant funding has the potential to revolutionize the measurement of research productivity.
Randomisation Can Resolve the Uncertainty at the Heart of Peer Review
Randomisation Can Resolve the Uncertainty at the Heart of Peer Review
Embracing uncertainty could improve peer review processes.
Assessments of Research Culture Should Be Open About Failure
Research assessments regularly focus on outstanding and unique achievements, rather than the everyday failures and disappointments associated with academic work. Discussing a recent self-assessment and annual research report at Maastricht University that took a more candid approach to failure, Sally Wyatt suggests that research culture can benefit from a more realistic appraisal of failure.
Coara Hosts First Dialogue Between National Chapters
Fifteen national groups coordinating researcher assessment reform hold first meeting in Portugal
I Couldn’t Move For A Postdoc. Fellowship Reviewers Shouldn’t Have Penalized Me For It
I Couldn’t Move For A Postdoc. Fellowship Reviewers Shouldn’t Have Penalized Me For It
I wasn’t surprised to learn I hadn’t been selected for a prestigious postdoc fellowship. I had applied mostly hoping for feedback that would improve my application the following year. But comments from two reviewers made me rethink my plan to apply again—and even whether to continue in academia.
Removing Numerical Scoring When Evaluating Grant Proposals Found to Have No Effect on Outcomes
Removing Numerical Scoring When Evaluating Grant Proposals Found to Have No Effect on Outcomes
Gender Bias in Funding Evaluation: A Randomized Experiment
Gender Bias in Funding Evaluation: A Randomized Experiment
Gender differences in research funding exist but bias evidence is elusive and findings are contradictory. Contrary to some previous research, a new study found no evidence that male or female PIs received significantly different scores.
Highlight or Hide - What Role Should Peer Review Have in Researcher Development?
Highlight or Hide - What Role Should Peer Review Have in Researcher Development?
Peer review is, at heart, a process of validation - but how do you learn to peer review?
Is 'Wokeism' Slowly Killing Scientific Merit? Look to the Latter for the Real Threat to Science
Is 'Wokeism' Slowly Killing Scientific Merit? Look to the Latter for the Real Threat to Science
While some worry "wokeist" ideology could corrupt scientific merit, it could be our problematic understanding of the latter that poses an even greater threat to science, two philosophers argue.
Although Hard to Define, Narrative CVs Are Changing How We Think About Researcher Assessment
Although Hard to Define, Narrative CVs Are Changing How We Think About Researcher Assessment
Narrative academic CVs present a means to bypass aspects of a research evaluation culture that is focused on the volume and venue of publications. Drawing on work promoting this format, researchers show how these texts more often foreground the problems they are meant to address, than how the format works in practice.
More Carrot, Less Stick: How to Make Research Assessments Fairer
Beyond the Doughnut - Five Ways to Use Altmetrics for Academic Success
Beyond the Doughnut - Five Ways to Use Altmetrics for Academic Success
A decade on since their inception, Andy Tattersall considers how academics can make use of altmetrics in ways that go beyond counts and metrics.
Crucial! New! Essential! - The Rise of Hype in Research and Impact Assessment
Crucial! New! Essential! - The Rise of Hype in Research and Impact Assessment
Hyberbolic adjectives have been on the rise in academic writing. A study explores how this persuasive language is deployed across different fields of research
Horizon Europe Missions Gear Up for Their First Evaluation
Horizon Europe Missions Gear Up for Their First Evaluation
The targeted research Missions set up under Horizon Europe are turning three years old this year, and their ambitious logic is facing its first test in an upcoming review at the midpoint of the EU's €95.9 billion research programme.
DORA at 10: Looking Back at the History and Forward to the Future of Research Assessment
DORA at 10: Looking Back at the History and Forward to the Future of Research Assessment
The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.
German Universities Still Wary of EU Push to Reform Research Assessment
German Universities Still Wary of EU Push to Reform Research Assessment
The European Commission is making a big push to reform research assessment, but Germany's university leaders are not convinced the call for change from above is the right way to deliver it.
Funders Support Use of Reviewed Preprints in Research Assessment
Funders and other research organisations are embracing reviewed preprints as an alternative way to assess researchers, and call on others to do the same.
The Case for Lotteries As a Tiebreaker of Quality in Research Funding
The Case for Lotteries As a Tiebreaker of Quality in Research Funding
More funders should consider using randomization to choose grant recipients when decisions are too close to call.
Stress-Inducing and Anxiety-Ridden: A Practice-Based Approach to the Construction of Status-Bestowing Evaluations in Research Funding
Stress-Inducing and Anxiety-Ridden: A Practice-Based Approach to the Construction of Status-Bestowing Evaluations in Research Funding
More than resource allocations, evaluations of funding applications have become central instances for status bestowal in academia. Much attention in past literature has been devoted to grasping the status consequences of prominent funding evaluations.