Subscribe to our newsletter

Send us a link

Horizon Europe Missions Gear Up for Their First Evaluation

Horizon Europe Missions Gear Up for Their First Evaluation

The targeted research Missions set up under Horizon Europe are turning three years old this year, and their ambitious logic is facing its first test in an upcoming review at the midpoint of the EU's €95.9 billion research programme.

European Research Council Announces Plan to Update Its Evaluation System

European Research Council Announces Plan to Update Its Evaluation System

In a landmark decision this week, the European Research Council (ERC) announced changes to its application forms and evaluation procedures that will be implemented starting with the 2024 calls for proposals.

Enriching Research Quality: A Proposition for Stakeholder Heterogeneity

Enriching Research Quality: A Proposition for Stakeholder Heterogeneity

Dominant approaches to research quality rest on the assumption that academic peers are the only relevant stakeholders in its assessment. In contrast, impact assessment frameworks recognize a large and heterogeneous set of actors as stakeholders.

China's Research Evaluation Reform: What Are the Consequences for Global Science?

China's Research Evaluation Reform: What Are the Consequences for Global Science?

China created a research evaluation system based on publications indexed in the SCI and on the Journal Impact Factor, which helped China become the largest contributor to scientific literature and increase the position of its universities in global rankings.

Stress-Inducing and Anxiety-Ridden: A Practice-Based Approach to the Construction of Status-Bestowing Evaluations in Research Funding

Stress-Inducing and Anxiety-Ridden: A Practice-Based Approach to the Construction of Status-Bestowing Evaluations in Research Funding

More than resource allocations, evaluations of funding applications have become central instances for status bestowal in academia. Much attention in past literature has been devoted to grasping the status consequences of prominent funding evaluations. 

Recommendations for Discipline-Specific FAIRness Evaluation Derived from Applying an Ensemble of Evaluation Tools

Recommendations for Discipline-Specific FAIRness Evaluation Derived from Applying an Ensemble of Evaluation Tools

From a research data repositories’ perspective, offering research data management services in line with the FAIR principles is becoming increasingly important. However, there exists no globally established and trusted approach to evaluate FAIRness to date. This article applies five different available FAIRness evaluation approaches to selected data archived in the World Data Center for Climate (WDCC).

Designing Grant-Review Panels for Better Funding Decisions: Lessons from an Empirically Calibrated Simulation Model

Designing Grant-Review Panels for Better Funding Decisions: Lessons from an Empirically Calibrated Simulation Model

This article explores how factors relating to grades and grading affect the correctness of choices that grant-review panels make among submitted proposals. It seeks to identify interventions in panel design that may be expected to increase the correctness of choices.

A Pathway Towards Multidimensional Academic Careers

A Pathway Towards Multidimensional Academic Careers

LERU published a position paper “A Pathway towards Multidimensional Academic” to provide a LERU framework for assessing researchers careers. The report elaborates on three perspectives that form the basis of the framework for the assessment of research.

Creating What We Seek to Measure - How to Understand the Performative Aspect of Impact Evaluation?

Creating What We Seek to Measure - How to Understand the Performative Aspect of Impact Evaluation?

This post draws on a recent analysis of different impact evaluation tools to explore how they constitute and direct conceptions of research impact. 

Not What You Know, but Whom You Know? Study of ERC Stirs Old Scientific Controversy

Not What You Know, but Whom You Know? Study of ERC Stirs Old Scientific Controversy

A new study of grants awarded to early-career researchers by Europe's premier science agency is reviving an old controversy over the way governments decide which scientists get research money, and which do not.

The Changing Role of Funders in Responsible Research Assessment: Progress, Obstacles and the Way Ahead

The Changing Role of Funders in Responsible Research Assessment: Progress, Obstacles and the Way Ahead

A responsible research assessment would incentivise, reflect and reward the plural characteristics of high-quality research, in support of diverse and inclusive research cultures.

When More is More: Broad Calls for Multilingualism and Evaluation Reform

When More is More: Broad Calls for Multilingualism and Evaluation Reform

In recent years, numerous initiatives have highlighted linguistic biases embedded in current evaluation processes and have called for change. The DORA-hosted community discussion on multilingualism in scholarly evaluation was inspired by actions others have taken to address these issues.

AI-based Citation Evaluation Tools: Good, Bad or Ugly?

AI-based Citation Evaluation Tools: Good, Bad or Ugly?

What are the pitfalls of using AI as a citation evaluation tool?

Academia in Motion: a Different Form of Recognition and Reward

Academia in Motion: a Different Form of Recognition and Reward

A better balance between teaching and research duties, greater recognition of team performances and the elimination of simplistic assessment criteria would improve the systems of recognition and rewards in academia.