Evaluation | ScienceGeist

Send us a link

Use of the Journal Impact Factor in Academic Review, Promotion, and Tenure Evaluations

Use of the Journal Impact Factor in Academic Review, Promotion, and Tenure Evaluations

The Journal Impact Factor (JIF) was originally designed to aid libraries in deciding which journals to index and purchase for their collections. Over the past few decades, however, it has become a relied upon metric used to evaluate research articles based on journal rank. Surveyed faculty often report feeling pressure to publish in journals with high JIFs and mention reliance on the JIF as one problem with current academic evaluation systems.

Read this article

Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-Making Mechanisms for Allocation of Research Grants

Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-Making Mechanisms for Allocation of Research Grants

By forming a pool of funding applicants who have minimal qualification levels and then selecting randomly within that pool, funding agencies could avoid biases, disagreement and other limitations of peer review.

Read this article

Gender Bias in Teaching Evaluations

Gender Bias in Teaching Evaluations

Paper provides new evidence on gender bias in teaching evaluations. Despite the fact that neither students’ grades nor self-study hours are affected by the instructor’s gender, it was found that women receive systematically lower teaching evaluations than their male colleagues.

Read this article

Nationalfonds: Frauen Bei Vergabe Von Fördergeldern Benachteiligt

Nationalfonds: Frauen Bei Vergabe Von Fördergeldern Benachteiligt

Der Nationalfonds ist der wichtigste Förderer hiesiger Forschung.

Read this article

Predicting the Results of Evaluation Procedures of Academics

Predicting the Results of Evaluation Procedures of Academics

The 2010 reform of the Italian university system introduced the National Scientific Habilitation (ASN) as a requirement for applying to permanent professor positions. Since the CVs of the 59149 candidates and the results of their assessments have been made publicly available, the ASN constitutes an opportunity to perform analyses about a nation-wide evaluation process.

Read this article

Counting is Not Enough - How Plain Language Statements Could Improve Research Assessment

Counting is Not Enough - How Plain Language Statements Could Improve Research Assessment

Academic hiring and promotion committees and funding bodies often use publication lists as a shortcut to assessing the quality of applications. In order to avoid bias towards prestigious titles, plain language statements should become a standard feature of academic assessment.

Read this article

2019 EUA Workshop on Research Assessment in the Transition to Open Science

2019 EUA Workshop on Research Assessment in the Transition to Open Science

EUA is organising a series of workshops raising awareness and fostering discussion on research assessment reform. The 2019 edition will focus on research evaluation for the purpose of recruitment and career progression of researchers.

Read this article

Profiles Not Metrics

Profiles Not Metrics

Clarivate Analytics' Institute for Scientific Information Launches Global Research Report titled Profiles Not Metrics.

Read this article

Scaling Down Inequality: Rating Scales, Gender Bias, and the Architecture of Evaluation

Scaling Down Inequality: Rating Scales, Gender Bias, and the Architecture of Evaluation

Quantitative performance ratings are ubiquitous in modern organizations — from businesses to universities — yet there is substantialevidence of bias against women in suchratings. This study examines how gender inequalities in evaluations dependon the design of the tools used to judge merit.

Read this article

Ghent University, in Belgium, Embraces New Approach to Faculty Evaluation Less Focused on Quantitative Metrics

Ghent University, in Belgium, Embraces New Approach to Faculty Evaluation Less Focused on Quantitative Metrics

Saying it wants to "again become a place where talent feels valued and nurtured," Ghent University overhauls its system for faculty evaluation to de-emphasize quantitative metrics and annual progress reports. Professors will be asked about their goals and what they are proud of.

Read this article

CWTS Launches New Course on Responsible Metrics

CWTS Launches New Course on Responsible Metrics

CWTS announces the launch of the new course called "Responsible Metrics for Research Evaluation".

Read this article

Elsevier Acquires Science-Metrix Inc., Provider of Research Analytics Services and Data

Elsevier Acquires Science-Metrix Inc., Provider of Research Analytics Services and Data

Elsevier, the information analytics business specializing in science and health, has acquired Science-Metrix Inc., a research evaluation firm that provides science research evaluation and analytics to assess science and technology activities

Read this article

Talent Identification at the Limits of Peer Review: an Analysis of the EMBO Postdoctoral Fellowships Selection Process

Talent Identification at the Limits of Peer Review: an Analysis of the EMBO Postdoctoral Fellowships Selection Process

A study evaluating two aspects of the selection process of the top-ranked applicants to the EMBO Long-Term Fellowship program in 2007.

Read this article

DORA, Plan S and the (open) Future of Research Evaluation

DORA, Plan S and the (open) Future of Research Evaluation

Slides from a talk given to the general assembly of Science Europe in Brussels on 22 Nov 2018. Gives an overview of the problems of over-metricised research evaluation and how this might be tackled, in part through initiatives driven by DORA, and how they are linked with drives such as Plan S to promote open science. Shared under a CC-BY-SA opinion (though Figshare doesn't seem to allow me to select that option from their drop-down menu).

Read this article

Race for 'excellence' Funding Damaging Science, Warns Thinktank

timeshighereducation

Race for 'excellence' Funding Damaging Science, Warns Thinktank

Competitive funding once helped novel ideas get off the ground, but now funding 'excellence' is hampering new research, says Dutch institute

timeshighereducation

Read this article

Subscribe to Evaluation