WG TIER – Towards an Inclusive Evaluation of Research
WG TIER – Towards an Inclusive Evaluation of Research
WG Objectives
TIER aims at:
-
- Addressing the primary sources of unconscious bias and intersectional gender discrimination in the evaluation of research quality and researchers at any stage of their career
- Identifying mitigation actions
- Proposing concrete actions for research assessment criteria and practices that ensure equal opportunities, inclusiveness and valorisation of the diversity
- Producing guidelines and specific consciousness-raising training for evaluators, building on existing resources and European guidelines/project outputs.
Latest Activities
TIER Survey and Development of Self-Assessment Tool
The TIER survey reached 1,682 researchers and staff from Research Performing and Funding Organisations across Europe. The findings are unambiguous: traditional metrics — publications, citations, H-index — dominate perceived evaluation, while teaching, peer review, data sharing, and open access consistently rank at the bottom. The gap between the two exceeds 1.2 points on a 5-point scale, in both institutional and funding contexts.
Women are more than 3 times more likely than men to perceive gender bias in the definition of excellence — regardless of age, career stage, or role. Women also perceive evaluation as more demanding overall, and the gap is largest precisely for the criteria least rewarded by current systems: open science and broader contributions. 50% of respondents report that non-linear career paths negatively impact evaluation, rising to 60% among women. The most requested reforms are career gap protections, best practice guidelines, and bias detection tools — yet only 25% feel that narrative CVs currently carry real weight in practice.
The conclusion is simple: there is an entire layer of work that holds academia together — and we are not evaluating so valorizing it.
What TIER is building:
The Self-Assessment Toolkit. TIER is finalising a self-assessment toolkit for RPOs and RFOs — a structured, non-judgmental guide to help institutions understand where they stand and what they can do to improve. A dedicated web interface and downloadable PDF outputs will make it practical and accessible. A complementary institutional survey has just concluded data collection. We are also developing, with psychologists, a tool to measure unconscious bias in evaluation — work that will continue beyond our September 2026 deadline.
Events
Updated 25 May 2026
Dissemination Tour — Italian Launch
(May 20, Scuola Normale Superiore): Our dissemination tour is underway across multiple European countries. The official Italian launch event took place on May 20 at 9:30 AM at the Sala Stemmi of the Scuola Normale Superiore, Pisa, and online. The workshop — held in Italian — focused on gender bias in Italian academia, Gender Equality Plans, and the tools TIER has developed to support fair research evaluation.
The dissemination tour will continue in other countries with key organisations to host events, including: Switzerland, Netherlands, Spain, Turkiye, Wellcome Trust (UK), and Marie Curie Alumni Association (international).
Research Evaluation in the Social Sciences and Humanities (RESSH 2026) Conference
RESSH 2026, Florence (April 22–24): TIER presented "What is inclusive excellence? Reflections on excellence and equality in research evaluation" at the Research Evaluation in the Social Sciences and Humanities conference. The contribution examined how current excellence definitions are shaped by formal bibliometric indicators and how bias enters evaluation in practice. The abstract is available in the Conference Proceedings (pp. 138–140).
Geophysical Union General Assembly
TIER will also presented at the European Geophysical Union General Assembly hybrid meeting in Vienna, Austria on 3-8 May 2026. Click here to learn more.
Resources
Among the useful references being collected by the WG members are GEAR, a step-by-step online guide to develop Gender Equality Plans in academic and research organisations and GRANteDproject outputs:
Gender Equality Plans
GRANteDproject outputs
Inclusive Excellence Report
Implicit Biases in Research Evaluation
Affiliated Organisations
- Australian National Health and Medical Research Council (NHMRC)
- CERN
- CERN, CNR-Consiglio Nazionale delle Ricerche
- CSIC-Consejo Superior de Investigaciones Científicas
- European Chemical Society
- EPFL (Ecole Polytechnique Fédérale de Lausanne)
- European Union
- Federation of Finnish Learned Societies
- Instituto Brasileiro de Informação em Ciência e Tecnologia
- Istituto Italiano di Tecnologia (IIT)
- Istituto Nazionale di Geofisica e Vulcanologia (INGV)
- Joanneum Research
- Kristianstad University
- Karelia University of Applied Sciences
- Marie Curie Alumni Association
- Politecnico di Torino
- Research Foundation Flanders
- Swiss National Science Foundation (SNSF)
- Scuola Normale Superiore
- Universidad CEU San Pablo – Madrid
- Universidad de Córdoba
- Università degli Studi di Cagliari
- Università degli Studi di Firenze
- Università degli Studi di Messina
- Università degli Studi di Milano
- Università degli Studi di Milano-Bicocca
- Università degli Studi di Modena e Reggio Emilia
- Università degli Studi di Padova
- Università Vita-Salute San Raffaele
- Université de Reims Champagne-Ardenne
- University of Applied Sciences and Arts of Western Switzerland (HES-SO)
- University Medical Center – Groningen (UMCG)
- Wellcome Trust
- Young Academy of Europe
- Zimbabwe Young Academy of Sciences
Find out more!
Follow Us on LinkedIn
Stay up to date on our latest news!
Contact
Interested in joining the WG or have an inquiry?
Please contact us!
Silvia Penati (Chair)
University of Milano-Bicocca
Maura Coniglione (Deputy Chair)
University of Milano-Bicocca
Activities
TIER promotes a new survey for institutions on intersectional basis
After collecting useful insights from individuals in RPOs and RFOs, TIER invites CoARA members to compile a new survey on biases in evaluations for institutions by March 31st, 2026.
One coordinated response per institution is required. Questions address various topics, such as research evaluation practices, career progression criteria, bias mitigation strategies, etc. that may require input from multiple offices or experts within each organisation.
TIER presented at the CoARA General Assembly, December 2025
The TIER working group was invited to take part in the General Assembly on December 3, 2025. Silvia Penati, TIER’s chair, presented TIER's key activities focused on studying gender biases in science, particularly gender bias, and collecting best practices for bias mitigation and training of evaluation committees. Key outputs and activities include:
- TIER has produced a report on five case studies to collect current statistics on gender distribution and existing best practices
- Compiled a set of references and online materials for communication and training on gender bias
- Conducted a survey to assess individuals' self-perception of bias in evaluation, with another survey in preparation
- Organised a workshop open to the CoARA community to share insights with other Working Groups (27 June 2025)
- Participated in various meetings and conferences.
Particularly, the idea of a Dissemination Tour in 2026 in various countries has been welcomed by both the Steering Board, to share TIER’s approach with other WGS, and by members in the audience, to train evaluation committees.
Mind the GEPs Special Report
The MINDtheGEPs project published a special report summarising key takeaways from an Open Forum roundtable discussion on gender equality and inclusive progress in research. It highlights challenges hindering gender equality, such as systemic barriers, intersectionality, and data gaps. The report also offers recommendations for institutions on how to promote gender equality.
Survey on Biases in Research Evaluation
From early February to 15 April 2025, WG TIER opened a survey to evaluate systematic biases in research assessment. We thank all those who participated in the survey! Your input is invaluable for mitigating confirmation biases and for WG TIER to develop guidelines to foster inclusive research assessment practices!
TIER presents preliminary survey results at STI-ENID 2025
On September 3-5 September 2025, TIER attended the Science and Technology Indicators international conference in Bristol, STI-ENID 2025. At the conference, TIER presented preliminary results from a survey examining the concept of inclusive excellence.
Around 2,000 respondents from research performing organisations (RPOs) and research funding organisations (RFOs) participated in the survey that focused on key themes, including: perceptions of excellence, bias mitigation, and implicit biases.
In the preliminary findings, High Impact Factor, H-index, and the prestige of publication venues emerged as the most influential metrics impacting the perception of excellence. Respondents identified best practice guidelines, aligned with national legislation and allowing for broad institutional interventions, as the most effective measures for bias mitigation. In order to examine implicit bias for stereotypes, identical statements with only the gender swapped (male -female) have been presented.
Curious to learn more about Inclusive Excellence and TIER's work? Click on the button below for recordings of TIER's recent open webinar, as well as presentation slides and recordings.