Reframing Research Assessment: A New Vision for Researcher Profiles

By Zenia Xenou (OpenAIRE) & Provost Lottie (CNR)

fteval Journal for Research and Technology Policy Evaluation, Issue #57

A Step Forward in Rethinking How We Evaluate Researchers

The reform of research assessment has become a cornerstone of policy action in the European Research Area. In a time where the scientific landscape is rapidly evolving, with more collaboration, interdisciplinarity, and societal engagement than ever before, traditional methods of evaluation are falling behind. Overreliance on narrow metrics such as journal impact factors or publication counts can no longer capture the full scope of what it means to do meaningful, impactful research in the 21st century.

In this recent article in the fteval Journal for Research and Technology Policy Evaluation (Issue #57), Zenia Xenou (OpenAIRE) and Provost Lottie (CNR) take a deep dive into this topic with "Reframing Research Assessment: towards a comprehensive framework for Researcher Profiles."

Through this article a flexible and inclusive framework for assessing researchers was presented—one that reflects the complexity, diversity, and societal relevance of research today.

A Snapshot: What's Changing in Research Assessment?

As is explained, the reform movement gained major traction with the CoARA Agreement on Reforming Research Assessment, officially opened for signature in September 2022. As of March 2025, the agreement has already been endorsed by over 830 institutions and organizations. The core message of the agreement is that it's time to shift away from overly simplistic, quantitative measures and adopt a more holistic, qualitative approach, one that values collaboration, transparency, and meaningful real-world outcomes.

In line with these goals, Zenia Xenou and Provost Lottie introduce a framework being developed as part of the Horizon Europe project GraspOS. This framework, centered around the idea of "Researcher Profile," is designed to help institutions implement CoARA-aligned policies. The profile enables a structured but adaptable way to showcase a researcher's diverse contributions such as open science, teaching, interdisciplinary collaboration, policy engagement, or mentoring.

Researcher Profiles: A New Tool for a New Era

The Researcher Profile framework (currently named MyResearchFolio) doesn't aim to replace all forms of evaluation; it aims to expand them. The tool considers a range of research outputs and activities, offering a more nuanced and equitable view of researcher performance. It helps institutions value not just what researchers produce, but how and why they do it.

Some key features of the proposed framework include:

• Emphasis on qualitative peer review, with responsible use of metrics
• Recognition of open science practices and data sharing
• Inclusion of contributions to teaching, supervision, and community engagement
• Flexibility to accommodate different career paths and disciplines

The way we assess researchers shapes the kind of science we value, support, and reward. Traditional evaluation methods often overlook essential aspects of research—like collaboration, openness, mentorship, and societal impact. This can discourage practices that are vital for addressing today's complex challenges.

The developing framework offers a way to realign assessment systems with the changing roles, contributions, and expectations of researchers. By recognizing diverse outputs and career paths, it supports a more inclusive, fair, and responsible research culture. It empowers institutions to not only measure what matters—but to foster what matters in research.

Final Thoughts

Reforming research assessment requires a deep cultural and structural transformation. As research becomes increasingly interdisciplinary, collaborative, and socially engaged, evaluation systems must evolve to reflect these realities. The framework around the Researcher profile presented is a meaningful step in this direction—offering institutions a practical way to value diverse contributions, support responsible research practices, and align with emerging European and global standards.

Their work addresses current gaps in how we recognize research excellence and lays the foundation for a more inclusive, impactful, and forward-looking research ecosystem.

To learn more, read the full article in the fteval Journal Issue #57 and explore how the proposed Researcher profile framework contributes to the future of research assessment.