Skip to main content
WHEN - May 27-28th, 2019
WHERE - Het Pand, the culture and congress centre of Ghent University, Onderbergen 1, 9000 Ghent, Belgium - see map
WHAT - A two day workshop exploring mechanisms for research policy monitoring and indicators: discussing the what 'indicators' and the how: infrastructure. This workshop is in collaboration with Data4Impact, with support of Science Europe.

New: Read about the outcomes and results!


Research funders across Europe are increasingly mandating Open Science practices for funded research outputs to support open and free access to valuable elements of the scholarly communication life-cycle. From OA to publications and the recent PlanS developments, to the promotion and uptake of coordinated RDM practices, to the more advanced research assessment exercises to understand innovation and societal impact, there is a need for monitoring of research output.

National and EU e-Infrastructures respond to these needs by embedding and developing monitoring tools to provide evidence-based data on policy uptake, costs, and research impact, while at the same time promoting interoperability of information outputs, shareable across networks.

This two-day workshop, co-organised by OpenAIRE and Data4Impact, with support of Science Europe, will explore mechanisms for research policy monitoring and indicators, and how to link these to infrastructure and services. The first day will focus on open science indicators as these emerge from national and EU initiatives, while the second will be a forward thinking exploration for more advanced aspects of indicators for innovation and societal impact.

Other elements addressed in this two-day workshop:

  • Existing ways of monitoring for Open Science – the what and the how
  • Collaboration aspects to achieve a seamless monitoring landscape via open infrastructures
  • Data driven techniques for research assessment and their links to open data
Takeaways will be:
  • A set of priorities of what elements in the research cycle need to be monitored
  • How infrastructures can work together to collectively provide monitoring elements and where to start
  • A deeper understanding of the benefits monitoring tools can bring to the OS lifecycle
  • A glimpse into emerging and future trends for research impact assessment using big (open) data and AI

Programme (also available in .pdf)

Overview of Data4Impact results can be found here: D4I Booklet (Final)

  • Monitoring and Infrastructure for Open Science

    Session 1: Monitoring for Open Science: The Building Blocks
    This session will set the context in terms of Open Science, address what different scholarly outputs are being monitored, and how policies can influence the landscape and implementation.

    Moderated by Inge Van Nieuwerburgh

    10.30-10.40 Introduction to the workshop Inge Van Nieuwerburgh-OpenAIRE
    10.40-11.00 Keynote speaker – Open Science monitoring and the notion of research impact - slides Marc Vanholsbeeck-Federation Wallonie-Bruxelles

    The Open Science Monitor: a collaborative open effort for tracking open science progress - slides

    David Osimo, Lisbon Council
    11.30-12.00 RDM: how can we monitor FAIRness and Openness of research data? - slides Brecht Wyns and Christophe Bahim, RDA-FAIR Data Maturity Model WG
    12.00-12.30 Plan S and the building blocks for monitoring open science Stephan Kuster, Secretary General of Science Europe
    12.30-13.30 Lunch
    Session 2: Monitoring for Research/Open Science: Practical Implementations
    This session will focus on existing practical implementations for monitoring from a funders’ perspective as well as existing initiatives and services.

    Moderated by Biljana Kosanovic

    13:30-15:30 New indicators for open science-Possible ways of measuring the uptake and impact of open science - slides Dietmar Lampert, ZSI Research Policy & Development
      Research evaluation: the unseized opportunities of the open science era and the possible technology and methodology approaches - slides Diego-Valerio Chialva, European Research Council
      The OPERA project: Exploring Open Research Analytics using VIVO - slides Karen Hytteballe Ibanez, Technical University of Denmark
      OpenAIRE-Unlocking Open Science monitoring - slides Paolo Manghi, OpenAIRE
      Portugal - Supporting a national funder Open Access policy - slides Vasco Vaz, Foundation for Science and Technology
    15:30-16:00 Coffee break
    Session 3: How can we work together: A Panel Session with infrastructure providers, funders and policy makers
    16:00-17.30 Panel with: EUA, OpenAIRE, FREYA, Clarivate Analytics, FREYA and funder.

    Moderated by Natalia Manola, OpenAIRE Managing Director, Athena Research & Innovation Center

    Panellists will include:

    • Bregt Saenen, EUA
    • Helena Cousijn, FREYA - slides
    • Paolo Manghi, OpenAIRE
    • James Hardcastle, Clarivate Analytics
    • Diego-Valerio Chialva, ERC
  • Open Science and Big data in support of measuring R&I Indicators



    09.00-09.30 Opening remarks Vilius Stanciauskas, Data4Impact
    09.35-09.55 Conceptual framework and overview of indicators Rainer Frietsch and Alexander Feidenheimer, Data4Impact
    Presentation of Data4Impact results - Combined slides for all Data4Impact presentations


    10.00-10.20 Tracking of research outputs Haris Papageorgiou, Data4Impact
    10.20-10.35 Coffee Break
    10.35-11.15 Academic impact & societal relevance of research Ioanna Grypari & Iason Demiros, Data4Impact
    11.20-11.45 Economic impact Vilius Stanciauskas & Ioanna Grypari, Data4Impact
    11.50-12.30 Societal and health impact Vilius Stanciauskas & Gustaf Nelhans, Data4Impact
    12.30-13.30 Lunch
    Group discussions: user feedback and possible ways forward


    13.30-13.40 Introduction to afternoon session - slides group discussion Vilius Stanciauskas, Data4Impact

    Breakout sessions:

    • Relevance of metrics produced by Data4Impact
    • Utility of the indicators

    Vote on the indicators

    Members from the Data4Impact team will guide discussions in each breakout group
    14.30-15.00 Open Floor Discussion and the results of the breakout session Group leads to present the results
    15.00-15.30 Coffee Break

    Panel discussion focusing on:

    • Possibilities and limitations of big data
    • Lessons learned from the use case
    • Transfer of knowledge and methodology to more environments and programmes - slides for the panel discussion

    Panellists will include:

    • Vilius Stanciauskas, Data4Impact
    • Natalia Manola, OpenAIRE
    • Silvia Pozzi, Fondazione Telethon
    • Frank Manista, JISC

Practical information


Policy makers, funders, research decision-makers, infrastructure providers, project officers H2020, bibliometrics and scientometrics experts, commercial entities (policy-making consulting companies, publishers, research analytics companies)


The workshop registration is now closed. If you have any questions, please, send email to info [at]

Recommended Accommodations


For information and questions, contact info[at]


workshop, research policy monitoring