A new typology of national research assessment systems: continuity and change in 13 countries. RoRI Working Paper No.15

How are national systems for assessing publicly funded research evolving? What purposes do they serve and how are they designed to fulfil these? This working paper, which forms part of RoRI's AGORRA project, surveys the landscape of national research assessment and funding systems across thirteen countries from 2010 to 2024, and makes three contributions to our understanding of these systems.

First, we advance a new typology to categorize and compare important characteristics of these systems, providing insights into their similarities and differences, and a basis for mutual learning.

Second, we identify and compare important shifts over time across the thirteen systems through the framework of three dynamic and interacting research performance paradigms. These point to a gradual shift away from narrow conceptions of research ‘excellence’ towards more holistic criteria of value, qualities and impacts across several systems – though not all.

Finally, we consider potential trajectories over the next decade: including how a variety of assessment systems might respond to and incorporate responsible research assessment (RRA) movements for reform.

The paper is a unique collaboration between researchers and colleagues working in the funding or evaluation agencies of the thirteen countries in question. By mapping these research assessment systems and identifying dynamics of change, the paper offers insights for policymakers, research funders and institutional leaders looking to navigate this terrain at a time of heightened yet shifting expectations.