Research on Research Institute
Browse

Peer review in funding organizations: An analytical literature review (RoRI Working Paper No.11)

Download (1.03 MB)
Version 5 2024-09-10, 15:06
Version 4 2024-08-28, 15:23
Version 3 2024-08-28, 15:23
Version 2 2024-08-28, 12:28
Version 1 2024-08-28, 09:09
preprint
posted on 2024-09-10, 15:06 authored by Kathleen GregoryKathleen Gregory, Ludo WaltmanLudo Waltman, Stephen PinfieldStephen Pinfield

Peer review performs a crucial and expanding role across the research system. Reviewers evaluate articles, grant proposals, tenure and promotion applications, and research units. Peer review across these domains is prone to common problems, such as the risk of bias, a lack of transparency, and system overload (Smith, 2006; Tennant & Ross-Hellauer, 2020). It also involves common actors, artefacts, and processes, with the same people often doing duplicative reviewing work – adding burden to an already overburdened system. Despite potential synergies across areas where peer review occurs, current analyses examine particular domains in isolation, e.g., focusing only on peer review in publishing or solely on peer review within funding organizations.

How can these systems of peer review work better together? Where do synergies exist? How can peer review be streamlined to reduce burden and increase efficiency? This working paper is part of a broader project to develop a systematic understanding of the goals and characteristics of peer review across domains to develop solutions targeting these questions.

Here, we build on our earlier taxonomy of peer review practices in the publishing domain (Kaltenbrunner et al., 2022) to map out the characteristics of peer review within funding organizations. We present the results of an analytical literature review according to this taxonomy; we conclude by considering possible points for synergies across domains where peer review takes place and pose next steps for future research. 


Funding

RoRI’s second phase (2023–2027) is funded by an international consortium of partners, including: Australian Research Council (ARC); Canadian Institutes of Health Research (CIHR); Digital Science; Dutch Research Council (NWO); Gordon and Betty Moore Foundation [Grant number GBMF12312; DOI 10.37807/GBMF12312]; King Baudouin Foundation; La Caixa Foundation; Leiden University; Luxembourg National Research Fund (FNR); Michael Smith Health Research BC; National Research Foundation of South Africa; Novo Nordisk Foundation [Grant number NNF23SA0083996]; Research England (part of UK Research and Innovation); Social Sciences and Humanities Research Council of Canada (SSHRC); Swiss National Science Foundation (SNSF); University College London (UCL); Volkswagen Foundation; and Wellcome Trust [Grant number 228086/Z/23/Z].

History

Usage metrics

    Research on Research Institute

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC