Metrics in research impact assessment and grant funding: Insights from researchers in the “Reviewer 2 Must Be Stopped!” Facebook group

Abstract

Research assessment and grant funding are vital to higher education. However, the reliance on quantitative metrics in these processes has raised concerns about their validity and potential negative consequences. This study aims to investigate the game of numbers in research assessment and grant funding, focusing on the perspectives of experienced researchers from around the globe. Accidental sampling elicited responses from more than 15 experienced researchers across different academic disciplines, institutions, and countries. The data were collected from the popular “Reviewer 2 Must be Stopped!” Facebook platform, which includes more than 135,000 members across the globe. Two posts were made, allowing participants to share their experiences, perspectives, and concerns related to metrics and numbers in research assessment and grant funding. The results from the thematic analysis revealed diverse perspectives among experienced researchers. Some participants expressed concerns about the dominance of quantitative metrics, highlighting the limitations and potential biases associated with their use. Others acknowledged the value of certain indicators in showcasing research impact. Moreover, the impact of metrics on grant funding awards was also documented. The study highlights the necessity for a more balanced and context-aware approach to research assessment and grant funding, incorporating qualitative measures and acknowledging the diverse nature of research impact.