Defining, measuring, and rewarding scholarly impact: mind the level of analysis

Ramani, Ravi S., Aguinis, Herman and Coyle-Shapiro, Jacqueline A.M. ORCID: 0000-0002-7658-7878 (2022) Defining, measuring, and rewarding scholarly impact: mind the level of analysis. Academy of Management Learning and Education, 21 (3). 470 - 486. ISSN 1537-260X

Text (Defining, measuring, and rewarding scholarly impact) - Accepted Version Download (1MB)

• Author

Abstract

We address the grossly incorrect inferences that result from using journal impact factor (JIF) as a proxy to assess individual researcher and article scholarly impact. This invalid practice occurs because of confusion about the definition and measurement of impact at different levels of analysis. Specifically, JIF is a journal-level measure of impact, computed by aggregating citations of individual articles (i.e., upward effect), and is therefore inappropriate when measuring impact at lower levels of analysis, such as that of individual researchers, or of individual articles published in a particular journal (i.e., downward effect). We illustrate the severity of the errors that occur when using JIF to evaluate individual scholarly impact, and advocate for an immediate moratorium on the exclusive use of JIF and other journal-level (i.e., higher level of analysis) measures when assessing the impact of individual researchers and individual articles (i.e., lower level of analysis). Given the importance and interest in assessing the scholarly impact of researchers and articles, we delineate level-appropriate and readily available measures.

Item Type:	Article
Additional Information:	© Academy of Management Learning & Education.
Divisions:	Management
Subjects:	H Social Sciences > HD Industries. Land use. Labor > HD28 Management. Industrial Management L Education
Date Deposited:	10 Nov 2022 16:24
Last Modified:	16 Nov 2024 23:18
URI:	http://eprints.lse.ac.uk/id/eprint/117286

Actions (login required)

View Item