Deakin University
Browse

Scientific impact assessment cannot be fair

Version 2 2024-06-13, 13:19
Version 1 2019-10-09, 08:30
journal contribution
posted on 2024-06-13, 13:19 authored by M Gagolewski
In this paper we deal with the problem of aggregating numeric sequences of arbitrary length that represent e.g. citation records of scientists. Impact functions are the aggregation operators that express as a single number not only the quality of individual publications, but also their author's productivity.We examine some fundamental properties of these aggregation tools. It turns out that each impact function which always gives indisputable valuations must necessarily be trivial. Moreover, it is shown that for any set of citation records in which none is dominated by the other, we may construct an impact function that gives any a priori-established authors' ordering. Theoretically then, there is considerable room for manipulation in the hands of decision makers.We also discuss the differences between the impact function-based and the multicriteria decision making-based approach to scientific quality management, and study how the introduction of new properties of impact functions affects the assessment process. We argue that simple mathematical tools like the h- or g-index (as well as other bibliometric impact indices) may not necessarily be a good choice when it comes to assess scientific achievements.

History

Journal

Journal of Informetrics

Volume

7

Pagination

792-802

Location

Amsterdam, The Netherlands

ISSN

1751-1577

Language

eng

Publication classification

C1.1 Refereed article in a scholarly journal

Copyright notice

2013, Elsevier

Issue

4

Publisher

Elsevier