Responsible use of publication metrics at the University of Oulu

Recommendation for the responsible use of publication metrics at the University of Oulu

The University of Oulu has committed to the responsible use of publication metrics by signing the DORA Declaration in 2020. The main recommendation of Dora prohibits the use of journal-based indicators (such as the Journal Impact Factor and the Publication Forum Classification) as a substitute for measuring the quality of an individual research article when evaluating an individual researcher. It is important to follow this recommendation, since the quality of an individual publication does not depend on the level of the publication channel in which it is published.

In addition to Dora, a key recommendation is the Good Practice in Researcher Evaluation: Recommendation for the responsible evaluation of a researcher in Finland, coordinated by TSV. Regarding publication metrics, the recommendation includes a section on the responsible use of publication metrics produced at the national level by Finnish publication metrics experts. The long version of the metrics section is published in Finnish only.

As the latest international recommendation, the University of Oulu has committed to the CoARA coalition's commitments. Regarding publication metrics, the key sub-commitment involves abandoning the inappropriate use of journal- and publication-based metrics in research assessment, particularly the inappropriate use of Journal Impact Factor (JIF) and h-index.

The library’s bibliometric services have compiled, together with the Working group for responsible assessment of the researcher, the following guidelines for the use of publication metrics at the University of Oulu.

Based on the recommendations presented in the introduction, the following issues should be taken into account when producing and using publication metrics at the University of Oulu:

1. It is recommended that publication metrics are used mainly to support qualitative expert evaluation. When evaluating an individual researcher, expert evaluation should be used as the main evaluation method.

2. Journal-based metrics, such as Journal impact factor or Publication Forum classification, should not be used as a substitute for measuring the quality of an individual research article when evaluating an individual researcher. The University of Oulu has committed to this by signing the DORA Declaration.

3. The use of the h-index in evaluating individual researchers is often overemphasized. Its use should be considered carefully, as it is influenced by factors such as the length of the researcher's career and the different publication practices across various disciplines.

4. The publication metrics should be based on data relevant to the subject of the evaluation. The known limitations of the data must be stated.

5. The data, methods of analysis and results shall be as open and transparent as possible. Whenever possible, the subject of the evaluation should be able to verify the data used in the analyses and the results of the analyses.

6. Disciplinary differences and interdisciplinarity should be taken into account when producing and using publication metrics.

7. The publication indicators to be used in the evaluation should be selected in such a way that they can meet the objectives of the evaluation. When selecting indicators, it is preferable to favour a diverse use of indicators rather than rely too heavily on a single type.

8. The results should be reported in a way that is relevant from the perspective of the subject, methods and data of the evaluation. The limitations of problematic indicators must be clearly communicated.

9. Expertise in the field should be used when producing and using publication metrics, for example by consulting or commisioning the library's bibliometric services.

Bibliometric services adhere to international and national recommendations in the services they provide, based on which the above recommendation has been formed.

If you have any questions regarding the responsible use of publication metrics and related recommendations, please contact the library's bibliometric services via email at bibliometriikka@oulu.fi.

Questions regarding the use of publication metrics as part of research and researcher evaluation can be sent to the Responsible Evaluation Development Group at responsibleassessment@oulu.fi.

For more information on the subject, see the Finnish national guide to publication metrics