Siirry pääsisältöön

Systematic searching: Start here

Welcome to study systematic searching

This guide provides guidance on the different stages of systematic searching. It focuses on undertaking systematic searches in health sciences and medicine, but the guidelines can be applied to other fields as well. 

Systematic searching is usually associated with systematic reviews, but the guidelines can be applied to all types of comprehensive and in-depth searching. Comprehensiveness is achieved by keeping the search terms, search methods and database selection sufficiently versatile. Systematic searching also involves careful documentation of the search to ensure it can be reproduced.

Sensitivity and specificity

A systematic literature search aims to find all relevant documents on a topic without increasing the search result set to such an extent that it is no longer possible to sift through the search result. The concepts of recall (or sensitivity) and precision (or specificity) are related to information retrieval.

Recall = the ratio of hits in the search result to all relevant documents in the database. The proportion of relevant documents in the database that were found.

Precision = the ratio of hits in the search result to all documents found. What percentage of the search result consisted of relevant documents.

Source: Järvelin K, Sormunen E. Tiedon tallennus ja haku

The relationship between recall and precision is inverse. If you increase the precision, i.e. reduce the number of irrelevant documents in the search result, you may also lose relevant documents, i.e. your recall will suffer. If the recall is increased, i.e. the search becomes more comprehensive, precision may suffer.

Systematic information retrieval is a balancing act between sufficient recall and precision. Systematic searching as a method involves searching through a large set of search results where necessary. Good knowledge of the subject and search techniques, search planning and persistent testing of search phrases will usually lead to the best results in terms of both recall and precision. 

A variety of reviews

The types and names of reviews vary between disciplines, but also within a discipline. Different types of reviews are used for different purposes. Common to the different types of reviews is the search, evaluation, synthesis and analysis of the literature.

Familiarise yourself with the type of review you have chosen.  The last tab of this guide contains methodological literature on literature reviews. You can find more on Oula-Finna, by searching e.g.  "literature review" OR "systematic review" 

A systematic review takes a systematic approach to different stages of the review. 

  • It seeks to answer a well-defined research question
  • the search is carried out systematically and reported accurately
  • Inclusion and exclusion criteria are defined before the start of the review
  • methodological quality of the selected studies and the risk of bias are carefully assessed


Other types of systematic reviews include:

  • umbrella review
  • integrative review
  • systematized review

References: 

  • Bettany-Saltikov J. How to do a systematic literature review in nursing: A step-by-step guide. Maidenhead, Berkshire: Open University Press, 2012.
  • Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108.
  • Sutton A, Clowes M, Preston L, Booth A. Meeting the review family: exploring review types and associated information retrieval requirements. Health Info Libr J. 2019;36(3):202–22.

     

Narrative reviews (or literature reviews) characteristically

  • Are methodologically the lightest forms of literature review
  • Describe previous research on the topic
  • Often address a broad research question 
  • Literature search is not carried out in a fully systematic way
  • Selective collection of data may result in divergent descriptions of the topic

Sub-types include:

  • critical review
  • scoping review
  • mapping review
  • overview

Some of the sub-types contain features of a systematic review.

 

References: 

  • Bettany-Saltikov J. How to do a systematic literature review in nursing: A step-by-step guide. Maidenhead, Berkshire: Open University Press, 2012.
  • Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108.
  • Sutton A, Clowes M, Preston L, Booth A. Meeting the review family: exploring review types and associated information retrieval requirements. Health Info Libr J. 2019;36(3):202–22.

     

A meta-analysis can be qualitative or quantitative.

  • In a qualitative meta-analysis, data is classified and summarised. Qualitative meta-analysis can be divided into meta-synthesis and meta-summary.
  • Quantitative meta-analysis involves combining and generalising quantitative studies using statistical methods. The results can be given in numerical form.

References: 

  • Bettany-Saltikov J. How to do a systematic literature review in nursing: A step-by-step guide. Maidenhead, Berkshire: Open University Press, 2012.
  • A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108.
  • Sutton A, Clowes M, Preston L, Booth A. Meeting the review family: exploring review types and associated information retrieval requirements. Health Info Libr J. 2019;36(3):202–22.

     

Need help with searching?

Did you have any questions after reading the guide? Book an appointment for a workshop or a personal guidance session.

Picture: https://pixabay.com/fi/

Feedback

Do you know of a good information source or a link that should be added to this guide? Let us know! Feedback and suggestions for improvement can be sent to information.service(at)oulu.fi

Steps in a systematic review

  1. Framing questions for a review
  2.  Identifying relevant studies
  3. Assessing the quality of studies
  4. Summarizing the evidence
  5. Interpreting the finding

 

Reference: Khan KS, Kunz R, Kleijnen J, Antes G. Five steps to conducting a systematic review. J R Soc Med. 2003 Mar;96(3):118-21. doi: 10.1258/jrsm.96.3.118. 

Rights of use

Creative Commons lisence
This work is licensed under a Creative Commons Attribution 4.0 International License.

This guide is a translation of the Systemaattinen tiedonhaku libguide. The English version is based on a similar guide by the University of Tampere. The DeepL translator was used in the translation process.