#Finding scientific information: Evaluating the references

Evaluating the references

Evaluation of the reliability of the sources is an important element in scientific research. The idea is to establish the reliability of the source of the information and the information itself, and to consider their value as source material.

When evaluating, attention should be paid to the following issues: 

1.  relevance
2.  reliability of the author and publisher
3.  objectivity of the author
4.  quality of the references
5.  coverage
6.  how old the research is

 

Assessing the relevance

Issue:

Hints for assessment:

How well does the search result meet your information needs?

Consider your own research problem or assignment.

Is the content appropriate for your research topic?

  • Study the contents list, or skim the titles
  • Read the preface, abstract, introduction, and the conclusion
  • Study the references and the bibliographic information
  • Find reviews

Assessing reliability

Issue:

Hints for assessment:

What kind of journal has published the work?

Who is the publisher?

  • Commercial publishing house, university, scientific association, official body etc.
  • Values and objectives
  • Speciality
  • Editorial Board

 

  • Check the publisher's homepages
  • Check the editorial principles from the webpages of the jounal or the publisher.

Who is the author? What backgound information does the author give about her/himself?

  • The author or her/his background community are known

The author's credentials?

  • Academic background, education, career, job experience, other publications
  • Study the available information about the author
  • Find information from biographic sources, e.g. name listings or directories and personal web-pages
  • Find the author's other work from databases

The author's reputation in the scientific community?

  • Citations and references in textbooks and lectures

 

  • Look in, for example, Annual Reviews, the Web of Science or Scopus databases, or Google Scholar

What is the author's background organisation?

  • The organisation's tasks, values and goals
  • National or international
  • Memberships and affiliations
  • Check from the organisation's web-pages
  • Check from different indices or directories

Assessing objectivity

Issue:

Hints for assessment:

Who is the author? What backgound information does the author give about her/himself?

  • The author or her/his background community are known

The author's credentials?

  • Academic background, education, career, job experience, other publications
  • Study the available information about the author
  • Find information from biographic sources, e.g. name listings or directories and personal web-pages
  • Find the author's other work from databases

The author's reputation in the scientific community?

  • Citations and references in textbooks and lectures

 

  • Look in, for example, Annual Reviews, the Web of Science or Scopus databases, or Google Scholar

Who is the publisher?

  • Commercial publishing house, university, scientific association, official body etc.
  • Values and objectives
  • Speciality
  • Editorial Board

 

  • Check the publisher's homepages
  • Check the editorial principles from the webpages of the jounal or the publisher.

What is the author's background organisation?

  • The organisation's tasks, values and goals
  • National or international
  • Memberships and affiliations
  • Check from the organisation's web-pages
  • Check from different indices or directories

What kind of journal has published the work?

Quality assessment

Issue:

Hints for assessment:

Is the information well presented and without errors?

  • Sources are documented
  • Methodology is explained
  • Theories and issues that may nullify the main theses are also presented
  • Questionable assumptions are avoided
  • Check also the reliability and objectivity of the cited sources

Is the text coherent?

  • Does the title correspond to the structure?
  • Are the reviews similar?
  • Logically analysed
  • Main points are clearly presented
  • Readable text without pointless repetition

Is the text graphically well presented?

  • Images, tables and charts are clear, aptly named and understandable without without additional explanatory text
  • Think about other possible ways of presentation

Is the language flawless?

  • No printing, grammatical or spelling errors
  • Read the text carefully

Evaluating the scope and coverage

Issue:

Hints for assessment:

Have latest sources been used?

Compare the date of publication and the contents with the other sources that you have found.

Is the work compatible with other materials that you have read?
How does the data compare with other data from the same subject area and with what you already know about the topic?

Seek other points of view and observe the diversity of sources and ideas.

Estimating the age

Issue:

Hints for assessment:

When was the study carried out and the work published?

Does your your topic require the latest information?

Information ages at different rates in different fields, therefore the age of sources used varies among different disciplines.

Are there revised editions of the source?

Look for other editions in the databases and library catalogues.