Skip to content
Pureza

Research concepts

Narrative reviews versus systematic reviews

A long bibliography does not make an article a systematic review. The difference lies in how the question was defined, studies were sought and inclusion was decided. How results were combined also matters: a synthesis without meta-analysis can still be systematic.

Source editorial review:

The search must be reconstructible

The Cochrane Handbook connects the search strategy with previously defined eligibility criteria. To assess a review, look for databases searched, dates covered, search terms and restrictions. These details reveal which evidence could enter and which could be missed.

The phrase ‘the literature was reviewed’ is insufficient. Listing databases without explaining their use is insufficient too. A question about a cell model and one about animal outcomes require searches and criteria addressing those differences.

Study selection is a method too

Cochrane recommends documenting inclusion and exclusion decisions and using independent assessors to determine final eligibility. The record allows readers to check why an apparently relevant study is absent from the synthesis.

As an editorial check, choose a known reference and follow its path. If excluded, there should be a reason linked to the criteria. This does not certify the entire review, but can reveal selection that is difficult to reconstruct.

What a narrative review can contribute

SANRA was developed to assess narrative reviews through objectives, topic importance, searching, references, evidence level and outcome presentation. Its purpose was evaluating article quality, not converting an article into a systematic review.

A narrative review can organize concepts, relate mechanisms and explain the history of a hypothesis. Its usefulness depends on readers distinguishing interpretative synthesis from an exhaustive search. A coherent narrative does not demonstrate inclusion of every conflicting result.

No meta-analysis does not mean no method

Cochrane's chapter on other synthesis methods describes options for circumstances in which results are not pooled statistically. Absence of a pooled estimate still requires explanation of grouping, comparisons and data presentation.

In a peptide review, for example, separating cell cultures, animals and formulations may be more informative than combining them into one number. This illustrates a synthesis decision; its justification should appear in the article.

Counting positive studies can distort the conclusion

Cochrane warns against classifying studies solely by statistical significance and counting the positive ones. Two studies may estimate similar effects yet fall on opposite sides of a threshold because their precision differs.

Before accepting ‘most studies agree,’ check what was counted as agreement. Direction, magnitude and uncertainty provide different information. A useful review shows these differences and explains how it moved from individual studies to its conclusion.

Questions and answers

Must every systematic review include meta-analysis?

No. It can use other synthesis methods if they are described and appropriate to the data.

Does SANRA certify an exhaustive search?

No. It assesses narrative reviews and does not replace the methods of a systematic review.

Sources

  1. SANRA-a scale for the quality assessment of narrative review articles.
  2. Cochrane: búsqueda y selección de estudios
  3. Cochrane: síntesis y presentación mediante otros métodos