Scientific article
OA Policy
English

A systematic survey of 200 systematic reviews with network meta-analysis (published 2020–2021) reveals that few reviews report structured evidence summaries

Published inJournal of clinical epidemiology, vol. 173, 111445
Publication date2024-09
First online date2024-05-26
Abstract

Objectives: To map whether and how systematic reviews (SRs) with network meta-analysis (NMA) use presentation formats to report (a) structured evidence summaries - here defined as reporting of effects estimates in absolute effects with certainty ratings and with a method to rate interventions across one or more outcome(s) - and (b) NMA results in general.

Study design and setting: We conducted a systematic survey, searching MEDLINE (Ovid) for SRs with NMA published between January 1, 2020, and December 31, 2021. We planned to include a random sample of publications, with predefined mechanisms in place for saturation, and included SRs that met prespecified quality criteria and extracted data on presentation formats that reported: (a) estimates of effects, (b) certainty of the evidence, or (c) rating of interventions.

Results: The 200 eligible SRs, from 158 unique Journals, utilized 1133 presentation formats. We found structured evidence summaries in 10 publications (5.0%), with 3 (1.5%) reporting structured evidence summaries across all outcomes, including benefits and harms. Sixteen of the 133 SRs (11.7%) reporting dichotomous outcomes included estimates of absolute effects. Seventy-six SRs (38.0%) reported both benefits and harms and 26 SRs (13.0%) reported certainty ratings in presentation formats, 20 (76.9%) used Grading of Recommendations Assessment, Development and Evaluation and 6 (23.1%) used Confidence In Network Meta-analysis. Surface Under the Cumulative Ranking Curve was the most common method to rate interventions (69 SRs, 34.5%). NMA results were most often reported using forest plots (108 SRs, 54.0%) and league tables (93 SRs, 46.5%).

Conclusion: Most SRs with NMA do not report structured evidence summaries and only rarely do such summaries include reporting of both benefits and harms; those that do offer effective user-friendly communication and provide models for optimal NMA presentation practice.

Keywords
  • Certainty of the evidence
  • Evidence summaries
  • Network meta-analysis
  • Presentation formats
  • Summary of findings tables
  • Systematic reviews
Funding
  • South-Eastern Norway Regional Health Authority [2017015]
Citation (ISO format)
LØVSLETTEN, Per Olav et al. A systematic survey of 200 systematic reviews with network meta-analysis (published 2020–2021) reveals that few reviews report structured evidence summaries. In: Journal of clinical epidemiology, 2024, vol. 173, p. 111445. doi: 10.1016/j.jclinepi.2024.111445
Main files (1)
Article (Published version)
Identifiers
Journal ISSN0895-4356
29views
46downloads

Technical informations

Creation14/03/2025 17:08:54
First validation17/06/2025 15:53:02
Update17/06/2025 15:53:02
Status update17/06/2025 15:53:02
Last indexation17/06/2025 15:53:03
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack