poster

Peer Review Congress 2022

September 11, 2022

Chicago, United States

Completeness of Reporting and Its Association With Risk of Bias in Systematic Reviews Published in Rehabilitation Journals: A Meta-research Study

keywords:

reporting guidelines

editorial and peer review process

bias

Objective Problems with reporting a scientific study can affect research in different manners. For example, it is known that study methods are frequently not described in adequate detail and that results are presented ambiguously, incompletely, or selectively. A previous study1 confirmed that most of the authors (approximately 67%) publishing systematic reviews (SRs) in high-impact rehabilitation journals did not mention the use of a reporting guideline. Therefore, the objectives of this study were (1) to evaluate the completeness of reporting of SRs published in rehabilitation journals by evaluating their adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009 checklist, (2) to investigate the relationship between completeness of reporting and risk of bias (ROB), and (3) to study the association between completeness of reporting and the characteristics of SRs and journals.

Design A random sample of 200 SRs published between 2011 and 2020 in the 68 rehabilitation journals was indexed under the rehabilitation category in the InCites Journal Citation Report. Two independent reviewers evaluated the completeness of reporting as the adherence to the PRISMA 2009 checklist and assessed ROB using the ROBIS tool. Overall adherence and adherence to each PRISMA 2009 item and section were calculated as a percentage of the total number of items described and reported of the total number of applicable items. Regression analyses investigating the association between completeness of reporting, ROB, and other characteristics (impact factor, publication options, year of publication, and study protocol registration) were performed.

Results The mean overall PRISMA 2009 adherence was 61.4% (Figure 34). Studies with high ROB in ROBIS domain 1 had an overall adherence to the PRISMA 2009 checklist, which was 5.70% (95% CI, −10.07% to −1.34%) lower than those with low ROB. In domain 2, studies with high ROB had 5.41% (95% CI, −9.74% to −1.07%) lower adherence than those with low ROB. Studies with high overall ROB had 7.06% (95% CI, −12.10% to −2.01%) lower adherence than those with low overall ROB. Studies published in fourth- quartile journals displayed an overall adherence of 7.24% (95% CI, −13.19% to −1.29%) lower than those published in the first quartile; there was an 11.95% (95% CI, 5.94%- 17.96%) increase in overall adherence if the SR protocol was registered.

Conclusions The completeness of reporting in SRs published in rehabilitation journals is still suboptimal. High ROB is associated with poorer completeness of reporting, indicating that if a study has better reporting, this could positively affect the transparency of the ROB evaluation. The registration of study protocols and journal ranking are also associated with a more complete reporting. Authors of SRs should improve adherence to the reporting standards, and journal editors could implement strategies to optimize the completeness of reporting.

Reference

  1. Innocenti T, Salvioli S, Giagio S, Feller D, Cartabellotta N, Chiarotto A. Declaration of use and appropriate use of reporting guidelines in high-impact rehabilitation journals is limited: a meta-research study. J Clin Epidemiol. 2021;131:43-50. doi:10.1016/j.jclinepi.2020.11.010

Conflict of Interest Disclosures None reported.

Downloads

SlidesTranscript English (automatic)

Next from Peer Review Congress 2022

Inaugural Drummond Rennie Lecture: Bias, Spin, and Problems With Transparency of Research, Isabelle Boutron
lecture

Inaugural Drummond Rennie Lecture: Bias, Spin, and Problems With Transparency of Research, Isabelle Boutron

Peer Review Congress 2022

Isabelle Boutron

08 September 2022

Similar lecture

For the Underrepresented in Gender Bias Research: Chinese Name Gender Prediction with Heterogeneous Graph Attention Network
poster

For the Underrepresented in Gender Bias Research: Chinese Name Gender Prediction with Heterogeneous Graph Attention Network

AAAI 2023

+1Zihao Pan
Zihao Pan and 3 other authors

09 February 2023

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Lectures
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2023 Underline - All rights reserved