poster
Completeness of Reporting and Its Association With Risk of Bias in Systematic Reviews Published in Rehabilitation Journals: A Meta-research Study
keywords:
reporting guidelines
editorial and peer review process
bias
Objective Problems with reporting a scientific study can affect research in different manners. For example, it is known that study methods are frequently not described in adequate detail and that results are presented ambiguously, incompletely, or selectively. A previous study1 confirmed that most of the authors (approximately 67%) publishing systematic reviews (SRs) in high-impact rehabilitation journals did not mention the use of a reporting guideline. Therefore, the objectives of this study were (1) to evaluate the completeness of reporting of SRs published in rehabilitation journals by evaluating their adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009 checklist, (2) to investigate the relationship between completeness of reporting and risk of bias (ROB), and (3) to study the association between completeness of reporting and the characteristics of SRs and journals.
Design A random sample of 200 SRs published between 2011 and 2020 in the 68 rehabilitation journals was indexed under the rehabilitation category in the InCites Journal Citation Report. Two independent reviewers evaluated the completeness of reporting as the adherence to the PRISMA 2009 checklist and assessed ROB using the ROBIS tool. Overall adherence and adherence to each PRISMA 2009 item and section were calculated as a percentage of the total number of items described and reported of the total number of applicable items. Regression analyses investigating the association between completeness of reporting, ROB, and other characteristics (impact factor, publication options, year of publication, and study protocol registration) were performed.
Results The mean overall PRISMA 2009 adherence was 61.4% (Figure 34). Studies with high ROB in ROBIS domain 1 had an overall adherence to the PRISMA 2009 checklist, which was 5.70% (95% CI, −10.07% to −1.34%) lower than those with low ROB. In domain 2, studies with high ROB had 5.41% (95% CI, −9.74% to −1.07%) lower adherence than those with low ROB. Studies with high overall ROB had 7.06% (95% CI, −12.10% to −2.01%) lower adherence than those with low overall ROB. Studies published in fourth- quartile journals displayed an overall adherence of 7.24% (95% CI, −13.19% to −1.29%) lower than those published in the first quartile; there was an 11.95% (95% CI, 5.94%- 17.96%) increase in overall adherence if the SR protocol was registered.
Conclusions The completeness of reporting in SRs published in rehabilitation journals is still suboptimal. High ROB is associated with poorer completeness of reporting, indicating that if a study has better reporting, this could positively affect the transparency of the ROB evaluation. The registration of study protocols and journal ranking are also associated with a more complete reporting. Authors of SRs should improve adherence to the reporting standards, and journal editors could implement strategies to optimize the completeness of reporting.
Reference
- Innocenti T, Salvioli S, Giagio S, Feller D, Cartabellotta N, Chiarotto A. Declaration of use and appropriate use of reporting guidelines in high-impact rehabilitation journals is limited: a meta-research study. J Clin Epidemiol. 2021;131:43-50. doi:10.1016/j.jclinepi.2020.11.010
Conflict of Interest Disclosures None reported.