Peer Review Congress 2022

September 11, 2022

Chicago, United States

Characteristics and Opportunities for Improvement of Methods Guidance Published in General and Methodology-Focused Medical Journals


conflict of interest

reporting guidelines

research methods

Objective To systematically assess the characteristics and current practice of developing methods guidance for health researchers and explore opportunities for improvement.

Design A systematic survey of methods-guidance articles published in general and methodology-focused, high-impact medical journals indexed in MEDLINE in 2020 was performed. Articles that explicitly stated the objective to provide methods guidance for health research were eligible. Characteristics related to findability, methods for guidance development, and transparency were extracted.

Results A total of 105 guidance articles published in 12 different journals were included. Few articles had a structured abstract (44 42%) or were indexed with Medical Subject Headings (40 38%) or author keywords (18 17%) related to guidance. Of the 105 guidance articles, less than half reported any methods for development (44 42%), most frequently stakeholder involvement (30 28%), systematic review of the methodological literature (21 20%), or consensus process (21 20%). Use of explicit methods for development differed between reporting guidelines (13 of 13 100% reported a development process) and other types of methods guidance (ie, guidance for planning, conduct, analysis, interpretation, or quality assessment: 31 of 92 articles 34% reported a development process). Transparency was limited, with few guidance articles describing the authors’ expertise (23 22%). Conflicts of interest, if reported (36 34%), were frequently unclear.

Conclusions Most methods-guidance articles published in 2020 were difficult to find in MEDLINE, were developed with unclear methods, and lacked transparency regarding the authors’ expertise and conflicts of interest. For health researchers, those limitations implied important barriers to the uptake of methods guidance. To improve findability, we developed the new open-access Library of Guidance for Health Scientists (LIGHTS; More research is required to inform methods for guidance development and transparency considerations.

Conflict of Interest Disclosures None reported.

Funding/Support This work was supported by grant 190566 from the Swiss National Science Foundation and grant 3MS1043 from the University of Basel.

Role of the Funder/Sponsor The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the abstract; and decision to submit the abstract for presentation.

Additional Information Julian Hirt is a co–corresponding author.

Next from Peer Review Congress 2022

Inaugural Drummond Rennie Lecture: Bias, Spin, and Problems With Transparency of Research, Isabelle Boutron

Inaugural Drummond Rennie Lecture: Bias, Spin, and Problems With Transparency of Research, Isabelle Boutron

Peer Review Congress 2022

Isabelle Boutron

08 September 2022

Similar lecture

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)


  • All Lectures
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2023 Underline - All rights reserved