Reporting Guidelines and scientific articles’ impact

1. A(n) (un)breakablebond Reporting Guidelines and scientific articles’ impact PEREIRA, Ana Catarina || RODRIGUES, Ana Raquel || BRANDÃO, Daniela || ALVES, Filipe || BASTOS, José Mário || SILVA, José Nuno || MORGADO, Margarida || SILVA, Marta || Class 21 fmup.turma21@gmail.com Adviser: Prof. Pedro Pereira Rodrigues Introdução à Medicina II Ano lectivo 2011/2012

2. Introduction Research question & Aims Methodology Results References Abstract About 1.350.000 articles are published in a year and scientific articles have a major importance in scientific knowledge. Vascular system: role of nitric oxide in cardiovascular diseases. Bian K, Doursout MF, Murad F. Source The University of Texas Health Science Center at Houston, The Brown Institute of Molecular Medicine, Houston, TX 77030, USA. Conclusions Reporting Guidelines, impact, guidelines compliance, articles’ impact

3. Introduction Research question & Aims Methodology Results References Abstract Background & Justification Original empiric and theoretical work are both disseminated through Scientific Literature Scientific Advancementhigh impact journals article may not be properly written! • Journals may have: • their own policies of publishing; • no rules at all. Conclusions

4. Introduction Research question & Aims Methodology Results References Abstract Background & Justification It is rare to find a clear description of the monitoring phase in guidelines for cardiovascular diseases Example 1: Cardiovascular diseases What to monitor? Conclusions What to do if a change in a risk factor is detected? [4] A clear guideline would help clinicians to apply the recommendations in clinical practice [4] du Sert NP. Improving the reporting of animal research: when will we ARRIVE? Disease Models & Mechanisms. 2011; 4: 281-282

5. Introduction Research question & Aims Methodology Results References Abstract Background & Justification Example 2: CONSORT • The use of specific reporting guidelines, such as CONSORT, actually have a positive influenceon the impact of reports. [5] • The introduction of guidelines resulted in significant improvement in the quality of reporting in the Journal of Pediatric Surgery. [6] Conclusions [5] Cobo E, Cortés J, Ribera JM, Cardellach F, Selva-O’Callaghan A, Kostov B, García L, Cirugeda L, Altman DG, González JA, Sànchez JA, Miras F, Urrutia A, Fonollosa V, Rey-Joly C, Vilardell M. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomized trial. BMJ, 2011  [6] Larson EL, Cortazal M. Publication guidelines need widespread adoption. Journal of Clinical Epidemiology. 2011;

6. Introduction Research question & Aims Methodology Results References Abstract Background & Justification ! Need of widespread adoption of reporting guidelines Conclusions • Research increasingly reported in a standardized and consistent manner [7] [7] Moschetti I, Brandt D, Perera R, Clarke M, Heneghan C. Adequacy of reporting monitoring regimens of risk factors for cardiovascular disease in clinical guidelines: systematic review. BMJ. 2011; 342

7. Introduction Research question & Aims Methodology Results References Abstract Background & Justification But how to develop guidelines? • Guideline developers must endeavor to: • maximize the quality of their product; • make journal editors more confident in endorsing reporting guidelines. [10] Conclusions [10] Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, Schulz KF, Miller D, Simera I, Grimshaw J, Hoey J. Describing reporting guidelines for health research: a systematic review. Journal of Clinical Epidemiology. 2011; 64:718-742

8. Introduction Research question & Aims Methodology Results References Abstract Background & Justification Reporting Guidelines Over the years, researchers tried to reach common and clear: • TREND • ORION • COREQ • QUOROM • REMARK • CONSORT • ARRIVE • STREGA • STROBE • STARD • SQUIRE • MOOSE • PRISMA • GNOSIS Conclusions

9. Introduction Research question & Aims Methodology Results References Abstract Background & Justification Reporting Guidelines • “Reporting guidelines are statements that provide advice on how to report research methods and findings. Most widely recognized guidelines are based on the available evidence and reflect consensus opinion of experts in a particular field, including research methodologists and journal editors.” • “Reporting guidelines complement advice on scientific writing, which concentrates on the basic writing principles and styles of research reports and publications, and journals' instructions to authors.” Conclusions From Equator Network

10. Introduction Research question & Aims Methodology Results References Abstract Background & Justification Reporting Guidelines • “Reporting guidelines are statements that provide advice on how to report research methods and findings. Most widely recognized guidelines are based on the available evidence and reflect consensus opinion of experts in a particular field, including research methodologists and journal editors.” • “Reporting guidelines complement advice on scientific writing, which concentrates on the basic writing principles and styles of research reports and publications, and journals' instructions to authors.” Conclusions From Equator Network

11. Introduction Research question & Aims Methodology Results References Abstract Research question & Aims Does the use of Reporting Guidelines improve the scientific articles’ impact of the General and Internal Medicine (G&IM) journals? Conclusions

12. Introduction Research question & Aims Methodology Results References Abstract Research question & Aims Assess the association between articles' impact and the existence of reporting guidelines available at the journal web site. Conclusions Specific Objectives • Measure the utilization rate of Reporting Guidelines • Describe the G&IM articles’ impact • Acknowledge the type and number of Reporting Guidelines used in G&IM scientific journals

13. Introduction Research question & Aims Methodology Results References Abstract Research question & Aims Assess the association between articles' impact and the existence of reporting guidelines available at the journal web site. Conclusions Specific Objectives • Measure the utilization rate of Reporting Guidelines • Describe the G&IM articles’ impact • Acknowledge the type and number of Reporting Guidelines used in G&IM scientific journals

14. Introduction Research question & Aims Methodology Results References Abstract Methodology Conclusions

15. Introduction Research question & Aims Methodology Results References Abstract Methodology • Web Site • Language • Impact Factor Conclusions • Collectinformationaboutalljournals

16. Introduction Research question & Aims Methodology Results References Abstract Methodology • Web Site • Language – Portuguese, English, Spanish • Impact Factor – at least one from 2008, 2009 or 2010 Conclusions • ApplyInclusion & Exclusioncriteria

17. Introduction Research question & Aims Methodology Results References Abstract Methodology • Statisticalanalysisbasedon: • IF’s • Website • Language Conclusions • Statisticalanalysis

18. Introduction Research question & Aims Methodology Results References Abstract • Journalswhichdon’tsayanythingabout RG • JournalswhichRecommend RG • JournalswhichImpose RG Methodology These are the three groups in which we divided our articles, in order to analyze them. Conclusions

19. Introduction Research question & Aims Methodology Results References Abstract • Choose6articlesfrom 2008 per journal Methodology & Conclusions • Randomlychoose 6 journals

20. Introduction Research question & Aims Methodology Results References Abstract Methodology • Don’tsayanythingaboutusing RG • Internal Medicine Journal • QJM: AnInternationalJournalof Medicine • Recommendthe use of RG • JournalofPainandSymptom Management • ArchivesofInternal Medicine • Imposethe use of RG • Family Medicine • Healthmed Conclusions

21. Introduction Research question & Aims Methodology Results References Abstract Methodology Conclusions Werandomlyselectedthearticles for ourstudy, using ISI Web ofKnowledgeand Excel.

22. Introduction Research question & Aims Methodology Results References Abstract Methodology • CONSORT: • Randomizedtrials • 37 items • STROBE: • Observationalstudies • 33 items for case-controlstudies, 34 for cohortstudies Conclusions • Use CONSORT & STROBE reportingguidelines – checklist

23. Introduction Research question & Aims Methodology Results References Abstract Methodology Conclusions • CalculateImpact per article • ImpactFactor≠Impact per article • JOURNALS • ARTICLES

24. Introduction Research question & Aims Methodology Results References Abstract Methodology • Based on: • Articles’ impact – ONLY articles from 2008; • Checklist used Conclusions • Statisticalanalysis

25. Introduction Research question & Aims Results Methodology References Abstract Results • Reporting Guidelines & • Scientific articles’ impact • We’re looking for this association! Conclusions

26. Introduction Research question & Aims Results Abstract Results Methodology Conclusions References Table 1.DistributionofIF’sfrom 2008, 2009 and 2010 for includedandexlcudedjournalsand for allofthem. 1) For excludedjournals, IF’shavegot a normal distributionand data shows as mean ± standard deviation (N=absolutefrequencies). 2) For includedjournalsandallofthejournals, IF’shaven’tgot a normal distributionand data shows as median; [quartil 25, quartil 75] (N=absolutefrequencies).

27. Introduction Research question & Aims Results Abstract Results Methodology Conclusions References Table 2.DistributionofIF’sfrom 2008, 2009 and 2010 for threegroupsbytheirutilizationofReportingGuidelines. IF’shaven’tgot a normal distributionand data shows as median; [quartis 25 and 75] (N=absolutefrequencies).

28. Introduction Research question & Aims Results Abstract • ReportingGuidelines’ Endorsement • Theresultsaren’tstatisticalsignificant • (p=0,672) Results Methodology Conclusions References Table3.DistributionoftheArticles’ impact in thethreegroupsofjournals.

29. Introduction Research question & Aims Results Abstract Results Methodology Conclusions References

30. Introduction Research question & Aims Results Abstract • Theresultsaren’tstatisticalsignificant • (p=0,501) Results Methodology ReportingGuideline’sendorsement Conclusions References Table4.DistributionoftheAccordanceofthearticleswiththeReportingGuidelineused in thethreegroupsofjournals. N:JournalsthatsaynothingaboutReportingGuigelines; R: JournalsthatRecommendthe use ofReportingGuidelines; I:JournalsthatImposethe use ofReportingGuidelines.

31. Introduction Research question & Aims Results Abstract • CONSORT • Theresultsaren’tstatisticalsignificant • (p=0,884) Results Methodology Conclusions References Table5. Ainda não sei como legendar esta.

32. Introduction Research question & Aims Results Abstract • STROBE • Theresults are statisticalsignificant • (p=0,041) Results Methodology Conclusions References Table6. Ainda não sei como legendar esta.

33. Introduction Research question & Aims Conclusions Abstract • We recommend… Conclusions Methodology Results References

34. Introduction Research question & Aims References Results Methodology Abstract References [1] Bennett C, Khangura S, Brehaut JC, Graham ID, Moher D, Potter BK, Grimshaw JM. Reporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices.PLoS Med. 2011; 8(8) [2] Vandenbroucke JP. STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK. and CONSORT: for whom does the guideline toll? Journal of Clinical Epidemiology. 2009; 62: 594-596 [3] Simera I, Altman DG, Moher D, Schulz KF, Hoey J. Guidelines for Reporting Health Research: The EQUATOR Network’s Survey of Guideline Authors. PLoS Med. 2008; 5(6) [4] du Sert NP. Improving the reporting of animal research: when will we ARRIVE? Disease Models & Mechanisms. 2011; 4: 281-282 [5] Cobo E, Cortés J, Ribera JM, Cardellach F, Selva-O’Callaghan A, Kostov B, García L, Cirugeda L, Altman DG, González JA, Sànchez JA, Miras F, Urrutia A, Fonollosa V, Rey-Joly C, Vilardell M. Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomized trial. BMJ, 2011 [6] Larson EL, Cortazal M. Publication guidelines need widespread adoption. Journal of Clinical Epidemiology. 2011; [7] Moschetti I, Brandt D, Perera R, Clarke M, Heneghan C. Adequacy of reporting monitoring regimens of risk factors for cardiovascular disease in clinical guidelines: systematic review. BMJ. 2011; 342 [8] Wangler M, Fujikawa R, Hestbæk L, Michielsen T, Raven TJ, Thiel HW, Zaugg B. Creating European guidelines for Chiropractic Incident Reporting and Learning Systems (CIRLS): relevance and structure. Chiropractic & Manual Therapies. 2011; 19(9)

35. Introduction Research question & Aims References Results Methodology Abstract References [9] MoherD, Schulz KF, Simera I, Altman DG. Guidance for Developers of Health Research Reporting Guidelines.PLoS Med. 2010; 7(2) [10] Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, Schulz KF, Miller D, Simera I, Grimshaw J, Hoey J. Describing reporting guidelines for health research: a systematic review. Journal of Clinical Epidemiology. 2011; 64:718-742 [11] Grol R, Dalhuijsen J, Thomas S, in’tVeld C, Rutten G, Mokkink H. Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. BMJ. 1998; 317: 858–61 [12] Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. MJA. 2006; 185: 263–267 [13] Wynne KE, Simpson BJ, Berman L, Rangel SJ, Grosfeld JL, Moss RL. Results of a longitudinal study of rigorous manuscript submission guidelines designed to improve the quality of clinical research reporting in a peer-reviewed surgical journal. Journal of Pediatric Surgery. 2011; 46: 131–137

36. Do you have any questions?