1 / 33

Step 3:

Step 3:. Critically Appraising the Evidence: Statistics for Diagnosis. Clinical Statistics Calculator (Excel) Statistics for: Diagnosis Sensitivity (Sn) Specificity (Sp) Likelihood Ratios (LR) Pre-test Probabilities/Prevalence Post-Test Probabilities/Predictive Values.

krysta
Télécharger la présentation

Step 3:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Step 3: Critically Appraising the Evidence: Statistics for Diagnosis

  2. Clinical Statistics Calculator (Excel) Statistics for: Diagnosis Sensitivity (Sn) Specificity (Sp) Likelihood Ratios (LR) Pre-test Probabilities/Prevalence Post-Test Probabilities/Predictive Values Table of Contents

  3. If available, find the best evidence in secondary sources where analysis has already occurred. If not pre-assessed, use critical appraisal worksheets to help you through the process. Making It Easier

  4. Importance of Critically Appraising the Evidence • Understanding the Limitations of the Author’s Analyses and Interpretations of the Data • Assessing Internal Validity • Assessing External Validity • Identifying Potential Confounding Variables • Simpson’s Paradox

  5. Critical Appraisal Basics • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  6. Generalized 2x2 Clinical Table

  7. Sensitivity and Specificity • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  8. Diagnostic Table Sensitivity a/(a+c) Specificity d/(b+d)

  9. Sensitivity • Answers the question: When the target disorder was present, what fraction of the time did the diagnostic test produce positive results? • Excludes all trials where the diagnostic test produced negative results

  10. Try it Yourself: Calculating Sensitivity 1 Step 1: • How many times was the target disorder actually present? • a • a + c • c • a + b

  11. Calculating Sensitivity 2 • How many of these times did the diagnostic test produce positive results? • Note: We do not count the number of times the diagnostic test produced positive results when the target disorder was absent (b). We are only interested in the cases where target disorder was present .

  12. Try it Yourself: Calculating Sensitivity 2 Step 2: • How many of these times did the diagnostic test produce positive results?: • a • a + c • c • a + b

  13. Try it Yourself: Calculating Sensitivity 3 Step 3: • So what fraction of the total number of times the target disorder was present did the diagnostic test produced positive results?: • c/(a + c) • a/(a + c) • c/(b + c) • a/(a + b)

  14. Specificity • Answers the question: When the target disorder was not present, what fraction of the time did the diagnostic test produce negative results? • Excludes all trials where the diagnostic test produced positive results

  15. Calculating Specificity 1 • How many times was the target disorder absent?: b+d • How many of these times did the diagnostic test produce negative results?: d • Note: We do not count the number of times the diagnostic test produced negative results when the target disorder was present (c). We are only interested in the cases where the target disorder was absent. • So what fraction of the total number of times the target disorder was absent did the diagnostic test produced negative results?: b/(b+d)

  16. Helpful Acronyms • Specificity – SpPin (spin) • When a test has a high Specificity, a Positive test rules in the diagnosis. • Sensitivity – SnNout (snout) • When a test has a high Sensitivity, a Negative test rules out the diagnosis.

  17. Another Way of Looking at It • Specificity • 1 - α • Probability of not getting a Type I Error/α Error/False Positive • Sensitivity • 1 - Β • Probability of not getting a Type II Error/Β Error/False Negative • Also know as the statistical power of the test

  18. Sensitivity/Specificity Example • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  19. Likelihood Ratios • Likelihood Ratio for a Positive Result (LR+) • The number of patients testing positive for the target disorder who have the disease for every patient testing positive that does not have it • Likelihood Ratio for a Negative Result (LR-) • The number of patients testing negative for the target disorder who have the disease for every patient testing negative that does not have it

  20. Calculating Likelihood Ratios • Likelihood Ratio for a Positive Result (LR+) • sensitivity/(1-specificity) • Likelihood Ratio for a Negative Result (LR-) • (1-sensitivity)/specificity

  21. Likelihood Ratios Video • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  22. How to use Likelihood Ratios • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  23. Likelihood Ratio Example • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  24. Prevalence and Probability • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  25. Prevalence • Fraction of the population at risk at a given time who have the target disease

  26. Pre-Test Probability • Probability that a patient has the target disease without knowing the results of a diagnostic test

  27. Calculating Prevalence • (a+c)/(a+b+c+d) • The number of those with the disease divided by the total number of people

  28. Post-Test Probabilities • Positive Predictive Value • Probability that a patient with a positive diagnostic test actually has the disease • Negative Predictive Value • Probability that a patient with a negative diagnostic test actually does not have the disease

  29. Calculating Predictive Values • Positive Predictive Values (+PV) • a/(a+b) • Negative Predictive Values (-PV) • c/(c+d)

  30. Predictive Values • View movie as: • QuickTime (.mov) • Flash (.swf) • Double-click on video for full-screen mode.

  31. Try it on your own. • Critical Appraisal Practice Exercises • From CEBM

  32. Links to Other Websitesand Hands-On Activities • EBM Glossary • From CEBM • Critical Appraisal Practice Exercises • From CEBM

  33. Congratulations!You have successfully completed Step 3.The End

More Related