Oklahoma Quality Improvement Collaborative Interim training

1. Oklahoma Quality Improvement Collaborative Interim training Marlene Mason MCPP Healthcare Consulting, Inc. October 28, 2010

2. Training Agenda – October 28, 2010 • Review team progress and data collection on short term measures • Using Logic Models to Link Outcome Measures • Tools and Strategies for Effective Community Engagement • Develop Implementation Plan • Tying it all Together MCPP Healthcare Consulting

3. Teams Report AIM and Progress • Review current AIM statement and any baseline data or results of data collection (15 minutes each) • Cleveland County • Comanche County • Logan County • Okfuskee County • Washington County

4. Using Logic Models to Link to Outcome Measures

5. The Logic of Public Health We inspectrestaurants So that # of inspections Conditions in the restaurant don’t create unsafe food So that # of critical violations Public is sold food that is safe to eat So that % of critical violations corrected within 24 hours There are fewer incidents of foodborne illness Rate of food borne illness MCPP Healthcare Consulting

6. Why Logic Models? • Show how a program’s activities relate to the intended outcomes • Link our process outputs to our outcomes • Connect what we do every day to why we do it • Help you plan, evaluate, describe and market your program • Show your funder how you do what they fund you to do MCPP Healthcare Consulting

7. Logic Models Come in all Shapes and Sizes • As long as the format is legible, logical, and it works for you, it’s probably fine • Boxes and arrows are not required • New computer software is not required MCPP Healthcare Consulting

8. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Resources Activities Reduced Morbidity Informed, Targeted Program Program Development Improved knowledge, beliefs, attitudes Money Improved Behaviors Reduced Mortality Program Planning Appropriate, Targeted Materials Staff Improved Quality of Life Materials Development, Distribution Logic Model: Any Public Health Program MCPP Healthcare Consulting

9. MCPP Healthcare Consulting

10. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Resources Activities Inputs: Resources or the things you start with such as funding, staff, materials, etc. Activities or the things you do every day such as conduct educational meetings, investigate complaints or reports of illness, see clients, distribute materials, etc. Components of a Logic Model MCPP Healthcare Consulting

11. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Resources Activities Components of a Logic Model Outputs: What you get as a result of the resources and activities you put “in”; Not an end in itself Examples: Number of clients seen, attendees in classes or restaurants inspected MCPP Healthcare Consulting

12. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Resources Activities Outcomes:The results we expect from our resources and activities as stated quantifiable, time-framed performance measuresExamples: results from the process such as the percent of planned activities that were achieved or results related to clients or the public such as improved knowledge, behavior change, reduced risk or exposure to illness or improved health status Components of a Logic Model MCPP Healthcare Consulting

13. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Improve health of adolescents in county Strengthen Adolescent Health and Youth Development When you make a logic model for a brand new program, it’s easiest to begin with what you are trying to achieve and work backwards. MCPP Healthcare Consulting

14. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Improve health of adolescents in county How do we do this? Strengthen Adolescent Health and Youth Development When you work backwards through your logic model, ask HOW? MCPP Healthcare Consulting

15. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Improve health of adolescents in county Individual Behavior Change Systems Change Strengthen Adolescent Health and Youth Development When you work backwards through your logic model, ask HOW? How do we do this? MCPP Healthcare Consulting

16. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Improve Health of Adolescents in WA state Individual Behavior Change Systems Change Strengthen Adolescent Health and Youth Development Encourage use of best practices in local programs When you work backwards through your logic model, ask HOW? Community partners maintain or increase support for youth development How do we do this? Influence policy decisions MCPP Healthcare Consulting

17. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes When you make a logic model for an existing program, it’s easiest to begin with what you are already doing and work forwards. Increase Number and Strength of Partnerships Vision for Long term Planning Long term commitments from key stakeholders for development and implementation of plan Utilize Data & Research MCPP Healthcare Consulting

18. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Increase Number and Strength of Partnerships When you work forwards through your logic model, ask WHY? Vision for Long term Planning Long term commitments from key stakeholders for development and implementation of plan Why do we do this? Utilize Data & Research MCPP Healthcare Consulting

19. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Increase Number and Strength of Partnerships When you work forwards through your logic model, ask WHY? Vision for Long term Planning Adolescent Health Plan Long term commitments from key stakeholders for development and implementation of plan Why do we do this? Ongoing Partnerships Utilize Data & Research MCPP Healthcare Consulting

20. Inputs Outputs Short Term Outcomes Intermediate Outcomes Long Term Outcomes Resources Activities Reduced Morbidity Program Development Improved knowledge, beliefs, attitudes Money Improved Behaviors Reduced Mortality Program Planning Staff Improved Quality of Life Materials Development, Distribution Logic Model: Any Public Health Program Appropriate, Targeted Materials Informed, Targeted Program MCPP Healthcare Consulting

21. Establishing Process Outcomes Measures From Logic Model • Develop Logic Model with activities and outputs (productivity data) • Describe short term, intermediate and long term outcomes • If outcome is stated as “desired” outcome, then establish quantifiable measure based on available output data • Develop data collection tools (if needed) and set targets for each measure

22. Different Types of Objectives • Process Outputs • Results of the work we do every day • Short-term to Long-term Outcomes • What has to happen for our long term outcomes to be achieved • Impact or Goal • The end goal—what we’re really after—improved health outcomes MCPP Healthcare Consulting

23. Logic Model with Outcome Measures

24. MCPP Healthcare Consulting

25. Resources • CDC Evaluation Working Group • http://www.cdc.gov/eval • United Way Outcome Measurement Resource Network: • http://national.unitedway.org/outcomes/ • W.K. Kellogg Foundation Logic Model Development Guide: • http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf • How Logic Models Can Help NIDRR Grantees Plan and Demonstrate Progress: • http://www.ncddr.org/du/researchexchange/v09n02/1_logic.html • University of Wisconsin- Extension: Planning and evaluating education and outreach programs with a logic model: • http://www.uwex.edu/ces/lmcourse/# MCPP Healthcare Consulting

26. What questions do you have? MCPP Healthcare Consulting