190 likes | 371 Vues
Evaluating Title IIID Programs. Evaluating Title IIID Programs. November 8, 2012 1:00-2:00 PM Webinar conference line toll free number (888)895-4286 Code 234049 Login information https://www2.gotomeeting.com/join/712383586/106280687. How do you Evaluate Title IIID Programs.
E N D
Evaluating Title IIID Programs • November 8, 2012 • 1:00-2:00 PM • Webinar conference line toll free number • (888)895-4286 • Code 234049 Login information https://www2.gotomeeting.com/join/712383586/106280687
How do you Evaluate Title IIID Programs • Is the program an evidence-based program? • Highest Tier • Does not require evaluation if you follow the program.
Intermediate Criteria • Published in a peer-reviewed journal • Uses pre-post tests or case controls • Has dissemination products for use by community organizations
Minimum Criteria • Evaluated to be effective for improving health, wellbeing or reducing disease, disability and or injury among older adults. • Uses an appropriately credentialed practitioner • Is backed by a peer-reviewed journal article on the activity • Is ready to be used in the community
Steps • Engage Participants • Describe the program • Focus the evaluation design • Gather credible evidence • Draw conclusions • Ensure use and share lessons learned
Center for Disease Control Standards • Utility • Feasibility • Propriety • Accuracy
Supporting Documentation OR AND
Why Evaluate • When no research is available • To meet AoA requirements • For data driven decisions
When do you evaluate? • At the beginning of your efforts • Determine what you will measure • To determine participant change at the end of the program • To provide tailored results in the middle of the program • To provide feedback on specific questions
What results do you need? • Avoid measure mayhem • Interact with participants on specific outcomes • Evaluate only what you can control • Get information that will help you determine if your program is effective or if you need to change direction
How do you evaluate? • Determine who will evaluate • Plan simple steps that are maintainable by staff • Make evaluating routine • Establish a plan to manage data, document results and publish findings
Examples of Evaluations • Anecdotal stories or testimonials • Surveys • Pre and post tests • Observations • Use variety of data
Draw Conclusions • What is the ultimate impact? • Was the desired change accomplished? • Look at short term, medium and long term results. • What could be improved? • Share your results.
Discussion • What results do you want to evaluate? • What can you measure to find the answer? • Who will be responsible for the information?
References Evaluation of Health Promotion Programs for Older Adults: An Introduction. http://www.ncoa.org/improve-health/center-for-healthy-aging/content-library/EvaluatingEBPrograms_Intro.pdf Evaluation Workshop PowerPoint. http://tracs.unc.edu/docs/cec/Program-Evaluation-Workshop.pdf
Resources Administration on Aging Resource List of evidence-based programs: • http://www.aoa.gov/AoARoot/AoA_Programs/HPW/Title_IIID/index.aspx The Center for Health Aging (The National Council on Aging). Learning modules. • www.healthyagingprograms.org/content.asp?secionid=67 The California Department of Aging • http://www.aging.ca.gov/ProgramsProviders/AAA/Disease_Prevention_and_Health_Promotion/
Resources Evaluation Management Checklists by Western Michigan University Retrieved from: • http://www.wmich.edu/evalctr/checklists/evaluation-management/ • http://www.wmich.edu/evalctr/archive_checklists/cippchecklist_mar07.pdf Developing an Effective Evaluation Plan • http://www.cdc.gov/obesity/downloads/CDC-Evaluation-Workbook-508.pdf
Resources A Framework for Program Evaluation http://www.cdc.gov/eval/framework/index.htm http://www.cdc.gov/eval/materials/frameworksummary.PDF Introduction to Program Evaluation for Public Health Programs: A Self-Study Guide http://www.cdc.gov/eval/guide/CDCEvalManual.pdf