80 likes | 204 Vues
This document outlines essential strengths and next steps for enhancing guidance on Impact Evaluation (IE). Key areas of focus include integrating IE within a comprehensive monitoring and evaluation system, investing strategically in IE, incorporating intervention theories, and addressing value-based impacts and benefits distribution. Diverse examples illustrate these concepts, while next steps emphasize consolidating measurement guidance, evaluating benefit distribution, incorporating participatory approaches, and tackling the complexities of attribution. The overall aim is to improve knowledge uptake and accessibility for intended users.
E N D
Draft NONIE guidanceMarch 2009 Discussant comments Patricia Rogers
STRENGTHS Guidance in terms of • Locating IE within a robust system of monitoring and evaluation (p. 51) • Strategic investment in IE (p. 51) • Incorporating an intervention theory (p. 20) • Attention to values in terms of impacts, processes and distribution of costs and benefits (p. 17) • Diverse examples of IE RMIT University
NEXT STEPS • Consolidate and expand guidance on measurement • Add guidance on evaluating distribution of costs and benefits, not just average effect • Incorporate participatory approaches as an option for each task • Address implications of simple, complicated, complex aspects • Add guidance on supporting knowledge uptake – transfer and translation RMIT University
Nature June 2008 Special issue on translational research [Nobel laureate Sydney] Brenner is one of many scientists challenging the idea that translational research is just about carrying results from bench to bedside, arguing that the importance of reversing that polarity has been overlooked. “I’m advocating it go the other way,” Brenner said. Bedside to bench means that clinical trials and patients’ unexpected responses are valuable human experiments, and failed trials can stimulate new hypotheses that may help refine the experiment in its next iteration. RMIT University
NEXT STEPS • Consolidate and expand guidance on measurement • Add guidance on evaluating distribution of costs and benefits, not just average effect • Incorporate participatory approaches as an option for each task • Address implications of simple, complicated, complex aspects • Add guidance on supporting knowledge uptake – transfer and translation • Address the attribution problem adequately RMIT University
ATTRIBUTION • Address acknowledged limited applicability of experimental and quasi-experimental designs by including details of other approaches – eg contribution analysis, Multiple Lines of Evidence, General Elimination Methodology, Qualitative Comparative Method • Correct erroneneous statements about certainty provided by RCTs RMIT University
NEXT STEPS • Consolidate and expand guidance on measurement • Add guidance on evaluating distribution of costs and benefits, not just average effect • Incorporate participatory approaches as an option for each task • Address implications of simple, complicated, complex aspects • Add guidance on supporting knowledge uptake – transfer and translation • Address the attribution problem adequately • Edit for accessibility by intended users RMIT University
NEXT STEPS • Consolidate and expand guidance on measurement • Add guidance on evaluating distribution of costs and benefits, not just average effect • Incorporate participatory approaches as an option for each task • Address implications of simple, complicated, complex aspects • Add guidance on supporting knowledge uptake – transfer and translation • Address the attribution problem adequately • Edit for accessibility by intended users RMIT University