Download
1 / 10
100 likes | 222 Vues
This guide provides insights into the monitoring and evaluation (M&E) of policy influence, focusing on the significance of policy objectives and theories of change (TOC). It outlines various data collection tools and indicators necessary for assessing outputs, outcomes, and policy impacts. By engaging with stakeholders, such as policymakers and practitioners, it emphasizes the importance of workshops, media dissemination, and participatory methods. The guide also shares lessons learned and best practices for effective M&E, ensuring that organizations can effectively measure their policy objectives and adapt their strategies accordingly.
E N D
Elements of a monitoring frame.. • Policy objective and theory of change • Indicators • Data collection tools
Starting with policy objective and TOC.. • To identify key moments Access to Secretary, Ministry of Highways ? Workshops with RDA officers Change in resettlement practices ? Workshops with ADB, JICA Public pressure to change Media dissemination
Thinking about indicators… • Output level • Meetings, presentations…. • Outcome level • Uptake: citations, media clippings…. • Changes in Knowledge, Attitudes, Behaviors: changes in interest, participation in events… • Policy Impact level • Changes in policy / practice: changes in policy documents, legislation, replication….
Choosing data collection tools.. Sources of data • The IE team • The users - policy makers / practitioners • Academics, other researchers • Media • ….. • Possible tools • AIIM • After Action Reviews • User Surveys • Bellwether Method • Outcome Mapping • Most significant change • ……
After action reviews • Useful for evaluating quality of outputs • Guiding Questions • What was supposed to happen? • What actually happened? • Why were there differences? • What worked? What didn’t? Why? • What would you do differently next time? Turn conscious learning into tacit knowledge..
User surveys • Useful for monitoring uptake - to get perceptions and reactions of a range of users • Can be in the form of • Large scale questionnaires • Small focus group discussions Useful for monitoring uptake of websites, policy briefs
Bellwether Method • Bellwethers Defined ‘Influentials’ in the public and private sectors whose positions require that they are politically informed and that they track a broad range of policy issues ► Policymakers ► Administrators ► Media ► Advocates ► Funders ► Business ► Associations Useful for monitoring if policy messages have ‘broken through’
Group Exercise • Question: What indicators can you suggest to monitor whether the IE’s policy objective(s) are being met? • To the plenary, please present the following • Proposed indicators together with rationale, for the selected project • any “lessons” from the exercise that the other projects in the group can take forward into their own projects
How to monitor policy influence: in summary • Many activities, many contexts, much still to be learnt on how to monitor • But some lessons are available: • Select few key Indicators • Use fit-for-purpose, easy to use data collection tools • Where to begin? Policy Objective and Theory of Change If you want to read more… A guide to monitoring and evaluating policy influence by Harry Jones Making a difference: M&E of policy research by IngieHovland
