70 likes | 174 Vues
This review analyzes DFATD’s Country Program Evaluation (CPE) approach, reflecting on nearly four years of evaluations across 20 focus countries. It underscores the need for a balanced methodology that prioritizes learning alongside accountability, while retaining essential rating scales. The review suggests modifications, including a more in-depth analysis of policy coherence and program relevance, simplified evaluation criteria, and improved mechanisms for efficiency and equity assessments. Ultimately, a stronger emphasis on user engagement and timely evaluations will enhance the utility of findings for programs.
E N D
Why do Country Program Evaluations? • Policy requirement – achieving 100% coverage • Unit of accountability – 20 countries of focus • Paris principles – non investment issues • An integrating narrative • History
Why do the review? How? • After 4 years and nearly 20 CPEs – time to reflect • Does the standard methodology serves us well? • Rating scales • Project samples • Numerous criteria • What is the audience? Are users satisfied? • International literature, analysis of past CPEs, interviews with senior executives, program managers, Evaluation Committee, representatives of bilateral development agencies, and external consultants.
Three options • Option 1: Status quo – strong on accountability (external audience) • Option 2: More learning and user focus • Option 3: Totally decentralised – let programs take the lead • Overwhelming preference – Option 2
The Review suggests: Revised Focus for CPEs • Better balance between learning and accountability, but retain rating scales • More focus on depth than breadth of analysis • More analysis of policy coherence across delivery channels • More thorough analysis of Relevance and Rationale (doing the right things?) • More emphasis on program than projects
The Review suggests: Modifications to Design & Methodology • Greater flexibility in evaluation design and products • Use of a smaller number of evaluation criteria and simplified rating system • VfM – improved measures for Efficiency, Economy and Equity • Increased use of contribution analysis • Targeted coverage of delivery channels • Improved usefulness of recommendations
The Review suggests: • Renewed emphasis on neutrality and engagement • Clarity of roles between DFATD and consultants • Improved availability of supporting documents/ data for data collection and analysis • More timely evaluations to increase their usefulness to programs