Indicators for Program Quality

1. Indicators for Program Quality The Ethiopian Great Race P-shift Launch Workshop April 30, 2008

2. Measuring Program Quality Three areas of focus: • Alignment to CI Programming Principles in our work. • Other priority strategies, such as Advocacy, and Learning and Knowledge Management. • Adherence to technical and project management standards.

3. Key Definitions Program Initiative • A set of coherent activities with a final goal and one or more programmatic objectives, and which has specific resources (human, financial, etc.) available to achieve the objectives and contribute to the attainment of the goal. • May be project-based or non-project based initiatives

4. Review of Indicators Refer to handout

5. Proposed Process for Baseline • Develop an inventory of all program initiatives • Identify which program initiatives will be assessed • Train 2 to 3 facilitators to guide data gathering and reflection processes with program initiative teams • Facilitators apply data gathering tool with program initiative teams • Digitize and process data • Data analysis and AOPs

6. Identify Program Initiatives to Assess • Generate an inventory of all program initiatives currently being implemented • Identify which program initiatives will be assessed (all or representative sample) • Identify program initiative managers and location of teams for each selected program initiative

7. Training Identify and train 2 to 3 facilitators to guide data gathering and reflection process with program initiative teams • Initial testing of tools • Learn by doing • Troubleshooting support • Resources to be perfected over time • Glossary of terms • Tips for facilitating

8. Data gathering and reflection • To assess the extent to which a program initiative incorporates our principles and strategic priorities • To provide guidance to staff on how to better incorporate these principles and priorities into their program initiatives • Leads to immediate improvements to quality of assessed program initiatives

9. Processing of data Digitization and processing of data • Need to identify who will be digitizing data • First year, simple technology for storing and processing data like Excel is sufficient • In future years, more robust solutions will need to be developed • OPM Unit and PIKL can provide support

10. Analyses and action planning • Baseline results reviewed by SLT to identify initial insights and implications for FY09 priorities • Creation of spaces for staff beyond SLT to analyze baseline results (determine where we are doing well and what the areas of improvement are) • Identify for FY09 AOP • Setting targets for indicator for FY 08

11. Glimpse of the future • Learning to set targets • Inserted into existing business process • Collected yearly

12. Questions • In the future, it is recommended that COs assess program quality of all program initiatives under implementation. However, for the baseline, you may decide if you want to assess all program initiatives or just a representative sample. • If you choose a representative sample, what criteria will you use to identify the sample of program initiatives? • What changes would you make to the overall proposed process? • What timeline do you propose for the process if it must be completed by June 30? (establish a timeline with key steps, dates and leads)