Two Examples of Program Planning, Monitoring and Evaluation

1. Two Examples of Program Planning, Monitoring and Evaluation Laili Irani

2. Example 1: Evaluate a Family Planning Program • Objective: • To evaluate the impact of a family planning program in a rural village in West Africa • Main goal: • To increase contraceptive knowledge, fertility preferences and contraceptive use

3. Q.1) What is the problem and why does it exist? • Study recent DHS for evidence on rural area of interest • Results show: low contraceptive prevalence, knowledge and attitudes See Toolkit for examples of population based surveys • Review data from formative research • Results shows: low prevalence of contraceptive use

4. Q.1) What is the problem and why does it exist? (cont.) • Conduct a needs assessment • Survey village leaders and community members • In this example, results show: • Greater need for modern contraceptive methods • Easier access to wider range of methods See Toolkit on how to conduct a needs assessment

5. Q. 2) What interventions can work? • Design an intervention • A community outreach program in which health workers visit homes and address the contraceptive needs of families • Plan a pilot project • Carry out the project in one neighborhood of the village • Expand to the entire village

6. Q. 3) What are we doing? • Develop a logic model • Inputs  outcomes See Toolkit for description and examples of logic models • Create an M&E plan • Include a timeline of program activities See Toolkit for sample outline & program examples • Produce a Performance Monitoring Plan (PMP) • Share proposed activities with stakeholders and donors • Identify indicators to be collected and analyzed See Toolkit for compendium of FP indictors • Engage stakeholders in every step of the program

7. Q. 3) What are we doing? (cont.) • Monitor the various components of the program • Inputs • Finances, staff, training materials, contraceptives and transportation • Processes • Health workers trained to work in the community • Health workers visit community periodically and distribute contraceptives • Program officers meet with village leaders often • Ensure quality of program is maintained

8. Q. 4) Are we implementing the program as planned? • Output monitoring • Number of first visits made • Number of follow-up visits • Types and numbers of contraceptives distributed • Outcome monitoring • Change in percentage of contraceptive users over time See Toolkit for indicator guides for FP programs

9. Q. 5) Are the interventions working / making a difference? • Outcome evaluation See Toolkit for examples of evaluation designs and resources

10. Q. 6) Is the program sustainable and scalable? • Sustainability • Ensure local government continues the community outreach program with the aid of health workers • Build the community’s capacity to encourage voluntary contraceptive use among families • Scalability • Expand the program to other villages and regions within the country See Toolkit for means to measure sustainability and scalability

11. Next Steps • Share findings with all the stakeholders, including • Village leaders and community members • Local government and health department • Funding agency • Higher levels of government and health leadership • Disseminate findings widely including through mass media, research literature and the internet

12. Example 2: Evaluate a Malaria Prevention Program • Objective: • To evaluate the impact of a malaria prevention program in a district in East Africa • Main goal: • To ensure all pregnant women and children <14 years are sleeping under insecticide treated nets (ITNs) in all the villages of a district in East Africa

13. Q.1) What is the problem & why does it exist? • Study recent population based surveys • DHS, Multiple Indicator Cluster Survey • Results show: High malaria prevalence and low ITNs use • Conduct a needs assessment • Visit selected homes; interview selected community members • In this example, results show: Use of ITNs is low due to lack of knowledge and cost See Toolkit for various data sources and assessment designs

14. Q. 2) What interventions can work? • Review other programs • Collaborate with more experienced programs • Plan a pilot project • Design an intervention • Use handheld GPS devices to create clusters • Visit all homes, identify pregnant women and children <14 years and provide them with vouchers for ITN • Program staff visit to ensure ITN installed correctly and teach villagers how to reapply insecticide See Toolkit for resources, i.e., Roll Back Malaria website

15. Q. 3) What are we doing? • Develop a logic model • Inputs  outcomes • Develop a PMP • Engage stakeholders in every step of the program • Community members and village leaders • Local government and district officials • Experts in the field • Donors and policy makers See Toolkit for a logic model and draft checklist for developing PMP plan for malaria program

16. Q. 4) Are we implementing the program as planned? • Monitor the various components of the program • Ensure quality of program is maintained See Toolkit for: • Indicator guides for malaria programs • References on how to conduct routine monitoring • Impact evaluation references

17. Q. 5) Are the interventions working / making a difference? • Outcome evaluation See Toolkit for alternative study designs

18. Q. 6) Is the program sustainable and scalable? • Sustainability • Ensure local government continues the voucher program • Empower community leaders to encourage community to access ITNs and to use them effectively • Scalability • Expand the program to other districts and regions within the country See Toolkit for descriptions and examples of how programs can be sustainable and scalable

19. Thank you!