1 / 10

Implementation Challenges

This presentation details the real challenges faced during educational interventions in Gambia, Niger, and Senegal. We will categorize issues such as attrition, partial compliance, and selection bias, and highlight how funding discrepancies and environmental factors impacted outcomes. Specific cases illustrate how schools struggled with resource allocation and timing issues. Additionally, we will discuss the importance of data accuracy and timely monitoring to avoid misleading conclusions, emphasizing the necessity for high standards in achieving valid results.

trang
Télécharger la présentation

Implementation Challenges

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Implementation Challenges Accra, 10-14 May

  2. Introduction • We will go through real challenges encountered in Gambia, Niger, Senegal; • We will present situations experienced and try to classify them into attrition, partial compliance, selection bias, etc; • Then we will propose possible solutions.

  3. Gambia • Schools in the treatment group did not receive funding for certain reasons; • Teachers of schools in the treatment group were reassigned to some schools in the control group and vice versa.

  4. Niger • Some schools in the control group received books; • Difficulties of access due to heavy rains and schools closed earlier than expected. The characteristics of the two groups are identical in spite of problems.

  5. Senegal • Schools still closed when running the survey (1 month after academic year start). Security and geographic impediments prevent from reaching schools. Targeted grades not present in a few schools; • 2 schools out 211 moved from control group to the treatment one, receiving treatment (textbooks from a donor); • No school (among 11 recipients) in the treatment group of a region had received funding.

  6. Other threats to internal validity (1) • Take pre-cautions prior to occurrence of threats; • Other threats of internal validity: • the quality of data collected; • delays in giving treatment to beneficiaries; • time lag between conducting baseline and follow-up; • rigid outcomes that do not change as a result of the intervention; • treatment given before baseline; • etc.

  7. Other threats to internal validity (2) • Even if evaluation is well designed, monitoring well done, we may end up with misguided conclusions with wrong data, thus misleading decision makers; • Always recall : Garbage In  Garbage Out.

  8. Other threats to internal validity (3) • Serious problems in the case of Senegal: almost 3 checks out of 5 were wrong; • Need to start over the data entry which took 10 weeks.

  9. Conclusion (1) • Given the costs of the evaluation, should avoid any second best solutions; the best remedy is prevention; • Monitor the roll-out carefully – demand high standards of compliance with the original design (small details make a difference) ; • Make adjustments immediately as needed.

  10. THANKS YOU

More Related