Challenges in Measuring Governance Impact The Experience of ENCISS Prepared and presented by

1. Challenges in Measuring Governance Impact The Experience of ENCISS Prepared and presented by PATRICK E. ROBIN – Main Author Ahmed Ag Aboubacrine and Andrew Lavali – Co Authors Semiramis Intercontinental Hotel - Cairo, Egypt

2. Overview • This short paper has been divided into three parts. • Country Context • Review of relevant literarture • Challenges in Measuring Governance Impact: Case of ENCISS Semiramis Intercontinental Hotel - Cairo, Egypt

3. Country Context Country Background • Gained independence in 1961 • Huge deposits of minerals • A vibrant agricultural sector • Referred to as Athens of West Africa • Post-independence history marred with frustrating absurdity – undermined this great potential for national development Semiramis Intercontinental Hotel - Cairo, Egypt

4. Country Context Some Statistics • Population stands at approx. 5m • 57% live on less than 1 US/day • 26% live in extreme poverty • Over 70% of women and 50% of men are illiterate • Average life expectancy is 42yrs • A qtr of children die before they reach age 5 & mothers have a one in six chance of dying at child birth Semiramis Intercontinental Hotel - Cairo, Egypt

5. Country Context • Political Arena • After attainment of sovereignty – enjoyed brief multi-party democracy. The decline started. • Coup d’etat after 1967 general elections • One party political dictatorship interspersed with military interregnum • One party rule characterized by neglect of social needs, economic mismanagement and bad governance • Resulting malaise is the rebel uprising in 1991 and the initial popularity of the 1992 coup d’etat Semiramis Intercontinental Hotel - Cairo, Egypt

6. Country Context • Challenge for Sierra Leone • Is to move towards sustainable peace and development. Thanks to development partners for a substantial investment in SL. • For the above to happen better democratic governance on the part of SL leadership must previal, thereby encouraging dialogue, promoting voice and inclusion Semiramis Intercontinental Hotel - Cairo, Egypt

7. ENCISS EXPERIENCE 1. Making attribution to the change in governance In evaluating ENCISS’ effectiveness to improving the governance landscape in Sierra Leone, it faces the problem of attribution —that is of being able to show a clear causal linkage between ENCISS activities and changes in governance. MajorStakeholders – PA and CS. Semiramis Intercontinental Hotel - Cairo, Egypt

8. ENCISS EXPERIENCE 1. Making attribution to the change in governance Cont’d E.g. 1. The achievement of outcome indicators like, “effective institutions (state and civil society) of good governance in place promoting democratic decision making” and “effective pro-poor resource allocation at the national and local levels” lie outside ENCISS’ powers and needs political will Semiramis Intercontinental Hotel - Cairo, Egypt

9. ENCISS EXPERIENCE 1. Making attribution to the change in governance Cont’d E.g. 2. Indicators relating to behavioural shifts/changes from citizens i.e. “60% of citizens in targeted districts know where and how to access their rights to education, health and food” and “level and quality of response by chiefs (in 20 chiefdoms) and five (5) local council to concerns of poor and marginalised people (youths and women’s groups) in 8 targeted districts” . Could be achieved through multi-scale intervention involving many stakeholders and not ENCISS alone Semiramis Intercontinental Hotel - Cairo, Egypt

10. ENCISS EXPERIENCE 2. Indicator Definition – Qut&Qul ENCISS faces the challenge of adequately specifying their meaning or providing concrete operational definition of these indicators so they do not lend themselves to easy interpretation of success. Semiramis Intercontinental Hotel - Cairo, Egypt

11. ENCISS EXPERIENCE 3. How can we measure and evaluate ENCISS’ impact with regards to its effects on the two overarching reform processes: PRS and Decentralization. Linking governance to development outcomes is complex Semiramis Intercontinental Hotel - Cairo, Egypt

12. ENCISS EXPERIENCE 4. Weak Capacity of CSOs and limited space for engagement. In SL, the capacity of CSOs are very weak. The concept of social accountability is also new. The Challenge faced by ENCISS: They cannot collectively articulate their feedback on service delivery. Also challenged in using participatory monitoring tools i.e. CRC & CSC Semiramis Intercontinental Hotel - Cairo, Egypt

13. ENCISS EXPERIENCE 5. Ethnic and political polarization – this was clearly manifested in the last general elections conducted in September 2007. This coupled with the reluctance of citizens to give honest and critical feedback on government performance. Semiramis Intercontinental Hotel - Cairo, Egypt

14. ENCISS EXPERIENCE 6. Another challenge is measuring governance in a context where many are bordered about “Bread and Butter” issue. Poverty is widespread in Sierra Leone. Semiramis Intercontinental Hotel - Cairo, Egypt

15. THANK YOU ALL FOR LISTENING Semiramis Intercontinental Hotel - Cairo, Egypt