Monitoring and Evaluation of Implementing National ICT Policies for the ICB4PAC Project

1. Monitoring and Evaluation of Implementing National ICT Policies for the ICB4PAC Project Honolulu, Hawaii 18-20 July, 2011 Day 1 Session 4: Process & Framework (Structure) Norman H. Okamura, Ph.D., Faculty Specialist Christina Higa, Associate Director Telecommunications and Information Policy Group Social Science Research Institute University of Hawaii at Manoa

2. Understanding Key Components of Policy Monitoring and Evaluation Process of M&E Planning

3. Steps in Getting Started • Before you Begin • Establish Point-of-View • Whose project is it? • Define overall goals and objectives, context, key players and select overall M&E Approach • Develop clear M&E goals and objectives • Goal - High-level statements of that provide the overall context for M&E (often longer-term and less tangible) • Objective – Concrete statements of what M&E project is trying to achieve (often shorter-term and precise) Source: InfoDev, WHO, World Bank

4. Steps in Getting Started 3. Context • Understand influences of national and local policies and strategies, political and administrative structures that affect implementation • Baseline data – any information that can be gathered prior to start of M&E, reports, studies, proposals, plans • Risks? (e.g., cooperation of key players; difficult to collect data) Source: InfoDev, WHO, World Bank

5. Steps in Getting Started 4. Key Players • Stakeholders • Policy Makers, national/local authorities, community associations; • Understand interest, concerns and intentions of M&E • Implementers • Program Manager and Staff • M&E personnel ideally brought in early in the project • Appropriate skills for M&E or concerns about credibility • Beneficiaries • Who suppose to benefit from the project • Long term beneficiaries Source: InfoDev, WHO, World Bank

6. Steps in Getting Started 5.Approaches to carrying out M&E • Most challenging – how to integrate M&E in planning and implementation • Defining the Framework Source: InfoDev, WHO, World Bank

7. Understanding Key Components of Policy Monitoring and Evaluation Framework (Structure) of M&E Plan

8. What will be the breadth, depth & approach? Different ways of looking at the same policy, program or project…

9. Point-of-View • Pasted from <http://www.pacplan.com/db4/00374/pacplan.com/_uimages/byperiod.jpg>

10. Point-of-View • Pasted from <http://www.pacplan.com/db4/00374/pacplan.com/_uimages/byperiod.jpg>

11. Point-of-View • Pasted from <http://www.pacplan.com/db4/00374/pacplan.com/_uimages/byperiod.jpg>

12. Point-of-View • Pasted from <http://www.pacplan.com/db4/00374/pacplan.com/_uimages/byperiod.jpg>

13. Point-of-View is Relative Cause & Effect • Minister – Program Level • Implementation Team – Project Level • Cause & Effect Stays the same: the point of view alters DO = Development Objectives Source: The World Bank The LogframeHandbook http://gametlibrary.worldbank.org/FILES/440_Logical%20Framework%20Handbook%20-%20World%20Bank.pdf

14. Different M&E Frameworks & Tools

15. Basic Definitions Logframe The Logical Frame is a tool to communicate the essential elements of a project clearly, and succinctly through the project cycle. Used to develop the overall design of a project, to improve implementation monitoring, strengthen periodic project evaluation “Cause & Effect” Model of project interventions to create desired impacts for beneficiaries Many Types of Frameworks One of many tools used for evaluation and monitoring Source: The World Bank The LogFrame Handbook http://gametlibrary.worldbank.org/FILES/440_Logical%20Framework%20Handbook%20-%20World%20Bank.pdf

17. Different Types of Frameworks SOURCE: LemaluNeleLeilua

18. Benefits • Participatory • Develop collaboratively to engage views of intended beneficiaries, key stakeholders – ownership and commitment, implementation readiness of the project team • Conflict Resolution Model • Defines relationships among providers, and users, of results • “Dialog Matrix” – provides structure and focused approach to what can be an emotionally charged negotiation process • About results, benefit and impact outcomes; useful conflict resolution for determining political outcomes. • Political – setting objectives defines how scarce resources will be used, who will benefit and who will not. Source: The World Bank The LogFrame Handbook

19. Benefits • Contract Law: Logframe incorporates three essential concepts from contract law to clarify understanding and agreements among the key stakeholders: • The meeting of the minds (Objective) • Project Deliverables (Outputs) • Force Majeure (Assumptions) Source: The World Bank The LogFrame Handbook

20. Advantages & Limitations

21. Discussion Operationalizing a Model NICTP M&E Framework

22. Discussion on M&E Framework Education for All – Goal 2: Ensuring that by 2015 all children, particularly girls, children in difficult circumstances and those belonging to ethnic minorities have access to and complete free and compulsory primary education of good quality SOURCE: LemaluNeleLeilua

23. ICB4PAC Model National ICT Policy (5) GOALS • Achieve Accessible and Affordable Communications for All • Strengthen ICT Human Resources and Increase Human Resource Development Opportunities through ICT • Improve Economic Growth and Sustainable Development through ICT • Utilize ICT for Good Governance • Create an Enabling ICT Environment through Policy Reform and Improvements in Legal Frameworks.

24. Context of M&E in NICTP From ICB4PAC Applying NICTP Model

25. Objectives for Goal 1 GOAL 1: Achieve Accessible and Affordable Communications for All Policy Statement: All citizens will have equitable access to affordable and secure ICT. The Government will play a leading role in building a networked society where organizations and individuals have equitable access to ICT-enabled resources. The objectives for this goal are: Objective 1 – Establish mechanisms for ensuring non-discriminatory access to ICT regardless of level of income, education, age, rural or urban, gender and people with special needs Objective 2 – Develop mechanisms for increasing access to ICT by maximizing resources through shared use of facilities, subsidized ICT and decreasing the cost of ICT equipment and services for rural, underserved and public service sectors Objective 3 – Develop FSM National Broadband Super Highway

26. Discussion on Model NICTP M&E Framework GOAL 1: Achieve Accessible and Affordable Communications for All

27. Discussion Process & Framework Take Away Points: Key Steps to Get Started – very similar process as project planning and policy development; buy-in essential; systematic and transparent Logframes – one of many tools for E&M ICB4PAC will be developing a model E&M logframe based on model NICT Policy, however meant as an example and to develop capacity to developing strong key performance indicators. Logframes are to be flexible and fit to meet respective NICTP