180 likes | 188 Vues
This text discusses the use of social network analysis (SNA) as an evaluation tool in international development aid programmes. It highlights the benefits and challenges of using SNA, compares it to traditional evaluation methods, and suggests strategies for improving its effectiveness.
E N D
Social Network Analysis as an Evaluation Tool: Experiences with International Development Aid Programmes UK Social Network Conference
Evaluation as Research • Within significant time constraints • More opportunistic use of data • Supported by monitoring systems • Evaluation processes need to be transparent and reasonably participatory • Results expected to have practical use • Making activities accountable • Improving performance UK Social Network Conference
Two types of comparisons • Evaluations compare results to plans • Plans can be seen as theories of change • Evaluation as theory testing, on the run • “Logical Framework” tool is used to represent plans as theories • In the form of a chain of “if …and… then…” logic statements built into project designs UK Social Network Conference
The second comparison • The use of linear logic models • As represented by use of the Logical Framework, and related tools • and • The use of network models • As constructed with the use of SNA tools UK Social Network Conference
Logical Framework Narrative description Indicators (OVI) Source of Information Important Assumptions Goal Purpose Outputs Activities UK Social Network Conference
The problems • Stage distinctions are difficult to define / explain • Details of causation between levels are opaque • Logical Framework does not allow representation of • Parallel-but-different processes • Interactions between these • Feedback processes • Descriptions of expected changes are often complex and abstract. UK Social Network Conference
The alternative: Network models • About people and their relationships • A simple idea, no need for explanation • Relatively easy to verify • No difficulty showing • Multiple pathways of influence • Within interactions between them • Feedback loops • Within relationships • Via loops involving others UK Social Network Conference
The challenges • Complexity of software, esp. for newbies • Abundance of network measures • Scarcity of participatory approaches to the use of SNA • Network thinking is a “paradigm change” compared to linear causal models • Therefore a need to “keep it simple” UK Social Network Conference
Five provisional lessons... • Pooling ego networks into a single network can widen actors’ choices about who to work with. • Two-mode networks (e.g. actors x issues) can generate more implications for action • Matrices are more open to participatory construction than network diagrams UK Social Network Conference
Five provisional lessons... • Matrices can be used as modular building blocks, producing theories-of-change that have: • scalability • flexibility • Use of SNA tools can help uncover different planning perspectives UK Social Network Conference
1. Ghanaian NGOs Blue nodes = funded NGOs Yellow nodes = alliances that two or more NGOs reported working with Red nodes = alliances that only one NGO reported working with Line thickness = frequency of reference to that working relationship UK Social Network Conference
2. Eight NGOs in Ghana Blue nodes = Governance issues (in PRSP) Round nodes = NGOs Same color nodes = groups of members with common interests two issues Sharing interests in 2+ topics may be more likely to prompt contact UK Social Network Conference
3. Matrices in workshops UK Social Network Conference
4. Scalability & Flexibility UK Social Network Conference
4. Scalability & Flexibility UK Social Network Conference
5.1 Different perspectives M4P project, Hanoi Nodes = workshops Links = movement of participants from one workshop to another Thicker link = more participants moving Node colour = type of workshop (by topic ) UK Social Network Conference
5.2 Different perspectives MSC Training Workshop, Accra Nodes = workshop participants Links = intend to talk to each other after workshop, but had not worked together before. (=Old minus new links) Thick lines = reciprocated intentions UK Social Network Conference
5.3 Different perspectives • Participatory planning involving multiple independent stakeholders, with multiple objectives • Who will be working with who, on what objectives • Actor x Objective matrices (cell values = priority) • How the achievement of each objective will contribute to the others • Objectives x Objectives matrix (cell values = causality) • Check alignment of both networks • Are the objectives connected by expected causation supported by actors having shared interests in them? • If not, re-iterate first step in process UK Social Network Conference