70 likes | 204 Vues
This document outlines evaluation strategies utilized by NPower to assess the effectiveness and impact of their technology assistance programs on nonprofit organizations. It details client satisfaction, knowledge transfer, and opportunities for service improvement. Additionally, it presents common evaluation questions aimed at measuring mission-driven impacts, expansions, and operational efficiency. Recommended techniques include client surveys, retrospective inquiries, and benchmarking analysis. This serves to guide NPower and similar organizations in maximizing their technology capacity and improving service delivery.
E N D
Evaluating Our Impact Jaime Greene, NPower Emily Bancroft, NPower Simon Moloney, NPower NY
Sample Evaluation Questions – NPower Seattle Evaluation • Who uses, and does not use, NPower’s services? • Are NPower’s clients and members satisfied with the services they receive? • Does NPower transfer knowledge to clients and increase their operating capacity? • What opportunities exist for improving NPower’s services?
Common Consulting Evaluation Questions for Mission-Impact • We are able to assist more people or groups. • We have added new programs or services. • We have expanded the geographic reach of our organization. • The quality of our work has improved. • We are better able to communicate with one another and with outside stakeholders. • We are better able to access/share information. • We are better able to analyze and report data to stakeholders and funders. • We are able to do more work with fewer resources. • We are better able to manage our technology systems. • We have eliminated or reduced technology barriers which interfere with our work.
Long-Term Outcomes Measurement Some techniques we’ve tried: • Surveying past clients to learn about long-term impacts and behaviors • Asking “retrospective” questions as well as “projecting” questions • Looking for changes over time
Recent Findings Blueprint Research & Development Report • Focus most outcomes evaluations on client IT and operation outcomes • Share learnings and tools across the sector • Develop a common set of evaluation tools and strategies for the field • Pursue “improvement-oriented” evaluation
More recent findings Evaluation Research Design for a 3-Year Evaluation of Technology Capacity Building Efforts in the Nonprofit Sector Recommendation • NTAP Evaluation & Outcomes Survey • Develop Model Tools • Conduct a Benchmark Analysis Goals • To analyze best practices • Create readiness indicators • Assess the impact of technology assistance on mission achievement and organizational efficiency • Build evaluation capacity of NTAPs
Additional Resources • W.K. Kellogg Foundation Evaluation Toolkit www.wkkf.org/Programming/Overview.aspx?CID=281 • Blueprint Research & Design – From Improving IT Infrastructures to Achieving Something Good: Outcomes of Nonprofit Technology Assistance Providers www.blueprintrd.com/text/ntap_outcomes.pdf • NPower’s Evaluation Toolkitwww.npower.org/tools/directory/eval/index1.htm • Innovation Network’s Workstation 2.0 www.innonet.org/tools