290 likes | 442 Vues
Program Planning for Impact. Fatima Perkins, MSLIS,MNO IOLUG Spring Program Indiana Wesleyan University North, Indianapolis Friday, May 16, 2014. Welcome and Introductions. Introduce yourself and briefly state what was your favorite library program and why ?
E N D
Program Planning for Impact Fatima Perkins, MSLIS,MNO IOLUG Spring Program Indiana Wesleyan University North, Indianapolis Friday, May 16, 2014
Welcome and Introductions Introduce yourself and briefly state what was your favorite library program and why? What would you like to learn within the next hour? Today – we will consider elements of program planning and evaluation.
What is your program portfolio? • Music • History • Exercise • Writing • GED/ESOL
What is a program/service? • A program is a planned event with goals/objectives and an expected audience. • A service is an on-going planned event with goals/objectives and an expected audience. • Program vs service – used interchangeably
What drives you to creating/Guiding Factors? • Library’s Strategic Plan • Community Assessment • Customer surveys • Demographics/Census Bureau • Other community stakeholders • Grants/donations
Factors to Consider • Program Significance • Budget • Staffing/Partnerships and collaborations • Program Design • Implementation • Evaluation
What should you use to determine impact? • Feedback ( customer, speakers, staff) • Surveys • Complaints • Participation/Attendance • Formal evaluation ( outcome based evaluation)
Why is evaluation important? • Determines goals/objectives have been achieved • Shows intended outcomes have been achieved/program makes a difference • Identifies weaknesses • Demonstrates library engagement/impact • Keeps stakeholders focused/Satisfy funders • Accountability
Outcome Based Evaluation An approach to determine whether goals/outcomes have been achieved. .
What are outcomes? Outcomes are results that benefit people due to a change in skills, knowledge, attitude, behavior, condition, or life status.
Process vs Impact Process evaluation looks at how efficient a program/service is. Whereas Impact evaluation looks at whether a program has made a difference.
What is a logic model? A depiction of a program showing what the program will do and what it is to accomplish. ( University of Wisconsin – Extension, Cooperative Extension, Program Development and Evaluation, 2014)
Primary tool for OBE: Logic Model • Inputs • Activities • Outputs • Outcomes • Initial • Intermediate • Long-term
What are inputs? Inputs are resources needed to have a achieve the outcome. • Staffing • Equipment • Facility • Funding • Consultant
What are Activities? • Activities are tasks that need to occur in order to achieve the outcome. Shows what the program does. • Scheduling • Coordination • Marketing • Purchasing • Recruiting • Meetings
What are outputs? • Outputs are the products of the activities. Generally framed in numbers/percentages. • #/%Participants served • #/%Interviews held • #/%Website hits • #/%Programs held • #/%Volunteers recruited • #/%Items circulated
What are outcomes? Outcomes are results that benefit people due to a change in skills, knowledge, attitude, behavior, condition, or life status.
Criteria for developing an outcome • Customer focused/singular • Measures change • Objective • Specific • Identifies who • Describes customer change that can be related to the program/service
Types of Outcomes(OBE: Outcomes-Based Evaluation-RUSA, Midwinter 2014)
Outcomes versus OutputsIllustrating the difference – Participant exercise Outputs Outcomes Participants know basic English Customers improve access to quality materials Students are aware of community resources Volunteers learn story-time standards 7 workshops 1 million items circulated 75 participants 100 backpacks distributed 283 career sessions 15 volunteers recruited
Categories for Outcomes • Immediate/Initial/Short-term • Intermediate • Long-term/Permanent
Logic Model Exercise • Ready Set Go… • Complete the logic model with your group-three items for each category. • Reconvene • What did you come up with
Library ABC-Reading is Fundamental The library has joined community stakeholders to improve the community’s poor reading scores. They have a year long program for K-3rd grade students – Reading is Fundamental. The library has received a $100,000 grant for the program. The program must include volunteers, workshops, study sessions, creative programming, parent engagement, three community partners etc.
Completed Logic Model • Included in packet
Moving Forward • Choose the outcomes to measure • Select indicators • Collect data • Analyze the data • Create a report • Report findings to stakeholders
Resources • http://www.imls.gov/applicants/obe.shtm • http://www.liveunited.org/outcomes/resources/MPO/ecerpts.cfm • http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf • Workbook: Outcome Measurement of Library Programs(September 2000, Division of Library and Information Services, Florida Department of State) • OBE: Outcomes-Based Evaluation ( RUSA, Midwinter 2014)
Thank you for participating in Program Planning for Impact Fatima Perkins, MSLIS,MNO