230 likes | 241 Vues
Performance Indicators Within and Across Community Settings. Reed Early Canadian Evaluation Society Conference 2013 Toronto. Activity 1 - Obstacles to selecting indicators (3-4 min). Close eyes and write name on piece of paper
E N D
Performance Indicators Within and Across Community Settings Reed Early Canadian Evaluation Society Conference 2013 Toronto
Activity 1 - Obstacles to selecting indicators (3-4 min) • Close eyes and write name on piece of paper • Turn it over and write place of birth using non-dominant hand • Swap cards with person next & verbally instruct them to write your age in months without telling them what it actually is • Optional - Provide lengthy written instructions via a Policy and Procedure Manual on how to measure your success on the card
Logic Model Inputs Activities Outputs Outcomes Ultimate Outcomes Performance Indicators
Performance Indicator Proximity Distant Environment Beyond attribution Beyond the sphere of influence Organization Ultimate indicators Program/ServiceEnvironment Immediate performance indicators
Strategic Choice of Indicators Strat-egies Indicators Targets Consultative Choice of Indicators Data Collection Indicators Analysis Best Practice Choice of Indicators Borrow & Adapt Shared and evaluated Indicators Styles of Indicator Selection Management Choice of Indicators Objectives Indicators Goals
Management • Indicators reflect goals and objectives – i.e. related to logic model outcomes • Useful in service/prevention agencies • Often mandated via legislation • This style may be used by senior managers to independently choose the indicators
Strategic • Indicators reflect strategies and targets – i.e. activities, outputs and near outcomes • Useful for quantifiable or tangible products • Often result of accountability initiative • This style may be used by performance team in a larger agency
Consultative • Indicators based on focus group or survey of employees (or clients) • Useful for decentralized, flat organizations • Requires time, effort and original data collection • May be used by smaller agencies practicing more democratic management
Best Practices • Selecting indicators from literature/Internet, from similar leading agencies, and adapted • Useful to any agency with resources to search and research • Requires time, effort, and openness to experimentation • May provide benchmark comparability
Surgical wait time Immunization rate Infant mortality rate Hospital acquired infections Inpatient mortality rate Cost per bed/day Health Indicators
Child Behavior Checklist Youth unemployment rate Teen pregnancy and childbearing School attendance or graduation rate Children in families below poverty line Cost per child in care Social Services Indicators
Sales Sales of new products Value added to raw material consumed Cost savings to industry i.e. reduced training and down time Increased market share % Increased geographic penetration Industry Indicators
Educational Financial Effectiveness ratio Reach Relevance Efficiency ratio Staffing Overhead Continuing Education
Performance Measurement Systems community results based indicators, i.e. Tools For Action Series A resource guide for designing a community indicator project. a report by SPARC BC, April 2008 • Community Objective and Potential Indicators, United Way of Greater Milwaukee, Planning, Allocation & Monitoring Division
Conference Indicators… • Participant satisfaction • Citations to conference • Publications from conference • Networking and outside connections • Sleeper effects • Diffusion of benefits • …others
Criteria for Indicators • Is it: • Authoritative - commonly agreed to be true • Economical – only what’s needed • Ethical • Feasible – possible to measure • Logical – outputs vs. outcomes
Criteria Con’t • Is it: • Manageable - suggest 10 -40 • Measurable – qualitative or quantitative • Reliable - accurate • Specific – at the right level of precision • Visible/accessible like a car dashboard • Timely True and Valid
Take away notes • Performance indicators relate to logic models • Indicator selection requires care, time and conscious thought • Different styles are: • Management, strategic, consultative, best practice • Indicators should be selected and evaluated against criteria