1 / 24

Project Tracking and Evaluation Training Module in Rehabilitation Engineering Research Center

This module covers basic concepts and terms in program evaluation, defining effectiveness indicators, tracking methods, and using results for project monitoring. Learn about merit, worth, efficiency, formative and summative evaluation, outcomes, and impacts.

gage-gaines
Télécharger la présentation

Project Tracking and Evaluation Training Module in Rehabilitation Engineering Research Center

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. REHABILITATION ENGINEERING RESEARCH CENTER ON TECHNOLOGY TRANSFER (T2 RERC)TRAINING MODULES ONTECHNOLOGY TRANSFER MODULE 8:PROJECT TRACKING AND EVALUATION

  2. Objective of the Module: Participants will: • explain basic concepts and terms used in program evaluation/research; • define indicators of effectiveness and efficiency for a project of their interest • suggest methods to track the indicators; • identify how the results would be used for project monitoring and evaluation

  3. BASIC CONCEPTSAND TERMS • Research and Evaluation • Merit and Worth • Management Orientation: Evaluation for Development • Effectiveness and Efficiency • Formative and Summative Evaluation • Outcome and Impact

  4. Merit refers to intrinsic quality of person/ product/ system its potential, or promise to be “valued” in its broader context. Ex: Program inputs (resources, design, theory); processes (operations) and outcomes indicate its merit Worth refers to extrinsic value of person/ product/ system its actual “value” in the broader context Ex: program effects/ impacts on internal and external environments indicate its worth. Merit and Worth

  5. Fig 2. Evaluation and the Planning Cycle Context Evaluation Cycle ← ↓ ← ← ← ← ← ← ← Evaluation ← ← ← ← ← ↓ ↑ ß ↓ ↑ ↓ Planning Cycle ↑ ↓ What needs ↑ ↓ to be done? ↑ ↓ ← ← [ Defining ← ← ↑ ↓ ↓ objective] ↑ ↑ ↓ ↑ Þ Product Evaluation Are we there yet? How to do it? Ü Recycle output or [Defining Input disseminate? resources ] Evaluation ↓ ↓ What is the ↑ ↑ ↓ ↓ optimal path ↑ ↑ ↓ → → to get to → → ↑ ↓ goal? ↑ ↓ [process ↑ ↓ improvement ↑ ↓ ] ↑ ↑ Ý ↓ ↑ ↓ ↑↑ → → → → → → → Process → → → → → → → → Evalu ation

  6. INPUT ---- P ROCESS ---- OUTPUT à à ↑ ↓ ← ← ← ← ← ← ← FEEDBACK Effective: gets outcome at the desired quality/quantity level Efficient: Maximizes effectiveness, minimizes cost Efficiency =Output/ Input

  7. FORMATIVE Assesses quality of outcome during the process, while outcome is taking shape Provides basis for improving/maintaining program actions SUMMATIVE Assesses quality of outcome at the end of process when outcome is in final stage Provides basis for establishing program effectiveness & efficiency; [accountability] Formative vs.Summative Evaluation

  8. Outcomes direct outputs or immediate effects assess program’s performance- its effectiveness and efficiency; an indicator of merit Impacts long term effects; benefits to staff, participants, other stakeholders and community at large assess program’s validity/relevance; indicator of worth Outcomes and Impacts

  9. Framing program evaluation: three basic questions • Is the program effective? - has it achieved its goals? • Is it efficient? - did it optimize its methods, resources to achieve the goals? • Is it valid? - are its goals relevant to the context? Is it valued by its stakeholders and beneficiaries?

  10. In Response: what to assess • Effective? --- Outcome quality; outcome quantity (for duration of program) • Efficient? -- Cost per outcome; Time per outcome • Valid? Worth it? -- internal and external impacts; long term effects on/ benefits to stakeholders and others involved NOTE: outcome,cost/time [merit indicators] - assessed through tracking program performance. Impact [worth indicator]: - assessed through tracking effects beyond program period

  11. Use of Information • Monitoring project Performance • Improve intermediary outcomes [quality vs. timelines] • Improve process • re-distribute personnel • review protocols/timelines • Describing performance level -[effectiveness and efficiency]

  12. Related Issues Questions, Comments, Suggestions

  13. Workshop Session Two For your project, identify, or discuss applicability of: • Goals, Protocols, Action Plan (or similar framework) • Expected Outcomes - final [and intermediary, if applicable] • Outcome Tracking: (a) process and (b) use- improving outcomes (formative eval.) and finding effectiveness (summative eval.) • Tracking resource utilization (time/cost …): (a) process and (b) use for process improvement and finding efficiency (summative eval.) • Instrument and database alternatives

More Related