190 likes | 315 Vues
This workshop at the NLTAPA Conference in Boise, ID, focused on evaluating the effectiveness of training programs using Donald Kirkpatrick's four-level model. The evaluation aimed to assess reactions, learning, behavior, and results from training sessions. Participants learned how to gather feedback on training effectiveness through quizzes, skills enhancements on the job, and measurable financial savings, including avoidance of equipment costs and potential lawsuits. This comprehensive evaluation process aids in continuously improving training programs and outcomes.
E N D
Workshop EvaluationWorth the Effort! NLTAPA Conference Boise, ID
Evaluation Overview • Purpose: To determine the effectiveness of a training program.
Evaluation Overview • Four-level model developed by Donald Kirkpatrick (1998). • Reaction • Learning • Behavior • Results
Evaluation Overview (continued) • Each successive evaluation level is built on information provided by the lower level.
Level 1 • Level 2 • Level 3 • Level 4 • Reaction – Learning – Behavior – Results –
Reaction (Level 1) What they thought and felt about the training.
Level 1 • Courses expanded, or condensed • Instructors adjusted • Courses removed from the program pending further review
Learning – Level 2 Pre and Post Quiz • Developed to evaluate the instruction and content of our training programs (NOT the student) • Consists of 6 questions • Note your answers on the back of the evaluation sheet
Quiz Example Question • Denying physical access to someone because of their impairment is: • Sometimes necessary • Discrimination • Permitted by law in certain circumstances • Unimportant compared to making roads safe for cars
Learning • Course content modified • Quiz questions refined
Behavior - Level 3 • Enhanced skills and knowledge identified on the job • Newer process • 6 month evaluation
Cost savings of approximately $5,000 related to remediation of current signage Results – Level 4 • $1,500 of savings in equipment expenditures • $30,000 of expenses avoided that might have been incurred if gas line had to be relocated after completion • Lawsuits avoided
Questions ... LTAP – Local Technical Assistance Program Pennsylvania Department of Transportation Bureau of Planning and Research 400 North Street, 6th Floor Harrisburg, PA 17120 • E-mail: LTAP@state.pa.us • Web Site: www.ltap.state.pa.us