70 likes | 173 Vues
Chapter 12. Designing and Conducting Summative Evaluations. Background. Summative Evaluation : a process of collecting data and information in order to make decisions about the acquisition or continued use of some instruction(339)
E N D
Background • Summative Evaluation : a process of collecting data and information in order to make decisions about the acquisition or continued use of some instruction(339) • External or third-party evaluators were often hired to conduct summative evaluations(340) • Did it solve the problem? VS Which is better? (340)
Two phases of summative evaluation • Expert judgment :Relationship between the instruction of interest and needs of the organization(341) • Field trial of the instruction
Concepts • Expert judgment phase • Congruence analysis : • Congruence between Organization's needs, the characteristics of their target learners, and the needs and characteristics the materials were designed to address.(342) • Congruence between the resources the organization has available for purchasing and implementing instructional materials and the costs of obtaining and installing candidate materials.(342)
Concepts • Content analysis • Ask content experts to judge the accuracy and completeness of the materials for the organization's stated goals.(343) • Design analysis • Evaluate the adequacy of the components of the instructional strategy included in the candidate materials(343)
Concepts • Utility and feasibility analysis(344) • Availability of a learner guide or syllabus and an instructor's manual • Current user analysis(344) • Additional information about the candidate materials from organizations that are experienced in using them
Concepts • Field trial phase • Types • Outcomes analysis • Management analysis • Phases • Planning for the evaluation • Preparing for the implementation • Implementing instruction and collecting data • Summarizing and analyzing data • Reporting results