70 likes | 205 Vues
Summative evaluation is crucial for making informed decisions regarding instructional materials and their effectiveness. This process involves collecting data to assess the acquisition or continued use of instructional resources. Typically conducted by external evaluators, summative evaluations have two main phases: expert judgment and field trials. Key analyses, including congruence, content, and utility analyses, ensure that materials align with organizational needs and learner characteristics. The evaluation process encompasses planning, implementation, data collection, and result reporting to improve instructional decisions.
E N D
Background • Summative Evaluation : a process of collecting data and information in order to make decisions about the acquisition or continued use of some instruction(339) • External or third-party evaluators were often hired to conduct summative evaluations(340) • Did it solve the problem? VS Which is better? (340)
Two phases of summative evaluation • Expert judgment :Relationship between the instruction of interest and needs of the organization(341) • Field trial of the instruction
Concepts • Expert judgment phase • Congruence analysis : • Congruence between Organization's needs, the characteristics of their target learners, and the needs and characteristics the materials were designed to address.(342) • Congruence between the resources the organization has available for purchasing and implementing instructional materials and the costs of obtaining and installing candidate materials.(342)
Concepts • Content analysis • Ask content experts to judge the accuracy and completeness of the materials for the organization's stated goals.(343) • Design analysis • Evaluate the adequacy of the components of the instructional strategy included in the candidate materials(343)
Concepts • Utility and feasibility analysis(344) • Availability of a learner guide or syllabus and an instructor's manual • Current user analysis(344) • Additional information about the candidate materials from organizations that are experienced in using them
Concepts • Field trial phase • Types • Outcomes analysis • Management analysis • Phases • Planning for the evaluation • Preparing for the implementation • Implementing instruction and collecting data • Summarizing and analyzing data • Reporting results