160 likes | 283 Vues
This proposal outlines a decoupled architecture for item banking developed by Brendan Tierney and Linn van der Zanden from the Scottish Qualifications Authority. It presents the advantages of an autonomous system, including adaptability to change, ease of upgrading components, and immediate usability of developed parts. The architecture comprises various elements such as item storage, generation, delivery, marking, and result processing. Future exploration areas include defining user roles and workflow processes to enhance this innovative approach to item banking.
E N D
Itembanking Infrastructure: A Proposal for a Decoupled Architecture Brendan Tierney and Linn van der Zanden Scottish Qualifications Authority TENCompetence, Sofia
Overview • Introduction • Autonomous development • Diagram • Elements which make up the architecture • Future areas of exploration
Introduction and Definition • Itembank is considered to be made up of a repository and database • Itembanking system is considered everything up to the point of delivery, and everything from the output of data from the delivery system
Decoupled Architecture: Benefits • Easily adapted to accommodate change in model or workflow • Pieces can be upgraded in line with specifications • Small chunks can be built and used immediately • Sophistication of the system/ community will place additional demands
Decoupled Architecture: Implications • Standards compliance • Additional functionality to support existing processes may not be required at a later stage • Robust testing required: early detection of errors difficult in pieces where there is little user interaction
What does Itembanking entail? • Storage of items • Generation of items • Delivery, Marking and Result Processing • Test Construction • Roles and Workflows
Storage of Items The Itembank: • Repository: storage of QTI files, resources, manifest files • Database: storage of LOM and QTI metadata, search and retrieval functionality • Unpackaging Functionality
Generation of Items • QTI Authoring Tool: outputs QTIv2.0 items • Specialist Authoring Software: i.e. for graphics or other markup languages • Metadata Tagger: attributes data to items according to IEEE LOM standard and extracts QTI metadata • Application Profile Development Software: interface for development of profiles which prefills metadata • Content Packager: packages elements of QTI items according to IMS specification
Test Construction • Glossary Development Software: produces glossary which defines statistics for test construction • Test Construction Software: takes in application profile (metadata) and glossary (statistics) to produce algorithm • Item Analysis Software: runs required analysis from algorithm, identifying items from pool that match the conditions
Delivery, Marking and Result Processing • Delivery Software: imports QTIv2.1 package from itembank, and sends responses to Marking Processing Software • Marking Processing Software: has several elements for different item types i.e. human based, computer based or both • Result Processing Service: aggregates items and implements pass mark or grade boundaries • Master Results Databank: stores candidate interactions with item IDs which are fed out from the Delivery Software
Future areas of Exploration • First attempt at scoping the potential for decoupled architecture • Requirements must be scoped for each element • Roles of users need further defined • Workflow processes need defined • Seeking partners (UK and EU)
Contact Linn van der Zanden Learning Technologist Linn.vanderZanden@sqa.org.uk Brendan Tierney Project Manager Brendan.Tierney@sqa.org.uk