130 likes | 255 Vues
This paper discusses the implementation of the eTest solution in integrating both large and small-scale assessments in Serbian educational institutions. Acknowledging the underdeveloped internet infrastructure and limited computer availability, the authors present the context of an e-assessment project. They highlight pilot testing experiences, the evolution of technology from Moodle to a new system, and the surprising preferences of students towards e-testing. Key challenges include untrained teachers and the need for high-quality test preparation and training.
E N D
eTest Solution: Software for Integrating Large- and Small-scaleAssessment 18th July 2012 @ Lisbon Srdjan Verbić1, Srdjan Božović2, Saša Veličković2 1Institute for Education Quality and Evaluation, Belgrade 2MFC Mikrokomerc, Belgrade
still undeveloped Internet infrastructure • just adequatecomputer classrooms • MS Windows only • available free software • lack of experience • curious students • unmotivated and untrained teachers Context of e-assessment project
Trial testing (or pilot-testing) • the same conditions as for final test • more-less the same questions • smaller sample (usually volunteers) • (very) low-stakes • looking for items’ characteristics Trial-testing meeting point of assessment professionals and teachers
Moodletesting machine, 2007 • Moodle large-scale on-line test, 2009 Prehistory of the project
put Ttest instead of Quiz • adjust Moodle distribution • distribute Moodle installation to schools • encourage teachers to use it • ask them to download test • :) • collect data Large-scale e-assessment 2007(the evil plan)
Moodle is not so good solution for on-line tests, after all. • memory leaking, again • unreliable Internet connections • slow update of the awkward database • … Never-ending series of problems
Microsoft technology • XML based interoperability (like IMS QTI) • Separate system components • On- and off-line testing • Efficient use of multimedia New system 2011
2808 schools (95% of all schools in SRB) • 30,000 working places 2 Multipoint Servers and 16 workstations per clssrm http://digitalnaskola.rs/ Digital Schools Unfortunately, broadband connection is not included!
eTest Player • eTest School Portal • eTest Management Portal • eTest Question Editor http://mfc.rs/ • SQL Server as database • IIS as Web server • ASP.NET as Web application platform • Silverlight as a browser plug-in that for hosting eTest Player eTest Solution
Students prefer e-testing mode… • …and don’t have problem to communicate with computers. • “collective behavior” • Teachers agree that <30% of colleagues would be able to conduct e-testing. • Main obstacle: untrained teachers • Main challenge: to prepare enough high-quality tests ready for download Questionnaires’ feedback
Teachers’ training • Installing software in all digital classrooms • More training • Providing high-quality tests Further steps