Basic Education Portfolio Committee State of Readiness – 2013 NSC examinations (47 days to go) 10 September 2013
Presentation Outline • Introduction • Enrolment Statistics • Monitoring Approach • Target Success Indicators • Progress - Examination Cycle • Progress Chart • Conclusion
Introduction • The attainment of examination and assessment credibility is a journey and not a destination. • As a system the DBE has attained a degree of success over the years, with regard to Public Examination administration. • However, the DBE strives to migrate to the next level of effective functionality. • The model of a national examination system is not achieved in totality.
HE World of work
Scope and Size of 2013 NSC Exams Total Candidates: 707 136 Full Time Candidates: 576 490 Part Time Candidates : 130 646 Question Papers: 258 Printed Question Papers: 9.1 million Scripts: 8.7 million Examination Centres: 6699 Invigilators: 65 000 Markers: 35 000 Marking Centres: 118
Monitoring Approach • Broader mandate of building a national examination and assessment system • DBE engages with the PEDs on an ongoing basis through meetings, teleconferences and regular reporting. • Intensive audit of the examination/assessment processes and systems of the Provincial Education Departments (PEDs) conducted. • Audit was based on the shortcomings identified in the previous examinations. • Examination and assessment processes, facilities and resources and management procedure were audited
Monitoring Approach • Audit plan submitted to PEDs in preparation for the audit visit. • Evidence based. • Based on the audit, the areas of weakness identified, improvement plan developed. DBE provides ongoing support and monitoring. • Final State of Readiness visit in September 2013
Target Success Indicators High quality question papers are set and moderated. Examination centre and candidates are accurately registered on the examination computer system. Question papers are accurately printed. Question papers are distributed on time to all schools and candidates and strict security measures adhered to in the distribution process.
Target Success Indicators SBA is completed in accordance with policy prescripts and moderated. All examination and SBA marks are accurately captured. All examination irregularities are appropriately managed. All candidates are accurately and timeously resulted. Effective feedback provided to schools. All eligible candidates receive certificates.
Target Success Indicators e) All candidates including learners with special needs are accommodated in the examination. Examinations are conducted under controlled conditions across all examination centres. Answer scripts accurately marked and moderated. h) All examination marks are accurately captured on the examination computer system.
Registration of Candidates/Centres All candidates have been registered on the Examination Computer System . Two schedules of entries have been sent to all schools to verify accuracy of registration of all candidates. Subject changes, immigrant candidates and special concessions have been appropriately managed. Registration data has been audited by the DBE. Mark sheet printing commenced on 30 August 2013. Letters of admission to the examination will be sent to schools by 13 September 2013.
Registration of Candidates/Centres All enhancements on the examination computer system will be completed by 30 September 2013. A complete dry run on the system will be commence by 30 September 2013. Dry run done in conjunction with Umalusi. i) All independent centres have been evaluated to ensure that they satisfy the criteria for registration. Centres with repeated irregularities have been de-registered. j) In cases where there is doubt about the integrity of the centre, the examination will be administered by the PED at these centres, or will be closely monitored. k) Candidates from the South African Comprehensive Assessment Institute (SACAI) have been registered as private candidates.
Registration of Candidates/Centres PEDs are now able to register learners on the IECS from Grade 10 and transfer candidate data to grade 11 and 12. As from 2014, this will be made compulsory for all PEDs. Improved management of subject changes which would minimise non - resulting of candidates. Concessions granted to candidates with special needs include: Additional time Amanuensis Scribe
Question Papers • All 258 question papers for November 2013 and March 2014 examinations have been set and moderated by the DBE to ensure a national standard • Question papers have been approved by Umalusi, edited, quality assured and handed over to PEDS for printing. • Adaptation of the question papers for blind, partially sighted and deaf candidates is complete. • Brailing of the adapted papers for the blind is in progress.
Question Papers • Improvement Initiatives: • Reviewed the examining panels where there was evidence of capacity shortfalls. • Trained examiners and moderators. • Results of intensive post test analysis results shared with examiners and moderators. • Findings from international benchmarking shared with examiners and moderators and incorporated where necessary.
Question Papers • Improvement Initiatives • Pre-writing of selected question papers • Close monitoring of the setting and moderation process • Improved editing and translation of question papers, with the inclusion of an additional tier of quality assurance
Question Papers • Preparations for CAPs 2014 • Exemplars for Grade 11 were developed in selected subjects and distributed. • Examiners and moderators for Grade 12 (2014) appointed and trained. • Examination guidelines and Exemplars Grade 12 (2014) currently being developed . To be released to Provinces by 30 October 2013.
Printing, Packing and Distribution Six of the PEDs have excellent in-house printing facilities. The remaining two PEDs utilise the services of GPW, SITA, and the remaining PED outsources printing to a reputable service provider. Printing and packing progressing according to plan. Common date for the commencement of printing across all PEDs - 01 August 2013. This allowed more time for the additional quality checks to be completed before printing commences. 38
Printing, Packing and Distribution Storage facilities across all PEDs have been inspected and security has been improved at distribution points. Question papers will be distributed to examination centres on the morning of the examination, except in the Western Cape. In the Northern Cape, only in schools that are far from the districts, will question papers be stored at schools. Western Cape piloted daily distribution of question papers to schools during the SC examination in June 2013, and will extend the pilot in November 2013. 39
Writing of the examination • Examination commences on 28 October 2013 and concludes on 29 November 2013. • Invigilators who supervise the writing of exams are in the process of being trained across all PEDs. • The principal is the Chief Invigilator. • Detailed regulations and guidelines govern the conduct of exams and the managing of irregularities. • To inculcate a sense of commitment to complying with the examination code of conduct, all learners will sign a Pledge on 18 October 2013, at a Pledge Signing Ceremony.
Writing of the examination • All chief invigilators and invigilators are officially appointed for the duration of the examination. Chief Invigilators are all trained by the PED and the district, who in turn train the invigilators. e) The writing of the examinations will be monitored by DBE, PEDs and Umalusi. DBE has appointed 30 independent monitors who will be deployed to the provinces. • Schools with previous irregularities will be closely monitored. • Collaborative forum established with SAPs, Crime Intelligence and Disaster Management services through National Joint Operational and Intelligence Structure (NATJOINTS). A priority committee on Education has been formed.
Collection of Answer Scripts • Stricter control of Answer books introduced across all PEDs. • All scripts to be returned to the district office the same day. c) Scripts to enjoy the same attention and security as the question paper. • 7 of the 9 PEDs (except WCED and NC) will be using bar coded labels in the 2013 NSC examination. This will enable PEDs to scan scripts and ensure better script control. • All scripts must be correctly labeled with centre number and subject and must be sealed at the school level. 44
Collection of Answer Scripts All scripts to be controlled and checked at each stage of the process. DBE has introduced norm times for the return of scripts between the different collection points.
Marking • Marking centres have been established across all PEDs based on the prescripts contained in the Policy. • Markers have been appointed based on the PAM criteria and most PEDs have added learner performance as an additional criteria. • Training of markers is ongoing and specialised training sessions will be organised prior to the marking sessions. • National Marking Guideline discussions will be hosted in Pretoria for all subjects, to ensure standardisation of marking across all PEDs.
Marking e) Internal moderators to be appointed for each subject at each marking centre. f) DBE will appoint external moderators to evaluate the marking at each centre. • Umalusi conducts centralised moderation of marking, while the marking is in progress.
School Based Assessment (SBA) • Moderation of SBA is ongoing at the school, district and provincial level. • DBE conducted • Audit of provincial SBA moderation systems • Focused moderation of assessment tasks in selected districts across all PEDS, in July 2013. • Second national moderation will be conducted in October 2013 and will evaluate the assessment tasks and the learner evidence. d) Provincial moderation to be completed by 16 October 2013. e) All SBA marks will be captured by 15 November 2013.