1 / 52

Dr MS Rakometsi

Dr MS Rakometsi. State of Readiness Report 2018 National Senior Certificate Examinations PORTFOLIO COMMITTEE ON BASIC EDUCATION 9 October 2018. Presentation Outline. 1. Umalusi mandate and regulatory framework 2. Framework for Quality Assurance of Assessment

bplace
Télécharger la présentation

Dr MS Rakometsi

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dr MS Rakometsi State of Readiness Report 2018National Senior Certificate ExaminationsPORTFOLIO COMMITTEE ON BASIC EDUCATION 9 October 2018

  2. Presentation Outline 1. Umalusi mandate and regulatory framework 2. Framework for Quality Assurance of Assessment 3. Reconceptualised State of Readiness approach 4. Findings on State of Readiness to conduct, administer and manage the 2018 National Senior Certificate Examinations 5. Conclusion 2

  3. Umalusi mandate and regulatory framework • According to the National Qualification Framework (NQF) Act No. 67 of 2008, Umalusi must: • Develop and implement policy and criteria for assessment for the qualifications on its sub-framework; • with regards to quality assurance within its sub-framework, do the following: • develop and implement policy for quality assurance; • ensure the integrity and credibility of quality assurance; • ensure that quality assurance as is necessary for the sub-framework is undertaken; • Section17A of the GENFETQA Act • (3) The Council must, perform the external moderation of assessment of all assessment bodies and education institutions • (4) The Council may adjust raw marks during the standardization process 3

  4. Framework for Quality Assurance of Assessment • Quality assurance of assessment is conducted to ensure that assessment leading to the award of certificates in schools, adult education centres and technical and vocational education and training colleges is of the required standard. This is in order to ensure that the certificates issued by Umalusi are credible. • This is achieved through: • Moderation of examination question papers, Practical Assessment Tasks (PAT) and Common Assessment Tasks in the case of Life Orientation • Monitoring and moderation of School Based Assessment (SBA) • Monitoring the state of readiness to conduct, administer, and manage examinations • Monitoring of the conduct, administration and management of assessment and examination processes • Monitoring and moderation of marking • Management of concessions and examination irregularities • Standardisation of assessment outcomes • Certification 4

  5. Reconceptualised SOR Previously, the State of readiness was conducted as a once-off event, than a process. • 2017 Umalusi conducted an independent SOR and audited the PEDs. • 2018 Umalusi re-conceptualized the approach to the evaluation of the State of Readiness of the assessment bodiesand adopted a risk management based approach for the conduct of SOR Phase 1: Requirements A. Assessment Body Annual Plans i) Submission of improvement plans and progress reports on improvement of directives issued at the conclusion of the previous examination cycles; ii) Submission of annual management plans. B. Desktop evaluation i) Submission of completed self-evaluation instrument ii) Quarterly submission of progress reports to cover activities undertaken in that quarter. 5

  6. ReconceptualisedSOR …. Phase 2:Risk analysis and Feedback Umalusi used submitted self-evaluation reports to assess the level of preparedness of the assessment bodies. This phase was used to analyse information gathered and identify the risks or gaps that might impact on the delivery of a credible examination. The identified gaps or potential risks identified informed the follow-up verification audits which Umalusi undertook. 6

  7. ReconceptualisedSOR …. Phase 3: Summative evaluation This process is used to evaluate the systems, and related evidence as outlined in the self-evaluation report and/or any other reports received. Verification audit instruments are administered during the on-site verification visits, and the assessment bodies are informed ofthe identified risks and are required to address them before the examinations commence. 7

  8. Progress Report • ReconceptualisedSOR …. 8

  9. Findings on State of Readiness to conduct, administer and manage the 2018 National Senior Certificate examinations 9

  10. Monitoring the State of Readiness Focus Areas 10

  11. Monitoring the State of Readiness Focus Areas 11

  12. Monitoring the State of Readiness Focus Areas 12

  13. Monitoring the State of Readiness Focus Areas 13

  14. Monitoring the State of Readiness Focus Areas 14

  15. Monitoring the State of Readiness Focus Areas 15

  16. Monitoring the State of Readiness Focus Areas 16

  17. Monitoring the State of Readiness Focus Areas 17

  18. Monitoring the State of Readiness Focus Areas 18

  19. Monitoring the State of Readiness Focus Areas 19

  20. Monitoring the State of Readiness Focus Areas 20

  21. Monitoring the State of Readiness Focus Areas 21

  22. Monitoring the State of Readiness Focus Areas 22

  23. Monitoring the State of Readiness Focus Areas 23

  24. Monitoring the State of Readiness Focus Areas 24

  25. Monitoring the State of Readiness Focus Areas 25

  26. Monitoring the State of Readiness Focus Areas 26

  27. Monitoring the State of Readiness Focus Areas 27

  28. Monitoring the State of Readiness Focus Areas 28

  29. Monitoring the State of Readiness Focus Areas 29

  30. Monitoring the State of Readiness Focus Areas 30

  31. Monitoring the State of Readiness Focus Areas 31

  32. Monitoring the State of Readiness Focus Areas 32

  33. Monitoring the State of Readiness Focus Areas 33

  34. Monitoring the State of Readiness Focus Areas 34

  35. Monitoring the State of Readiness Focus Areas 35

  36. Monitoring the State of Readiness Focus Areas 36

  37. Monitoring the State of Readiness Focus Areas 37

  38. Monitoring the State of Readiness Focus Areas 38

  39. Monitoring the State of Readiness Focus Areas 39

  40. Monitoring the State of Readiness Focus Areas 40

  41. Monitoring the State of Readiness Focus Areas 41

  42. Monitoring the State of Readiness Focus Areas 42

  43. Monitoring the State of Readiness Focus Areas 43

  44. Monitoring the State of Readiness Focus Areas 44

  45. SOR for the conduct and administration of SASL HL Examinations Scope: • Umalusi staff and monitors were deployed on 15 and 17 August 2018 to monitor the writing of SASL HL preparatory examinations at all the five provinces writing the SASL HL: Eastern Cape; Free State; Gauteng; KwaZulu Natal and Western Cape. • The monitoring was observed at the following schools: - Sizwile School for the Deaf in Gauteng - Kwathintwa and Fulton Schools for the Deaf in KwaZulu Natal - Efata and St. Thomas Schools for the Deaf in Eastern Cape - Dominican School for the Deaf in Western Cape - Thiboloha and Bartimea Schools for the Deaf in Free State 45

  46. SOR for the conduct and administration of SASL HL Examinations Moderation of SASL HL Question Papers • The moderation of the November 2018 NSC examination question papers is still in progress • For the preparatory examinations all three question papers were approved at second moderation with minor changes • The moderation included moderating and approving the: • English (written) version of the question papers • Signed version of the question papers • To avoid to and fro that would delay the approval of the question papers the translation to sign language was done in the presence of the external moderators 46

  47. SOR for the conduct and administration of SASL HL Examinations Moderation of School Based Assessment: • Umalusi moderated school-based-assessment for 35 out of 58 SASL HL learners. Findings • Some DVDs with the learners assessments could not open for moderation • First Additional Language rubrics and not SASL rubrics were used to assess /mark learners in one of the schools • There was no evidence of internal moderation of the tasks. • In the rest of the schools valid and appropriate methods of assessment were used. • The DBE moderated the tasks of all the learners. 47

  48. SOR for the conduct and administration of SASL HL Examinations Monitoring the writing phase Umalusi monitored 8 out 10 centres offering the SASL HL. The DBE conducted National preliminary examinations as a dry run of the coming November 2018 examinations Examination centres visited complied with the requirements; Findings • Most of the centres monitored adhered to regulations and instructions for examinations as provided by DBE; • External monitoring by all stakeholders was evident. • Training of invigilators was not conducted by PED by the time the preparatory examination was administered at Efata (EC) and Fulton (KZN). • No supply of CDs by the PED or district and examination centre had to provide for themselves. This was evident at Bartimea in Free State, and St. Thomas in Eastern Cape; • Bags for packaging of examination answer material (e.g. CDs) were not supplied and the centre had to make its own arrangements. This was evidenced in Fulton in KZN, • The seen poetry essay question was not accompanied by the extract of a seen poem at Sizwile School for the Deaf (Gauteng). As a result, candidates had to answer questions without the extract. 48

  49. SOR for the conduct and administration of SASL HL Examinations Marking Guideline Discussion and Verification of Marking Umalusi participated in the standardisation of the marking guidelines for Paper 1 and Paper 2 and also approved the rubric for marking Paper 3. Findings • During the marking process, senior markers could pick up mistakes and thus rectify them on the spot • The variance of mark allocation was very low indicating that the standardisation meeting was very effective • The norm time for marking and verification is longer than other Home Languages as markers/moderators have to consider expressions in addition to the signing. 49

  50. Conclusion • Umalusi verification of the state of readiness of all the assessment bodies was concluded on 4 October 2018. • Assessment bodies are furnished with letters communicating identified risks to enable them to address the concerns before the commencement of the November 2018 NSC examinations. • Based on the report on the SOR of the PEDs Umalusi declares the DBE and PEDs ready to conduct the 2018 NSC examinations, taking into account the issues that need to be addressed prior to commencement of the examinations. • Umalusi is in the process of appointing monitors who are conversant with the sign language. • The SASL HL task team where Umalusi is represented is attending to the following: • Applications for concession for writing • Norm time for marking • Umalusi will hold a media briefing on the state of readiness of the Assessment bodies to conduct the November 2018 NSC examinations on 12 October 2018. 50

More Related