1 / 20

Item Level Data

Item Level Data. Item Level Data What is it?. A detailed breakdown of performance on each ‘item’ (usually questions or part questions within a script). Item Level Data is available for most subjects (where marks are submitted via EMI or there is electronic script marking ESM).

bowen
Télécharger la présentation

Item Level Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Item Level Data

  2. Item Level DataWhat is it? • A detailed breakdown of performance on each ‘item’ (usually questions or part questions within a script). • Item Level Data is available for most subjects (where marks are submitted via EMI or there is electronic script marking ESM).

  3. Item Level DataWhat is it for? For centres, it can be used to: • Evaluate their own performance against specification norms. • Identify strengths and weaknesses for a candidate cohort and suggest areas of improvement. • Assist individual candidates in improving their own performance.

  4. Item Level DataWhat is it NOT? • Information on grading and boundaries • A reflection of standards for a centre

  5. Access to Item Level Data First you will need to navigate to the WJEC secure website (www.wjecservices.co.uk or from a link on the public website), and then login. Your examination centre number ······· 12345 See your examinations officer for a password. The password is for staff use only and should not be shared with anyone.

  6. Access to Item Level Data A window similar to that below will open (some of the navigation buttons shown here on the left may not be available to you). Mouse click the ‘Walled Garden’ button (top left).

  7. Item Level Data A new window will open. There are two ‘buttons’ that give access to item level data: Choose a series from the ‘drop-down’ menu. • Centre Performance in Context • Item Level Summary (Candidates)

  8. Item Level Data A new window will open. There are two ‘buttons’ that give access to item level data: Choose a series from the ‘drop-down’ menu. Choose the Item Level Summary (Candidates) to analyse data at the CANDIDATE LEVEL • Item Level Summary (Candidates)

  9. Item Level Summary (Candidates) For each unit a candidate has sat, the mark achieved on each item is given.

  10. Item Level Summary (Candidates) You can select a subject from the drop-down menu.

  11. Item Level Summary (Candidates) Click the candidate’s name to compare his/her performance with other candidates in the centre and overall as a report.

  12. Item Level Summary (Candidates) The report shows: • Mark achieved by candidate • Average mark achieved by centre • Average mark achieved for all candidates entered with WJEC (Click the bullets above to highlight the sections)

  13. Centre Performance in Context To see how your centre performed, relative to other centres with WJEC, the Centre Performance in Context should be selected: • Centre Performance in Context

  14. Centre Performance in Context This gives (for each item) the mean, facility factor and attempt %, for all candidates as well as males and females separately. mean facility factor attempt %

  15. Centre Performance in Context - MEAN The mean mark (often called the average) is a measure of the overall performance by the candidates for a particular item. A simple comparison of the mean marks across all items will identify those items that have been well answered. mean 20 Number of students 15 10 5 F D C B A 0 Test scores

  16. Centre Performance in Context - MEAN NOTE: The maximum mark may not be the same for each item and so a direct comparison of the mean score across items is not meaningful. For questions with different maximum marks, the facility factor should be used to compare performance. mean 20 Number of students 15 10 5 F D C B A 0 Test scores

  17. Centre Performance in Context – Facility Factor The facility factor (FF) for an item describes the mean mark as a percentage of the maximum mark and is a measure of the accessibility of the item. mean mark × 100 Facility factor (FF) = max. mark For example, if the mean mark for a question with a maximum mark of ten was six marks, the facility factor would be 60 per cent. (6 divided by 10 multiplied by 100)

  18. Centre Performance in Context – Facility Factor The facility factor (FF) for an item describes the mean mark as a percentage of the maximum mark and is a measure of the accessibility of the item. mean mark × 100 Facility factor (FF) = max. mark A well answered question may have a facility factor of over 80 per cent. For example, a mean mark of 13 marks out of a maximum 15 marks would be a facility factor of 87 per cent. The facility factor allows you to quickly identify the items that candidates either struggled with or excelled at.

  19. Centre Performance in Context – Attempt % This is the percentage of candidates that have attempted a specific question and has two useful applications: • To assess if candidates are ‘leaving out’ those questions they find difficult. • Where candidates have a choice of question the statistics can evidence candidate preference or the teaching policy within centres.

  20. Using the Item Level Data • Take ownership – it’s YOUR data. • Understand what your data is telling you about your centre. • Make decisions or recommendations within your centres based on the data evidence. • Identify the accessible and challenging questions for your centre and address them.

More Related