Data and SEN

1. Data and SEN A practical approach Tony Newman

2. Objectives • A brief history lesson • A clear view of what the data is for • How do we build up a picture over time (Formative) • An annual judgement (Summative) • Analysis

3. Overview What is the data for Formative Assessments Summative Assessments Analysis

4. 1970 the Education (Handicapped Children) Act - 400 new schools - educationally sub normal-severe How we got here: a history lesson • Mental deficiency act 1913

5. How we got here: a history lesson • 1944 Education Act – ‘ineducable’ – Junior Training Centres

6. How we got here: a history lesson • 1969 – A man on the moon

7. How we got here: a history lesson • 1970 the Education (Handicapped Children) Act - 400 new schools - educationally sub normal-severe

8. How we got here: a history lesson Assessments Psychometrics (Defecits) Skills Analysis Model Checklists Alan Howarth

9. How we got here: a history lesson • Supplements the National Curriculum up to level 1 in each of the National Curriculum foundation subjects at key stages1, 2 and 3. • Pupils, aged 5-16, with Special Educational Needs who are working below level 1 of the National Curriculum. • Eight level descriptions of increasing difficulty, from P1-P8. • The performance descriptions for P1 to P3 are common across all subjects.

10. How we got here: a history lesson English - Speaking • P6 Pupils initiate and maintain short conversations using their preferred medium of communication. They ask simple questions to obtain information, [for example, ‘Where’s cat ?’]. They can use prepositions, such as ‘in’ or ‘on’, and pronouns, such as ‘my’ or ‘it’, correctly.

11. The P Scales - are we clear what they should be used for? • Schools should have a clear rationale for what the data is for. Why? • Confusion over which pupils they are for • Confusion over the uses of the data • Need to know the target audience • Need to know information we want from the data What is the data for

12. The P Scales - are we clear what they should be used for? Confusion over which pupils • Pupils with Special Educational Needs (P Level Guidance DCSF 2007) They are not appropriate for use with children who do not have a SEN even if they are working below National Curriculum level 1 • But (Ofsted 2010) says the term (SEN)is used ‘too widely’ and leads to low expectations and low achievement. • But progression Guidance says Throughout this guidance we refer to learners with SEN/LDD. In some of our analyses and in much of what we say, we also include learners who have fallen below age-related expectations but who may not have a special educational need or learning difficulty . (DCSF 2009) • Less of a problem in Special Schools (SLD/PMLD)? • In mainstream there may be a grey area – special need/slow learners. • Age 5-16 (DCSF 2007), Not age specific (PIVATS), 2-16 (PACE) What is the data for

13. The P Scales - are we clear what they should be used for? • Confusion over what the data will be used for? • ‘The Department and Ofsted hope to make use of this national information in future so that schools which use the P Scales can make meaningful comparisons about the progress made by pupils working below National Curriculum levels’. (DfES 2005 P 10). • QCA stated that P Scales should not be used ‘as a crude performance indicator’ (QCA 2005 P6). • ‘School and national performance indicators should include the data that is now collected on the progress and outcomes of children and young people working below Level 1 of the National Curriculum.’ (OFSTED 2010 P 14). What is the data for

14. The P Scales - are we clear what they should be used for? • Confusion over what the data will be used for? • There was ‘no agreement about what constituted good progress for pupils with LDD’ which ‘prevented vital analysis of data at all levels’ [School, LA and National]. (Ofsted 2005 P 2). • They go on to say ‘Pupils with even the most severe and complex needs were able to make outstanding progress in all types of settings’. (Ofsted 2005 P3). • The 2010 document states ‘there is little validated information for headteachers to use when challenging the view of pupils’ achievement’. (Ofsted 2010 P64) What is the data for

15. The P Scales - are we clear what they should be used for? What is the data for Statutorywhen reporting attainment for pupils with special educational needs who are working below level 1 of the national curriculum. They are used at the end of key stage 1, key stage 2 and key stage 3 for reporting teacher assessment in English, mathematics and science to QCDA. P scales are also used for reporting teacher assessment to parents

16. The P Scales - are we clear what they should be used for? What is the data for Supporting the Target Setting Process – 2001 Setting Targets for Pupils with SEN – 2004 Progression Guidance – 2009 onwards

17. The P Scales - are we clear what they should be used for? • Data is collected nationally but analysed locally/internally (Progression Guidance) • We need to report to parents (From the guidance so far)We need to • Submit key stage data nationally and set targets • Use annually to track progress • Report to parents • Track individual pupils and set targets • Look at the school as a whole (school improvement) • Look at groups of pupils within the school • Compare the school and individuals with external benchmarks (ideally) That is relatively clear. What is the data for

18. The P Scales - are we clear what they should be used for? • No one (OFSTED, DFE, HMI) has a clear idea about what data should be collected and particularly how it should be analysed • Schools need to be able to tell a coherent well argued story about their pupils progress. • To do this they need to be clear about the purpose of collecting it and the group they are doing it for. What is the data for

19. Overview Statutory obligations Target Group Target audience Purpose What is the data for Formative Assessments Summative Assessments Analysis

20. Assessment using the P Scales Teachers should base such judgements on a review of evidence gathered from everyday teaching and learning(a Formative Record) Professional judgement should be used to decide which P scale description best fits a pupil’s performance.

21. Assessment using the P Scales – A Formative Record • Built up over time • Evidence of Achievement • Show progression through Levels • Allows teacher to know roughly where to aim the Summative Assessment • Allows setting of ‘small step/next step targets (AfL) WEB

22. Formative Record Assessment using the P Scales – A Formative Record

23. Formative Record Assessment using the P Scales – A Formative Record Evidence/Portfolio/Learning Journey • Important for pupils working at early levels who may not have much written work • Useful for moderation • Powerful to report back to parents – more meaningful than ‘P6’ • Consolidates the teachers judgement for the summative assessment

24. Formative Record Assessment using the P Scales – A Formative Record WEB

25. Overview Statutory obligations Target Group Target audience Purpose Statutory obligations Target Group Target audience Purpose What is the data for Small steps record Portfolio of evidence ‘Ballpark’ view for summative AfL Formative Assessments Summative Assessments Analysis

26. Summative Record Assessment using the P Scales – A Summative Record Making a Summative Judgement • ‘Standard’ procedures? • Teacher judgement – ‘best fit’ • Moderation • Whole P Levels (Durham, Government) • Alternative Schemes (PIVATS, B Squared, PACE)

27. Summative Record Assessment using the P Scales – A Summative Record Standard Procedures There are none nationally. Schools need to decide • Date for tests (summer, 2nd half term?). Consistency • System to use (PIVATS, B Squared, PACE). Consistency locally? • Protocol around ‘best fit’ judgements whether whole P scales or alternatives. • At what point do you credit a pupil with a level? Usually everything but there are exceptions eg handwriting • Dilemma of some at one level, some at the next. • Formative records are vital here. • Enter data into…..

28. Summative Record Assessment using the P Scales – A Summative Record Moderation • Cold or hot • Pupil Ranking report • Portfolio of examples – eg PIVATS, Assessing Pupil Performance Using the P Levels (Buck and Davies) or school examples through the Learning Journey • Should not be over complicated

29. Summative Record Assessment using the P Scales – A Summative Record • Moderation Use the Durham Data base to Rank Order the pupils and group them. Note the disparity in age between similar attaining pupils. School/Local/Regional

30. Statutory obligations Target Group Target audience Purpose Statutory obligations Target Group Target audience Purpose Statutory obligations Target Group Target audience Purpose Agree protocols Moderate Enter Data What is the data for Small steps record Portfolio of evidence ‘Ballpark’ view for summative Formative Assessments Summative Assessments Analysis

31. Analysis • School Level • Overall trends • Attainment • Progress • Targets • Pupil Level • Overall trends • Attainment • Progress • Targets

32. Analysis - Whole School Analysis Question – How do the P scores vary over time for the whole school? • Last few years relationship is consistent. • Writing is lowest – national picture • Overall steady increase over time • Drop off since 2008 School Level Picture over time Trends Relationship between aspects Relationship between subjects

33. OFSTED - Attainment • It should not be assumed that standards in a special school are below those expected of pupils of a similar age nationally. For some pupils this may well be the case but for others it may not. This is covered in the supplementary guidance which is included in The evaluation schedule for schools. Inspectors should: • not hold preconceived notions about pupils’ abilities • check on the attainment of pupils on admission to the school and their current attainment level • recognise that in some cases an increase in the number and range of qualifications achieved by pupils may be a reflection of curriculum changes rather than improvements in attainment or progress • describe the attainment of different pupils in the text of the report if there is a significant difference between groups that cannot be fully explained by the grade awarded (or an asterisk if attainment has not been graded). ‘learning and progress judgement alone to determine the judgement for achievement’

34. Analysis – Whole School Analysis Question – How does attainment look for different aspects compared to similar pupils? Attainment Overall Y4? Teaching/pupils Y3?

35. Analysis – Whole School Analysis Question – Does attainment vary for different year groups in the school? Attainment – Whole School These graphs show variations across the Year Groups

36. Analysis Analysis Attainment - Questions • How do we compare overall • Variations in year groups/Key Stages • Variations between aspects • Variations between groups • Cohort targets? School Improvement Plan

37. OFSTED – Special Schools • analyse the outcomes for different groups. While these groups may be small it is still meaningful to look at patterns over time as these can be a good indicator of differences in outcomes • analyse the quality of provision, especially teaching and access to additional opportunities for different groups, and consider the impact this has on outcomes • ask how the school has responded to any changes in its pupil population, such as admitting pupils with more complex needs. While attainment information may show a difference in the levels reached from year to year, if school’s response to these changes has been effective there should not be a reduction in the progress made by pupils or the quality of provision.

38. Analysis – Individual Pupils Analysis Question – What are the patterns of attainment Individual Pupils – Attainment • Look for • Trends • Strengths Weaknesses • Areas for development • Useful to give parents an overview Plateau Rapid improvement

39. Analysis – Individual Pupils Analysis Question – Do pupils attainments show they are correctly placed and following the correct curriculum? Individual Pupils – Attainment MLD? ? RFL National Curriculum PMLD?

40. Analysis – Whole School Analysis Question – Does Progress vary for different groups in the school? Progress • Same questions • Same groups • Do FSM/Ethnicity effect progress of SLD/PMLD/MLD Using Excel we can easily sort the lists by adding an extra column and looking at FSM, ethnicity – Do these effect progress?

41. Analysis – Whole School Analysis Question – How does progress compare with national data? • Progress • We can analyse how each aspect compares with the national sample and with each other • Can also compare years Improvement in writing?

42. Analysis Progression Guidance Good start but • Category of need (Evidence from Ndaji and Tymms + the progression guidance tables). Can we ‘wish away disability’? • Other disabilities (eg SLD +ASD) • Aggregated English Scores (Lit + Comm) – how useful? • 2 levels of progress (MLD/SLD/PMLD) • PMLD (Routes for learning) • The ‘remarkable persistence’ of some children’s difficulties despite skilled teaching has been noted by Friedrickson and Cline (2009 P41). • Danger of low expectations / ‘a child like that’ • Despite that the OFSTED guidance is very clear – use the PG Individual stories Analysis

43. OFSTED - Progress • use RAISEonline and the Progression materials 2010–11 data sets 1 to 3 • evaluate the rigour of the moderation procedures for assessing against P-scales. As a minimum this should be across the school; better practice involves moderation across a group of schools, local authority or region • consider pupils’ ages and starting points, together with the time they have been receiving specialist support or attending the school, to form a view about progress • do not use a pupil’s category of special educational need or disability to make a judgement about the progress made. However inspectors should look to see if pupils with a particular need or disability are performing differently from other pupils in the school (School Level) • maintain high expectations of pupils’ learning during lesson observations • check that individual targets and group targets have sufficient ambition and have taken into consideration the expectations illustrated within the Progression Materials 2010–11 and RAISEonline

44. Raise on line – Stanley School

45. Analysis – Individual Pupils Analysis Question – which pupils are not making progress? Individual Pupils – Annual Progress • Progress • Which pupils are / are not making progress. Those not making progress should trigger an alert

46. Analysis – Individual Pupils Analysis Individual Pupils – What do we do about it • A plan that will include action and targets and an alert if progress wasn’t as expected • Individual targets based on ‘expected progress’ from a national database eg Durham – What is a challenging target? • Assumption they will make the target or we will investigate why • Teaching (methods, specialist approaches) • Curriculum balance/time • Physical barriers • Planning

47. Analysis – Individual Pupils

48. Analysis Telling the story See RAPP