Nederlands science onderwijs in internationaal perspectief: PISA & TIMSS

1. Nederlands science onderwijs in internationaal perspectief: PISA & TIMSS Harrie Eijkelhof

2. Waarom dit onderwerp? • Globalisering: economisch, cultureel, informatie • Internationale vergelijkingen • PISA • TIMSS • Betekenis voor het Nederlandse onderwijs • Maatschappelijke discussie • Aktieplan Beter Presteren • Inspiratiebron voor ons onderwijs • Belang voor de lerarenopleiding • Internationalisering • Leraren krijgen ermee te maken • Persoonlijke betrokkenheid Workshop ECENT

3. Programme for International Student Assessment (PISA) • Created in 1997 by OECD • Aim: to monitor outcomes of educational systems in terms of student achievement • Age: 15 years • Surveys every 3 years since 2000 in reading, mathematical and scientific literacy • 2000 reading, math, science • 2003 reading, math, science • 2006 reading, math, science • 2009 reading, math, science • 2012 reading, math, science • 2015 reading, math, science Workshop ECENT

4. Focus of PISA • Collaborative effort: OECD + non-member partner economies • To measure how well students at age 15 are prepared to meet challenges in future life • Beyond school-based approach: use of knowledge in everyday tasks and challenges • Based on model of lifelong learning • Not only assessing knowledge: also how to apply knowledge in real-life issues Workshop ECENT

5. PISA 2006 Scientific Literacy Framework Workshop ECENT

6. Scientific competencies • Identifying scientific issues • issues • keywords • key features • Explaining phenomena scientifically • applying knowledge • describing, interpreting, predicting • identifying descriptions, explanations, predictions • Using scientific evidence • interpreting evidence • identifying assumptions • reflecting on social implications Workshop ECENT

7. Scientific knowledge Of science: • Physical systems • Living systems • Earth and space systems • Technology systems About science: • Inquiry: origin, purpose, experiments, data, measurement, characteristics • Explanations: types, formation, rules, outcomes Workshop ECENT

8. Scientific contexts Five contexts: • Health • Natural resources • Environment • Hazards • Frontiers of science and technology At three levels: • Personal: self, family, peer groups • Social: community • Global: life across the world Workshop ECENT

9. Draft Contexts for the PISA 2015 science assessment Workshop ECENT

10. Sample PISA-items (released) • Study sample questions • Look at • the question type (open/closed) • cognition/attitude • content characteristics (framework) • difficulty • Give your opinion on the nature and level of the questions Workshop ECENT

11. Organisation Pisa tests in schools • Selection of schools • Schoolcoordinator appointed • Random selection of 35 15year olds per school • Permission from parents • Tests session organized by test administrator • 13 different booklets with sets of questions • 2 hours for knowledge testing of students • 30 minutes for student questionnaire: personal background, learning habits, attitudes, motivation • School questionnaire (headmaster): demographic characteristics, quality of the learning environment Workshop ECENT

12. PISA 2009 – cognitive performance Workshop ECENT

13. Other PISA-results 2006: attitudes about science Workshop ECENT

14. How to explain PISA-results? • Cultural factors • Value of knowledge in society • Value of arguing • Science in the media (TV, journals, newspapers) • Educational factors • Organization of education • Nature of the school curricula • Quality of teaching • Quality of assessment • Investments in education • PISA-factors • Attitude towards PISA-test 15-year olds • Nature of the PISA-questions • Composition of the target group Workshop ECENT

15. PISA-sources • http://www.pisa.oecd.org/ • http://www.pisa.oecd.org/document/3/0,3746,en_32252351_32236130_49553155_1_1_1_1,00.html • http://www.cito.nl/ PISA pages Workshop ECENT

16. Trends in International Mathematics and Science Study • Started in 1995 by IEA (International Association for the Evaluation of Educational Achievement) • Aim: to measure math and science knowledge and skills aligned with curricula in participating countries • Age: grades 4 and 8, end of schoolyear • Surveys every 4 years in many countries: Grade 4 Grade 8 • 1995 26 41 • 1999 -- 38 • 2003 25 46 • 2007 36 48 Workshop ECENT

17. Grade 4  Singapore 587 Chinese Taipei 557 Hong Kong 554 Japan 548 Russian Fed. 546 Latvia 542 England 542 USA 539 Hungary 536 Italy 535 Kazakhstan 533 Germany 528 Australia 527 Slovak 526 Austria 526 Sweden 525 NL 523 Slovenia 518 …… Yemen 197 Grade 8 Singapore 567 Chinese Taipei 561 Japan 554 Korea 553 England 542 Hungary 539 Czech 539 Slovenia 538 Russian Fed. 530 Hong Kong 530 USA 520 Australia 515 Sweden 511 Italy 495 Indonesia 427 ….. Ghana 303 TIMSS Results Science 2007 Workshop ECENT

18. TIMSS-resources • http://timss.bc.edu/# • http://www.utwente.nl/gw/timssenpirls/timss/ TIMSS 1999 Video Study • http://timssvideo.com/videos/Science Workshop ECENT

19. TIMSS video: educators’ judgements of Dutch math lessons • Teacher’s role: not dominating, guiding role, friendly, remains close to the textbook • Students’ role: active, some groups, low expectations, help from classmates or teacher • Content: not demanding, textbook dominates, structured scheme, focus on rules and results, superficial, no development of higher order thinking • Climate: casual between teacher and students, informal, laissez faire, very permissive, relaxed, lack of discipline, high noise level, chaotic Workshop ECENT

20. Toepassingen in de lerarenopleiding • Waarom PISA en TIMSS? • Aard van de studies • Achterliggende raamwerken • Aard van de vragen • Resultaten • Interpreteren van de resultaten • Betekenis voor het Nederlandse onderwijs • TIMSS-videolessen • PISA-landenfilms • Onderzoekspublicaties Workshop ECENT