The Evolution of the Connecticut Kindergarten Entrance Inventory

1. The Evolution of the Connecticut Kindergarten Entrance Inventory Peter Behuniak University of Connecticut

2. AERA Presentation • Understanding Students’ Skills at Kindergarten Entry: Findings from Connecticut • Jessica Goldstein, Ph.D., Melissa Eastwood, M.A., & Peter Behuniak, Ph.D. • Presentation at the Annual Conference of the American Educational Research Association, April 2012, Vancouver, B.C.

3. The presentation • Connecticut’s Kindergarten Entrance Inventory (KEI) • Validity research • Predictive studies of the KEI • Quantitative study of structure of teacher ratings • Lessons for the future

4. A mandated measure The 2007 Legislation required that:“(h) Within available appropriations, the Commissioner of Education shall, not later than October 1, 2007, develop and implement a state-wide developmentally appropriate kindergarten assessment tool that measures a child’s preparedness for kindergarten, but shall not be used as a measurement tool for program accountability pursuant to section 10-16s, as amended by the act.”

5. From mandate to policy LEGISLATIVE MANDATE CSDE POLICY Developmentally appropriate kindergarten assessment tool that measures a child’s preparedness for kindergarten A statewide snapshot of the skills and behaviors students demonstrate, based on teachers’ observations, at the beginning of the kindergarten year

6. Structure of the KEI • Census measure • Administered annually in October • Ratings assigned on 6 domains • Domains are defined by 3-5 indicators each

7. D1: Language skills • Participate in conversations • Retell information from a story read to him/her • Follow simple 2-step verbal directions • Speak using sentences of at least 5 words • Communicate feelings and needs • Listen attentively to a speaker

8. D2: Literacy skills • Hold a book and turn pages from the front to the back • Understand that print conveys meaning • Explore books independently • Recognize printed letters, especially in their name and familiar printed words • Match/connect letters and sounds • Identify some initial sounds • Demonstrate emergent writing

9. D3: Numeracy skills • Count to 10 • Demonstrate one-to-one correspondence while counting (e.g., touches objects as he/she counts) • Measure objects using a variety of everyday items • Identify simple shapes such as circles, squares, rectangles, and triangles • Identify patterns • Sort and group objects by size, shape, function (use), or other attributes • Understand sequence of events (e.g., before, after, yesterday, today, or tomorrow)

10. D4: Physical/motor skills • Run, jump, or balance • Kick or throw a ball, climb stairs or dance • Write or draw using writing instruments (e.g., markers, chalk, pencils, etc.) • Perform tasks, such as completing puzzles, stringing beads, or cutting with scissors

11. D5: Creative/aesthetic skills • Draw, paint, sculpt, or build to represent experiences • Participate in pretend play • Enjoy or participate in musical experiences (e.g., singing, clapping, drumming, or dancing)

12. D6: Personal/social skills • Engage in self-selected activities • Interact with peers to play or work cooperatively • Use words to express own feelings or to identify conflicts • Seek peer or adult help to resolve a conflict • Follow classroom routines

13. Rating scale

14. Rating scale

15. Rating scale

16. What do the data look like?2007 KEI Ratings

17. Classifications of validity evidence AERA, APA, NCME Standards for Educational & Psychological Testing (1999)

18. Validity evidence Based on test content

19. Validity evidence based on test content • Indicators were developed from • Connecticut Preschool Curriculum Framework • Connecticut Preschool Assessment Framework • Connecticut Curriculum Standards for Language Arts • Connecticut Curriculum Standards for Mathematics • Indicators were reviewed by • Preschool and kindergarten teachers • Representation from urban and suburban districts, special education, and educators of English language learners

20. Validity evidence Based on relationships to other variables

21. Validity evidence based on relationships to other variables • Are ratings on the KEI in kindergarten associated with performance on the state’s summative assessment in third grade? • Fall 2007 Kindergarten Entrance Inventory data • Spring 2010 Grade 3 Connecticut Mastery Test • 2007 KEI Ratings / 2010 CMT Data Study • Matched sample of students statewide (n= 29845)

22. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

23. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

24. 2007 KEI Ratings by 2010 Grade 3 CMT Reading Proficiency

25. Validity evidence based on relationships to other variables • Are ratings on the KEI at the start of kindergarten associated kindergarten retention? • Fall 2008 Kindergarten Entrance Inventory data (n = 40,713) • Fall 2009 dichotomous retention variable 4% of 2008 kindergarten students were retained in 2009 • The type of student who is the most likely to be retained for a second year of kindergarten is • Young • Male • Eligible for free or reduced lunch • Has KEI Ratings of “1” on Language, Literacy, Numeracy, and Personal/Social domains

26. Validity evidence Based on internal structure

27. Language skills • Participate in conversations • Communicate feelings and needs • Speak using sentences of at least 5 words • Follow simple 2-step verbal directions • Listen attentively to a speaker • Retell information from a story read to him/her

28. A new structure for teacher ratings

29. Re-conceptualized language domain

30. Language domain in detail

31. Language domain in detail

32. Language domain in detail

33. Validity evidence based on internal structure

34. Validity evidence based on test consequences • Fall 2010 survey study of K teachers (n = 1084) • Teachers believe the KEI is an appropriate representation of students’ skills at the start of the kindergarten year. • Teachers felt the rating scale was appropriate. • Teachers reported that they had appropriate time and training to complete the Inventory. • Teachers were neutral about administrative support to complete the instrument.

35. Looking across the studies

36. What have we learned? • Teachers can form accurate judgments of student knowledge and skills at the start of the kindergarten year. • Teacher judgments at the start of the kindergarten year are related to academic performance in later grades. • Higher ratings at the domain level are related to higher levels of proficiency in each of the domains covered by the CMT. • Future development of the KEI • Ratings of simple, discrete skills are easier than general domains. • More detailed indicators provide more information about students. • KEI focused on specific discrete skills could be rated dichotomously.

37. Conclusion • Questions • Discussion • Follow-up issues or thoughts: PeterBehuniak@cox.net