Anne Marie Karlberg Director of Institutional Research and Assessment (360) 383-3302

1. Assessment 101 PNAIRP Conference Thursday October 1, 2009 Anne Marie Karlberg Director of Institutional Research and Assessment (360) 383-3302 amkarlberg@whatcom.ctc.edu http://faculty.whatcom.ctc.edu/InstResearch/index.htm

2. Outcomes Define assessment. Identify the components of a successful assessment program. Articulate three types of assessment information or data and provide examples of each. Identify three levels of assessment. Identify two phases in creating an effective outcomes process.

3. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

4. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

5. What is assessment? “ The systematic collection of information about student learning…to inform decisions about how to improve learning.” (Walvoord, 2004, p. 2)

6. Purposes • improvement (formative) • improvement (formative) • accountability (summative)

7. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

8. Educational Evaluation Model: CIPP By Daniel Stufflebeam

9. Using CIPP to Create an Effective Assessment Program

10. Using CIPP to Create an Effective Assessment Program: Context

11. Context: What do we know about the context of our colleges? At Whatcom Community College… 8.3% of our employees 18.9% of our degree and certificate seeking students 16.0% percent of Whatcom County residents …indicate they are of color.

12. Using CIPP to Create an Effective Assessment Program: Inputs

13. Resources • human resources  • financial support  • technical support  • administrator and faculty support

14. Plans and Strategies • Whatcom will… • revise its mission statement and familiarize faculty / staff with mission • implement the strategic plan • implement the assessment plan

15. Using CIPP to Create an Effective Assessment Program: Processes

16. Implementation • Link assessment program to mission statement • redirect resources towards priorities • increase responsiveness to community needs • measure the extent to which we are successful • Provide opportunities for meaningful, collaborative college-wide conversations, by structuring assessment • in an ongoing, simplified, participatory way • relevant and meaningful

17. Embed assessment throughout college • strategic planning • curriculum review • budgeting • program review • the college catalogue • college publications • the website • employee professional development and performance • student government • program planning

18. Learning and teaching practices • Apply meaningful, relevant and contextualized experiences for students, such as… • using self-reflection • applying concepts to a relevant context • teaching material to peers • discovering connections between subjects

19. Using CIPP to Create an Effective Assessment Program: Products

20. Assessment data • Direct indicators (outcomes): e.g., essays, capstone projects, demonstrations, presentations

21. Assessment data • Direct indicators (outcomes): e.g., essays, capstone projects, demonstrations, presentations • Indirect indicators (perceptions): e.g., surveys, focus groups, interviews

22. Assessment data • Direct indicators (outcomes): e.g., essays, capstone projects, demonstrations, presentations • Indirect indicators (perceptions): e.g., surveys, focus groups, interviews • Institutional data: e.g., retention, graduation, enrollment, transfer trends

23. Assessment levels • College level • Program level • Course level

24. Assessment Products: Examples

25. Assessment Products: Examples

26. Assessment Products: Examples

27. Assessment Products: Examples

28. Using CIPP to Create an Effective Assessment Program

29. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

30. Assessment Products

31. Two phases of an outcomes process

32. (1) Development of an outcomes process

33. (2) Implementation of an outcomes process

34. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

35. Using CIPP to Create an Effective Assessment Program

36. Assessment Products: Examples

37. Assessment Products: Examples

38. Direct indicators: College outcomes plan

39. Direct indicators: College outcomes plan

40. Assessment Products: Examples

41. Indirect indicators: College survey schedule

42. Assessment Products: Examples

43. Institutional data: College-level plan

44. Overview • What is assessment? • Components of an effective assessment program • Phases of an outcomes process • Assessment plan • Website

45. Website • WCC Homepage • “About Whatcom” • “Assessment / Inst Research” • http://www.faculty.whatcom.ctc.edu/InstResearch/

46. Comments and questions?

47. Using CIPP to Create an Effective Assessment Program

48. Assessment Products: Examples Anne Marie Karlberg (Director of Institutional Research and Assessment) (360) 383-3302 amkarlberg@whatcom.ctc.edu http://faculty.whatcom.ctc.edu/InstResearch/index.htm