Activities in California’s Accreditation System March 2008

1. Activities in California’s Accreditation SystemMarch 2008 Ensuring Educator Excellence

2. Accreditation Activities • Ongoing Data Gathering & Analysis (Annually) • Biennial Report (Years 1, 3, & 5) • Program Assessment (Year 4) • Site Visit (Year 6) • Follow Up (Year 7)

3. Data Gathering & Analysis • …collects, analyzes, and utilizes data on candidate and program completer performance… • …comprehensive data collection related to candidate qualifications, proficiencies, competence… • …identify patterns and serve as the basis for programmatic and unit decision-making.

4. Biennial Reports • Focus on candidate outcomes • Each program sponsor will submit a report for each approved program that is offered that includes aggregated data, analysis, and program modification information • Two sections of the report: A—for each program (see above) and B—for overall trends and action plan submitted by the ‘Dean’

5. Biennial Reports • Submitted in years 1, 3 and 5 of the cycle • CTC staff will review the reports • 07-08 is the first year, reports due in August, October or December 2008 • All approved credential or certificate programs submit Biennial Reports

6. Program Assessment • Each institution in a cohort will participate in a thorough review of all approved preparation programs during the 4th year of their cohort’s cycle. On average, 106 programs will be reviewed representing approximately 16 institutions annually.

7. Program Assessment • CTC staff will organize and facilitate the Program Assessment which will involve two days of dedicated time—readers meeting together—to complete. • Two trained reviewers will be looking for the links between the Biennial Report data and how it relates to the programs. Are changes made in response to candidate competence? How does the program know it is preparing competent educators?

8. Program Assessment • Reviewers are looking for congruence of standards, input factors, output data and programmatic changes. • Program Assessment is a process--a professional dialogue.

9. Program Assessment Three parts to the Program Assessment Document… • Part I: description of current program and any new/additional information to place program in context. • Part II: current course syllabi and updated faculty vitae

10. Program Assessment • Part III: assessments used to measure candidate competence, including rubrics, training information and calibration activities. • Due date: institutional choice: October or January. October submissions—at least 2 rounds of dialogue. January—at least one.

11. Program Assessment • Preliminary Report of Findings to COA by January of year following submission (example: reports due in either Oct. 07 or Jan. 08—Preliminary Report of Findings to COA, January 2009. • Results of the Assessment will “focus” the site visit.

12. Site Visit • Year 6 of the cycle • The visit focuses on Common Standards (NCATE unit standards), areas of question from Program Assessment and confirmation of the Preliminary Report of Findings. • Team of trained Board of Institutional Reviewers (BIR). The team will range from 3-8 individuals.

13. Accreditation Activities across the Cycle

15. Preparing a Biennial Report2007-08: Green, Orange, Violet 2008-09: Yellow, Indigo, Red 2009-10: Orange, Violet, Blue Sherrye Smith, Cal Baptist • Program Entry • During-the-Program (program student outcomes, critical assignments, CalTPA) • Program Exit (Exit Survey, Master Teacher Evaluation of University Supervisor) • After the Program (First year teaching survey)

16. Reviewing the Biennial Report Cheryl Hickey, CTC • Review Biennial Report for 4 things • Did program submit a BR? • Did it include aggregated candidate data? • Were the data analyzed? • Are program modifications based on analysis of the data?

17. Preparing Program Assessment Documents2007-08: Yellow 2008-09: Orange 2009-10: Red • Keith Walters, Biola • Reflect Reality • Make the process work for your institution • Look for opportunities to secure buy-in • Coordinate with biennial reports • Think about making future revisions

18. Reviewing the Program Assessment Documents • Keith Walters, Biola & Jo Birdsell, CTC • Focus on ‘HOW’ questions • Focus on the key elements in the standards • If programs mirror each other synthesize • Verify that all evidence is included

19. Site Visits 2007-08: Blue—Prior system 2008-09: Green—New Common Standards 2009-10: Yellow—Revised system • The team will use the information from both the Biennial Reports and the Program Assessment in addition to the interviews with employers, graduates, candidates and faculty to make a decision regarding each Common Standard. • CTC staff will attend each review as facilitators.

20. Site Visits • Institutions/Program sponsors will receive a draft site visit report at the end of the site visit. • The visits for 07-08 (Blue cohort) and 08-09 (Green cohort) will be conducted under the current Accreditation Handbook. Blue and Green cohorts—no major changes from prior structure. • Visits with the fully revised system begin in 09-10—Yellow Cohort.

21. Site Visits • The team will use the information from both the Biennial Reports and the Program Assessment in addition to the interviews with employers, graduates, candidates and faculty to make a decision regarding each Common Standard. • CTC staff will attend each review in the role of facilitator. • Institutions/Program sponsors will receive a draft site visit report at the end of the site visit.

22. Post Site Visit After the COA makes the Accreditation Decision-- • Follow-up Report (Year 7) addresses any stipulations, questions or concerns • Program Sponsor continues in cohort with accreditation activities

23. Follow-up: Site Visit Report • Completed and submitted the year after the site visit will address • Stipulations, if any • Any standards less than fully met • Questions or Concerns

24. Resources • CTC Web Pages www.ctc.ca.gov → Program Sponsors → Accreditation • Biennial Reports • Program Assessment • Site Visits