1 / 39

Assessment, Evaluation, Research, and e-Learning

marguerite
Télécharger la présentation

Assessment, Evaluation, Research, and e-Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. 1 Assessment, Evaluation, Research, and e-Learning Tennessee Comprehensive Assessment Program (TCAP) Tennessee Value Added Assessment System (TVAAS) Updates 2008-09

    2. 2 Purposes of Assessment Inform Instruction Diagnose Improve Student Learning Prepare for Future Learning Improve Programs and Schools Provide for Accountability Provide Valid Feedback (Conversations) Balanced assessment should inform instruction. Reporting must assist in that mission. Accountability is a huge issue. Decisions inside classrooms can address a bare minimum i.e. teaching what is tested only. Field tested items on the 09 TCAP will be based on the new standards. Assessment will be aligned to the curriculum. The new vendor will be providing the next 4 test assessments. Balanced assessment should inform instruction. Reporting must assist in that mission. Accountability is a huge issue. Decisions inside classrooms can address a bare minimum i.e. teaching what is tested only. Field tested items on the 09 TCAP will be based on the new standards. Assessment will be aligned to the curriculum. The new vendor will be providing the next 4 test assessments.

    3. 3 What the State provides in reporting: Individual student reporting Report Card aggregated data, some data reported based on USDOE policy decisions Dr. Smith teaching and learning and accountability Dr. Green - Assessment Let state know of specific reporting needs Aggregate Reporting What the State provides in reporting: Individual student reporting Report Card aggregated data, some data reported based on USDOE policy decisions Dr. Smith teaching and learning and accountability Dr. Green - Assessment Let state know of specific reporting needs Aggregate Reporting

    4. 4 Online Reporting access provided to educators, can use any online reporting but must have sign offs on security, info must be confidential, Board Policy must address those who do not follow rules. New Reports (09-10) TurnLeaf will be available through the end of June 09. Data will be submitted to new vendor. TurnLeaf allows for re-roster of classes. Email suggestions/questions related to reporting. ACT Reports Students can choose to take SAT even if district uses ACT and use a voucher for that test. K-2 Stanford 10 new assessment for K-2 (Pearson). Online Reporting access provided to educators, can use any online reporting but must have sign offs on security, info must be confidential, Board Policy must address those who do not follow rules. New Reports (09-10) TurnLeaf will be available through the end of June 09. Data will be submitted to new vendor. TurnLeaf allows for re-roster of classes. Email suggestions/questions related to reporting. ACT Reports Students can choose to take SAT even if district uses ACT and use a voucher for that test. K-2 Stanford 10 new assessment for K-2 (Pearson).

    5. 5 TCAP Applications and Reports New Tech Vendor no longer Business Information Group (BIG) RANDA new vendor handling ordering and online apps for testing.New Tech Vendor no longer Business Information Group (BIG) RANDA new vendor handling ordering and online apps for testing.

    6. 6

    7. 7 1900 miles of paper scanned (each year)? # of students tested in 3-8 (each year) would fill 5773 school buses? # of students tested in 3-8 (each year) would fill stadium over 6 times? # of students tested in high school EOC (each year) would fill the stadium in 2 games? # of entries in TVAAS data base (26 million records) 390 games?1900 miles of paper scanned (each year)? # of students tested in 3-8 (each year) would fill 5773 school buses? # of students tested in 3-8 (each year) would fill stadium over 6 times? # of students tested in high school EOC (each year) would fill the stadium in 2 games? # of entries in TVAAS data base (26 million records) 390 games?

    8. 8 Testing Window determines when your data will be returned to you for purposes of teacher and school online processing such as end-of-year SDDV and Teacher Effect process.Testing Window determines when your data will be returned to you for purposes of teacher and school online processing such as end-of-year SDDV and Teacher Effect process.

    9. 9 Updates: USDOE proposes a requirement of AYP reporting 14 days prior to the start of the school year. In TN that would be July 1, options: -Move testing window to earlier time -Standardized opening of school date Announcement due after Nov. 4 Portfolio testing of 2% - or loose 13% amendment added to SpEd proficiency percentage, will be field test (MAAS) notification coming soon. Modified ELL test in simplified language similar to Braille test. Out-of-level not an option this year, only option 1% portfolio. Field test of MAAS will involve every district and every school, after TCAP. Does not involve high school students this year. The MAAS test, once operational, will be considered on grade level standards and will not count as a non-proficient. Plan to have guidelines for participation in spring field tests by February, ready to implement in spring IEP. RFPs must be done every 5 years. Writing Assessment Measurement Incorporated, human-scored (committees) Gov. has an Assessment Taskforce working toward making assessment more NARP-Like. Gateway & EOC new high school transition policy, Gateway will not go away, but will be different. The students starting in high school next year will not have a graduation requirement based on passing an assessment. Equity issue student in 10 grade required to pass a test to graduate in class with 9th grade who does not have grade requirement. They will take the same test, the new Algebra I assessment, the 9th graders score will go into the class average, but the 10th grader will have to make a specific cut to make proficiency indicating if diploma met. Definition for proficiency was D- student. New definition = mastery or B- student. Proficiency levels: below proficient, approaching proficient , proficient , advanced. Law says student must pass a Gateway to graduate. If student does not pass Gateway must do interventions and re-test electronically (online, CD, jump drive?). Requesting transition time for AYP and NCLB to reduce high pressure New cut scores will be set on new assessment (spring/summer 2010) TN Tests are easy? Very few students get perfect scores (only 9 on 8th grade 08 test) What do you expect? How do you align expectations? Provide teachers to states request for item bias reviews to provide diverse (large/small system, years experience) 2009-2010 Test 10 test, but budget may only allow 5: Eng. I, II, Alg. I , US History, Bio (Eng I may be swapped for Eng. II) and may include an Alg II test. AYP is based on 1st time test takers or highest score during that school year. AYP is based on new cut score for all students (all 9th grade test takers and 10th -12th ) Next year state is requesting from SDOE that AYP be based on old standard. Updates: USDOE proposes a requirement of AYP reporting 14 days prior to the start of the school year. In TN that would be July 1, options: -Move testing window to earlier time -Standardized opening of school date Announcement due after Nov. 4 Portfolio testing of 2% - or loose 13% amendment added to SpEd proficiency percentage, will be field test (MAAS) notification coming soon. Modified ELL test in simplified language similar to Braille test. Out-of-level not an option this year, only option 1% portfolio. Field test of MAAS will involve every district and every school, after TCAP. Does not involve high school students this year. The MAAS test, once operational, will be considered on grade level standards and will not count as a non-proficient. Plan to have guidelines for participation in spring field tests by February, ready to implement in spring IEP. RFPs must be done every 5 years. Writing Assessment Measurement Incorporated, human-scored (committees) Gov. has an Assessment Taskforce working toward making assessment more NARP-Like. Gateway & EOC new high school transition policy, Gateway will not go away, but will be different. The students starting in high school next year will not have a graduation requirement based on passing an assessment. Equity issue student in 10 grade required to pass a test to graduate in class with 9th grade who does not have grade requirement. They will take the same test, the new Algebra I assessment, the 9th graders score will go into the class average, but the 10th grader will have to make a specific cut to make proficiency indicating if diploma met. Definition for proficiency was D- student. New definition = mastery or B- student. Proficiency levels: below proficient, approaching proficient , proficient , advanced. Law says student must pass a Gateway to graduate. If student does not pass Gateway must do interventions and re-test electronically (online, CD, jump drive?). Requesting transition time for AYP and NCLB to reduce high pressure New cut scores will be set on new assessment (spring/summer 2010) TN Tests are easy? Very few students get perfect scores (only 9 on 8th grade 08 test) What do you expect? How do you align expectations? Provide teachers to states request for item bias reviews to provide diverse (large/small system, years experience) 2009-2010 Test 10 test, but budget may only allow 5: Eng. I, II, Alg. I , US History, Bio (Eng I may be swapped for Eng. II) and may include an Alg II test. AYP is based on 1st time test takers or highest score during that school year. AYP is based on new cut score for all students (all 9th grade test takers and 10th -12th ) Next year state is requesting from SDOE that AYP be based on old standard.

    10. 10 Getting Ready for the ACT for Tennessee Statewide Test Wednesday, April 22, 2009 Secondary diagnostic assessment, 8th , 10th , 11th All students issues: special needs Use common sense in dealing with testing of individual students 8 other states are in this process, some states are high stakes using ACT as part of AYP. ACT will not customize for TN. Will ACT become AYP accountability? Not anytime soon. This year additional reporting will be available but in format ACT has established. Will allow TN to use state accommodations, but they will not be part of the reportable scores. Secondary diagnostic assessment, 8th , 10th , 11th All students issues: special needs Use common sense in dealing with testing of individual students 8 other states are in this process, some states are high stakes using ACT as part of AYP. ACT will not customize for TN. Will ACT become AYP accountability? Not anytime soon. This year additional reporting will be available but in format ACT has established. Will allow TN to use state accommodations, but they will not be part of the reportable scores.

    11. 11 Benefits of Weekday Test Administration High Schools and Districts will receive comprehensive reporting Students who test with ACT- Approved Accommodations and Standard Time will receive college reportable scores Provides the opportunity for students to test with ACT-Approved and State-Allowed Accommodations ACT Accommodations TN has choice: no accommodations, ACT allowed accommodations (Report to State Scholarship), State allowed accommodationsACT Accommodations TN has choice: no accommodations, ACT allowed accommodations (Report to State Scholarship), State allowed accommodations

    12. 12 ACT for Tennessee Statewide Test April 22, 2009 - State Test Date April 22 - May 6, 2009 Testing window for students with ACT-Approved and State-Allowed accommodations All Grade 11 students will have the opportunity to take the ACT in their home school environment during the school day. The April weekday ACT Assessment will be invoiced directly to LEAs in late Spring. (No Voucher Required) BEP Formula funds are allocated to each LEA for this assessment. Cost incurred above the BEP Formula allocation are reimbursable as defined by the TN ACT Reimbursement protocol. Funding info sent out in July. Explore and Plan reimbursed. ACT funds are in BEP based on 12th grade ADM figure multiplied by ACT cost of test. Since based on 12th grade ADM could not cover cost of testing 11th grade. State will allow districts to report if number is off and reimbursed for those extra numbers. Voucher goes to ACT, state pays for one voucher and can be used on any national test day. There are 12th grade students who have not used voucher. On state date, no voucher is required, but you will receive an invoice for students tested on that date. Dont send document in for students who are absent or you will be charged for that student. Student can use the voucher on a later test date, if they are absent. Students can use voucher on any national test date, but can only use it once. Those who do so, do not have to participate in the state testing date. Students who take the test and do not use the voucher, can take it on the state testing date, if they are in the 11th grade, and use the voucher. No participation percentage requirement, but is state law that all 11th graders take the test.Funding info sent out in July. Explore and Plan reimbursed. ACT funds are in BEP based on 12th grade ADM figure multiplied by ACT cost of test. Since based on 12th grade ADM could not cover cost of testing 11th grade. State will allow districts to report if number is off and reimbursed for those extra numbers. Voucher goes to ACT, state pays for one voucher and can be used on any national test day. There are 12th grade students who have not used voucher. On state date, no voucher is required, but you will receive an invoice for students tested on that date. Dont send document in for students who are absent or you will be charged for that student. Student can use the voucher on a later test date, if they are absent. Students can use voucher on any national test date, but can only use it once. Those who do so, do not have to participate in the state testing date. Students who take the test and do not use the voucher, can take it on the state testing date, if they are in the 11th grade, and use the voucher. No participation percentage requirement, but is state law that all 11th graders take the test.

    13. 13 Establishment Process: Establishing your school as a test site for the Tuesday, April 22, 2009 test administration Timeline

    14. 14 Establishment Process School Administration Responsibilities Principal or designee must Consider staffing requirements and select staff to serve as a Test Supervisor (TS), Back-Up Test Supervisor (BU), and Test Accommodations Coordinator (TAC) Complete and return Establishment Packet Share information in Establishment Packets with assigned staff Beginning planning for testing rooms/facilities with Test Supervisor Key People: Testing Coordinator 1% portfolio can be excluded, IEP team (which includes the principal) can decide if other sped students should participate, if student is not portfolio the IEP team can decide that student should or should not be tested. Federal Law can be personally held legally liable for IEP team decisions. No paperwork required for the IEP teams decision. 11th grader with very few credits. If student is enrolled as an 11th grader in EIS, they should take the test.Key People: Testing Coordinator 1% portfolio can be excluded, IEP team (which includes the principal) can decide if other sped students should participate, if student is not portfolio the IEP team can decide that student should or should not be tested. Federal Law can be personally held legally liable for IEP team decisions. No paperwork required for the IEP teams decision. 11th grader with very few credits. If student is enrolled as an 11th grader in EIS, they should take the test.

    15. 15 Training Workshops All Test Supervisors, Back-up Test Supervisors and Test Accommodations Coordinators are required to attend a half day test administration training workshop The training workshop will review the standard testing requirements and the test administration / test accommodations process Mary Taylor contact person. Training is required. If not attend, school will not be ACT test site on State testing date. 3 people must attend the training. Mary Taylor contact person. Training is required. If not attend, school will not be ACT test site on State testing date. 3 people must attend the training.

    16. 16 Training Workshops Appointed staff will sign-up for a workshop online

    17. 17 Request Accommodations ACT-Approved Accommodations will be available to students for the statewide test administration A DVD will be provided for the Test Accommodations Coordinator to learn details about the accommodations process Accommodations procedures and request forms to be mailed to schools in late fall All accommodations must be approved. Districts must apply for state allowable accommodations. Apply for ACT accommodations first, then if turned down, apply for state accommodations. If student is not college bound, use state accommodations. Scores from state testing date are reportable to any college that accepts ACT, if only ACT accommodations are used. The large population of students (80% took it past year) compared to 100% requirement this year will make a difference in the scores. Prediction: slight drop in reported state and district ACT score this year. Student score report will be coded to identify if it is a national test date or state test date. They are NCAA reportable. Scores can be invalidated for any reason (security or test administration reasons) IMPORTANT CHANGE IN GRADE LEVEL ASSIGNMENT: Districts need to look at how they determine who qualifies to become an 11th grader, based on credits earned. 11th graders must meet new standard: being prepared for one path. The only advantage for students who are truly college bound to take the test on the state test site is that they will be taking the test in their local school setting. BEP Funding of Voucher: Vouchers will be available this year and next year. It will be reviewed next year to determine if it will be continued. It is expected funds. All accommodations must be approved. Districts must apply for state allowable accommodations. Apply for ACT accommodations first, then if turned down, apply for state accommodations. If student is not college bound, use state accommodations. Scores from state testing date are reportable to any college that accepts ACT, if only ACT accommodations are used. The large population of students (80% took it past year) compared to 100% requirement this year will make a difference in the scores. Prediction: slight drop in reported state and district ACT score this year. Student score report will be coded to identify if it is a national test date or state test date. They are NCAA reportable. Scores can be invalidated for any reason (security or test administration reasons) IMPORTANT CHANGE IN GRADE LEVEL ASSIGNMENT: Districts need to look at how they determine who qualifies to become an 11th grader, based on credits earned. 11th graders must meet new standard: being prepared for one path. The only advantage for students who are truly college bound to take the test on the state test site is that they will be taking the test in their local school setting. BEP Funding of Voucher: Vouchers will be available this year and next year. It will be reviewed next year to determine if it will be continued. It is expected funds.

    18. 18 TVAAS Update Report Card and ACT The ACT cohort group (graduation group) data is used on report card. Students who take 11th grade ACT will show up in a cohort group eventually. The only data will be reportable score data, the data that would have been in report card any other year. Final score will be used in report card, not best score.Report Card and ACT The ACT cohort group (graduation group) data is used on report card. Students who take 11th grade ACT will show up in a cohort group eventually. The only data will be reportable score data, the data that would have been in report card any other year. Final score will be used in report card, not best score.

    19. 19 TVAAS Update

    20. 20 Tennessee On-line Pilots: On-line Instruction to On-line Assessment

    21. 21 TVAAS Restricted Site ACT Explore PLAN

    22. 22

    23. 23

    24. 24

    25. 25

    26. 26

    27. 27

    28. 28

    29. 29

    30. 30

    31. 31

    32. 32

    33. 33

    34. 34

    35. 35

    36. 36

    37. 37

    38. 38

    39. 39

    40. 40 Whatever you are, be a good one.

More Related