1 / 40

IPT Scoring Training

IPT Scoring Training. PAMS. Goals. To review the IPT and rubric as exemplary models of a performance task and rubric To identify the critical thinking skills embedded in the performance task To become familiar with how to score student work

mardi
Télécharger la présentation

IPT Scoring Training

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IPT Scoring Training PAMS

  2. Goals • To review the IPT and rubric as exemplary models of a performance task and rubric • To identify the critical thinking skills embedded in the performance task • To become familiar with how to score student work • To calibrate, as a staff, our scoring of student work using the rubric

  3. About of the IPT • developed by Virginia Beach classroom teachers working collaboratively with the Departments of Curriculum & Instruction and Educational Leadership and Assessment • modeled after the College and Work Readiness Assessment (CWRA), a nationally-normed performance task that will be administered to VBCPS juniors in January 2013. • presents seventh-grade students will a real-life situation and related documents that they must analyze before writing responses to open-ended questions about the situation. • designed to measure the 21st century skills of critical thinking (CT), problem solving (PS), and written communication (WC) Source: Fall 2010 Integrated Performance Task Guide for Teachers Grade 7

  4. The Fall 2012 IPT… • is a low-stakes, diagnostic assessment to be used for formative purposes • was created to measure critical thinking, problem solving, and effective communication, three outcomes for student success specified by Compass to 2015 • should be scored by teachers, preferably in teams, during the first semester (no later than January 25, 2013), according to the procedures and scoring rubric Source: Fall 2012 Integrated Performance Task Guide for Teachers Grade 7

  5. Results from the Fall 2012 IPT… • may NOT be used as a grade in any subject • should be used by teachers to evaluate their students’ skill levels in the areas of critical thinking (CT), problem solving (PS), and written communication (WC) Source: Fall 2012 Integrated Performance Task Guide for Teachers Grade 7

  6. Results from the Fall 2012 IPT, cont. • can assist teachers in planning instruction that involves CT, PS, WC, and the use of rubrics • are expected to indicate that most seventh graders will be at Levels 1 or 2 in CT and PS due to the limited implementation across the division of performance tasks and other activities that develop CT and PS skills. • There are no expectations at this time that skills levels in CT, PS, or WC should be at Levels 3 or 4. It will take time to move our students toward mastery. Source: Fall 2012 Integrated Performance Task Guide for Teachers Grade 7

  7. Things to remember while scoring • Always score according to the rubric • Do not give a higher score just because it was the best you’ve seen in a while • Only scores are 1, 2, 3, 4—do not use decimals or fractions or two scores for an element • When in doubt, score down—”between-level” students are at the lower level • If unsure as to what to score, its okay to ask someone else what they think • A score of 0 is given when there is no response at all, a single character is considered a response

  8. Scoring IPT Responses • Familiarity with the IPT documents and rubric increases scoring efficiency and consistency. • It’s tedious at first but gets easier with experience. • Highlight, underline, circle, and/or write notes. • Silence is golden! Keep talk to a minimum.

  9. IPT Scenario for Grade 7 CONFIDENTIAL DO NOT DISTRIBUTE

  10. What does the rubric look like? • You have been provided the IPT Scoring Guide which includes: the prompts, a copy of the rubric and the documents which the students received as they took the test. • Each section of the rubric gives examples of what responses should contain in order to receive the level of proficiency

  11. Critical Thinking (CT1) Prompt 1only • The first element of the rubric, CT1, decides if the information in the IPT booklet is correct and believable • Involves two facets: • the quantity of distinct examples of information from Document 4 (news story) that the student identifies as incorrect, misleading, or unbelievable • the quality of the explanations why each example may be incorrect, misleading, or unbelievable • A student’s response must satisfy both of the criteria to be assigned a specific level. • Be sure to look at the Incorrect, Misleading, and Unbelievable Information From Document 4 sheet

  12. Skills Measured by the IPT

  13. Prompt 1 – Critical Thinking 1

  14. Scoring Critical Thinking 1

  15. Sample A1 – Prompt 1 (CT1) 3 The first information I believe is false is that 25,000 dollars worth of items were stolen from a music store. althogh a music store may contain this amount in items, six teenagers could not carry this many items. If each item is on average 25 dollars, then the teenagers would have to carry 1,000 items. A peiceof information I believe is misleading is AbnerCrutchfeild saying no teenagers are hanging around the mall because of the chaperone policy. this is not true because schoool starts and teenagers do not go to the mall as much. Finally I believe he graph is false. The graph does not contain a year or unit of time.

  16. Sample B1 – Prompt 1 (CT1) 1 I think that the increase in property damage and theft were reasons for the new policy is false.

  17. Sample C1 – Prompt 1 (CT1) 3 One piece of information that I thought is false in the document is where it states,"The incident involved a group of six teenagers stealing more than $25,000 worth of items at Your Music Now." I beleive this is false because a CD costs about five dollars, so if they stole $25,000 worth of items, they must have stolen about every item in the store. Unless there was no security near the store, then that could not have happened. If they want to prevent crimes from happening then they should improve their security, not punish every teenager for it. I also do not beleive the part of document one where it states, "However, support for the protest has dropped off greatly." I do not beleivethis because many teens in document 3 were very determined to get this protest to get called off by providing points like,"Excluding people from the themall based on their age violates their civil rights--especially the equal protection clause of the 14th amendment."

  18. Sample D1 – Prompt 1 (CT1) 2 I think the sales increace of certain stores is a little misleading because if they are preventing all of these teens from shopping at certain time frame, then how does their profit increase if the number of poeple is decresing. I also disbelvive that that 1400 signed a potition to boycott against the mall.

  19. Critical Thinking (CT2) Prompt 2 only • The second element of the rubric, CT2, sees the need for important information not in the IPT booklet • It also involves four facets: • Whether there is at least one relevant example of information that was not in the booklet or not clearly explained • The quality of the description of the information • Whether there is a reason for why the information is needed for the student to make a recommendation concerning the chaperone policy • Whether there is an effect statement that describes how the information could affect the student’s final recommendation • A student’s response must satisfy all the criteria at a specific level.

  20. Skills Measured by the IPT

  21. Prompt 2 – Critical Thinking 2

  22. Scoring Critical Thinking 2

  23. Sample A2 – Prompt 2 (CT2) 4 I think information that would be useful is more reactions from the teenager, people who own a store at the mall, and also the budget of the mall. If I could have more more reactions and quotes from teens and mall workers, then I could get a better understanding of their perspective and be able to come to fair agreement that might be based off of a vote or democracy for the customers of Beach Mall. If I had the mall budget, then I would know if they could afford to improve their security and offer more jobs for guards and policemen which would be what I write in a recommendation letter.

  24. Sample B2 – Prompt 2 (CT2) 1 or 2 how many thngs did they steal and they should have cameras in the stores the teenagers go in.

  25. Sample C2 – Prompt 2 (CT2) 2 In order to make a well justifyeddicition I would look at the sales numbers both before and after the policy went into affect. This information will help me make a informed dicitionabout the policy.

  26. Sample D2 – Prompt 2 (CT2) 1 In the documents, The explantion of people do not match the description of the policy. The policy states that children under the age of eighteen are allowed in the mall without a chaperone aas long as it is before 5:00. The commentator, Sk8rDude, states that, “There is no place to hang out with my buds except the vacant lot nner the dark alley." Althogh teens are not allowed without a gaurdian after 5:00, they can go to the mall after school since they have about two hours in high school. I need this informatio because if I am wrongly informed about the policy, my opinion would have incorrect facts on the situation. Finnaly, They do notclearly explain wether the policy is only at the Beach mall or every mall. Most of the Documents have the words "Beach Mall", Yet they do not state every mall. I would need this informaion because if it is for every mall, the policy is more acceptable, but if it is for one mall it is less broad.

  27. Problem Solving (PS) Prompt 3 only • The third element of the rubric, PS, the student evaluates the information and uses it to support one of the choices. • PS is related to: • The students recommendation of either continuing or discontinuing the chaperone policy • The quantity of reasons that support the recommendation • The quality of reasons that support the recommendation • The source of the reasons that support the recommendation • Students responses must satisfy all of the criteria at a specific level to be assigned to that level

  28. Examples of Responses for PS • Problem Solving should not be confused with Written Communication (WC) • If a response does not include an introductory sentence or concluding statement, it is a WC issue—do not penalize the student in PS • Level 3 or 4 reasons • must be explicitly relevant to the issue of whether or not to continue or discontinue the policy • “Distinct” reasons must be conceptually different from the other reasons in the response that support either recommendation to continue or discontinue the policy • Cannot include any reasons that embellish or misrepresent information or facts

  29. Skills Measured by the IPT

  30. Prompt 3 – Problem Solving

  31. Scoring Problem Solving

  32. Sample A3 – Prompt 3 (PS) 3 I am againtst keeping the policy because, first of all, of the fact that in document 1 it gives information about how youth crime is effected by violet tv shows and videogames but if the youth is nt at the mall then what will they be doing? I will tell you what they would be doing, they would be at home watching violent tv shows an playing violent vdeogames. Second,in document 3 it shws that five stores have list between 15%-35% of sales since the policy started and if the policy continues that could shut down some of the really good buisnesses in the mall. If you average together the top fie losses in percent of income then the mall has lost 24% of its income, and thats just the top five losses! That is almost 1/4 of the oncome that those 5 stores together normally make! Finally, in document 4 it say that that one theft was th only incedent like that, so all the y need is a couple of security cameras and the costomers are safe. All in all, it would be better for everyone if the mall just ended the policy.

  33. Sample B3 – Prompt 3 (PS) 2 Yes keep the mall chaperone policy because the people under 21 should be wached. Because they could get hurt or kidnaped. Grown ups should watch kids younger then 21 becaus some kids still from stores and it happens alot.Thas why they should keep the policiy.

  34. Sample C3 – Prompt 3 (PS) 1 Well I think all malls in the Us should get security camras and post signs saying they have security camras around and the police is watching every move you make so when kids come to the mall they will see that the police is watching them and they will get scared they will get caught easly. So then they will stop shoplifting and Starting fights and doing Graffiti.But I think they should stop the Chaperone policy. Also i think every mall should have more police officers to watch the kids. Because when I go to the mall I see only 2 or 3. But the mall I go to is either a 2 story one or a 4 story mall. So if there is only 2 or 3 mall cops and there is only 6 kids shoplifting or fighting then half of those kids will get caught or run away and start another fight.

  35. Sample D3 – Prompt 3 (PS) 2 I think that the chaperone policy shouldnt be continued because the teenagers should be trusted and andba able to buy there own cloths and if they do steal and you catch them you should make them work for it or call the cops on them. they should really let the policy up because the mall wont make as much money the would if they didnt have the policy plus the parents wont come because there kids wont come.the kids need to have their own privacy andshouldnt be crowded by their parents.

  36. Sample E3 – Prompt 3 (PS) 3 After considering the two main concerns for keeping the policy, I strongly recommend that the policy not stay. Businesses' profits have dropped now that teens aren'nt there anymore, especially ones that have teens as their main clientel. If businesses close down, then people lose their job and malls lose money from not having the shop there anymore. The safety and security of the mall's costumers are not compromised by teens being there. If it was, then this policy would ahve been installed a lot sooner. Profits for malls' stores are compromised by teens attending the mall because teens tend to shop at malls more than anywhere else. Teens have made malls hotspots for friends to hang out at and get a bite to eat. If the policy were to stay than teen wouldn't have anywhere to go to hang out with friends, and profits of the mall would go down. For these reasons, I believe that the chaperone policy should not stand.

  37. Sample F3 – Prompt 3 (PS) 1 My reccomendation is that I'm splitting it 50/50.The reason being 50/50 is that I totally understand where the mall officials are coming from I understand.However I think that kids should have their freedoom and not be punished because of something possibly an adult could have did.You can assume anything but you just never know who did what and they are just assuming that kids/teenagers are commiting the crime.I understand how they are making profits better because before they were scared to come to the mall with the kids around not sure if they would get robbed or not.But I also understand that safety comes first and you should always be kept under your parents/guardians wing with supervision.So even though i agree with both sides i do very much disagree with the mall officials.

  38. Written Communication (WC) Prompt 3 only • The Written Communication presents information and ideas that are clear, organized, detailed, and written for the intended audience • Scorers should look for: • Clear/organized response • Detail • Transitions/sentences • Voice and Tone/Vocabulary • Spelling, grammar, and keyboarding skills are not scored on the IPT unless they interfere with the clarity or organization of a response • Do not penalize students in their WC scores due to PS problems. Students who write excellent responses but lack PS abilities should receive a high WC and low PS

  39. Skills Measured by the IPT

  40. Prompt 3 – Written Communication

More Related