1 / 17

Why Peer Review? Rationale #4

Learn about the benefits of peer review, including the provision of more extensive and quicker feedback, scalability, and the encouragement of metacognitive thinking. Discover five types of feedback and examples of helpful versus unhelpful comments.

mhurst
Télécharger la présentation

Why Peer Review? Rationale #4

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Why Peer Review?Rationale #4

  2. Some advantages of peer review • Feedback is • more extensive • quicker • scalable • Can’t blame the reader! • Forces students to think metacognitively

  3. Five types of feedback • Describe what you see in the work, e.g., by summarizing. • Clarify what is being said, e.g., ask questions. • Alter or point out corrections to be made • Suggestimprovements • Evaluate how well it meets its objectives

  4. Helpful vs. unhelpful feedback “Helpful vs. unhelpful” slides taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

  5. Helpful vs. unhelpful feedback 1. What are the main strengths of this report? • Unhelpful comment: “Your report was really good! I enjoyed reading it.” Author’s response: “I’m flattered you liked my report, but I don’t have a sense of what you thought was good about it.” • Helpful comment: “This report was succinct and well written. The aims of the report were clear and I found it easy to identify your take-home messages...”

  6. Helpful vs. unhelpful feedback 2. Where are the main areas for improvement? • Unhelpful comment: “Your report was poorly written and hard to read!” Author’s response: “This comment doesn’t really help me to improve anything!” • Helpful comment: “There are a few areas that might make this report stronger. Expanding the Introduction to include more background information would help set the scene a little more (para 2). The arguments could also be strengthened by adding additional references, for examples lines 3, 16 and 55...”

  7. Helpful vs. unhelpful feedback 3a. Is the balance between the sections about right? • Unhelpful comment: “No – there wasn’t enough space left for covering the background of the study.” • Helpful comment: “The balance feels very good; however you may consider expanding the background section with greater information on theoretical concepts being tested” Author’s response: “Although stating good and bad points, none of it was portrayed negatively. The comments were given helpfully, with clear points for me to follow.”

  8. Helpful vs. unhelpful feedback 3b. Is the balance between the sections about right? • Unhelpful comment: “The overall balance was good, with no section outweighing any other at all.” Author’s response: “Very positive review, but not much given that I can improve on - I highly doubt it was almost perfect.” • Helpful comment: “Not the best balance: The introduction and rationale sections were too lengthy. While very clear, they could be trimmed down quite a bit and made to be much more concise. For example, I think lines 108 to 113 are unnecessary...”

  9. Suppose you like it … • Suppose you don’t see anything wrong with the work; what should you say? • Why not just pass? • Because the author won’t know why it’s good, and how to replicate the success. • Because you don’t learn from it. • Because it’s too easy!

  10. Example review 1 “I like the writing style, and I think the article is relatively easy to follow and the paragraphs are well linked. The article might be stronger if some of the sentences were more simple and succinct such as line 1 and 7 in paragraph 1, and line 3 in paragraph 4.” Specific? Constructive? Balanced? Clear? “Helpful vs. unhelpful” slides taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

  11. Example review 2 Specific? “This paper has poor structure and flow. There are several grammatical and spelling errors and some of the paragraphs should be shortened. I got confused about what you were trying to say at some points.” Constructive? Balanced? Clear? “Helpful vs. unhelpful” slides taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

  12. Example review 3 “Some sentences lacked commas where there should have been one, or were too long at times (e.g. line 34 and line 41). Otherwise, the article as a whole had a smooth flow and the intent behind each paragraph clear and understandable.” Specific? Constructive? Balanced? Clear? “Helpful vs. unhelpful” slides taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

  13. Read a work twice before reviewing • Once for the big picture • Once for details • Take notes!

  14. How to say it • Psychology is as important as assessment • Proceed from general to specific • Suggestions should be realistic in scope • Review the content, not the author • Avoid “always,” “never,” etc. • Start and end with positive

  15. How to “receive” a review • Realize that reviews will vary in quality. • Make an effort to digest comments. • Even if they seem “off the wall,” they could still be how your readers see the work. • Be grateful for others’ help. • Ask for clarifications.

  16. Receiving feedback: tips • Don’t panic! • Read all the comments & make notes • Take time to reflect • Address major issues • Tackle smaller points • Proofread final document This slide taken from Pearce & Mulder, “Student peer review: an introductory tutorial.”

  17. Learn from doing peer reviews • Lundstrom & Baker 2009 • Class divided into 2 groups • Group A provided feedback to Group B • Students in Group A improved more than students in Group B. • Shah-Nelson 2014 • Survey answered by 1040 students in MOOCs • Educational value of • “grading others’ papers” was 3.17 on a scale of 1 to 4 • “feedback from other students” was only 2.92 on scale.

More Related