190 likes | 301 Vues
Learn how to effectively review research papers for conferences or journals, covering topics like readability, structure, methodology, and supporting evidence. Includes tips on writing constructive feedback.
E N D
A gentle introduction to reviewing research papers Alistair Edwards
Writing for the audience • Who is the intended readership? • conference • journal • marker • peers • To what extent are you typical of the intended readers?
Is there a hypothesis? • If so • Have authors supported or rejected it in their current study? • To support the null hypothesis is equally valid scientifically • e.g. Animation in web advertising does not improve click-through rates • If not • Have they nevertheless addressed a valid question?
Is there a story? • If not • a bad sign • …but is the paper nevertheless readable?
Is there a sufficient literature review? • Does it provide sufficient context for the (average) reader?
Is the paper well structured? • Introduction • Contribution • Generally • Method • Results • Discussion • Conclusion
Is the quality of the writing good? • Can you read it first time? • Are grammatical errors • non-existent? • few? • annoying? • detracting from your understanding? • How readable is it?
Is the voice appropriate? • Not too formal – or informal? • Is offensive language avoided? • Without being too politically correct?
Are figures and tables well used? • …and well explained?
Are statements backed by evidence? • Are there any opinions?
Is the methodology sound? • Validity: • construct • internal • external • ecological
How good is the abstract? • Does it • State the contribution made? • State the motivation as to why it is interesting? • State the methodology followed? • State the results? • State the conclusions? • 1-2 sentences for each of these?
Is there a good introduction? • Does it • Introduce the topic? • ‘This paper is about…’ very early on • Introduce the background? • Introduce the paper?
Conclusions? Does the paper state – or re-iterate – succinctly: • The contribution made? • The motivation as to why it is interesting to the audience and how it applies to them? • The methodology already described? • The key results? • What the findings mean to the field and how it is original and important?
What can you say that is positive about the paper? • It is easy to be negative • The review process tends to encourage this • Reasons not to accept papers • But positive feedback may be most valuable to the authors
Comments for the committee/editor alone (hidden from the authors) • What – if anything – would you put in this section?
Why? • Having read the paper, can you answer the questions: • Why did the authors write it? • Would anyone want to read it?
Your reviews • http://www-module.cs.york.ac.uk/advt/Tutorials/Review.php