Chapter 10

1. Chapter 10 Reporting and Evaluating Research Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell

2. Key Ideas • What is a research report? • Who will receive this report? • What are the types of reports? • How should your report be structured? • How do you write in a sensitive and scholarly way? • How do you evaluate the quality of your research? Educational Research 2e: Creswell

3. What is a research report? • A research report is a completed study that reports an investigation or exploration of a problem, identifies questions to be addressed, and includes data collected, analyzed, and interpreted by the researcher. Educational Research 2e: Creswell

4. Who will receive this report? The audience for your report • Determine the acceptable standards • Look in journals to learn the criteria required for submitting articles • Look at the literature for specific standards • Check with the school to determine specific standards for a thesis or dissertation Educational Research 2e: Creswell

5. What are the types of research reports? • Research Report: a completed study that reports an investigation or exploration of a problem • Dissertations and theses • Dissertation and theses proposals • Journal articles • Conference papers • Conference paper proposals • Reports for policy makers and schools Educational Research 2e: Creswell

6. How can you learn about the structure of research report? • Examine the APA heading styles • Examine the six steps in the research process • Examine the research questions or hypotheses • Examine the structures or different types of reports Educational Research 2e: Creswell

7. Quantitative Format Title page Abstract Introduction Review of the Literature Methodology Timeline, Budget, and Preliminary Chapter Outline References Appendices Qualitative Format Title page Abstract Introduction Procedure Preliminary Findings Anticipated Outcomes Timeline, Budget, and Preliminary Chapter Outline References Appendices Structure of Quantitative and Qualitative Proposal Educational Research 2e: Creswell

8. Variations in Structure of a Qualitative Study • Scientific model • Storytelling model • Thematic model • Descriptive model • Theoretical model • Experimental, alternative, or performance models Educational Research 2e: Creswell

9. How do you write your report in a sensitive and scholarly way? • Use non-discriminatory language • Level of specificity • Labels for people • Terms for people in their own language Educational Research 2e: Creswell

10. How do you write in a scholarly way? • Encode scholarly terms • Employ a point of view consistent with quantitative and qualitative approaches • Balance research and content • Interconnect parts of the study • Use computer aids Educational Research 2e: Creswell

11. How do you evaluate the quality of your research report? • Does it meet publication standards? • Will it be useful in our school? • Will it advance policy discussions? • Will it add scholarly knowledge about a topic or research problem? • Will it help address some pressing educational problem? Educational Research 2e: Creswell

12. What are some signs of a poor quantitative research study? • Validity and reliability of data-gathering procedures • Inappropriate or problems in research designs • Limitations of study not stated • Inappropriate sampling Educational Research 2e: Creswell

13. What are some signs of a poor quantitative research study? • Results of analysis not clearly reported • Inappropriate methods to analyze data • Unclear writing • Assumptions not clearly stated • Data-gathering methods not clearly described Educational Research 2e: Creswell

14. What are some signs of poor qualitative research? • Weak links to philosophical ideas behind the research • Lack of rigorous data analysis • Lack of advocacy for the participants Educational Research 2e: Creswell

15. What are some qualitative standards to use? Lincoln’s (1995) philosophical criteria • Standards set in inquiry community (guidelines for publication) • Positionality (“Text” honest and authentic) • Community (serves community purposes) • Voice (participants heard) • Critical Subjectivity (researcher heightened self-awareness/creates social transformation) • Reciprocity (between researcher and participants) • Sacredness of Relationships (respect for participants) • Sharing privileges (sharing of rewards with participants) Educational Research 2e: Creswell

16. What are some qualitative standards to use? Creswell’s (1998) procedural criteria • Rigorous data collection (multiple forms, extensive data) • Consistent with philosophical assumptions of qualitative research (evolving design, multiple perspectives) • Employs tradition of inquiry (e.g. case study, Grounded Theory, Narrative) • Starts with focus on central phenomenon • Written persuasively • Multiple levels of analysis • Narrative engages the reader • Includes strategies to confirm accuracy Educational Research 2e: Creswell

17. What are some qualitative standards to use? Richardson’s (2000) participatory advocacy criteria • Substantive contribution (significant understanding of social life) • Aesthetic merit (practices open up text, artistically shaped, not boring) • Reflexivity (adequate self-awareness, self-exposure to reader) • Impact (affects the reader emotionally, intellectually, moved to action) • Expression of reality (seems “true”) Educational Research 2e: Creswell

18. What are some process criteria to use for all research? • Research problem • The literature review • The purpose statement and questions/hypotheses • The data collection • The data analysis • The report writing Educational Research 2e: Creswell