230 likes | 321 Vues
ICT Efficacy and Efficiency for Academic Writing. William S. Warner, Ph.D. Combine audio, visual and written feedback Compare efficacy and efficiency Assess instructor and student response.
E N D
ICT Efficacy and Efficiency for Academic Writing William S. Warner, Ph.D. William S. Warner
Combine audio, visual and written feedback • Compare efficacy and efficiency • Assess instructor and student response Of all the factors that make a difference to student outcomes, the power of feedback is paramount.... Hattie, J.C (2009) Visible Learning Information and Communication Technology William S. Warner
13 Assignments 2-3 Days for Feedback Fronter-based William S. Warner
IMPACT TIME Efficiency vs. Efficacy William S. Warner
Efficacy – 29 Students Efficiency – 5 TAs • Appealing idea Unhelpful % Helpful 2 1 0 1 2 Written 0 5 7 7 81 Tutor 0 0 3 21 76 Fronter 0 2 14 30 54 Rubric 0 4 12 35 49 Audio 3 10 3 38 45 • 10-30 seconds/comment • 1-2 comments/paragraph • Too soon to judge • Technical snags • Time-consuming Pilot Project Evaluation
Disagree % Agree audio is more… 2 1 0 1 2 • efficient 20 40 30 20 0 • effective 0 305020 0 • More suite for encouraging than editing Relative to Fronter comments William S. Warner
Final 3 papers – with rubric • TAs • Spot more errors • Rubric provides equitable quality-control • Ease of evaluation: 4X4 matrix • Students • Written comments qualified detail • Rubric quantified standards: 16-24 points • Targets strengths and weaknesses Hard Copy Preferred William S. Warner
0-1 2 3 4 Rubric William S. Warner
We’re not as smart as we think StudentTARubric Scores William S. Warner
Audio replaced with JING • SKYPE introduced • Social media • 6 (45-min) video lectures • Introduction • Outline • Clarity • Cohesion • Tables & Figures Autumn 2012 William S. Warner
Writing Centre http://www.umb.no/nwc/ • Writing Wrongs Blog http://writingwrongsblog.wordpress.com/ Social Media William S. Warner
Autumn – 3 assignments 81 students: 49 BSc, 32 MSc Spring – 10 assignments 75 students: 15 BSc, 60 MSc Unhelpful % Helpful 2 1 0 1 2 JING 0 0 0 18 82 Tutor 0 0 3 15 82 Paper 0 0 11 39 50 Rubric 0 1 12 41 45 I found JING as helpful as the tutor Disagree % Agree 2 1 0 1 2 5 11 23 2928 Unhelpful % Helpful 2 1 0 1 2 JING 0 2 2 16 80 Tutor 0 0 12 2761 Fronter 0 4 7 29 60 Paper 0 6 6 41 44 Rubric 0 2 10 45 43 I prefer JING to Fronter comments Disagree % Agree 2 1 0 1 2 6 4 14 19 57 Effect William S. Warner
Autumn Spring • 98 % students found JING increased writing efficiency • Easier to understand than cryptic or loaded sentences • Voice tone • Emphasize/prioritize • Confidence/support JING saved me time Disagree % Agree 2 1 0 1 2 0 7 20 3538 JING motivated/gave me confidence Disagree % Agree 2 1 0 1 2 3 3 20 4035 JING improved my writing Disagree % Agree 2 1 0 1 2 0 1 3342 24 STUDENT: Efficient Effect William S. Warner
Autumn 6 TAs 3 assignments Did not track student Spring 8 TAs 4 and 6 assignments Tracked 10 students • Efficacy • Very effective – 4 • Effective – 2 • Efficiency • Very efficient – 1 • Efficient – 5 • Efficacy • Very effective - 1 • Effective - 7 • Efficiency • Very efficient - 2 • Efficient - 6 Not 2 1 0 1 2 Very Effective/Efficient TA Evaluation William S. Warner
JING’simpact on student writing is noticeable when tracking re-writes. Agree Disagree 2 1 0 1 2 5 3 0 0 0 Which feedback method provides the most help to a student in the least amount of time? 6 JING 4 Face-to-face consultation 1 Rubric 1 Writing comments on hard copy Notice the lack of improvement? 30 minutes for both? Spring TAs William S. Warner
30 minutes/session 30 sessions/term Unhelpful (students) Helpful 2 1 0 1 2 Autumn 10 students 0 1 2 4 3 Spring 17 students 1 0 5 4 7 For night owl or procrastinator? William S. Warner
I suggest that you watch the video lecture on… • Half watched the video lectures Unhelpful % Helpful 2 1 0 1 2 Autumn(40) 0 0 2 63 35 Spring (34) 0 0 9 35 56 Video Lectures William S. Warner
80% watched • Principles of paraphrasing http://isites.harvard.edu/icb/icb.do?keyword=paraphrasing • APA Format for Referencing http://isites.harvard.edu/icb/icb.do?keyword=apa_exposed Unhelpful % Helpful 2 1 0 1 2 Autumn 1 3 13 33 50 Spring 0 2 5 36 58 SpringFeedback Tutorials William S. Warner
Half (75) students found Unhelpful Very helpful 2 1 0 1 2 Website 1 0 18 20 12 Writing Wrongs blog 0 0 12 28 15 Student Journal 0 0 10 11 7 Social Media William S. Warner
Develop protocol • Read first – not on the fly • Balloon comment • Color code highlight • Green – good • Yellow – suggest/consider • Red - error • I suggest you watch the video lecture on cohesion, which explains how to make transitions betweens paragraphs. • Save document on Fronter Recommendations William S. Warner
Integrate JING across curriculum • Require video tutorials (e.g., EndNote) • Develop social media for peer-review • Explore MOOC automated feedback Conclusions William S. Warner