180 likes | 313 Vues
This work in progress investigates the impact of two delivery models of information literacy instruction on the quality of citations in student assignments within engineering learning communities. By comparing a single 50-minute lecture to multiple shorter "just-in-time" sessions before assignments, the study evaluates whether students receiving the latter demonstrate superior citation quality and resource selection. Results indicate significant differences in the quality and type of resources used, suggesting that just-in-time instruction may enhance student learning outcomes.
E N D
ONE OR MANY?ASSESSING DIFFERENT DELIVERY TIMING FOR INFORMATION RESOURCES RELEVANT TO ASSIGNMENTS DURING THE SEMESTER. A WORK IN PROGRESS Amy S. Van Epps and Megan R. Sapp Nelson Engineering Librarians, Purdue University
OPPORTUNITY Information Literacy opportunity with different sections of the same first year course • Fundamentals of Speech Communication • Associated with engineering learning communities Different delivery models • a single, 50 minute lecture early in the semester • four, approximately 12 minute lectures to be offered just before each assignment was given Material presented was coordinated • LibGuideto minimize variation
RESEARCH QUESTION Is there a noticeable difference in the quality of citations in student assignments when “just-in-time” instruction is used as opposed to a “one-shot” session? Hypothesis Sections which received the just-in-time instruction would have better citations, both in quantity and quality than the section which received the one-shot session.
METHODS AND SAMPLE
METHODS Study Group All students in 3 sections of the course Data Outlines with references required for each assignment Data received by librarians after anonymized Reference Analysis Done using a framework to identify resource type and quality of intended audience and purpose
SAMPLE SELECTION Sampling Random sample of outlines for coding Analysis Set 5 bibliographies for each assignment (1-3) per team 3 bibliographies for final assignment per team 36 bibliographies 233 references 124 references from just-in-time set; 109 from one-shot
CODING FRAMEWORK Based on the work of Wertz et al (2011) Resource type QualityBook Periodical Web Facts & Figures Unknown Inter-rater reliability, consensus estimate • 84.1 percent agreement Informative High Medium Popular Scholarly Medium Low Biased
RESULTS AND DISCUSSION
RESULTS Average number of references per outline All assignments required a minimum of 3 references. * Statistically significant difference (p<.05)
QUALITY OF RESOURCES USED High, medium, and low quality sources all show statisticallysignificantdifferencesbetween sections. * Statistically significant difference (p<.05)
COMPLETENESS OF CITATIONS Difference for Incomplete May reflect differences between raters more than differences in student abilities. APA format was not taught by the librarians complete reference = presence of all elements * Statistically significant difference (p<.05)
TYPE OF RESOURCE Significantly different distribution of resources between sections. One-shot students use many more web resources. Just-in-time students split between journals and web resources. * Statistically significant difference (p<.05)
DISCUSSION An apparent benefit can be see with just-in-time teaching • Use of more high quality resources • Use of more periodicals • Frequently visits = opportunity for follow-up Overall use of popular and informative resources • Medium quality; 59.9% not surprising to the authors • Speech communication is well suited to popular resources • Less requirement of research or scholarly publications than design assignments or research papers • 93.4% of the resources used were classified as informative
CONCLUSION • A correlation exists embedded just-in-time teaching approach and the quality of reference sources used can be seen. • Still unknown… if the library instruction model is responsible for the difference