340 likes | 347 Vues
SURVEY OF RECENT GRADUATES AS AN INSTRUMENT FOR ASSISTING IN THE ASSESSMENT OF INSTITUTIONAL EFFECTIVENESS. Dr. Teresa Ward Ms. Beth Katz Office of Institutional Research Georgia State University. Presentation Outline. Conceptual Model Technical Logistics Dissemination of Survey Data
E N D
SURVEY OF RECENT GRADUATES AS AN INSTRUMENT FOR ASSISTING IN THE ASSESSMENT OF INSTITUTIONAL EFFECTIVENESS Dr. Teresa Ward Ms. Beth Katz Office of Institutional Research Georgia State University
Presentation Outline • Conceptual Model • Technical Logistics • Dissemination of Survey Data • Utilization of Data
Survey Matrix • General Academic Skills – Questions 1-13 • Major Area of Study and University Support – Questions 14-26 • Engagement – Questions 27-31 • Comments
Please rate the degree of competency you had in the following areas when you entered/graduated from Georgia State University Graph 1 (Entering) Graph 2 (Exiting) *Mean range: 1=very weak competency to 5=very strong competency **p<.001 all pairs Learning Outcomes Communication Technology Collaboration Quantitative Skills Critical Thinking Contemporary Issues
English Majors 5 All Others 4.7 4.5 4.5 Mean 4 3.9 3.7 3.5 3 Ability to write clearly and effectively Entering Ability to write clearly and effectively Exiting
Math Majors 5 All Others 4.7 4.5 4.3 4.3 Mean 4 3.9 3.7 3.5 3 Ability to analyze quantitative problems Entering Ability to analyze quantitative problems Exiting
5 Physics Majors 4.9 All Others 4.5 4.3 Mean 4 3.7 3.6 3.5 3 Apply scientific reasoning in problem-solving Entering Apply scientific reasoning in problem-solving Exiting
5.00 4.80 Mean of communication (exiting) 4.60 4.40 4.20 Mean of communication (entering) 4.00 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA
5.00 4.80 Mean of quantitative skills (exiting) 4.60 4.40 4.20 4.00 Mean of quantitative skills (entering) 3.80 3.60 2.0-2.99 3.0-3.69 3.7-4.0 GPA
5.00 Mean of critical thinking (exiting) 4.80 4.63* 4.56 4.60 4.47* 4.40 4.20 Mean of critical thinking (entering) 4.00 3.92 3.86 3.83 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA *p<.01
5.00 4.80 Mean of technology (exiting) 4.60 4.40 4.20 Mean of technology (entering) 4.00 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA
*Mean range: 1=poor to 4=excellent 4 point scale: Poor to Excellent
Utilization of Survey Data • Department Level • Identify strengths and weaknesses using comparative data • Identify trends and implications of program changes using longitudinal data • Ability to triangulate survey data with other assessment measures • Starting point for conversations
University Level • Identify trends and implications of University policy changes using longitudinal data • Ability to triangulate survey data with other assessment measures • Contribute to strategic planning and policy discussions
Conclusion • High reliability index • Focused on indirect measures of learning outcomes • Saved OIR a considerable amount of money and time via online administration • Increased response rates • Facilitated access to the data • Contributed to department and University assessment activities
Teresa Ward – tward@gsu.edu • Bethann Katz – bnorthup@gsu.edu • Office of Institutional Research, Georgia State University – http://www2.gsu.edu/~wwwire/