1 / 38

Evaluation Report

Evaluation Report. A preliminary report to the faculty and administrators of the online distance learning program in the Department of Educational Research in the College of Education at Florida State University . April, 2002 “There is no royal road to learning” Euclid, 300 B.C. Agenda.

margot
Télécharger la présentation

Evaluation Report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Evaluation Report A preliminary report to the faculty and administrators of the online distance learning program in the Department of Educational Research in the College of Education at Florida State University. April, 2002 “There is no royal road to learning” Euclid, 300 B.C.

  2. Agenda • Evaluation Team • Description of the Students • Procedures Used • Results • Conclusions • Preliminary Recommendations • Reactions – Discussion and Written

  3. Overall, How Would You Rate the Program? Overall, How Would You Rate the Curriculum? Overall, How Would You Rate the Faculty? M = 3.29 SD = .68 M = 3.29 SD = .72 M = 3.49 SD = .68 Key Evaluation Results (4 = Excellent)

  4. I. The Evaluation Team

  5. Michael Simonson, Ph.D. Evaluation Coordinator

  6. Judy Converso, Ph.D. Comparisons With Similar University Programs

  7. Maggie Crawford Information Specialist Telephone Interviews

  8. II. The Students

  9. Ages of Students Responding Median = 41

  10. Number of Online Courses Taken + Taking Median = 6

  11. Hours/Week Studying – One Course Median = 10 hours/week

  12. III. Procedures • Student Survey (online) • Telephone Interviews • Faculty Interviews and Meetings • Literature Searches and Program Comparisons • “Lurking”

  13. IV. ProceduresV. Conclusions

  14. 1. Student Survey Response = ~70%

  15. 1. A. Are You Satisfied with Your Courses and Curriculum? Not SatisfiedMean • Grading Requirements? 1 3.3 • Required Course Content? 1 3.2 • Required Course Selection? 1 3.2 • Course Difficulty? 1 3.2 • Elective Course Content? 10 3.1 • Relevance of Courses ? 2 3.1 • Online Teaching? 2 3.0 • Elective Course Selection? 10 2.9 N = 41 4 = Excellent

  16. 1. B. Are You Satisfied with Your Instructors? Not SatisfiedMean • Content Knowledge? 1 3.6 • Feedback? 3 3.2 • Skills at Online Teaching? 1 3.1 • Interaction? 3 2.9 N = 41 4 = Excellent

  17. 1. C. Are You Satisfied With? Not SatisfiedMean • Number of Required Courses? 2 3.4 • FSU Technical Support 4 3.2 • Prep. For Profession? 6 3.1 • Portfolio Experience? 10 3.1 • Number of Electives? 5 3.1 • FSU Library Support? 9 2.9 N = 41 4 = Excellent

  18. 1. D. General Questions: How Would You Rate: Mean • Faculty? 3.5 • Program – Overall? 3.3 • Curriculum? 3.3 • FSU’s Support? 3.3 • Texts and Printed Materials? 3.1 • Program Support Services 3.0 N = 41 4 = Excellent

  19. Open-Ended Questions-Student SurveyWhat Improvements Would You Recommend? • More electives • More teaching and less discussion • More courses each semester • Improve Blackboard • Eliminate discrepancies in course policies

  20. Open-Ended Questions-Student SurveyWhat Do You Like Best? • Content • Faculty • Reputation of the program • Freedom • Flexibility • Relevance

  21. Open-Ended Questions-Student SurveyWhy Is Your Favorite Course Your Favorite? • Quality interaction with the instructor • Excellent professor • Interesting Content • Various instructional Strategies used • Relevant content

  22. Open-Ended Questions-Student SurveyHow Likely Would You Be To Choose An Online Program, Given Free Choice? Almost evenly split between those who prefer face-to-face and online learning

  23. Open-Ended Questions-Student SurveyOther Comments? • Do something about Blackboard • Offer courses in the summer • Provide more interaction with faculty

  24. 2. Telephone Interviews • 10 Students Called ~ Randomly • 5 Females and 5 males (30 Females/18 Males) • Age = ~45 • 15 – 45 Minutes Each • 3 Questions

  25. Summary Statements – Telephone Interviews Why did you enroll? • Reputation of the program • Convenience • Content • Skill Building

  26. Summary Statements – Telephone Interviews Major Program Strength? • Faculty • Organization • Flexibility • Students

  27. Summary Statements – Telephone Interviews What Changes Would You Recommend? • Get a better system than Blackboard • Improve consistency of policies between courses • More immediate feedback • Help us connect with other students • Be realistic about time commitments • Consider synchronous instruction

  28. 3. Faculty Interviews • 7 Interviews • Face-to-face and Telephone • 30 – 60 Minutes

  29. Summary StatementsFaculty Interviews • Instructional Systems Design is the key to the program • Rigor and quality are critical • The program is very labor intensive • Synchronous instruction should be considered • Various instructional platforms should be available • Identify program benchmarks • Provide training in distance education for faculty • Support for faculty is needed – graduate assistants and local production equipment • Camaraderie among students is important – add synch. • 3 faculty promised, only one hired

  30. 4. Literature & Program Review • 11 programs reviewed • Titles of courses compared • Similarities and differences noted

  31. VI. Preliminary Recommendations Policy & Management Faculty & Curriculum Instruction & Delivery

  32. RecommendationsPolicy & Management • Tuition and Fees • Program Policy Statements • Incentives and Involvement of Faculty • Entrance Requirements – Skills AND Resources • 5-Year Plan

  33. RecommendationsFaculty & Curriculum • Move from text-based instruction to media • Explore various management platforms in addition to Blackboard • Review the capstone experience • Consider specializations w/in the degree • Involve full-time faculty

  34. RecommendationsInstruction & Delivery • Offer Summer courses • Increase selection of online materials • Consider use of adjuncts, supervised by full-time faculty • Secure local production resources for faculty • Offer synchronous instruction, and consider face-to-face activities

  35. VII. Reactions

More Related