1 / 25

Enhancing Learning Outcomes Through Effective Data Interpretation and Assessment Strategies

This guide outlines a structured approach to interpreting assessment data to improve educational outcomes. It emphasizes the importance of organizing data, identifying specific learning outcomes, gathering evidence, and articulating institutional goals. The process involves interpreting data reliability, making informed recommendations for curriculum and pedagogy adjustments, and initiating actionable steps to implement changes. The aim is to facilitate a data-driven educational environment that fosters continuous improvement and accountability.

teness
Télécharger la présentation

Enhancing Learning Outcomes Through Effective Data Interpretation and Assessment Strategies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Interpreting Data & “Closing the Loop” Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness

  2. Location in Assessment Cycle DETERMINE PRACTICES USED TO ACHIEVE OUTCOMES IDENTIFY SPECIFIC OUTCOMES GATHER EVIDENCE ARTICULATE MISSION/ GOALS RECOMMEND ACTIONS REVIEW & INTERPRET RESULTS

  3. Step #1: Organize Your Data • Assemble the following in one place: • All data or possible sources of data • List of learning outcomes/research questions • Curriculum, experiences, practices • Map data sources to outcomes • Outcomes x Measures Map • Map results to outcomes • Present in “user-friendly” way

  4. Mapping Data Sources to Outcomes: Engineering Example

  5. Presenting Results • It’s best to present results one outcome at a time • It’s not recommended to present results primarily by measure • Make sure to present the data in a user-friendly way (i.e., in a way that faculty in your department are comfortable with)

  6. Step #2: Interpret the Data • What type of criterion? • What is “significant?” • Are the findings reliable/valid?

  7. What type of criterion? • Norm-referenced • Need appropriate comparison group • Avoid percentile rankings • Good for more nebulous findings • Absolute standard • Usually more appropriate for performance-based measures

  8. What is significant? • Important to test when making comparisons • Numbers that look different may not really be different • However, just because a difference is significant doesn’t mean it’s important

  9. Are findings reliable/valid? • Can we believe student self-reports? • Are standardized measures more valid? • Single measure vs. multiple measures

  10. Step #3: Make Recommendations • Start by considering • Where in the curriculum are outcomes addressed? And at what level? • Refer to (or create) curriculum map, or • Inventory for particular outcome • How? What practices/techniques are used? • Where are the gaps? • What can be changed? • In the short-term? In the long-term?

  11. Step #3: Make Recommendations • Possible types of recommendations: • Changes to pedagogy • Changes to curriculum/programming • Allocation of resources • Keep in mind that you can’t fix everything at once – so start small • It’s usually better to modify than add • Be as specific/concrete as possible

  12. Step #4: Implement & Document Recommend Actions Example

  13. Example of Assessment Loop • Step #1: Articulate Goals/Outcomes • Goal: Graduates will possess strong communication skills • Outcome: Graduates will be able to write clearly and effectively • Step #2: Determine practices used to achieve outcome • Survey of required writing experiences in Core and academic programs

  14. Example of Assessment Loop, cont’d • Step #3: Conduct measurements • Higher Education Research Institute (HERI) College Student Survey (CSS) • National Survey of Student Engagement • HMC Alumni Survey

  15. Example of Assessment Loop, cont’d • Step #4: Review & interpret results • Faculty committees • Assessment • Curriculum • Teaching & Learning • Full faculty - workshop

  16. Writing SkillsFrequency data from HERI, NSSE & Alumni Survey Liberal Arts 4-Yr Non- Sectarian 1959-1987 Cohort 1988-2001 Cohort AITU Seniors HMC Seniors HMC Seniors

  17. Seniors’ Perceptions of Writing Skills by Major (from NSSE)

  18. Alumni Perceptions of Writing Emphasis by Major(alumni graduating in last 10 years)

  19. Example of Assessment Loop, cont’d • Step #5: Recommend actions • Universal writing handbook • Faculty workshop on writing instruction • Revision to Core Curriculum

  20. MULTIPLE CURRICULAR OBJECTIVESIN HORIZONTALLY INTEGRATEDCORE CURRICULUM

  21. QUESTIONS?

More Related