Development of an Assessment Strategy for Global Learning Outcomes at Koç University

2. Development of an Assessment Strategy for Global Learning Outcomes at Koç University

3. AGENDA PART • Become aware of the importance of assessing global learning outcomes • Approach to meaning and goals of global learning and competencies • Discover methodological possibilities with Samples • Get recommendations

4. Part I. Become aware of the importance of assessing global learning outcomes

5. “It was a life changing experience!”

6. Assessment is no goal but a means to an end.

7. Assessment as instrument • See effectiveness of internationalization strategy

8. General Program Logic Model Applied to Internationalization Source: Darla Deardorff (2004)

9. Assessment as instrument • See effectiveness of internationalization strategy -> Office Assessment • Promote programs -> Marketing • Guide the learner • Evaluate the significance of program type and length • Enhance programs

10. Our overarching goal: High Quality Education

11. Winthrop University – a pionier of assessing global learning outcomes • Multiple methods • Key component: Questionnaire that measures changes in global knowledge, attitudes, and engagement- Self developped - Can beadministered frequently without additional cost- Students’ responses can be tracked over time through their university ID numbers • Additional Qualitative Methods:- Student’s evaluation of global peer mentor- Global Learning cultural event reflective papers- Online presentation- Students reflective papers- Assessment of University-Level Competencies etc.

12. Part II. Approach to meaning and goals of global learning and competencies

13. Part II.1. Determine Goals

14. Define Goals By knowing where you intend to go, you increase the chances of you and the learner ending up there.

15. Define Goals – 5 levels to keep in mind Establishing Global Learning Goals Source: Association of American Colleges and Universities (2006): Assessing Global Learning – Matching Good Intentions with Good Practice

16. Sample 1: Definition of Global Learning Outcomes at Webster University

17. Sample 2: Definition of Global Learning Outcomes at Winthrop University

18. Sample 3: Proposal of the Association of American Colleges and Universities

19. Part II.2. Define Competences

20. “[...]competence can be measured. But its measurement depends first on its definition.” Klemp, 1979

21. Define Competences • Use definitions that already exist • Subdivide • Integrate levels • Define Indicators

22. Sample 1: Proposal of the Association of American Colleges and Universities (2009) – Definition of expected competences

23. Sample 1: Proposal of the Association of American Colleges and Universities (2009) – Definition of expected competences • Sense of global interconnections and interdependencies • Consider individuals intervention in a global social problem possible • Ability to describe a social problem • Ability to identify some of the ethical and moral questions that underlie a given transaction between countries • Development of greater courage to engage in social exchanges and enterprises, even when faced with radical cultural difference • Identification of obligations to people situated both inside and outside their own national borders

24. Sample 2: Definition of Global Learning Outcomes at Webster University

25. Sample 2: Definition of Global Learning Outcomes at Webster University Intercultural Competence • Cultural Self-Awareness (Knowledge) • Cultural Worldview Frameworks (Knowlegde) • Empathy (Skills) • Verbal and Nonverbal Communication (Skills) • Curiosity (Attitudes) • Openness (Attitudes)

26. Sample 2: Definition of Global Learning Outcomes at Webster University Intercultural Competence • Cultural Self-Awareness (Knowledge) • Cultural Worldview Frameworks (Knowlegde) • Empathy (Skills) • Verbal and Nonverbal Communication (Skills) • Curiosity (Attitudes) • Openness (Attitudes) Beginning Developing Proficient Exemplary

27. Intercultural Development Continuumby M. Hammer, IDI & Milton Bennett (1993)

28. Part III. Methodological Possibilities

30. Global Perspective Inventory • Developed by intercultural experts with a developmental focus • Paper based quantitative assessment tool: pre-posttest • Independently reviewed and tested • Strong reliability & validity • Available in several languages • Designed in 2010 and already used by over 150 Institutions and Universities

31. Global Perspective Inventory

32. Abilene Christian University, Agnes Scott College, Alderson-Broaddus College, American Institute for Foreign Study(AIFS), Anderson University, Appalachian State University, Arkansas State University, Auburn University, Augstana College, Illinois, Baldwin Wallace College, Banard College, Bellarmine University, Bethany College (WV), Bethel University (MN), Boise State University, Brevard College, Brigham Young University, Brown University, Buena Vista University (IA), Campbellsville College, Carroll University (WI), Carson Newman College, CEA Global Education, Center for Cross-Cultural Study (Spanish Studies), Central College (IA), Central College Abroad, Central Lakes College (MN), College of the Mainland, College of Wooster, Colombia College (IL), Colorado State University, Concordia College (MN), Davis and Elkins College, Delta University, Des Moines University, Drake University, Duke University, Elgin Community College, Elmhurst College, Elon University, Emory University, Emory and Henry College, Fairfield University, Ferrum University, Florida International University, Florida State University, Fordham University, Global Citizen Year, Grove City College, Guilford College, Gustavus Adolphus College, Hampton University, Hartwick College, Hobart and William Smith College, Hope College, Illinois State University, Indiana University, Indiana Wesleyan University, Johnson University, Kalamazoo College, King College, LaFayette College, Lee University, Lees McRae College, Lenoir Rhyne College, Lesley University, Lincoln Memorial University, Lindenwood College, Lindsey Wilson College, Loyola University Chicago, Lynn University, Macalester College, Marquette University, Marshall University, McDaniel College, Menominee Nation College, Mercer University, Miami Regional University (OH), Michigan State University, Mississippi State University, Milligan College, Monterrey Technological University (Mexico), New York University, North Carolina State University, Northeastern University, Ohio Valley University, Oregon University System, Pacific Lutheran University, Peninsula College, Pitzer College, Portland State University, Queens University, Randolph Macon College, Regent University, Santa Barbara City College, Santa Fe College, Semester at Sea, Seminole State College, Shenandoah University, Smith College, South Central University, St Ambrose College, St Augustine College, St Bonaventure University, St Cloud State College, St Edwards University, St Lawrence University, St Louis Community College, St Mary's College, SUNY Oswego, Susquehanna University, The Chicago School of Professional Psychology, Texas A & M University, Texas Woman's University, Tulane University, Tusculum College, University of Charleston (WV), University of Cumberlands, University of Georgia, University of Illinois Chicago, University of Maryland, University of Michigan, University of North Carolina, Chapel Hill, University of Northern Iowa, University of Notre Dame, University of Pikeville, University of Pittsburgh, University of San Diego, University of South Carolina Upstate, University of Southern Indiana, University of St Thomas (MN), University of Tennessee, Knoxville, University of Texas, San Antonio, University of Texas, Tyler, University of Wisconsin, Eau Claire, University of Wisconsin, La Crosse, University of Wisconsin, Milwaukee, University of Wisconsin, Platteville, Virginia Intermont College, Viterbo University, Walsh University, Washington University, Westminster College (UT), West Virginia Wesleyan College, Wofford College, Yale University

33. Abilene Christian University, Agnes Scott College, Alderson-Broaddus College, American Institute for Foreign Study(AIFS), Anderson University, Appalachian State University, Arkansas State University, Auburn University, Augstana College, Illinois, Baldwin Wallace College, Banard College, Bellarmine University, Bethany College (WV), Bethel University (MN), Boise State University, Brevard College, Brigham Young University, Brown University, Buena Vista University (IA), Campbellsville College, Carroll University (WI), Carson Newman College, CEA Global Education, Center for Cross-Cultural Study (Spanish Studies), Central College (IA), Central College Abroad, Central Lakes College (MN), College of the Mainland, College of Wooster, Colombia College (IL), Colorado State University, Concordia College (MN), Davis and Elkins College, Delta University, Des Moines University, Drake University, Duke University, Elgin Community College, Elmhurst College, Elon University, Emory University, Emory and Henry College, Fairfield University, Ferrum University, Florida International University, Florida State University, Fordham University, Global Citizen Year, Grove City College, Guilford College, GustavusAdolphus College, Hampton University, Hartwick College, Hobart and William Smith College, Hope College, Illinois State University, Indiana University, Indiana Wesleyan University, Johnson University, Kalamazoo College, King College, LaFayette College, Lee University, Lees McRae College, Lenoir Rhyne College, Lesley University, Lincoln Memorial University, Lindenwood College, Lindsey Wilson College, Loyola University Chicago, Lynn University, Macalester College, Marquette University, Marshall University, McDaniel College, Menominee Nation College, Mercer University, Miami Regional University (OH), Michigan State University, Mississippi State University, Milligan College, Monterrey Technological University (Mexico), New York University, North Carolina State University, Northeastern University, Ohio Valley University, Oregon University System, Pacific Lutheran University, Peninsula College, Pitzer College, Portland State University, Queens University, Randolph Macon College, Regent University, Santa Barbara City College, Santa Fe College, Semester at Sea, Seminole State College, Shenandoah University, Smith College, South Central University, St Ambrose College, St Augustine College, St Bonaventure University, St Cloud State College, St Edwards University, St Lawrence University, St Louis Community College, St Mary's College, SUNY Oswego, Susquehanna University, The Chicago School of Professional Psychology, Texas A & M University, Texas Woman's University, Tulane University, Tusculum College, University of Charleston (WV), University of Cumberlands, University of Georgia, University of Illinois Chicago, University of Maryland, University of Michigan, University of North Carolina, Chapel Hill, University of Northern Iowa, University of Notre Dame, University of Pikeville, University of Pittsburgh, University of San Diego, University of South Carolina Upstate, University of Southern Indiana, University of St Thomas (MN), University of Tennessee, Knoxville, University of Texas, San Antonio, University of Texas, Tyler, University of Wisconsin, Eau Claire, University of Wisconsin, La Crosse, University of Wisconsin, Milwaukee, University of Wisconsin, Platteville, Virginia Intermont College, Viterbo University, Walsh University, Washington University, Westminster College (UT), West Virginia Wesleyan College, Wofford College, Yale University.

34. Florida State University – GPI Pretest-Posttest

36. Florida State University – GPI Pretest-Posttest Some people have a culture and others do not. The role of student is to receive knowledge from authority figures.

38. Much more Quantitative Instruments to Assess Learning Outcomes • Global Competency Inventory (GCI), Kozai Group • Intercultural Effectiveness Scale (IES), Kozai Group • The International Profiler (TIP), WorldWork • Cultural Perspectives Questionnaire (CPQ), International Institute for Management Development • Self-Assessment for Global Endeavors (SAGE),Caligiuri and Associates • ...

39. Photo Contest : Categories at TCU

40. Winner in the category “knowledge”

41. Quantitative Methods • Pretest – Posttests • Secondary Data Analysis • Surveys by other campus units BUT: Only in combination with qualitative Methods!

42. Qualitative Methods –Self-Assessment • Student presentations • Student portfolios • Professor evaluations • Narrative diaries / journals • Essays • Reflection papers

43. Qualitative Methods –Other Reported Instruments • In depth student interviews • Faculty observation of students • Case studies • Audio that demonstrates foreign language competency

44. Qualitative Methods - Reciprocative • Focus groups • Dialogues • Workshops • Reflection Courses

45. Pre-Measurements Encouraged student awareness of the learning outcomes prior to participation and during the program.

46. Even more ... thematic learning communities (or linked courses); service- and community-based learning; experiential learning; vertically integrated curricula with first-year seminars and senior capstones; teaching science through problem-based inquiry; undergraduate research and active, hands-on, collaborative learning; and inquiry-based pedagogies...

47. Part IV. Recommendations

48. Step by Step Departamental Mission Statement Goals Resource Impact Koç University’s Mission, Core Purpose, Core Values, Strategic Goals, and Initiatives Recommendations / Improvement Objectives / Outcomes Measures Analysis / Results Following: A Model for Continuous Administrative Unit Improvement of Southwestern University

49. Developing Methodology -Keep in Mind: combine qualitative and quantitative methods Assessment should be ongoing and multiple involve whole campus community incl. students financial, technical and human resource conditions

50. Global Learning is a multi dimensional construct!While assessing...Differentiate! • Students’ individuality • Programs’ duration and type • Outcomes’ components and levels • temporally