APR

1. What is it? • Why do it? • Who gets involved? • When do we get started? • What resources do we need? • How long will it last? APR 20130925 WU AAAS Academic Program Review - CAS mtg

2. AAAS APR websites • Guidelines: http://www2.winthrop.edu/public/programreview/guidelines.aspx • Internal Self-Study Outline http://www2.winthrop.edu/public/programreview/documents/OutlineforSelf-Study_AAAS20130516.pdf • Programs with discipline-specific accreditation or approval use their discipline-specific re-affirmation standards, timelines, processes and procedures 20130925 WU AAAS Academic Program Review - CAS mtg

3. Resources needed to get the job done • People: • program faculty • unit assessment team • CAS Dean • Students • External Reviewers • Administrative support • A roadmap What do program faculty hope to gain from the process 20130925 WU AAAS Academic Program Review - CAS mtg

4. Program faculty, work with Dean • Select faculty member to chair internal self-study committee • Propose a timeline for internal self-study (AAAS input) • Establish goals for the APR consider President Comstock’s current Visioning Assessment Initiative, future directions of your disciplines, WU, CAS & Program Missions, needs of SC, global needs • Internal self-study completed • Collect and Examine artifacts to complete the self-study • Data Sources: e.g., Program, Department, Faculty and College annual reports, Curriculum Action System documentation, PICS, Activity Insight, OARS, Minutes of meetings, redacted student work samples used for assessment of specific outcomes The Process 20130925 WU AAAS Academic Program Review - CAS mtg

5. Review internal self study (Dean, Unit Assessment Committee) • May need more work (e.g., data, analysis) • When ready, self-study conveyed to AAAS • Dean works with Associate VPAA on ERT selection, site visit plans arranged thru N. Scurry • e-media like SKYPE an option • External Review is conducted, report of findings conveyed • Program faculty work with Dean on response to ERT report • Response phase 1, review ERT report, verify accuracy • Response phase 2, program faculty confer w/Dean & prepare an action plan to implement improvements emerging from the internal self-study and the ERT findings and recommendations. • Document Action Plans in OARS Track/report implementation and results over time. The Process con’t 20130925 WU AAAS Academic Program Review - CAS mtg

6. Define • careers, degrees • professional/community leadership • other measures • Alternatives • Feds: Gainful Employment (defines when financial aid repayment begins) http://ifap.ed.gov/GainfulEmploymentInfo/ • Student Achievement Measures (SAM) http://www.studentachievementmeasure.org/ Success and Achievement of your Graduates 20130925 WU AAAS Academic Program Review - CAS mtg

7. Workforce Quality Data Initiative (WDQI) • Develop/improve state-based longitudinal data systems, enable workforce data to be matched to education data to track individual employment and wages over time • supports development of, or enhancements to, longitudinal administrative databases that will integrate workforce data and create linkages to education data. • http://www.doleta.gov/performance/workforcedatagrant09.cfm • SC merge CHEMIS & SC DEW data files, limitations,d/n track • Military employment or graduates working out of state • graduates w/double majors • graduates who have multiple jobs • highest-paying job • Gainful Employment Feds, 2010, repayment federal std loans, targeted cohorts Tracking Employment 20130925 WU AAAS Academic Program Review - CAS mtg

8. College Scorecard http://www.whitehouse.gov/issues/education/higher-education/college-score-card • USDE College Affordability and Transparency Center • Costs, graduation rates, loan default rates, median borrowing • Metric on employment not finalized; will likely be framed in context of Gainful Employment • Does not provide details at program or discipline level • State Spending Charts (2006-2011) http://collegecost.ed.gov/statespending.aspx Affordability and Value 20130925 WU AAAS Academic Program Review - CAS mtg

9. Access to online data http://www.winthrop.edu/accountability/default.aspx?id=7996 • Common Data Set (CDS) http://www.winthrop.edu/accountability/default.aspx?id=11925 • Archived CDS http://www.winthrop.edu/accountability/default.aspx?id=11944 • Facts and Information (data warehouse, completions, credit hour production, enrollment, archived fact books) http://www.winthrop.edu/accountability/default.aspx?id=20545 • Data Request Form http://www.winthrop.edu/accountability/default.aspx?id=31370 AAAS Data Sources 20130925 WU AAAS Academic Program Review - CAS mtg

10. Assessment Best Practices Clearly articulated outcomes, multiple strategies, evidence assessment is completed, results analyzed & discussed by program faculty, not just an instructor of record, copies of rubrics & completed assessments archived. 20130925 WU AAAS Academic Program Review - CAS mtg

11. Blackboard Learning-Bb Rubrics application to assess authentic student artifacts & gain actionable results) • Bb Enterprise – deliver surveys to current students and alumni • Valid Assessment of Learning in Undergraduate Education Rubrics (Acceptable Use & Reprint Permission) http://www.umkc.edu/ia/it/blackboard/rubrics.aspx • Becoming experts at using assessment results to improve program and learning outcomes http://tncampuscompact.org/files/genref33.pdf For More Information About 20130925 WU AAAS Academic Program Review - CAS mtg

12. NSSE 11 Major Field reports (1st time customized, 8 categories) • NSSE 14 (results published in Nov 2014) • Major Field Reports (10 categories) • Topical Module-Diversity (ULC #3) http://nsse.iub.edu/html/modules.cfm • WU will participate in Carnegie Elective Classification Community Engagement comparison group (ULC #2) • 5 benchmarks being replaced with “engagement indicators” • Webinar: discussion of new survey and reports https://connect.iu.edu/p7fmis642mx/?launcher=false&fcsContent=true&pbMode=normal • PSRI13 results being summarized, see 2007 results • National Study of Learning, Voting and Engagement (NSLVE) (matches voting behavior with National Clearing House data). Metric for ULC #2, still waiting on inaugural report Supplemental Information (NSSE, PSRI13, NSLVE13) 20130925 WU AAAS Academic Program Review - CAS mtg

13. ULC #1 WU Graduates think critically & solve problems. • Critical Thinking http://www.aacu.org/value/rubrics/pdf/criticalthinking.pdf • Creative Thinking http://www.aacu.org/value/rubrics/pdf/CreativeThinking.pdf • Integrative Learning http://www.aacu.org/value/rubrics/pdf/integrativelearning.pdf • Inquiry and Analysis http://www.aacu.org/value/rubrics/pdf/inquiryanalysis.pdf • Problem Solving http://www.aacu.org/value/rubrics/pdf/problemsolving.pdf • Teamwork http://www.aacu.org/value/rubrics/pdf/teamwork.pdf WU graduates reason logically, evaluate & use evidence, & solve problems. They seek out & assess relevant information from multiple viewpoints to form well-reasoned conclusions. WU graduates consider the full context & consequences of their decisions & continually reexamine their own critical thinking process, including the strengths & weaknesses of their arguments. 20130925 WU AAAS Academic Program Review - CAS mtg

14. ULC #2 WU grads are personally & socially responsible. • Civic Engagement http://www.aacu.org/value/rubrics/pdf/civicengagement.pdf • Ethical Reasoning http://www.aacu.org/value/rubrics/pdf/ethicalreasoning.pdf • Lifelong Learning http://www.aacu.org/value/rubrics/pdf/lifelonglearning.pdf WU graduates value integrity, perceive moral dimensions, & achieve excellence. They take seriously the perspectives of others, practice ethical reasoning, & reflect on experiences. WU graduates have a sense of responsibility to the broader community & contribute to the greater good. 20130925 WU AAAS Academic Program Review - CAS mtg

15. ULC #3: WU graduates understand the interconnected nature of the world & the time in which they live.  WU graduates comprehend the historical, social, & global contexts of their disciplines & their lives. They also recognize how their chosen area of study is inextricably linked to other fields.  WU graduates collaborate with members of diverse academic, professional, & cultural communities as informed & engaged citizens.  • Global Learning (new 20130612) http://www.aacu.org/value/rubrics/pdf/globallearning.pdf • Intercultural Knowledge http://www.aacu.org/value/rubrics/pdf/interculturalknowledge.pdf • Problem-solving http://www.aacu.org/value/rubrics/pdf/problemsolving.pdf • Teamwork http://www.aacu.org/value/rubrics/pdf/teamwork.pdf 20130925 WU AAAS Academic Program Review - CAS mtg

16. ULC #4: WU graduates communicate effectively. WU graduates communicate in a manner appropriate to the subject, occasion, and audience. They create texts – including but not limited to written, oral, & visual presentations – that convey content effectively. Mindful of their voice & the impact of their communication, WU graduates successfully express & exchange ideas.  • Written Communication http://www.aacu.org/value/rubrics/pdf/writtencommunication.pdf • Information Literacy http://www.aacu.org/value/rubrics/pdf/informationliteracy.pdf • Oral Communication http://www.aacu.org/value/rubrics/pdf/oralcommunication.pdf • Quantitative Literacy http://www.aacu.org/value/rubrics/pdf/quantitativeliteracy.pdf • Reading http://www.aacu.org/value/rubrics/pdf/reading.pdf 20130925 WU AAAS Academic Program Review - CAS mtg