100 likes | 201 Vues
Explore assessment methodologies, tools, application guidelines, reporting, and best practices at the NSF CISE REU Sites PI Meeting 2010 Evaluation Cookbook Workshop. Learn to establish goals, assess outcomes, and ensure compliance.
E N D
Assessment Workshop NSF CISE REU Sites PI Meeting March 18, 2010 Audrey Rorrer UNC Charlotte
CISE REU Sites Assessment Project • Assessment WG Overview • a la carte Survey • Evaluation Toolkit • Common Application • Future Directions • Refinements • Best Practices NSF CISE REU Sites PI Meeting 2010
Workshop Overview Workshop Goals • Site evaluation cookbook • Provide assessment support • Interactive forum for information exchange • Table Mentors NSF CISE REU Sites PI Meeting 2010
Evaluation Cookbook IRB approval Application Project Goals Assessment Analysis Reporting Research Compliance Required for human subjects studies Review time ~ 6 weeks Must have prior to collection of any assessments or surveys Evaluation Step 1 NSF CISE REU Sites PI Meeting 2010
Student Applications Common information points Reference letters Transcripts Common Application Evaluation Step 2 Evaluation Cookbook • IRB approval • Application • Project Goals • Assessment • Analysis • Reporting NSF CISE REU Sites PI Meeting 2010
Establishing Goals & Intended Outcomes Recommended indicators Map with a logic model Evaluation Step 3 Evaluation Cookbook • IRB approval • Application • Project Goals • Assessment • Analysis • Reporting NSF CISE REU Sites PI Meeting 2010
Assessing Outcomes Methodology Pre/post comparison Data collection Tools Shared assessments A la Carte Survey Evaluation Step 4 Evaluation Cookbook • IRB approval • Application • Project Goals • Assessment • Analysis • Reporting NSF CISE REU Sites PI Meeting 2010
Analysis Descriptive analysis each year small number of participants Comprehensive statistical analysis year 3 pool all students T test (SPSS) Evaluation Step 5 Evaluation Cookbook • IRB approval • Application • Project Goals • Assessment • Analysis • Reporting NSF CISE REU Sites PI Meeting 2010
Reporting NSF Annual Reports Dissemination toolkit publications Evaluation Step 6 Evaluation Cookbook • IRB approval • Application • Project Goals • Assessment • Analysis • Reporting NSF CISE REU Sites PI Meeting 2010
Table Working Groups • Table discussions (10 minutes) • Group discussion (15 minutes) CISE REU Evaluation Toolkit http://www.cs.uncc.edu/reu/toolkit/ NSF CISE REU Sites PI Meeting 2010