Online Testing Programs

1. Online Testing Programs EDCI 750 Emerging Technologies Spring 2012 Presenters: Kris Oswald Shaun Rosell

2. Introduction • What are Online Testing Programs? • Websites or applications that allow instructors to share assessments using various platforms • Used in various environments, not just education • Lower education • Higher education • Corporate • Government

3. Education Formative assessment Summative assessment Standardized testing Preparatory or practice tests Self-assessment Corporate Customer and employee training Competency / compliance training Employee skills evaluations Multiple offices and locations Settings

4. Types • Create your own assessment and upload • Use online database to generate questions for assessment • Use other databases to generate questions for assessment and upload • Use a combination of the above methods • Computer Adaptive Testing (CAT)*

5. Uses • Create assessment • Share assessment • Administer assessment • Grade assessment • Statistical analysis for assessment • Provide information for individualized learning

6. Computer Adaptive Testing (CAT) • Adjusts questioning based on student responses to identify the level of the student • Tailored to each student • More accurate than traditional testing • Provides educators with better information • More efficient than traditional testing • More secure than traditional testing

7. Examples of Use • Online Testing and Computer Adaptive Testing • Pearson • ALEKS • Assessment Technology Incorporated (ATI)

8. Create tests from database library.

9. Example of a written test question. Example of a written test report.

10. Monitoring report to track students during test.

11. Class report including progress on particular topics.

12. Class report including time spent on the program.

13. Class report including student knowledge of individual topics.

14. Student performance report.

15. ePortfolios • Display student growth and achievement • Allow students to reflect on learning • Multiple types • Current work • Showcase of best work • Work that demonstrates mastery of specific learning objectives

16. Rubrics for Assessment • Needed for written responses, oral assessments, and ePortfolios • Provide equitable grading • Allow students to know standards before composing responses

17. X Benefits • No technical or programming skills needed • Minimal management needed • Assessments are customizable • Assessments can be shared in any setting • Track students throughout test • Assessments instantly graded • Instant reports and analysis • Saves paper

18. Challenges • Creating easy-to-use interface and navigation • Creating interface that does not distract from content • Student variability within and across age ranges • Accommodating students with disabilities • Control over who is taking the testing

19. Paper vs. Computer-based • Mixed results on test mode effect • Factors • Content familiarity • Computer familiarity • Gender • Race • Computer-based assessment success depends on usability and usefulness • Computer-based assessment has potential to be more sophisticated and a more accurate measure

20. Common Core State Standards (CCSS) • SMARTER Balanced Assessment Consortium (SBAC) and Partnership for Assessment of Readiness for College and Careers (PARCC) • Developing next-generation assessments aligned to the CCSS that: • Inform instruction • Guide interventions • Help target professional development • Ensure accurate measurement of student progress PARCC: http://www.parcconline.org/ SBAC: http://www.smarterbalanced.org/

21. Summary • When the usability and usefulness meets the needs of individuals, online testing programs: • Provide opportunity for sophisticated assessment administered in various settings • Provide instant feedback that can help educators individualize instruction • Can be used to help students progress to college or careers

22. Online Testing Program Companies • Hosting Sites • ClassMarker • HostedTest • OnlineTesting.net • Online Testing and Databases • Assessment Technology Incorporated (ATI) • Oxford University Press • ProProfs • Respondus • Computer Adaptive Testing • ALEKS • ETS

23. References • Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep/Paper_vs_Computer_Assessments.pdf • Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio • Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39-6235-4E9F-8AB8-F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerBasedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and_Design_Considerations • Clariana, Roy and Wallace, Patricia (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. Retrieved March 03, 2012 from http://www.speakeasydesigns.com/SDSU/student/SAGE/compsprep/Paper_vs_Computer_Assessments.pdf • Electronic portfolios. In Wikipedia. Retrieved March 08, 2012 from http://en.wikipedia.org/wiki/Electronic_portfolio • Harms, Michael and Adams, Jeremy (2008). Usability and design considerations for computer-based learning and assessment. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/E2B44D39-6235-4E9F-8AB8-F6EF2CAF7502/0/UsabilityandDesignConsiderationsforComputerBasedLearningandAssessment.pdf?WT.mc_id=TMRS_Usability_and_Design_Considerations

24. References Continued • Rubrics. In Kennesaw State University. Retrieved March 08, 2012 from http://edtech.kennesaw.edu/intech/rubrics.htm • Way, Walter D (2006). Practical questions in introducing computer adaptive testing for k-12 assessments. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/EC965AB8-EE70-46E5-B1A5-036BE41AB899/0/RR_05_03.pdf?WT.mc_id=TMRS_Practical_Questions_in_Introducing_Computerized • Way, Walter D., Lin, Chow-Hong, and Kong, Jadie (2008). Maintaining score equivalence as tests transition online: issues, approaches, and trends. Retrieved March 03, 2012 from http://www.pearsonassessments.com/hai/images/tmrs/Maintaining_Score_Equivalence_as_Tests_Transition_Online.pdf

25. References Continued • Way, Walter D., Davis, Laurie L., and Strain-Seymour, Ellen (2008). The validity case for assessing direct writing by computer. Retrieved March 03, 2012 from http://www.pearsonassessments.com/NR/rdonlyres/CAF6FF48-F518-4C68-AF2F-2959F902307E/0/TheValidityCaseforOnlineWritingAssessments.pdf?WT.mc_id=TMRS_The_Validity_Case_for_Assessing_Direct

26. Resources • Educause http://www.educause.edu/ELI/LearningPrinciplesandPractices/ITAssessment/12398 2. Web 2.0 Testing Tools http://web20teach.blogspot.com/2008/05/top-5-quiz-generators-for-online.html 3. Easy TestMaker http://www.easytestmaker.com/default.aspx 4. EdTech Toolbox: Web 2.0 Tools by Task – Surveys, Quizzes, and Polls http://edtechtoolbox.blogspot.com/p/web-2-tools-by-task.html 5. Engrade http://www.engrade.com/

27. Resources Continued 6. Fifty Sneakers http://www.fiftysneakers.com/ 7. Jeopardy Labs http://www.jeopardylabs.com/build 8. Free Rice http://www.freerice.com 9. Digi[cation] http://www.digication.com 10. Gooru http://www.goorulearning.org

28. Resources Continued 11. Christopher Long’s ePortfolio – Blogging Scoring Rubric http://www.personal.psu.edu/cpl2/blogs/cplportfolio/Blogging%20Scoring%20Rubric.pdf 12. University of Alaska-Southeast Online Discussion Rubric http://www.uas.alaska.edu/sitka/IDC/resources/onlineDiscussionRubric.pdf 13. Penn State University - VoiceThread Rubric http://voicethread.psu.edu/2011/06/rubrics-for-using-voicethread-in-your-course.html 14. University of Wisconsin-Stout School of Education Assessment Rubrics http://www.uwstout.edu/soe/profdev/rubrics.cfm 15. iRubric http://www.rcampus.com/indexrubric.cfm