Usability Testing T/TAC Online Project Design Team Tsehaye Habteselasie Jennifer Okezie Meredith Riddile Aanal Sheth
Usability in Practice • Incorporates direct user feedback throughout the development cycle to reduce costs and create products that meet user needs (Usability Professional Association) Learnability Efficiency Errors Satisfaction Memorability
Reality of Usability confUsedfruStrateduncertAin emBarrassed anxIous helpLess dissatIsfied disTressed mYstified
T/TAC Online Project- Phase 9 • Online performance support tool that allows users to input, view and search • Local Improvement Plans • Government-funded grants
Level 1 Evaluation • Collecting reactions and gauging perceptions • Predicting level of user acceptance
Usability Testing Cycle Expert Reviews Redesign Usability Testing Survey Redesign Launch analysis analysis
Planning Usability Testing • Solicited participation from target audience • Developed protocols • Developed task scenarios based on usability goals • Level 1 desired results
Expert Reviews • Allowed experts to test system • Asked experts a set of predetermined questions
Expert Review Findings • Organized comments into categories • Calculated frequency of comments
Redesign Before After
Redesign Before After
Usability Testing • Participants completed task scenarios • Used an observation log • Measured observations • Used Likert scale to measure user perceptions • Ease of use • Efficiency • Usefulness • Acceptable
Task Scenarios One example: • You began your Local Improvement Plan (LIP) for the 2004-2005 school year earlier and now you have collected more information that you would like to add to this LIP. • Add the following information to Section 2 of this LIP: • Add the table that corresponds with the description of Goal 3. This table is titled “Practice_Table.doc” and is located on your desktop. • Add the following information to Section 3 of this LIP: • “There will be a decrease by 10% in the special education teacher turnover rate during the 2003-2004 school year.” • Save your work and select continue.
Debriefing questionnaire • Used Likert scale 1 – 6 1. How do you rate the overall ease of use or difficulty of this system? 2. How would you compare using the online system with creating LIPs the way you currently do? 3. How useful is this system? 4. Would you use this system if it was available?
Usability Testing Findings • Calculated observations and Likert scale responses
Usability Reactions Cutting and pasting is easy! Much easier than current process! You can glean ideas from other LEAs! Standardized format is great!
Surveys • Used in order to reach out to users throughout the state • E-mailed one task scenario and questionnaire to 8 participants