1. Olin Library Reference Statistics Reporting System COM S 501 Team: Ron DeVera Matt Kulick Annie Lin Kavitha Nair Soutrik Pramanik Krystal Wang Kevin Wong

2. Presentation Topics Presentation Topics System Design System Demo User Testing Updated Schedule & Milestones Questions • Progress Update • System Design • System Demo • User Testing • Schedules & Milestones • Questions

6. System Demo Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

7. User Testing Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • Motivation • Methodology • Results • Feedback we’re addressing • Negotiable Feedback

8. Motivation • Why we’re user testing: • Feasibility analysis, emphasized “ease of use” • Stakeholders with differing technical backgrounds • Adoption and success hinge upon successful replacement of complicated paper-based solution • Data-intensive requirements, powerful and thought-out UI Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

9. Motivation • Why we’re user testing: • Our clients will be using the system, not us! • Evaluate our understanding of expectations • Promote process visibility – What we’ve accomplished • Generates helpful feedback from different perspective Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

10. Methodology • How we’re user testing: • One-on-one, 30-45 min user tests with staff levels • Specific tasks to complete • No prior demonstration or training • Pre-planned questions designed to stimulate feedback • Emphasis on testing system, not the stakeholder! • Standardized tasks / questions among all testers Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

11. Methodology How we’re user testing: Example User tasks included: - Logging In - Saving new reference questions - Editing reference questions - Searching / Exporting questions - Deleting record(s) - Using Keyboard Shortcuts Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

12. Methodology How we’re user testing: Example Administrator tasks included: - Exporting search results - Generating weekly report - Changing passwords - Adding, changing labels, categories - Adding locations Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

13. Methodology • How we’re user testing: • Types of questions we asked: • Which labels,keywords were confusing? • What was the hardest task? • What did you like, that should not be changed? • If you were us, what would you change? • How does this system compare to your paper based system • How useful do you find the new report layout? (admin) • Do you have any other comments or questions about the system? (open ended) Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

14. Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

15. Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

16. Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

17. Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

18. Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

19. Results, Addressing What we’ve found: Issue #2, Inconspicuous Edit/ Confirmations! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

20. Results, Addressing What we’ve found: Issue #3, Confirmation Terms Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

21. Results, Addressing What we’ve found: Issue #4, Entry Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

22. Results, Addressing What we’ve found: Issue #4, Entry Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

23. Results, Addressing What we’ve found: #5, Search Results Disambiguation & Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

24. Results, Addressing Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • What we’ve found: Other Issues • Scrollbar annoyances • Alt-O  “Press Alt-o to Log Out” • Ability to press 1 button to export all • More / Better Confirmations • Search interface needs to be overhauled

25. Results, Negotiable Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • What we’ve found: Negotiable concerns • Some prefer dropdowns, some prefer checkboxes • Some would prefer “2-D matrix” of buttons, a virtual paper entry sheet (input form matches current system exactly) • “Break-up Editing” of multiple reference question entries

26. Updated Schedule & Milestones Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Where we are in: Functionality Schedule Milestones

27. Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface login { 100% } data entry { 100% } searching - search by notes field - redesign - debugging

28. Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface exporting - “export all” - remove debugging output - testing

29. Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface admin - backup - site & system options - add / change user types - interface with report generation

30. Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Reports remaining: - dynamic report generation - database integration (basically coding)

31. Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Database (100%) All data structures are working Errors are logged into a separate table

32. Schedule Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions

33. Future Milestones Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Next Iteration - full functionality on all subsystems - report generation - interface redesign - further user testing, for redesign assurance

34. Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Questions?