1 / 14

Usability Evaluation

Usability Evaluation. Evaluation should occur continually through the design and implementation process. Evaluation methods are applied as the interface is being developed, rather than at the end. Usability Evaluation.

concettap
Télécharger la présentation

Usability Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Usability Evaluation • Evaluation should occur continually through the design and implementation process. • Evaluation methods are applied as the interface is being developed, rather than at the end.

  2. Usability Evaluation • Evaluation (Preece et al), is concerned with gathering data about the usability of a design or product by a specific group of users for a particular activity within a specified environment or work context. • Evaluate the design in terms of its usability (the efficiency, effectiveness and satisfaction)

  3. Usability Evaluation "When the cook tastes the soup, that's formative; when the guests taste the soup, that's summative." – Robert Stakes Formative Evaluation Designs evaluated as you go along • Evaluation of the interaction design to find usability problems to fix to improve usability (part of formation of design) • Early and continual • Should have something to evaluate no later than 10% into a project schedule • Carefully selected participants

  4. Usability Evaluation Summative Evaluation • Conducting full evaluation at end of design • Evaluation of interaction design to assess level of usability (as a summation of achievement) • Often used for comparison with previous version, or with another system • Randomly selected participants

  5. Usability Evaluation Conducting the Formative Evaluation Before evaluation session • Identify the usability properties to be measured • Make ready the prototype to be used for the evaluation • Design the experiment During evaluation session • Run the tests and collect data After evaluation session • Analyse the data to establish how the conditions of testing have affected the performance of activities Draw conclusions about any improvements needed in the design

  6. Usability Evaluation Conducting the Formative Evaluation Example from Prof. H. Rex Hartson, Computer Science, Virginia Technology.

  7. Usability Evaluation • Qualitative Formative Evaluation: Subjective • Qualitative Techniques: Introspection, Direct Observation, Direct Observation via ‘Think Aloud’ Protocols, Query Techniques, Interviews, Questionnaires/Surveys See Saul Greenberg presentation slides

  8. Usability Evaluation Conducting the Formative Evaluation Participants (the subjects/users) must be treated with respect ethical rules of behaviour by Saul Greenberg

  9. Usability Evaluation • Quantitative Formative Evaluation: Objective • Techniques: Controlled Experiments • Determine a causal relationship between interface characteristic and user performance/behaviour • Method is complex • Statistical analysis of results can be complex See Alan Dix: example of method and statistical analysis

  10. Usability Evaluation Results from Tests: What we hope for From Stephen Brewster

  11. Usability Evaluation Results from Tests: What we hope to avoid From Stephen Brewster

More Related