Weighted Scoring Model (2-level: Factors and Criteria )

1. Weighted Scoring Model(2-level: Factors and Criteria ) A 1-level model is explained in Schwalbe, K. (2005), Information Technology Project Management. If used for usability analysis this is also called a Weighted Usability Factors (WUF) model.

2. Example:Evaluating the best VCR The 2-level WSM method

3. 1. Select the main factors and criteria FACTORS 1. Simplicity of Controls Play Fast Forward Rewind Counter Timer 2. Flexibility of Recording Options “Instant” Recording Daily Recording Weekly Recording User Defined Recording Preset Recordings 3. Styling Colour Size CRITERIA

4. 2. Rate the importance of each factor on a scale of 10 • 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7 out of 10) (9 out of 10) (5 out of 10)

5. 3. Rate the importance of each criterion on a scale of 10 • 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7) 5 out of 10 6 6 9 8 (9) 9 out of 10 5 6 9 6 (5) 5 out of 10 5

6. 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7) 5 6 6 9 8 (9) 9 5 6 9 6 (5) 5 5 4. Rate the extent to which each criterion is met (out of 10) 8 out of 10 6 out of 10 6 out of 10 9 out of 10 4 out of 10 10 out of 10 8 out of 10 6 out of 10 8 out of 10 1 out of 10 8 out of 10 8 out of 10

7. 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7) 5 times 6 times 6 times 9 times 8 times (9) 9 times 5 times 6 times 9 times 6 times (5) 5 times 5 times 5. Calculate the weighted score for each criterion 8 = 40 6 = 36 6 = 36 9 = 81 4 = 32 10 = 90 8 = 40 6 = 36 8 = 72 1 = 6 8 = 40 8 = 40

8. 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7) 5 times 8 = 40 6 times 6 = 36 6 times 6 = 36 9 times 9 = 81 8 times 4 = 32 (9) 9 times 10 = 90 5 times 8 = 40 6 times 6 = 36 9 times 8 = 72 6 times 1 = 6 (5) 5 times 8 = 40 5 times 8 = 40 6. Total the scores } 225 } 244 } 80

9. 1. Simplicity of Controls • Play • Fast Forward • Rewind • Counter • Timer • 2. Flexibility of Recording Options • “Instant” Recording • Daily Recording • Weekly Recording • User Defined Recording • Preset Recordings • 3. Styling • Colour • Size (7) 5 times 8 = 40 6 times 6 = 36 6 times 6 = 36 9 times 9 = 81 8 times 4 = 32 (9) 9 times 10 = 90 5 times 8 = 40 6 times 6 = 36 9 times 8 = 72 6 times 1 = 6 (5) 5 times 8 = 40 5 times 8 = 40 7. Divide by the maximum possible score, and convert to a percentage } 225/340*100 = 66% } 244/350*100 = 70% } 80/100*100 = 80%

10. 7*66 + 9*70 + 5*80 1492 = = 71% 7*100 + 9*100 + 5*100 2100 8. Work out an overall weighted score Total weighted score Maximum possible weighted score =

11. 9. Compare this score with that for other VCRs

12. 10. Choose the VCR with the highest score

13. 11. Display the results graphically