ETSI HF STF 286 Access symbols for use with video content and ICT devices

1. ETSI HF STF 286 Access symbols for use with video content and ICT devices Symbol design & testing Richard Hodgkinson, TecAccess.net http://portal.etsi.org/stfs/hf/STF286.asp

2. What is ETSI? • European Telecommunications Standards Institute • One of three recognised European standards development organisations • CEN/ISSS – European Committee for Standardisation/Information Society Standardisation System • CENELEC – European Committee for Electrotechnical standardisation • Funded by member organisations (e.g. BT, Siemens, IBM, HP, etc) and the EU. • Produces Standards, Technical Reports, etc that address Information & Communication Technologies • ETSI standards are free and available electronically from www.etsi.org ETSI STF 286 - Design & Testing

3. ETSI STF 286 - Design & Testing

4. Why ETSI HF STF 286? • Supports the “eEurope 2005 Action Plan” to achieve an “Information Society for All”, and provide everyone the opportunity to participate in the global information society. • Access services: • Overcome cultural and social differences, • Renders content in alternative formats, • Provides access to all. • Team members: • Wally Mellors – Team leader (ANEC), • Richard Hodgkinson (TecAccess), • Clive Miller (ANEC). ETSI STF 286 - Design & Testing

5. ETSI STF 286 - Design & Testing

6. What is ETSI HF STF 286? • ETSI Standard (ES) 202 432, addresses five access symbols/icons for use with video content and ICT devices: • Subtitling: Superimposed text transcript of spoken dialogue. • Audio description: Additional audio dialogue describing significant visual content. • Signing: Sign language used for conveying significant audible content. • Speech output: Communication from the device using spoken language. • Spoken command: Ability of the device to accept spoken commands for the user. • ETSI Technical Report (TR) HF 00094 describes the development and evaluation of the symbols. ETSI STF 286 - Design & Testing

7. What is ETSI HF STF 286? • Access symbols can be used for: • Identifying buttons on hardware controls, • Way-finding signs in cinemas and theatres, • Packaging of DVDs and Videotapes (printed and tactile), • Printed media, e.g. TV magazines, newspapers, • Interactive media, e.g. TV and computer displays (icons). • Investigating tactile and auditory versions of a subset of symbols. • Submission of final symbols for ISO adoption and registration. • Final Standard and Report will be published electronically in early 2007, and will provide symbols in .pdf, .gif and .ico formats. ETSI STF 286 - Design & Testing

8. First, collect your symbols… • Search for existing symbols… ETSI STF 286 - Design & Testing

9. Then, collect some more symbols… • Search for existing symbols…

10. Then more symbols… • Brainstorm new symbols… ETSI STF 286 - Design & Testing

11. Then even more symbols… • Commission new symbols… ETSI STF 286 - Design & Testing

12. Collected symbols ETSI STF 286 - Design & Testing

13. ETSI STF 286 - Design & Testing

14. ETSI STF 286 - Design & Testing

15. Symbol testing - ISO 9186 • ISO 9186:2001 – Test methods for judged comprehensibility and for comprehension. • Judged Comprehensibility • “What percentage of the population expected to understand the meaning of the symbol?” • Where results are inconclusive, perform the comprehension test: “What do you think this symbol means?” and judge the results. • Comprehension responses: • Correct understanding is certain, • Correct understanding is very probable, • Correct understanding is probable, • Understanding is opposite of what is intended, • Any other response, • Response is “I don’t know”, • No response given. ETSI STF 286 - Design & Testing

16. Judged comprehensibility ETSI STF 286 - Design & Testing

17. Make louder Comprehension test You may see this symbol in association with a telephone. What do you think t his symbol means? If you cannot guess the meaning, please answer "Don't know". Do not worry if you give the same answer to more than one symbol. ETSI STF 286 - Design & Testing

18. Symbol testing – ETSI TR 0070 • ETSI TR 0070 – The Multiple Index Approach (MIA) for the evaluation of pictograms • The hit rate: Number ofcorrect associations between the referent and pictogram, • The false alarm rate: Number ofassociations with the wrong referent. • Missing values: No answer. • Subjective certainty: Certainty of association between pictogram and referent. • Subjective suitability: Impression of how well a pictogram represents its referent. • Pictogram preference: Which of the pictograms for a referent represents best the referent in question. • Pictogram set preference: Which set is preferred on aesthetic grounds. ETSI STF 286 - Design & Testing

19. Symbol testing • Web Site 1 created for initial filtering by ETSI Human Factors Committee members to reduce candidate symbols to 6 for each function. • Web Site 2 created for testing: • Test to ISO 9186 - both Comprehension and Comprehensibility...respondents see only one test, • Symbol order changed with each test, • Available in French, German, Italian, Spanish, Italian and Greek. • ETSI 0070 MIA data extracted from ISO 9186 Comprehension test results; • 1, 2 & 3 (Correct understanding) provided hit rate, • 4 & 5 (Opposite or Other) provided false alarm rate, • 6 & 7 (No response) provided missing values, • 1, 2 & 3 provided subjective certainty, • Pictogram set preference not addressed. ETSI STF 286 - Design & Testing

20. Test results to date • Test circulated to “Stakeholder” list of over 80 individuals, disability and user organisations. • 1999 accesses to the Web site. • 964 tests completed from 30 countries. • Cultural groups (completed tests): • UK & Ireland (183), • Scandinavia (282), • Southern Europe (148), • Central Europe (115), • Mediterranean (51), • Eastern Europe (5), • Plus USA, Japan, Australia, UAE, Canada, Argentina, Azerbaijan, Greenland, Philippines, etc. • Data also collected on respondents ages, education, occupations, disabilities and time taken. ETSI STF 286 - Design & Testing

21. Candidate symbols - 1 ETSI STF 286 - Design & Testing

22. Candidate symbols - 2 ETSI STF 286 - Design & Testing

23. Comprehensibility results - Judging ETSI STF 286 - Design & Testing

24. Comprehensibility results - Judging ETSI STF 286 - Design & Testing

25. Comprehensibility results – “Balancing” ETSI STF 286 - Design & Testing

26. Successful symbols ETSI STF 286 - Design & Testing

27. Test analysis - 1 ETSI STF 286 - Design & Testing

28. Test analysis - 2 ETSI STF 286 - Design & Testing

29. Symbol testing problems • Inability to control the display resolution. • Inability to select and control respondents. • Respondents biased by age and education. • More results sought from: • Central Europe (Austria, Belgium, Germany, Luxembourg, Netherlands & Switzerland). • Eastern Europe (so far only Bulgaria, Czech Republic, Estonia & Poland) • Mediterranean countries (so far France, Greece, Italy, Cyprus) ETSI STF 286 - Design & Testing

30. ISO Registration • Symbols tested in accordance with ISO 9186:2001 -Graphical symbols – Test methods for judged comprehensibility and for comprehension. • Symbols drafted in accordance with IEC 80416-1:2001 – Basic principles for graphical symbols for use on equipment – Creation of symbol originals • Provides layout grid and design rules, • Provides process for assessment by ISO TC 145 – Graphical Symbols and IEC SC3C – Graphical symbols for use on equipment, • Final symbols included on ISO 7000/IEC 60417 database. • NOTE: ISO 80416-4:2005 provides “Guidelines for the adaptation of graphical symbols for use on screens and displays”. ETSI STF 286 - Design & Testing

31. Other modalities being investigated • Tactile symbols: • Designed by the RNIB National Centre for Tactile Diagrams (NCTD). • Symbols for: • Audio description, • Speech output, • Spoken command. • Testing at “Sight Village” in July • Audio symbols: • Symbols for; • Audio description, • Speech output, • Spoken command. ETSI STF 286 - Design & Testing

32. ETSI STF 286 - Design & Testing