Promoting the Sustainability of a Digital Initiatives Project

1. Promoting the Sustainability of a Digital Initiatives Project User-Centered Assessment and Testing of Aerial Photographs of Colorado Holley Long, Kathryn Lage & Christopher Cronin University Libraries A presentation of the Faculty Staff Development Committee October 26, 2005

2. Aerial Photographs of Colorado • Initial prototype: http://ucblibraries.colorado.edu/aerialphotos/home.asp • Digital library of more than 1,700 scanned aerial photographs taken by U.S. Forest Service in 1938, 1940, 1946, and 1947 • Print collection of ~20,000 aerial photographs donated to the Libraries in 2001 by the Geography Department • Digitization project funded by a grant from the Collaborative Digitization Project.

3. Search Interfaces • Aerial photographs can function both as historical image documents and geospatial cartographic materials, depending on the perspective of the user • Two search interfaces were created to accommodate as many user groups and expertise levels as possible: • a map search interface that facilitates spatially-oriented searching • a geographic keyword interface for textual searching

4. Map Search

5. Keyword Search

6. Timeline for the testing • Short time-frame for the grant precluded a user-centered design of the prototype. Post-grant usability testing was important to ensure long-term sustainability of the project. • Testing of the prototype included: requirements analysis, heuristic evaluation, and user testing • Target audience: faculty, staff, and students of the university’s Geography and Geology departments.

7. Theory and Research Methods • What is user-centered design? (UCD) • How can this model benefit libraries? • What are the four stages of UCD? • How did we apply this model to the Aerial Photographs of Colorado project? • What methods did we use? • Usability (heuristic analysis, user testing) • User needs assessment

8. What is user centered design? • Design philosophy dedicated to creating highly functional, easy-to-use products • Characteristics: • Users involvement • Multidisciplinary design team • Four activities • Understand users’ needs and expectations • Plan • Design a prototype • Evaluate the prototype • Iterative design • Human Centred Design Process for Interactive Systems (ISO 13407)

9. Increased productivity Improved user satisfaction Enhanced quality of work Reduction in training and support costs What are the benefits?

10. How do libraries benefit? User centered design • resonates with profession • creates a competitive advantage • builds support among stakeholders • offers insight into optimal design for digital libraries “At the core of effective digital library design is the relationship between the content to be provided and the user community to be served.” -Christine Borgman

11. Four Stages of UCD

12. UCD: An Iterative Process

13. How does this research project relate to the model? Usability testing of the first version User needs assessment for second version

14. Usability Testing “Supposing is good, but finding out is better.” - Samuel Clemens

15. What is usability testing? • Usability testing measures: • Ease of learning • Memorability • Efficiency • Error rate and error recovery • Satisfaction • Characteristics of discount usability: • Small sample sizes • Simple testing techniques • Direct observation “Easy is hard.”- Peter Lewis, NY Times

16. Heuristic Evaluation • A method of usability testing that assesses a web site based on a set of established criteria for good design • Examples: • Jakob Nielsen’s 10 Usability Heuristics (http://www.useit.com/papers/heuristic/heuristic_list.html) • Benefits: • Easy and inexpensive • Does not require domain specialists (ex. Geologists or Geographers) • Identifies some problems that are difficult to find using other testing techniques

17. A group of usability testing methods for evaluating a user interface by collecting data from people while they are actually using the system User Testing

18. User Testing • Benefits: • Not only uncovers what the user is doing, but also why she is doing it • Identifies some problems that are difficult to find using other testing techniques “If the user can't use it, it doesn't work.”- Susan Dray “If the user can't find it, it doesn't exist.”- HFI button

19. Understanding the Audience “People’s behavior makes sense if you think about it in terms of their goals, needs, and motives.” - Thomas Mann

20. User Needs Assessment • Identify the audience and discover their needs and expectations for the system • Assessment should uncover the users’: • Knowledge • Experience • Attitude • Motivation • Typical tasks • Physical characteristics • Understand the context of use • Techniques: • Interviews • Observation • Analyzing tangible work documents

21. Aerial Photographs of Colorado:Portrait of a User • Familiar with the Libraries’ electronic resources and services • Studies geographic regions in Colorado • Uses aerial photographs to: • Identify field sites • Detect changes in the landscape over time • Create new cartographic materials • To accomplish these goals, users need to: • Imports digital photos into GIS software • Compares aerial photos to other cartographic materials

22. User Needs Assessment & Usability Testing Findings

23. User Needs Assessment:Functional Specifications • Ability to download at varying resolutions • Ability to zoom in & out • Ability to easily use photographs in a GIS

24. Heuristic Evaluation

25. User Testing Results • Navigation • Map Search • Maintaining spatial orientation: county map page, retrieved results page, access image page • Map Search vs. Keyword Search

26. User-Centered Design & Sustainability

27. Important Themes : Possible Solutions • Maintaining Spatial Orientation • Zooming & Downloading Capabilities

28. Maintaining Spatial Orientation • Aerial photographs = geographic materials • Issues: • county map page • retrieved results page • access image page

29. Possible Solutions • Html/JavaScript solutions within current web project • WebGIS

30. Web-based Interface: Possible solution to showing spatial orientation

31. WebGIS • Colorado Aerial Photos Interactive Map Viewer: http://mapdevel.ngdc.noaa.gov/website/kal/coaerials/

32. Zooming & Downloading Capabilities • Digital Library software • Luna Imaging

33. What’s Next? • Georeferencing & scanning more photos • Making ready to use in GIS • Collaborating with USFS • Next iteration of project

34. More information… • Lage, Kathryn, Christopher Cronin, & Holley Long. "Enhanced Library Collection Access through GIS: Historic Colorado Aerial Photographs." 2004 Environmental Systems Research Institute (ESRI) Education User Conference Proceedings. Presented by primary author. Available: http://gis.esri.com/library/userconf/educ04/papers/abstracts/a5105.html • Cronin, Christopher, Kathryn Lage, & Holley Long. "The Flight Plan of a Digital Initiatives Project: Providing Remote Access to Aerial Photographs of Colorado.” OCLC Systems & Services: International Digital Library Perspectives, 2005, 21(2), pp. 114-130. • Long, Holley, Kathryn Lage, & Christopher Cronin. "The Flight Plan of a Digital Initiatives Project, Part 2: Usability Testing in the Context of User-Centered Design” OCLC Systems & Services: International Digital Library Perspectives, 2005, 21(4). (In press)