Developmental Methods for Knowledge Management

1. Developmental Methods for Knowledge Management The Theory and Practice of Digital History Carl A. Young, M.A. in waiting 1 December 2009

2. Project Overview Challenge Resource and skill-constrained historians and archivists require efficient methods for capturing and sharing original artifacts. • Multi-phase project • Develop a low-cost methodology for digitally archiving documents • Store them in a standards-based data storage platform • Set the conditions to scale with future phases • Creating a collaborative, accessible, online digital repository Methodology Phase I – Prototyping Phase II- Capture Phase III- Web Access Phase IV- Initial Expansion Phase V- Infinite Expansion Major Phases

3. Phase I: Prototype Completed in November 2009, this phase established a coherent methodology for project development by prototypingthe capture and conversion of an original artifact for testing and exploration purposes.

4. Phase I: Prototype (cont.) Demonstration Original Digital Camera .JPG file format 2 MB Treatment w/Photoshop .TIFF 29 MB Adobe Converstion .pdf 278 KB Time elapsed: Photo: <1 min Treatment: ~3 min Conversion: <1min

6. Phase I: Prototype (cont.) Process Flowchart

7. Phase I: Prototype (cont.) Image Capture Image Preservation Image Manipulation Work Breakdown Structure Database Development TEI Process Development Data Development Documentation Disaster Recovery Testing Static Web-Page Prototyping

8. Phase I: Prototype (cont.) Gantt Chart

9. Phase II: Capture Completed in November 2009, this phase performed and documented a low-budget document capture, artifact preservation, and conversion to a distributable format where a historic text is extracted from the original document, archived, and presented to the user in both the original capture (.jpg or .tiff) and distributable (.pdf and .xml) format with an evaluation of optical character recognition (OCR) and transcription requirements.

10. Phase II: Capture (cont.) Image Treatment • Filter • Blur • Smart Blur • Radius-100 • Threshold-100 • Quality- High • Mode- Normal • Surface Blur • Radius-100 • Threshold-25 • Surface Blur (if needed) • Radius-100 • Threshold-25 • Lens Blur • Shape - Octagon • Radius - 5 • Blade Curve - 50 • Rotation - 300 • Brightness -10 • Threshold - 75 • Noise- 3 • Distro –Uniform Select • Select • Color Range • Modify Shadows • No Invert • Modify • Expand 2 Cut File • New * • Width-1600 • Height - 2500 • Resolution- 300 • CM - RGB 16bit • * Recommend saving as a preset. Paste Flatten Clean up as needed Save As .TIFF Select Area • Image • Adjustments • Curves “Digitization” • Channel - RGB • Output-203 • Input-160

11. Phase II: Capture (cont.) OCR and Transcription Demo OCR Time elapsed: OCR: <1 min Transcription: ~5min Transcription

12. Phase II: Capture (cont.) TEI Demo Time elapsed: Preliminary Data: ~45 min Page: ~5 min

13. Phase II: Capture (cont.) Methodology Flow Chart

14. Phase II: Capture (cont.) Image Capture TEI Work Breakdown Structure Prototype Database Input Documentation Disaster Recovery Testing

15. Phase II: Capture (cont.) Gantt Chart

16. Phase III: Web-Access This phase is the subject of this grant funding request. A team of professional developers will construct a suitable multi-media database for storage and access of original artifact captures, distributable .pdf versions, and XML-based data and metadata derived from the original. The team will also develop a working prototype web site to access the data. Fundamental to this phase will be data archiving and disaster recovery for the data. Successful conclusion of this phase will yield a working version 1.0 available for release and continued development.

17. Phase III: Web-Access (cont.) Flow Chart

18. Phase III: Web-Access (cont.) Database Development Prototype Evaluation Prototype Web Development Work Breakdown Structure Alpha Test & Mod Beta Test & Mod RC1 Documentation Disaster Recovery Testing Test & Mod v1.0

19. Phase III: Web-Access (cont.) Project Gantt Chart

20. Phase IV: Initial Expansion Beyond the scope of this grant request, this phase seeks to develop partnerships and data shares across multiple institutions with similar projects in development or production. The level of participation directly influences the scale of this phase. It is anticipated that the minimal costs will be shared across participating institutions.

21. Phase IV: Initial Expansion (cont.) Publish Methodology Find Partners Large Scale Capture Leverage v1.0 Work Breakdown Structure Update Code and Processes Conduct Lifecycle Management Review Documentation Disaster Recover Testing

22. Phase V: Infinite Expansion Optionally, and depending on the success of the earlier phases, this phase will greatly expand collaborative efforts by potentially make this capability available to amateurand resource-constrained archivists and historians by providing a standards-based methodology and data capture technique and a collaborative platform to share the data once stored. This aspect of the final phase will be limited only by technology maintenance and scalability costs.

23. Phase V: Infinite Expansion (cont.) Publish Updated Methodology Publish Membership Schema Work Breakdown Structure Open Data Models Leverage Current Version Conduct Lifecycle Management Review Documentation Disaster Recover Testing

24. Grant Support / Summary Project Summary Grant Request / Funding Summary • 5-Phase Approach • “How-To” • Digitization • TEI • Manage the project • Sets the stage • Broad/ambitious goals and plan • Manageable pieces • Phase III support: • $51,733.33 • Prototype Validation • Database Development • Web Development • Hosting • Disaster Recovery • Phase IV and V templates • Future expansion as desired • Flexible Planning

25. Questions