Sherrilynne Fuller, PhD Co-Director, Center for Public Health Informatics Professor Biomedical and Health Informatics,

1. Decision Support for Public Health Practice: Research Findings in the Development of Knowledge Management and Disease Surveillance ToolsUniversity of LjubljanaJuly 10, 2007 Sherrilynne Fuller, PhD Co-Director, Center for Public Health Informatics Professor Biomedical and Health Informatics, School of Medicine University of Washington, Seattle, USA Center for Public Health Informatics University of Washington

2. Alaska USA Seattle, Washington Vancouver, British Columbia, Canada NOTE: Map NOT to Scale for Alaska Center for Public Health Informatics University of Washington

3. UW Center of Excellence in Public Health Informatics Administrative Core A Epidemiology & Biostatistics Core Surveillance Integration Project WA State Dept of Health WA State local health agencies Knowledge Management myPublicHealth Informatics Technology Core C Regional Health Information Organizations University of Washington Center of Excellence in Public Health Informatics Technology & Design Core “Improving the public’s health through information integration” Center for Public Health Informatics University of Washington

4. Center for Public Health Informatics University of Washington

5. Role of Medical Care in 20th Century Public Health Achievements RA Patrick O’Carroll, MD Region X Health Administrator

6. RA Patrick O’Carroll, MD Region 10 Health Administrator

7. Clinical PH Information Interchange – Research Questions • Clinical (patient) information to support chronic disease interventions in communities: what is the minimum data set? • Situational awareness data exchange – how to do in a focused, timely, comprehensive way? • PH clinical data (e.g. immunization, disease status, relevant community information) to electronic health record? • Timely approaches to people and directory type information interchange? • Research findings – how to extract from the literature and present to practitioners? • Utilization of community health information for decision support for individual patients? Center for Public Health Informatics University of Washington

8. CPHI Key Research Areas • Knowledge in Practice 1.Managing information resources and data for PH practice 2.Business process analysis and workflow characterization • Surveillance Data for PH practice • Collection and Analysis • Geospatial Presentation

9. Knowledge in Practice: The Challenge • Neither the creation nor the distribution of information resources* upon which public health practitioners depend is managed or presented in any systematic or comprehensive way at the present time *data of all types, guidelines, research findings, maps, policies, laws, evaluation metrics, teaching materials, etc. Center for Public Health Informatics University of Washington

10. Approach Research workflow and information needs of public health practitioners to support evidence-based practice Develop and optimize a knowledge management system to support iterative refinement of a set of retrieval and information management tools for public health practitioners Center for Public Health Informatics University of Washington

11. Information Needs of Public Health Practitioners: Observations • Few formal studies of information needs, information-seeking behavior or workflow of PH professionals • Rapidly expanding volume of data and information • Major barriers: time, resource reliability; discerning credibility of information • People are a critical source of information in public health • Silos of surveillance information – lack currency and context • Lack of linkages between individual patient information and public health information systems • Revere D, Turner A, Madhavan A, Rambo N, Bugni PF, Kimball AM, Fuller SS. Understanding the information needs of public health practitioners: A literature review to inform design of an interactive digital knowledge management system. J Biomed. Informatics 2007. Special Issue on Public Health Informatics. Center for Public Health Informatics University of Washington

12. Information Needs of Public Health Practitioners Resources used influenced by job function, disciplines & training Want resources that are easy to access & use, up-to-date, free, pre-digested & stable, focused One size/approach does not fit all; personal customization is highly desired Revere D, Turner A, Madhavan A, Rambo N, Bugni PF, Kimball AM, Fuller SS. Understanding the information needs of public health practitioners: A literature review to inform design of an interactive digital knowledge management system. J Biomed. Informatics 2007. Special Issue on Public Health Informatics. Center for Public Health Informatics University of Washington

13. Information Needs of Public Health Practitioners: Resource Types • Information from areas beyond biomedical domains: e.g. social, legal, policy • Systematic reviews & summary information • Government reports (grey literature) & conference proceedings • Evidence-based resources – e.g. full-text research articles; synthesized reviews of clinical topics • Data from community-based and clinical systems with geographic mapping and analysis capability Center for Public Health Informatics University of Washington

14. Why a Content Management System? CMSs streamline the process of creating, managing & delivering content, & put processes in place to manage & control information as it is moved & changed • Publishing • Web delivery • Portal delivery • Content distribution & syndication • Streaming • Real-time content • Content intelligence • Collaboration services • Transformation • Renditions • Process automation • Library services • Repository services Manage Deliver Content Management Solution Create / Capture Archive / Retire • Authoring • Importing • Aggregation • Imaging • Records management • Final form storage Review / Approve Center for Public Health Informatics University of Washington

15. Rapid Prototyping: Iterative Refinement Process Center for Public Health Informatics University of Washington

16. Prototyping the Interface • Toolkits • Locally customizable, role-based resources views • Advanced retrieval tools Beta Version 3.0 http://myph.org/ Center for Public Health Informatics University of Washington

17. Center for Public Health Informatics University of Washington

18. Usage of myPH Prototype: Data summary, 03/05/2007Promotion began ramp-up - Feb 2007 http://myph.org/webalizer Center for Public Health Informatics University of Washington

19. Core Workflow Problem • The information processes and workflow of public health practice are not well characterized, making it difficult to build public health information systems that efficiently support practice.

20. Workflow Analysis Research • Faculty from the UW-CPHI are participating in requirements definition projects: • Kitsap County Health District - chronic disease prevention and control (J. Baseman, A. Turner) • Spokane County Health District - public health preparedness (B. Karras) • Significance to PH Practice: improved efficiency, cost savings, improved disease surveillance, and improvements to the health of communities

21. Biosurveillance Research • Value of data • Decision support for biosurveillance: Utility functions for identifying and evaluating a minimum data set (J. Doctor, J. Baseman, B. Lober) • Notifiable condition reporting • Electronic forms to support notifiable condition reporting in a health information exchange infrastructure (B. Lober, J. Baseman, B. Karras) • Future: Bayesian networks for case identification • Algorithms for probabilistic reporting criteria • Geospatial mapping of disease incidence

22. Uncertainties about Biosurveillance Data • Timeliness • Organizational processes • Data entry, system architectures • Network traffic delays • Integrity • Accuracy, Completeness • Depends on quality control • Relevance • Depend on purpose of data analysis • Outbreak detection, situational awareness, program monitoring & evaluation, community assessment • Multi-attribute Utility Theory - Utilizing to determine trade-offs

23. Relevance • Time tradeoff • Children exposed to a child w/. suspected measles. Low prior probability  confirmation needed. Time tradeoff w/ efficacy of vaccination. Utility of a lab result in N hours? • Subjects/Sampling/Instrument • PH professionals practicing at County PH offices • Email request sent to County PH Officers in WA • Interactive Web Survey - Tradeoff questions, rating scales and demographic questions

24. Notifiable Conditions Survey

25. Utility as a function of lab delay on time to act - measles outbreak Data elements have tractable utility representations, and utility tradeoffs. PH professionals place nonlinear value on time-to-act, preferences

26. Electronic Notifiable Condition Reporting • Electronic forms using Xforms technology (XML) • Form instance and data instance • Demonstration showcased: • Provider engagement • Efficiency through form pre-population • Efficiency through electronic transmission • Inherent auditing, recording workflow Center for Public Health Informatics University of Washington

27. Incidence: ICD-0: C34.0-C34.9, excluding histology codes 9140, 9590-9989 Mortality: ICD-9 (1990-1998): 162.2-162.9,  ICD-10 (1999- ): C34 Lung Cancer in Washington State Age Adjusted rates Tables Center for Public Health Informatics University of Washington

28. Conclusion • Integrated PH decision support systems are in their infancy in the U.S. • We can learn from lessons of clinical decision support system design and deployment • It is critical that we figure out how to optimize timely data exchange of critical information between clinical and public health information systems • Much more work is needed to understand information needs and practice in order to optimize the decision support environment for public health practitioners Centerfor Publ ic Health Informatics University of Washington

29. Bibliography – Cont. • Revere D, Madhavan A, Turner AM, Rambo N, Kimball AM, Bugni P, Fuller S. Understanding the information needs of public health practitioners: a literature review to inform design of an interactive digital knowledge management system. J Biomedical Informatics 2007 (Special Issue on Public Health Informatics). • Revere D, Bugni P, Fuller S. A Public Health Knowledge Management Repository that Includes Grey Literature. Publishing Research Quarterly 2007 (Special Issue on Grey Literature 2007). • Revere D, Bugni PF, Fuller S. An interactive digital knowledge management system to improve public health practitioners' access to public health resources. In Proceedings of the American Medical Informatics Association (AMIA) Annual Fall Symposium, Nov 2006. Washington DC. • Revere D, Madhavan A, Kimball AM, Turner A, Bugni P, Fuller S. myPublicHealth: Research in Public Health Knowledge Management to Support Evidence-Based Practice. In Proceedings of the CDC's Public Health Information Network (PHIN) Conference, Sept 2006. Atlanta GA. Center for Public Health Informatics University of Washington

30. Bibliography – Cont. • Revere D, Madhavan A, Kimball AM, Turner A, Bugni P, Fuller S. myPublicHealth: Research in Public Health Knowledge Management to Support Evidence-Based Practice. In Proceedings of the CDC's Public Health Information Network (PHIN) Conference, Sept 2006. Atlanta, GA • Doctor, J. Baseman, JG, Lober, BD, Davies, J., Kobayashi, J. , Karras. B., Fuller, S. Time tradeoff utilities for identifying and evaluating a minimum data set for event detection in time-critical biosurveillance. Submitted: Medical Decision Making. • Hoskins RE, O’Connor C, Johnson C, O’Carroll P, Fuller S. EpiQMS: An Internet Application for Access to Public Health Data for Citizens, Providers, and Public Health Investigators. Journal of Public Health Management and Practice, 8(3):30-36, 2002. Center for Public Health Informatics University of Washington

31. Center for Public Health Informatics University of Washington

32. Center for Public Health Informatics University of Washington