1 / 9

Making Data discoverable & accessible Introducing Dept of Parks & Wildlife’s

Making Data discoverable & accessible Introducing Dept of Parks & Wildlife’s Marine Science information management infrastructure Florian Mayer, Dept Parks and Wildlife Presentation to ANDS round table 18 March 2014. Biodiversity Conservation

Télécharger la présentation

Making Data discoverable & accessible Introducing Dept of Parks & Wildlife’s

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Making Data discoverable & accessible Introducing Dept of Parks & Wildlife’s Marine Science information management infrastructure Florian Mayer, Dept Parks and Wildlife Presentation to ANDS round table 18 March 2014

  2. Biodiversity Conservation “Conserve, protect, manage native fauna & flora based on best practice science” Dept Parks & Wildlife Strategic Directions 2013-2014 Wisdom to inform policy Knowledge defensible & transparent The challenge Data management Data classification and sensitivity Digital information security Discoverability Accessibility Compliance Corporate culture and paradigm shift IT infrastructure and architecture Government agency woes – funding, agency restructure, locked out of academia Information from reproducible, automated analyses Data discoverable & accessible Research & Monitoring outcome-focused

  3. The solution Data & metadata catalogue As used by 200+ govs&NGOs 4 years of my work Marines & OIM collaboration Works for Marines Available to Division & Dept Code https://bitbucket.org/dpaw/ Data catalog- Workflow automation - Stats work bench

  4. Office for Information Management Scope Department-wide Mission To enable developers like me to deliver products like this data catalogue Marine Science Information Management Scope from Marine Science up to Science & Conservation Division Environment OIM’s department-wide infrastructure and policies Mission To deliver information management to Marine Science (serving as template for others)

  5. Biodiversity Conservation “Conserve, protect, manage native fauna & flora based on best practice science” Dept Parks & Wildlife Strategic Directions 2013-2014 Wisdom to inform policy Knowledge defensible & transparent Information from reproducible, automated analyses Data discoverable & accessible Research & Monitoring outcome-focused

  6. Biodiversity Conservation “Conserve, protect, manage native fauna & flora based on best practice science” Dept Parks & Wildlife Strategic Directions 2013-2014 Wisdom to inform policy Knowledge defensible & transparent Information from reproducible, automated analyses http:// Data discoverable & accessible R code as web app Data API Code repository Research & Monitoring outcome-focused Source code

  7. Biodiversity Conservation “Conserve, protect, manage native fauna & flora based on best practice science” Dept Parks & Wildlife Strategic Directions 2013-2014 Wisdom to inform policy Reproducible report Knowledge defensible & transparent Information from reproducible, automated analyses Data + Code + Markup = PDF Data discoverable & accessible Sweave Data API Code repository Research & Monitoring outcome-focused Source code Collaboration

  8. Biodiversity Conservation “Conserve, protect, manage native fauna & flora based on best practice science” Dept Parks & Wildlife Strategic Directions 2013-2014 Wisdom to inform policy Knowledge defensible & transparent Reproducible research Information from reproducible, automated analyses Data discoverable & accessible Simulate then observe (rinse&repeat) Research & Monitoring outcome-focused Mayer et al. 2010 Applying software engineering best-practice to scientific research

  9. Internal workings of CKAN @ DPaW Ubuntu 12.04 LTS VM ~/projects/dpaw_docker/ckan dpaw_docker code repo clone First build creates docker image, copies some CKAN files from image to local file system, creates startup scripts and persistent files Modify settings and page templates Second build overlays modifications into image Your custom CKAN docker image /srv/dpaw/ckan/ Docker image scripts and persistent files http Startup container: /srv/dpaw/ckan/startup.sh Run shell in container: /srv/dpaw/ckan/shell.sh backup Database is persistent in /srv/dpaw/ckan/var/lib rsync

More Related