1 / 73

CEOS WGISS 24 - IDN Task Team

CEOS WGISS 24 - IDN Task Team. Task leader: Lola Olsen, represented by Tyler Stevens. Agenda.

audra-lyons
Télécharger la présentation

CEOS WGISS 24 - IDN Task Team

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CEOS WGISS 24 - IDN Task Team Task leader: Lola Olsen, represented by Tyler Stevens

  2. Agenda 1. GCMD/IDN Science User Working Group2. Review of Minutes and Action Items3. Update on Population and Usage Statistics4. Development Plans for MD9.8 - MD105. GEOSS Activities and other Collaborations6. Node Reports7. Evolution of Controlled Vocabularies8. Re-emergence of the Interop and Communication9. The CEOS IDN Newsletter

  3. Briefing on the GCMD IDN Science User Working Group Meeting, June 19-20 2007 by Dr. Wyn Cudlip

  4. Key Topics from WGISS 23 • New IDN Features in MD 9.7 • Evolution of the DIF • Future Development • Information System and Data Center (ISDC) for Geo-scientific Data • User Working Group (UWG) Meeting • IDN Contributions to Interoperability Handbook

  5. WGISS Action Items • No. 22-13: When JAXA is ready, add a link to JAXA multilingual prototype to the GCMD page. • No. 23-8: Arturo to report back to WGISS-All on the awareness of the GEO task teams of the new IDN portals that have been created for those GEO tasks, and clarify what reviews are currently underway for the new GEO portals. Status: 23 June 2007: Lola and Arturo distributed a memo describing the portals that are currently in place, and they have been register in GEO registry. CLOSED • No. 23-10: Arturo (IDN Team) to assess the differences between the platform and instrument descriptions in the IDN and those contained in the CEOS database (CEOS Earth Observation Handbook). • No. 23-22: The IDN team (Lola Olsen) to perform a detailed analysis of user query patterns and present a summary of usage patterns and lessons learned at WGISS-24.

  6. Characteristics of IDN Usersthrough Population and Usage Statistics

  7. Most Popular Keyword Search December 2005 - October 2007

  8. DIF Population by Earth Science Topic

  9. Most Popular Full-Text Searches December 2005 - October 2007

  10. Searches by Ancillary Keywords Platforms 12% Instruments 14%

  11. DIF Population Growth Deletion and eventual replacement of Antarctic DIFs

  12. DIF Population by IDN Node

  13. Quality Control is on-going New, Revised, and Deleted DIFs - 2007

  14. Problem with Google Cache Summer Declines Web Page Hits

  15. Users by Continent Asia Australia Europe South America Africa Other North America January 2007 - October 2007

  16. Users by European Country

  17. How the Users Access the IDN Others (20%) NASA (4%) Yahoo (6%) wikipedia.org noaa.gov usgs.gov GCMD Direct Access (20%) Google (50%) The IDN allows robots to crawl the site to help broaden user access.

  18. When Users Access the IDN Lets us know best time to schedule server maintenance. January 2007 - October 2007

  19. Most Popular Browsers and Platforms Important for cross-platform and browser support of IDN software. January 2007 - October 2007

  20. Metadata Contributions January-September 2007 Improved translation technology has increased contributions from sources using other “mandated” standards. From docBUILDER 45% 55 %

  21. Lessons Learned from User Stats • Concentrate resources on keyword interface because most consistent usage come from there. • Consider adding spell-corrector for full-text search to give users more chances of finding data. • Improve functionality of docBUILDER and metadata ingestion tools. • Capitalize on Google cache and provide additional mechanisms for accessing metadata (metadata in KML). • Use semantic web technology to offer the option to search on related words to their original query.

  22. Development Plans forMD 9.8-MD 10

  23. MD 9.8 - Migrate from Oracle to “Open Source” Software (MySQL) • Staff evaluated alternative databases: • PostgreSQL, Mckoi, MySQL, and XML databases. • MySQL chosen as alternative to Oracle. • Staff is now in the process of migrating to MySQL.

  24. Oracle Vs. MySQL Database Oracle: 4610 ms. MySQL: 1582 ms. (# of milliseconds to query 150 Atmospheric Keywords)

  25. Benchmark Report • GCMD Oracle: 4610 ms. • GCMD XML DB: 6361 ms. • OS X MySQL: 1582 ms. • OS X XML DB: 2978 ms. • GCMD BDB (Cache): 2378 ms. • OS X BDB (Cache): 1589 ms. (# of milliseconds to query 150 Atmospheric Keywords)

  26. MD 9.9 - Quality Upgrade • To improve user experience • To enhance interoperability • To reduce maintenance • To streamline software testing process

  27. MD 10 - Next Generation IDN • Empower data providers to manage their “own” metadata (load, query, share, etc.) through a distributed input capability. • Represent the GCMD vocabulary as an ontology. • Re-engineer server to support rising levels of data sets and increasing demands for services.

  28. GEOSS Activities and Other Activities/Collaboration

  29. IDN Registered in GEOSS Registry Publication Portal

  30. GEOSS Portals

  31. IDN Architecture Within GEOSS Import metadata into GEOSS Portal catalogues IDN Metadata content harvest from FGDC clearinghouse node IDN Components in GEOSS registry

  32. IPY Data & Services Portals Find IPY DIFs in

  33. New Portals Added Since May 2007 • NASA Data • THREDDS • OBIS-SEAMAP • EBA-AMD SCAR Project • GEOSS Wildfires • GEOSS Wildfires Services • GEOSS InSitu Instruments • European Space Agency • Essential Climate Variables

  34. Refine by Platforms Under Ozone To Get Detailed Platform Description The “King” Request Mapped IDN Keywords to Essential Climate Variables (ECV)

  35. Enhanced Platform & Instrument Descriptions

  36. Expanded database table structures for Instrument and Platform hierarchical keywords 3 Instrument Categories 25 Instrument_Classes 29 Instrument_Types 22 Instrument_Subtypes 10 Platform Categories 66 Platform Series/Entities

  37. Requirements for a Platform/Instrument Search Interface • Capitalize on existing platform and instrument ancillary information. • CEOS Earth Observation Handbook • NASA Science Reference Handbook • IDN Descriptions • Utilize new technology to create an intuitive interface. • Provide capability to sort platform and instrument information by columns in sequential order. • Enhance capability to refine search within interface. • Directly link from instrument to platform descriptions and vice-versa, and link directly to associated metadata.

  38. NASA Earth Observation Platforms Metadata Platform Name Orbit Type Launch Date Associated Instruments TERRA Polar Sun-Synchronous1999-12-18 TERRA METADATA ASTER CERES MISR MODIS MOPITT Left Hand Navigation UARS Polar Non-Sun-Synchronous 1991-09-12 ACRIM CLAESHALOEHRDII MLS PEM SAMSSOLSTICESUSIM WINDII UARS METADATA MOCK UP

  39. NASA Earth Observation Instruments Instrument Name Instrument Class Start Date Associated Platforms Metadata CALIPSO IIR METADATA Passive 2006-04-28 IIR MODIS Passive 2002-06-25 AQUA TERRA MODIS METADATA Left Hand Navigation MOCK UP

  40. docBUILDER Tool for Platforms - Demo

  41. PLATFORMS COMPARATIVE TABLE IN RESPONSE TO TASK WGISS 23-10 Note: Description information provided in the document task were created by Olsen, L.M., G. Major, S. Ritz, T. Stevens, M. Meaux, A. Restrepo, 2007 . NASA/Global Change Master Directory (GCMD) Earth Science Keywords.

  42. INSTRUMENTS COMPARATIVE TABLE IN RESPONSE TO TASK WGISS 23-10Note: Description information provided in the document task were created by Olsen, L.M., G. Major, S. Ritz, T. Stevens, M. Meaux, A. Restrepo, 2007 . NASA/Global Change Master Directory (GCMD) Earth Science Keywords.

  43. Follow-up • Evaluate the addition of fields within the IDN Instruments description. • Swath width • Accuracy • Continued addition of Instruments and Platforms from CEOS Handbook. • Online Demo to add Platforms and Instruments descriptions – previously viewed. • Suggestions and questions from WGISS-24 participants.

  44. Node Reports

  45. Bernd Ritschel - GFZ ISDC

  46. AMD

  47. AMD Search Page Hits ~ 40 % increase in 2006 from 2005 ~ 14, 000 Hits in 2006 Over 10,000 Hits in 2005

More Related