Safeguarding GIS Data through Metadata The Minnesota Geographic Metadata Guidelines

1. Safeguarding GIS Data through MetadataThe Minnesota Geographic Metadata Guidelines Christopher Cialek & Nancy Rader Land Management Information Center MN Planning U-MN GIS Student Organization March 29, 2003

2. What’s Metadata? If you had two cans without labels, which would you eat? Without a label, how would you know which was tuna and which was cat food? Tuna? CatFood?

3. By the end of the Workshop . . . You will: • Understand what metadata is; appreciate its value • Become familiar with Minnesota’s metadata guidelines • Create your own metadata records • Use the GeoGateway to find data • Know where to go for help

5. What’s Metadata? “the information that makes data sets understandable, usable and sharable.” International Standards Organization

6. What’s Metadata? FDA Food Label We often use metadata without knowing it -- even a food label is an example of metadata! Structured format Specific content Necessary information

7. What’s Metadata? Search metadata to find resources in the library • Library community has developed metadata systems to describe books • Dublin Core • Allows you to search by title, author, subject…

8. What are Metadata Used For? • MANAGING DATABASES • COMPARING DATA SETS • FACILITATING DATA SHARING • PROVIDING TECHNICAL SPECS • FINDING DATA

9. Standards • Content Standard for Digital Geospatial Metadata (CSDGM) • Established by the FGDC (v2.0) approved 1998 • Structured, thorough, complex • www.fgdc.gov/metadata/contstan.html • Minnesota Geographic Metadata Guidelines (MGMG) • Derived from the federal standard in 1998 • Simplified, but retains all required fields • Became state standard in 1999 • www.gis.state.mn.us/stds/metadata.htm

10. Standards • ISO 19115 • International geospatial metadata standard • Currently under development, available late this year • Crosswalk to CSDGM: http://ogcengine.nima.mil/metadata/index.htm

11. TheMinnesotaGeographicMetadataGuidelines

12. The MGMG • SUBSET OF A FEDERAL STANDARD • MADE UP OF SEVEN SECTIONS • DRIVES WEB SEARCH TOOLS • USED BY OVER 75 ORGS IN MN • MN STANDARD; FGDC RECOGNIZED

14. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Originator: name of organization or individual that developed the data • Title:name by which the data set is known

15. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets TITLE • Too cryptic: niclcpy3 • Too general: Landuse • Acronyms: Wisconsin DOPs • Too detailed: Wetland Polygon Coverage Overlay for St. Cloud (USGS Quad) • Just right (includes theme, area, date): Minnesota Telecommunications Service Area Boundaries, June 2002

17. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Abstract:summary of what’s in the data set • Purpose:why the data set was developed • Time Period of Content:single date that best describes when the data are current • Currentness:text describingwhat the Time Period date is referring to, e.g., range of dates of aerialphotography

18. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Abstract:This land cover data set was derived from 30 meter resolution LANDSAT Thematic Mapper (TM) satellite imagery. Classification is divided into 15 classes with source imagery dates ranging from September 1991 to August 1996. Both a raster and a vector version are available. • Purpose:Land use planning, natural resource monitoring • Time Period of Content:August 9, 2000 • Currentness:Date of source imagery (LANDSAT-5 TM, bands 3, 4, and 5) ranges from September 20, 1991 to August 30, 1996.

19. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Spatial Extent:description of the geographic area covered (Minnesota, Washington County) • Bounding Coordinates:the extreme north, south, east and west limits of coverage expressed in latitude and longitude values W -95.4 E -89.5 N 49.4 S 45.5

20. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Keywords: words or phrases that summarize the theme and location of the data set, together with the name of any formal list of keywords (thesaurus) Too general:GIS, layer, survey Just right:Feedlot, animal agriculture,hog • Constraints:any restrictions to the access or use of the data set Access:Due to increased security measures taken after 9/11/01, this data set is no longer available online. Use:. . .right to use these data for any internal purpose

21. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Contact Information:the person who can answer questions about the content or development of the data set

22. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Browse Graphic:a sample illustration of the data set

23. 1 Identification Originator Title Identifier (optional) Abstract Purpose Content Date Currentness Progress Maintenance and Update Frequency Spatial Extent Description Bounding Coordinates Keywords Constraints Contact Information Browse Graphic Information Associated Data Sets A Walk Through the Guidelines • Associated Data Sets: information about other, related data sets that may be of interest If you’re interested in this data set, here are others that may also interest you. NOT a list of source materials. For information on other air photos available for Minnesota, see www.lmic.state.mn.us/chouse/airphoto

24. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Attribute Accuracy: qualitative or quantitativeexplanation of how accurately features in the data set have been described, including procedures used to assess accuracy (examples: field-checking, checkplots, frequency counts to find invalid codes)

25. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Completeness:information about selection criteria, omissions, generalization, etc. EXAMPLE: Geographic exclusion “Data was not available for Smith County.”

26. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Completeness:information about selection criteria, omissions, generalization, etc. EXAMPLE: Categorical Exclusion “Municipalities with population under 2500 not included.”

27. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Positional Accuracy:an explanation of what’s known about the horizontal and vertical accuracy of the data set (can be qualitative or quantitative) • Qualitative example: Data was collected in the field and plotted on a variety of base maps. Archaeological properties visited in the past 30 years are located on USGS maps. Almost all site locations are accurate to the quarter section. Most site locations are accurate to within a quarter-quarter section. Site boundaries are poorly defined, as are site centroids. Minnesota State Historic Preservation Office Archaeological Inventory

28. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Positional Accuracy:an explanation of what’s known about the horizontal and vertical accuracy of the data set • Quantitative example: Using the National Standard for Spatial Data Accuracy, this data set tested 1 foot horizontal accuracy at 95% confidence level. City of Minneapolis (from Positional Accuracy Handbook)

29. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale A Walk Through the Guidelines • Lineage: information about the sources of data used to construct the data set & processing steps applied

30. 2 Data Quality Attribute Accuracy Logical Consistency Completeness Positional Accuracy Lineage Source Scale LINEAGE RECIPE • Source Information Data set reference Scale Media Time period of content Source contribution Source Metadatareference • Processing Step Process description software used organization doing the processing Process date • Miscellaneous Notes

31. 4 Spatial Reference Horizontal Coordinate Scheme Ellipsoid Horizontal Datum & Units Resolution Altitude Datum & Units Depth Datum & Units If Raster If Geographic If UTM If State Plane If County Coordinate If User Specified Projection If Other A Walk Through the Guidelines

32. 4 Spatial Reference Horizontal Coordinate Scheme Ellipsoid Horizontal Datum & Units Resolution Altitude Datum & Units Depth Datum & Units If Raster If Geographic If UTM If State Plane If County Coordinate If User Specified Projection If Other A Walk Through the Guidelines • Horizontal Coordinate Scheme: how horizontal coordinates are expressed (latitude/longitude, UTM, State Plane, county coordinates) • Ellipsoid: the mathematical shape of the earth from which the map projection is based (Clarke 1866, GRS80) • Horizontal Datum: the measurement scheme used to locate horizontal coordinates onto an ellipse. (North American Datum 1983 (NAD83))

33. 4 Spatial Reference Horizontal Coordinate Scheme Ellipsoid Horizontal Datum & Units Resolution Altitude Datum & Units Depth Datum & Units If Raster If Geographic If UTM If State Plane If County Coordinate If User Specified Projection If Other A Walk Through the Guidelines • Coordinate System Specifications(choose only one): • Geographics latitude & longitude resolution • Universal Transverse Mercator zone, offsets (if any) • State Plane Coordinate System zone, offsets (if any) • County Coordinates zone, offsets (if any) • User Specified Projection map projection name, specifications • Other

34. 5 Entity and Attribute Entity and Attribute Overview Entity and Attribute Detailed Citation A Walk Through the Guidelines • Entity & Attribute Overview: description of the information content of the data set: the features it represents (entities) and details about them (attributes). An entity might be road and the attributes that describe it might include interstate, 6 lanes, concrete. • Entity & Attribute Detailed Citation: reference to other sources of detailed information on the content of the data set; pointer to a data dictionary

35. 5 Entity and Attribute Entity and Attribute Overview Entity and Attribute Detailed Citation A Walk Through the Guidelines Useless: 21 22 23 Examples: Land Use Codes Slightly Better: AGRICULTURAL LAND 21 - Cultivated Land 22 - Pasture Land 23 - Transitional Agricultural Land

36. A Walk Through the Guidelines Much Better: AGRICULTURAL LAND 21 - Cultivated Land Cultivated land includes those areas under intensive cropping or rotation, including periods when a parcel may be fallow. It represents land planted to forage or cover crop. The units exhibit linear or other patterns associated with current or relatively recent tillage. 22 - Pasture Land Land in active pasture use. This class was discontinued and combined into 23. 23 - Transitional Agricultural Land This category includes areas that show evidence of past tillage but do not now appear to be continuously cropped or in a crop rotation. Parcels in this unit include fields that are idle or abandoned and may or may not have been planted to a cover crop. In addition to displaying some evidence of past tillage, they usually are relatively uniform in vegetation.

37. 6 Distribution Publisher Publication Date Distributor Information Distribution Liability Transfer Format Transfer Size Ordering Instructions Online Linkage A Walk Through the Guidelines • Publisher: organization or individual that distributes the data set • Distributor Information:person who can answer questions about the distribution of the data set • Distribution Liability:statement of any liability assumed by the distributor Limitations Warranty Liability Redistribution Conditions Data Delivery Terms

38. 6 Distribution Publisher Publication Date Distributor Information Distribution Liability Transfer Format Transfer Size Ordering Instructions Online Linkage A Walk Through the Guidelines • Ordering Instructions:instructions for obtaining the data set. If applicable, instructions for acquiring data through Online Linkage element below • Online Linkage:(optional)when the data set is available online, this is the link to the Internet site where it can be downloaded

40. Purpose of a Metadata Entry Tool • Organizes metadata content • Provides help • Formats results • printed reports • webpages • Clearinghouse searches • Can it write the whole record for you?

41. Tools • ArcCatalog • Part of ESRI’s ArcGIS software • Customized for MGMG; download MGMG at:www.lmic.state.mn.us/chouse/arccatalog.html • DataLogr (customized for MGMG) • Software independent • Customized for MGMG; download at:www.lmic.state.mn.us/chouse/datalogr.html • Idrisi • Metadata module • Not customized for MGMG

42. ArcCatalog • Editor • change an existing metadata record • create a new record • Stylesheet • needed to view a metadata record

43. MGMG Converter Utility • Creates standardized formatted output • HTML (.htm): for display • XML (.xml): used by ArcCatalog and Clearinghouse • LGR (.lgr): used by DataLogr • Generic database (.csv): use in databases • Creates hotlinks for web addresses

44. Hands-on Session with ArcCatalog • Part 1: Get started • Become familiar with viewing and editing screens • Part 2: Edit a record • Change the content of an existing metadata record • Part 3: Display a record • Create an HTML version of your edited record • Compare different views of a record • Part 4: Create a new record • Evaluate automatically created record • Create your own starter template

45. Exercise Wrap-up • View and edit existing metadata • Find help • Online Linkage • MGMG converter • Stylesheets • Starter template • Tools evolve

46. How to Make this Easier… • Use starter templates and existing documents • Prioritize your legacy data • What is most critical? • What will you get asked about the most? • Create metadata DURING your project • When you create new data • When you change existing data • If you leave metadata until the end, it rarely gets done • Avoid defining data sets too finely or too broadly

47. How to Make this Easier… • Share the task • Ask someone else to read your record

48. How to Make this Easier… • Something is better than nothing! Do Nothing Do Something Organize using a metadata standard Use a metadata tool