ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Course Outline Part I: What Is Metadata? Part II: Metadata Creation Part III: Class Exercise Part IV: Clearinghouses
First…. Some Terms Metadata - Documentation of geospatial data written in a consistent manner FGDC-Federal Geographic Data Committee CSDGM- Content Standard for Digital Geospatial Metadata, referred to commonly as “The Standard” or “The Content Standard” Clearinghouse- A distributed catalog of metadata Geospatial- refers to a geographic location
What is Metadata? Simply put, metadata is information about your data.
This is the metadata for this. Aunu`u What’s Missing?
This is the metadata for this. Author(s) Boullosa, Carmen. Title(s) History of American Samoa / by Carmen Boullosa Place New York : Grove Press, 1997. Physical Descr viii, 180 p ; 22 cm. Subject(s) Oceana Format Reference While the card-catalog entry is a form of metadata, it does not address topics such as quality, accuracy, or scale. Well-written geospatial metadata describes these and many more aspects of the data.
What is Metadata? a small part of This is the metadata for this. Identification_Information: Citation: Citation_Information: Originator: United States Department of Commerce, National Oceanic and Atmospheric Administration (NOAA), National Ocean Service (NOS), Coastal Services Center (CSC) Publication_Date: 20020923 Title: Vectorized Shoreline of Hawaii, Derived from Landsat ETM, 2002 Edition: first Geospatial_Data_Presentation_Form: vector digital data Publication_Information: Publication_Place: Charleston, SC Publisher: United States Department of Commerce,
Metadata contains vital information. Imagine, if you will… You are given two identical cans without labels. One contains cat food, the other contains tuna (dolphin-safe, of course). You must choose one these cans, and then eat the contents.
What is Metadata? Other Examples?
Properly documented data provides vital information to interested parties.
What is Metadata? RARNUM - unique combination of species, concentration, and seasonality CONC(concentration) = Density species is found at location Season_ID =seasonality code link to the seasonal table Element - Biology group Metadata is that component of data which describes it. Environmental Sensitivity IndexData Metadata
What is Metadata? Title Scale Source Content Location Publication Access Metadata GIS files Imagery Geospatial databases GPS data Data set It’s data about a data set.
What is Metadata? Metadata describes… CONTENT CONDITION QUALITY Characteristics of the data
Take Home Message Because metadata provides vital information about a dataset, it should never be viewed or treated as a separate entity. Metadata is a critical and integral component of any complete data set. Spatial Metadata Non-spatial or attributes
The Value of Metadata Two similar paintings by Picasso up for auction sold for vastly different prices. Why? One had metadata... ...One didn’t.
1970 HEW Western Samoa British Honduras Trust Territory Cape Hatteras Light Arpanet Mt. St. Helen West Germany 2000 HHS & HUD Samoa Belize U.S. Commonwealth Cape Hatteras Light Internet Mt. St. Helen Germany Metadata should be updated to reflect changes in the data.
The Value of Metadata For data developers, metadata... • Avoid duplication • Share reliable information • Publicize efforts • Reduce workload
The Value of Metadata For data users, metadata... • Facilitates understanding • Focuses on key elements • Enables discovery — inside and outside of organizations
The Value of Metadata For organizations, metadata... • Protect investment in data • Create an institutional memory • Counter personnel changes • Allow sharing of data with other agencies • Reduce costs • Limit potential liability • Save time and money
The Value of Metadata Metadata as a “data discovery” tool If it’s geospatial data you need, metadata helps • Find data of interest • Determine the usefulness of the data • Determine how to access the data This saves time and money.
Metadata Standards Think for a moment how hard it would be to… … bake a cake without standard units of measurement. … put gas into your car without standard nozzle sizes. … plug a lamp into a socket without standard electrical outlets.
Metadata Standards Standards ensure consistency. The standard for metadata ensures a level of consistency in data documentation.
Metadata Standards The Metadata Standard The Federal Geographic Data Committee (FGDC) was organized in 1990 under the Office of Management and Budget to promote the coordinated use, sharing, and dissemination of geospatial data on a national basis. The FGDC was tasked with creating a metadata standard to meet these objectives.
Metadata Standards The Content Standard for Digital Geospatial Metadata (CSDGM) "... each agency shall document all new geospatial data it collects or produces, either directly or indirectly, using the standard under development by the FGDC, and make that standardized documentation electronically accessible to the Clearinghouse network." Executive Order 12906, 1994
Metadata Standards Process step Access constraints The Content Standard utilizes... • Common terms • Common definitions • Common language • Common structure entity currentness domain lineage Citation attribute
Metadata Standards The Content Standard helps the user determine... • If a set of geospatial data is available and fit for a particular use. • How to access and transfer the • data set.
Metadata Standards FGDC’s Metadata Workbook Defines the 334 metadata elements.
What do I use “The Workbook” for? • It is the definitive resource for applying the FGDC Content Standard. • It provides section and element definitions. • It describes element domain values, which are valid values that can be assigned to the data element. • However, it does not define • the production rules.
Interpreting the Metadata Workbook A data element is a logically primitive item of data. Data elements are the things that you “fill in.” The form for the definition of a data element is: Data element name -- definition. Type: (choice of “integer”, “real”, “text”, “date”, or “time”) Domain: (describes valid values that can be assigned) An example of the definition of a data element is: Abstract -- a brief narrative summary of the data set. Type: text Domain: free text Note: Data element definitions are contained in the text of the Content Standard, not in the graphical production rules.
Organization of the Content Standard Use the “Graphical Representation” for quick access. • It is a quick reference for production rules and structure. • You will still need to use the workbook to find the definition of a particular element and its domain.
Organization of the Content Standard Metadata 8 Citation Information 9 Time Period Information 10 Contact Information The Three Supporting Sections The Seven Main Sections 1 2 3 4 5 6 7 Identification Information Spatial Reference Information Entity and Attribute Information Distribution Information Metadata Reference Information Data Quality Information Spatial Data Organization Information
Data Compound Element Element Mandatory if Applicable - must be provided if the data set exhibits the defined characteristic. Optional - provided at the discretion of the data set producer. What’s Mandatory? What’s Not? Meaning Mandatory - must be provided.
Remember, metadata is a legacy document that concisely sums up your data or data set. Without metadata, your data set is incomplete.
FOR MORE INFORMATION Michael Moeller NOAA CSC Metadata Specialist Mike.Moeller@noaa.gov www.csc.noaa.gov/metadata/
Writing Metadata is not THAT bad! • First records are the hardest. • Not all fields may need to be filled in. • Tools are available. • Training classes can be taken. • Can often be produced automatically. • Can (and should) be reviewed • for updates.
Writing Metadata Templates can help!! • Contain information that is specific to your project or organization • Allow you to enter and save pertinent information for use at later date • Save time and effort! • No special tools needed! • Like any other metadata, can (and should) be reviewed for updates.
Writing Metadata Before you begin writing, get organized.
Writing Metadata Document your data as you go.
Writing Metadata Write so others can understand.
Writing Metadata Keep your readers in mind. • Define all acronyms. • Avoid using jargon. • Clearly state data limitations.
Writing Metadata Always review your document.
Items required FGDC Workbook Metadata entry tool Chocolate
Tool Time A sample of some of the available tools for metadata creation, validation, and publication. • TKME • Text editor used for metadata entry. • NOAA CSC ArcView Metadata Collector • Extension for ArcView 3.x. • ArcCatalog Metadata Editor • Metadata creation in ArcGIS • NOAA CSC MetaScribe • Allows you to create a template record that can be used to create large numbers of similar records. • CNS and MP • “Chew ‘n spit,” checks and corrects structural errors, • and “Metadata Parser”, which checks for errors in • element compliance.
TKME • An editor for formal metadata. • TKME is intended to simplify the process of creating metadata • that conform to the content standard
Metadata Collector for ArcView 3.2 • A free, downloadable extension for ArcView 3.x users • Enters information for certain elements automatically • Allows user to save individual elements for future use
Metadata Collector for ArcView 3.2 On each screen, there is a Section Help and a Section Example button. The Section Help button opens a window containing definitions of the metadata elements for that section. The Section Example button provides an example of an FGDC-compliant metadata record. At the right side of most of the screens will be the option to Retrieve and Save the information you have entered into the fields. This allows you to save frequently used information such as contact and similar abstracts to be used repeatedly. These are generally saved as either .dbf or .txt files in the working directory specified.