Data Daze

1. Data Daze Statistics Canada and DLI Data

2. What is (are) Data? • Data are what statistics are derived from • In the case of Statistics Canada, Data are files that have been anonomized and organized in a file where the records in the file represent the responses to survey questions of each individual respondent • Not human readable!

3. Statistics or Data?

4. Size Concerns • Data files can contain <10,000 to 50,000+ records • Records can contain <50 to 1,000+ variables • Can be as few as 50 to over 2000 bytes in length • Documentation can consist of 50 to 600+ pages

5. DLI Data Available • DLI Products include: • Public Use Micro Data Files (PUMFs) • Census/Geography Files • Databases • DLI also contains some aggregate data in B2020 and other formats • Canadian Business Patterns • Justice Tables • Many (but not all) DLI products are in the Catalogue

6. How to recognize data questions • “I need this data file, please” • Need data to manipulate for an assignment • Geographic level of analysis • Variable level of analysis • Looking to combine a series of variables • “I need numbers on…”

7. Statistical Information available through Statistics Canada Open Restricted Free Expensive Statistics Data Different Services Statistics Depository Data Liberation Cu$tomized Remote Job Research Data Service: Canada Website Service Initiative Tabulations & Submission Centres Program Pay per View Who is General Public: Designated Post-secondary Individuals: Approved Approved Eligible & DSP Libraries Academic: Researchers: Researchers: available on the contract between Internet at STC and Conditions: & their Users: restricted to contract between SSHRC peer www.statcan.ca individual teaching and STC and review & deemed available on site research purposes individual STC employee - The Daily - Paper publica- Standard data Tables from “Dummy” or Confidential data - Canadian tions products: confidential files synthetic files to files from the Products: Statistics - Electronic pub- aggregate data that are specially build analysis longitudinal - Census lications, which bases, microdata produced by setups that must surveys begun in - Statistical profiles includes priced files and Statistics Canada then be submitted the 1990’s of Canadian down-loadable geography files for a fee and to Stats Can for communities publications & access to processing - Downloadable select CD ROMS specialized publications databases Warning: some Some DSP Interface to Specialized Notes parts of the Website libraries provide CANSIM I and databases include off-site access to Trade Analyzer are fee-based authenticated available through CHASS (University users of Toronto) by subscription ACCESS Services available Applications can for selected titles. now be submitted CANSIM II and Remote job through the submission is the Trade Analyzer SSHRC Web site. most developed for NPHS.

8. Example • A student comes to the desk asking how many people in St. John’s use the Internet for banking

9. Would STC collect this data? • Socio-Economic data • No company information • Not always the best choice (e.g., Heath= CIHI, Business= Strategis) • http://www.statcan.ca/english/about/used.htm

10. The Daily • First stop for information • It is legally required to announce every piece of information released by STC in the Daily • Searchable • Provides highlights of the release as well as links to more information

11. ESTAT vs. CANSIM • ESTAT • Nicer interface (IMHO) • Easier to select multiple variables • Easier to obtain longitudinal data • Subset of CANSIM • Updated annually • CANSIM • Contains all CANSIM tables • Can browse by Table Number • Updated weekly

12. If it’s a Data Question… • You need to determine three things: • Is the patron a current student, staff or faculty member? • Is the patron familiar with statistical software and analytical techniques? • Does the use of the data fall under the terms of the data licence?

13. DLI Licence • Under this licence data are made available for: • Teaching • Planning of academic/educational services • Academic Research and Publishing • Use of data in textbooks falls under a different set of STC licences and permissions • Data are not to be used in any commercial or private activities (even if no money is involved) • Data cannot be shared outside the institution

14. Is the Data Available? • STC Our Products and Services catalogue will tell you if a product is available through the DLI • Look for “information for libraries” • Public Use Data File = PUMF = DLI Data

15. Getting the Data • IDLS • Non-assisted interface for data • Does not contain all DLI data • Provides Codebooks and SPSS/SAS Syntax files • If our patrons can use it, we need how to as well!

16. Variable Searching in IDLS • IDLS allows you to search through the questions asked in STC surveys • Great if you have a really obscure question – “I want sales of children's shoes…”

17. Census Tables in IDLS • Thousands of B2020 census tables are available in IDLS • Back to 1986 • Free download of B2020 viewer available at: www.ucalgary.ca/~landru/b2020.html • Great searching!

18. Summary – DLI • Raw data PUMFs • Contain more detail than other STC products • Not every survey has a PUMF released • PUMFs need to be massaged using statistical software • Find them: • Library Catalogue • STC Catalogue (Products and Services) • IDLS

19. Summary - DLI • Aggregate Data • Collection of B2020 tables and databases • Often derived from reported statistics (i.e. Justice tables, Business) • Find them: • Library Catalogue • STC Catalogue (Products and Services) • IDLS

20. Summary - DLI • Geospatial Products • Majority are census files • Available in ArcView and MapInfo formats • Find them: • IDLS

21. Summary – Licenced Users • Before you refer a patron for data services, ensure: • They are a current student, staff or faculty member of Memorial • They are familiar with SPSS or other statistical software package (or have a resource to help)

22. Summary – IDLS • Contains: • DLI PUMFs & other products • Census Tables • Other free data • Searchable by: • Browse (or search) by name/subject of product • Variable keyword • File type • Lots more!

23. Summary – Search Techniques • To know if something exists: • The Daily • Catalogue of Products & Services (show information for libraries) • To find it: • CANSIM/ESTAT (longitudinal, census) • Census webpage (lots of free data) • Community profiles (basic demographic data, census) • Analytical reports • Print publications • If the survey exists, but the information you’re looking for isn’t available through one of these sources, then you might be looking at a data question

24. Useful Resources – Stats & data • The Daily http://www.statcan.ca/english/dai-quo/ • Products and Services catalogue http://www.statcan.ca/english/services/ • Definitions, Data Sources and Methods http://www.statcan.ca/english/concepts/index.htm • Guide to ESTAT http://www.statcan.ca/english/Estat/promo/user-guide.pdf • Guide to CANSIM II http://www.library.mun.ca/qeii/govdocs/cansimII.php • DLI Collection: survey names and acronyms http://www.statcan.ca/english/Dli/inventory.htm

25. STC Website Cheat Sheet • Looking for community information at the smallest geographic level? Community Profiles! • Looking for information about Canadians? Census! • Looking for statistics on a subject? The Daily!

26. STC Website Cheat Sheet • Looking what products are available from a survey? Products and Services! • Looking to see if a question was asked on a survey? IDLS Variable Search!

27. Exercise Fun!