Geographic Data Mining

1. Geographic Data Mining Paradigms for Spatial and Spatio-temporal Data Mining

2. About … • Mining from spatial and spatio-temporal data • Meta-mining as a discovery process paradigm • Processes for theory/hypothesis management

3. Mining from spatial and spatio-temporal data • Rule types • Spatial vs. spatio-temporal data • Handling second-hand data

4. Rule types • Spatio-temporal associations • Spatio-temporal generalization • Spatio-temporal clustering • Evolution rules • Meta-rules

5. Spatio-temporal associations • X -> Y (c%, s%) • Require the use of spatial and temporal predicates • For temporal association rules, the emphasis moves form the data itself to changes in the data

6. Spatio-temporal generalization • Concept hierarchies are used to aggregate data • Spatial-data-dominant • ‘South Australian summers are commonly hot and dry’ • Nonspatial-data-dominant • ‘Hot dry summers are often experienced by areas close to large desert systems’

7. Spatio-temporal clustering • Similar to normal clustering • Far more complex • Characteristic features of objects in a spatio-temporal region OR spatio-temporal characteristics of a set of objects are sought

8. Evolution rules • Explicit temporal and spatial context • Describes the manner in which spatial entities change over time • Exponential number of rules can be generated • Example predicates

9. Example predicates • Follows • One cluster of objects traces the same (or similar) spatial route as another cluster at a later time (spatial coordinates are fixed)

10. Example predicates • Follows • Coincides • One cluster of objects traces the same (or similar) spatial path whenever a second cluster undergoes specified activity (temporal coordinates are fixed)

11. Example predicates • Follows • Coincides • Parallels • One cluster of objects traces the same (or a similar) spatial pattern but offset in space (temporal coordinates are fixed)

12. Example predicates • Follows • Coincides • Parallels • Mutates • One cluster of objects transforms itself into second cluster

13. Meta-rules • Created when rule sets rather than datasets are inspected for trends and coincidental behaviour • Describe observations discovered amongst sets of rules • The support for suggestion X is increasing

14. Spatial vs. Spatio-temporal data • Dimensioning-up • Time: uni-directional and linear • Relational concepts (before, during, etc,) are easily understood, communicated and accommodated • Space: bi-directional and nonlinear

15. Spatial vs. Spatio-temporal data • Time & space: both continuous phenomena • Time: discrete and isomorphic with integers • Larger granularity often selected (days, years, etc.) • Space: isomorphic with real numbers • Granularity generally smaller (relative to the domain)

16. Spatial vs. Spatio-temporal data • Dimensioning-up strategies work poorly • Are accepted data mining procedures flawed? • No: Time scale differences between data types generally match characteristics we wish to include in most analyses of land-cover

17. Spatial vs. Spatio-temporal data • For example • Spectral time slice provides discrimination between vegetation types • Environmental data provide long-term conditions witch match germination, growth and development of largest plants • Very often, too little consideration is given to the appropriate temporal scales necessary

18. Spatial vs. Spatio-temporal data • Example • Monitoring of wetlands in dry tropics • The extend of these land-cover elements varies considerably through time • Inter-annual variability in expend is greater than the average annual variability • Spectral image without annual and seasonal and without monthly rainfall and evaporation figures is meaningless

19. Spatial vs. Spatio-temporal data • Temporal scales used in conjunction with spatial data often inconsistent -> Needs to be chosen more carefully • Considerably better results will be achieved by a considered re-coding of the temporal data • Palaeo-climate reconstruction demonstrates: Time can be associated with the relative positioning of the Earth, the Sun and the major planets in space

20. Spatial vs. Spatio-temporal data • Time is a spatial phenomenon • A point an the Earths surface (latitude, longitude, elevation) is not static in space, but moving through a complex energy environment • This movement, and the dynamics of the energy environment is ‘time’

21. Spatial vs. Spatio-temporal data • Three main components to the environmental energy field • Gravity • Radiation • Magnetism • Feedback relationships: Time

22. Spatial vs. Spatio-temporal data • Most important relationships • Relative positions of a point on the surface of the Earth and the Sun (Diurnal cycle) • Orbit of the Moon around the Earth • Orbit of the Earth around the Sun • These relationships have a very significant relationship with both our natural, cultural and economic environments

23. Spatial vs. Spatio-temporal data • Other relationships • Solar day: This sweeps a pattern of four solar magnetic sectors past the Earth in about 27 days. This correlates with a fluctuation in the generation of low-pressure systems

24. Spatial vs. Spatio-temporal data • Other relationships • Solar day: 27 days • Lunar cycle: This is a 27.3-day period in the declination of the moon during witch it moves north for 13.65 days and south for 13.65 days. This correlates with certain movements of pressure systems on Earth

25. Spatial vs. Spatio-temporal data • Other relationships • Solar day: 27 days • Lunar cycle: 27.3-day period • Solar year: The orbit of the sun around the center of the solar system. This cycle correlates with long-term variation in a large number of natural, cultural and economic indices

26. Spatial vs. Spatio-temporal data • These relate to both the Earth’s energy environment and the sorts of scales we are most concerned with in data mining • Recoding the time stamp on data to a relevant continues variable (eg. time of the Solar year) provides most ‘intelligent’ data mining software a considerably better chance of identifying important relationships in spatio-temporal data

27. Handling second-hand data • The need to re-use data collected for other purposes • Few data collection methods take into account the non-deterministic nature of data mining • Results into heterogeneous data sources being brought together

28. Possible errors • The rules reflect the heterogeneity of the data sets rather than any differences in the observed phenomenon. • The data sets being temporally incompatible • The collection methods being incompatible

29. About … • Mining from spatial and spatio-temporal data • Meta-mining as a discovery process paradigm • Processes for theory/hypothesis management

30. Meta-mining as a discovery process paradigm • Target of mining: traditionally data itself • Increase in data & polynomial complexity of many mining algorithms • Extraction of useful rules becomes difficult • A solution: mine from either summaries of the data or from results of previous mining exercises

31. Meta-mining as a discovery process paradigm

32. Meta-mining as a discovery process paradigm • For each rule generated some ‘irrelevant’ data is removed • Support and confidence ratings must be taken into account • Clusters may use criteria that may mask important outlying facts

33. About … • Mining from spatial and spatio-temporal data • Meta-mining as a discovery process paradigm • Processes for theory/hypothesis management

34. Processes for theory/hypothesis management • Analysis into geographic, geo-social, socio-political and environmental issues require a more formal, strongly ethical driven approach • Environmental science uses a formal scientific experimentation process requiring the formulation and refutation of a credible null hypothesis

35. Processes for theory/hypothesis management • Data mining over the past few years • Largely oriented towards the discovery of previously unknown but potentially useful rules • Some useful rule can be mined • Potential for either logical or statistical error is extremely high • Result of much data mining is at best a set of suggested topics for further investigation

36. The process of scientific induction • Two distinct forms of knowledge discovery • Process modeling approach: Real world is modeled in a mathematical manner • Pattern matching approach: Prediction is made on past experience • Data mining is latter

37. Using data mining to support scientific induction

38. The process of scientific induction • Another view of scientific induction • Given an infinitely large hypothesis space • Rule extracted from data used to constrain the hypothesis space • Very complex (search space is exponential) • Less than useful answers or high computational overhead

39. Using data mining to support scientific induction • Develop hypotheses that will constrain the search space by defining areas within which the search is to take place • Starting point: user supplied conceptual model • Hypothesis supported: weight is added to confidence of conceptual model • Hypothesis not supported: change to conceptual model or need for external input is indicated

40. Using data mining to support scientific induction

41. Using data mining to support scientific induction • Three aspects of interest • Able to accept alternative conceptual models an provide a ranking. Also allows for modification to a conceptual model • Hypothesis generation component may yield new unexplored insights into accepted conceptual models • Reasonably efficient because of directed mining algorithms