Geographic Data Mining

Paradigms for Spatial and Spatio-temporal Data Mining

2

About …

• Mining from spatial and spatio-temporal data

• Meta-mining as a discovery process paradigm

• Processes for theory/hypothesis management

3

Mining from spatial and spatio-temporal data

• Rule types• Spatial vs. spatio-temporal data• Handling second-hand data

4

Rule types

• Spatio-temporal associations• Spatio-temporal generalization• Spatio-temporal clustering• Evolution rules• Meta-rules

5

Spatio-temporal associations

• X -> Y (c%, s%)• Require the use of spatial and temporal

predicates• For temporal association rules, the

emphasis moves form the data itself to changes in the data

6

Spatio-temporal generalization

• Concept hierarchies are used to aggregate data

• Spatial-data-dominant– ‘South Australian summers are commonly

hot and dry’

• Nonspatial-data-dominant– ‘Hot dry summers are often experienced by

areas close to large desert systems’

7

Spatio-temporal clustering

• Similar to normal clustering• Far more complex• Characteristic features of objects in a

spatio-temporal region OR spatio-temporal characteristics of a set of objects are sought

8

Evolution rules

• Explicit temporal and spatial context• Describes the manner in which spatial

entities change over time• Exponential number of rules can be

generated– Example predicates

9

Example predicates

• Follows– One cluster of objects traces the same (or

similar) spatial route as another cluster at a later time (spatial coordinates are fixed)

10

Example predicates

• Follows• Coincides

– One cluster of objects traces the same (or similar) spatial path whenever a second cluster undergoes specified activity (temporal coordinates are fixed)

11

Example predicates

• Follows• Coincides• Parallels

– One cluster of objects traces the same (or a similar) spatial pattern but offset in space (temporal coordinates are fixed)

12

Example predicates

• Follows• Coincides• Parallels• Mutates

– One cluster of objects transforms itself into second cluster

13

Meta-rules

• Created when rule sets rather than datasets are inspected for trends and coincidental behaviour

• Describe observations discovered amongst sets of rules– The support for suggestion X is increasing

14

Spatial vs. Spatio-temporal data

• Dimensioning-up• Time: uni-directional and linear

– Relational concepts (before, during, etc,) are easily understood, communicated and accommodated

• Space: bi-directional and nonlinear

15

Spatial vs. Spatio-temporal data

• Time & space: both continuous phenomena– Time: discrete and isomorphic with integers

• Larger granularity often selected (days, years, etc.)

– Space: isomorphic with real numbers• Granularity generally smaller (relative to

the domain)

16

Spatial vs. Spatio-temporal data

• Dimensioning-up strategies work poorly• Are accepted data mining procedures

flawed?• No: Time scale differences between

data types generally match characteristics we wish to include in most analyses of land-cover

17

Spatial vs. Spatio-temporal data

• For example– Spectral time slice provides discrimination

between vegetation types– Environmental data provide long-term

conditions witch match germination, growth and development of largest plants

• Very often, too little consideration is given to the appropriate temporal scales necessary

18

Spatial vs. Spatio-temporal data

• Example– Monitoring of wetlands in dry tropics– The extend of these land-cover elements

varies considerably through time– Inter-annual variability in expend is greater

than the average annual variability– Spectral image without annual and seasonal

and without monthly rainfall and evaporation figures is meaningless

19

Spatial vs. Spatio-temporal data

• Temporal scales used in conjunction with spatial data often inconsistent -> Needs to be chosen more carefully

• Considerably better results will be achieved by a considered re-coding of the temporal data– Palaeo-climate reconstruction

demonstrates: Time can be associated with the relative positioning of the Earth, the Sun and the major planets in space

20

Spatial vs. Spatio-temporal data

• Time is a spatial phenomenon• A point an the Earths surface (latitude,

longitude, elevation) is not static in space, but moving through a complex energy environment

• This movement, and the dynamics of the energy environment is ‘time’

21

Spatial vs. Spatio-temporal data

• Three main components to the environmental energy field– Gravity– Radiation– Magnetism

• Feedback relationships: Time

22

Spatial vs. Spatio-temporal data

• Most important relationships– Relative positions of a point on the surface

of the Earth and the Sun (Diurnal cycle)– Orbit of the Moon around the Earth– Orbit of the Earth around the Sun

• These relationships have a very significant relationship with both our natural, cultural and economic environments

23

Spatial vs. Spatio-temporal data

• Other relationships– Solar day: This sweeps a pattern of four

solar magnetic sectors past the Earth in about 27 days. This correlates with a fluctuation in the generation of low-pressure systems

24

Spatial vs. Spatio-temporal data

• Other relationships– Solar day: 27 days– Lunar cycle: This is a 27.3-day period in the

declination of the moon during witch it moves north for 13.65 days and south for 13.65 days. This correlates with certain movements of pressure systems on Earth

25

Spatial vs. Spatio-temporal data

• Other relationships– Solar day: 27 days– Lunar cycle: 27.3-day period– Solar year: The orbit of the sun around the

center of the solar system. This cycle correlates with long-term variation in a large number of natural, cultural and economic indices

26

Spatial vs. Spatio-temporal data

• These relate to both the Earth’s energy environment and the sorts of scales we are most concerned with in data mining

• Recoding the time stamp on data to a relevant continues variable (eg. time of the Solar year) provides most ‘intelligent’ data mining software a considerably better chance of identifying important relationships in spatio-temporal data

27

Handling second-hand data

• The need to re-use data collected for other purposes

• Few data collection methods take into account the non-deterministic nature of data mining

• Results into heterogeneous data sources being brought together

28

Possible errors

• The rules reflect the heterogeneity of the data sets rather than any differences in the observed phenomenon.

• The data sets being temporally incompatible

• The collection methods being incompatible

29

About …

• Mining from spatial and spatio-temporal data

• Meta-mining as a discovery process paradigm

• Processes for theory/hypothesis management

30

Meta-mining as a discovery process

paradigm• Target of mining: traditionally data itself• Increase in data & polynomial

complexity of many mining algorithms– Extraction of useful rules becomes difficult

• A solution: mine from either summaries of the data or from results of previous mining exercises

31

Meta-mining as a discovery process

paradigm

32

Meta-mining as a discovery process

paradigm• For each rule generated some

‘irrelevant’ data is removed– Support and confidence ratings must be

taken into account– Clusters may use criteria that may mask

important outlying facts

33

About …

• Mining from spatial and spatio-temporal data

• Meta-mining as a discovery process paradigm

• Processes for theory/hypothesis management

34

Processes for theory/hypothesis

management• Analysis into geographic, geo-social,

socio-political and environmental issues require a more formal, strongly ethical driven approach– Environmental science uses a formal

scientific experimentation process requiring the formulation and refutation of a credible null hypothesis

35

Processes for theory/hypothesis

management• Data mining over the past few years

– Largely oriented towards the discovery of previously unknown but potentially useful rules

– Some useful rule can be mined– Potential for either logical or statistical error

is extremely high– Result of much data mining is at best a set

of suggested topics for further investigation

36

The process of scientific induction

• Two distinct forms of knowledge discovery– Process modeling approach: Real world is

modeled in a mathematical manner– Pattern matching approach: Prediction is

made on past experience

• Data mining is latter

37

Using data mining to support scientific

induction

38

The process of scientific induction

• Another view of scientific induction– Given an infinitely large hypothesis space– Rule extracted from data used to constrain

the hypothesis space

• Very complex (search space is exponential)– Less than useful answers or high

computational overhead

39

Using data mining to support scientific

induction• Develop hypotheses that will constrain

the search space by defining areas within which the search is to take place– Starting point: user supplied conceptual

model– Hypothesis supported: weight is added to

confidence of conceptual model– Hypothesis not supported: change to

conceptual model or need for external input is indicated

40

Using data mining to support scientific

induction

41

Using data mining to support scientific

induction

• Three aspects of interest– Able to accept alternative conceptual

models an provide a ranking. Also allows for modification to a conceptual model

– Hypothesis generation component may yield new unexplored insights into accepted conceptual models

– Reasonably efficient because of directed mining algorithms