an introduction to spatial point...

40
an introduction to spatial point processes Mohammad Mehdi Moradi Geotec: Geospatial Technologies research group, Institute of new imaging technology (INIT), Jaume I University, Castellon, Spain.

Upload: others

Post on 14-Oct-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

an introduction to spatial point processes

Mohammad Mehdi Moradi

Geotec: Geospatial Technologies research group,Institute of new imaging technology (INIT),Jaume I University, Castellon, Spain.

Page 2: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Outlines

Point patterns

Statistical methodology for point patterns

Intensity function

Bandwidth selection

Weighted kernel estimates

Relative risk

Second-order summary statistics

More to know

References

1

Page 3: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

point patterns

Page 4: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Point patterns

A ’spatial point pattern’ is a dataset giving the observed spatial locations ofthings or events. For instance locations of:

∙ Trees in a forest,∙ Stars in a star cluster,∙ Road accidents,∙ Earthquake epicentres,∙ Mobile phone calls,∙ Animal sightings,∙ Nuclei in a microscopic section of tissue,∙ Rare disease,∙ Crime,∙ Gold deposits mapped in a geological survey.

3

Page 5: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Point patterns

R> library(spatstat)R> plot(cells,pch=20,cex=2,main=””)R> plot(redwood,pch=20,cex=2,main=””)

Figure: Left: Biological cells observed under optical microscopy in a histologicalsection. Right: Locations of 62 seedlings and saplings of California redwood trees.

4

Page 6: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Point patterns

R> plot(ants,cex=2,main=””,lwd=2)R> plot(chicago,cex=2,main=””,col=2,lwd=2)

Messor

Cataglyphis

trespass

theft

robbery

damage

cartheft

burglary

assault

Figure: Left: Spatial locations of nests of two species of ants. Right: Spatial locationsof crimes reported in the period 25 April to 8 May 2002, in an area of Chicago (Illinois,USA)

5

Page 7: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Point patterns

R> plot(longleaf,main=””,cols=”gold”,lwd=2)

20

40

60

Figure: Locations and sizes of Longleaf pine trees. A marked point pattern 6

Page 8: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Note

∙ ‘Point data’ cannot necessarily be treated as a ‘point pattern’. Forexample, measurements of soil acidity at a series of sampling locations ina field would not normally be treated as a point pattern: the samplinglocations are artificial, and irrelevant to the study of soil acidity.

∙ Statistical analysis of the spatial arrangement of points can revealimportant features, such as a tendency for gold deposits to be foundclose to a major geological fault, or for cases of a disease to be moreprevalent near a pollution source, or for bird nests to maintain a certainminimum separation from each other.

∙ A dataset may also include covariates, i.e. any data that we treat asexplanatory, rather than as part of the ‘response’. Type of covariates varyfrom a dataset to another one. For instance, in case of studying crimepoint patterns, distance from data points to some particular places mightbe considered as covariates.

7

Page 9: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Note

∙ Points may be observed in different spaces. They might happen in R2 suchas “cells” and “redwood”. Some may happen in one-dimensional spacesuch as “Chicago crime data”. Another type could be those recorded inspace and time such as earthquake epicentre locations and times.

∙ Working with point patterns, we assume the location of points are alreadyprojected. If not, please project them before any analysis.

∙ When working with multi-type point patterns such as “ants”, make surethe location of all types are projected in a same ref system.

∙ In case of point patterns on network such as “Chicago crime data”, makesure all data point and network itself are projected using a same refsystem.

∙ Mathematically speaking, different spaces may demand their own specialattention.

∙ Other types of point patterns include replicated patterns and pointpatterns on sphere.

8

Page 10: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

statistical methodology for point patterns

Page 11: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Methodology

Aiming at analysing a point pattern, one might be interested in:

∙ Spatially varying distribution of the points. Is there any hot-spot? Howevents use space?

∙ The type of interaction between points.∙ Is there any evidence of clustering?∙ How is the spatially variation of marks?∙ How covariates affect the spatially varying distribution of points?∙ Are different types of points affected by each other?

10

Page 12: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Methodology

A point process is a random mechanism whose outcome is a point pattern.If the experiment could be repeated under identical conditions, theobserved point pattern would be different each time.

∙ Important note: If the researcher concludes that “the points arecompletely random” or “the points are uniformly spread”, this cannot be aliteral description of the point pattern dataset. Data are numbers thatwere observed and recorded: they are fixed, not random. A point in apoint pattern is a discrete object, and cannot be ‘spread uniformly’ likebutter. Instead, the conclusion is that the data points were generated bysome mechanism which was completely random, or which spread thepoints uniformly, etc.

11

Page 13: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Methodology

We assume x = {x1, x2, . . . , xn} as a point pattern generated by a pointprocess X. The number n of points in the pattern is not fixed in advance, andmay be any finite nonnegative number including zero.

A ‘completely random’ point process is characterised by two key properties:

Homogeneity: the points have no preference for any spatial location;

Independence: information about the outcome in one region of space hasno influence on the outcome in other regions.

It is a realistic model of some physical phenomena, such as radioactivity,rare events, and extreme events. It serves as a benchmark or standardreference model of completely random patterns, against which otherpatterns can be compared.

12

Page 14: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Methodology

A point process X is usually labeled by an intensity function λ which governsthe spatially varying distribution of points so that,

E[N(X ∩ A)] =∫Aλ(u)du, (1)

where N is a count function.

Poisson process: X is a Poisson process with intensity function λ > 0 on R2if

∙ For any B ⊂ R2, the number of points of X in B is Poisson distributed withparameter

∫B λ(u)du.

∙ The number of points in B1,B2, . . . ,Bm ⊂ R2 are independent randomvariables.

13

Page 15: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Intensity estimation

In order to understand the spatially varying distribution of the points, thekey point is to estimate the intensity function λ.

Kernel smoothing:

Simple explanation: place one square of chocolate on each data point.Using a hair dryer we apply heat to the chocolate so that it melts slightly.The result is an undulating surface of chocolate; the height of the surfacerepresents the estimated intensity function of the point process. The totalmass of chocolate is unchanged.

14

Page 16: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Intensity estimation

Mathematically speaking:

Consider a point pattern x observed in window W ⊂ R2. The usual kernelestimators of the intensity function are, with uniform correction,

λU(u) =n∑i=1

κσ(u− xi)CW,σ(u)

, u ∈ W, (2)

and with Jones-Diggle correction,

λJD(u) =n∑i=1

κσ(u− xi)CW,σ(xi)

, u ∈ W, (3)

where σ is the smoothing bandwidth parameter, κ is a kernel densityfunction and

CW,σ(u) =∫Wκσ(u− v)dv, v ∈ W. (4)

15

Page 17: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Intensity estimation

Properties:

∙ Intensity estimate (2) is unbiased if the true intensity is constant, i.e.E[λU(u)] = λ.

∙ Intensity estimate (3) provides mass conservation, i.e.∫W λJD(u) = n

Note: Smoothing parameter σ plays an important role in estimatingintensity function using kernel smoothing.

Note: Estimators (2) and (3) are implemented in function ‘density.ppp’ in Rpackage ‘spatstat’.

16

Page 18: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Bandwidth selection

∙ Likelihood cross-validation: Maximisingn∑i=1

log(λ−i(xi))−∫Wλ(u)du, (5)

where λ−i is the corresponding “leave-one-out” at xi, defined by omittingthe contribution from xi from the sum in (2) or (3) accordingly. This isimplemented in ‘spatstat’ by function ‘bw.ppl’.

∙ Scott’s rule of thumb for 2 dimension:

σx = (4n)−1/6sx, σy = (4n)−1/6sy, (6)

where ‘s’ is the sample standard deviation of the Cartesian coordinatevalues for the data locations. This is implemented in ‘spatstat’ by function‘bw.scott’.

17

Page 19: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

# redwoodR> d <- density.ppp(redwood,sigma = bw.ppl(redwood))R> plot(d,main=””,ribwid=0.04,ribsep=0.02)R> plot(redwood,pch=20,cex=2,add=T)# antsR> d1 <- density.ppp(ants,sigma = bw.scott(ants))R> plot(d1,main=””,ribwid=0.04,ribsep=0.02)R> plot(ants,cex=2,add=T,lwd=2)# chicagoR> d2 <- density.lpp(chicago,sigma = 100)R> plot(d2,main=””,ribwid=0.04,ribsep=0.02)R> plot(chicago,pch=20,add=T,cex=1.4)R> plot(d2,style = ”w”,main=””,adjust = 1.3)

18

Page 20: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0.00

015

2e−

040.

0002

53e

−04

0.00

035

4e−

04

010

020

030

0

Figure: Left: Estimated intensity for ants data. Right: Estimated intensity for Redwooddata.

19

Page 21: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

Note: Intensity estimation for point patterns on networks are different thanestimates (2) and (3), however it has the same interpretation adapted to thenetwork. We do not discuss that here.

00.

005

0.01

0.01

5Figure: Estimated intensity for chicago crime data. 20

Page 22: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0.005

0.01

0.015

Figure: Estimated intensity for chicago crime data. 21

Page 23: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Weighted kernel estimates

Uniform correction,

λU(u) =n∑i=1

wiκσ(u− xi)CW,σ(u)

, u ∈ W, (7)

and with Jones-Diggle correction,

λJD(u) =n∑i=1

wiκσ(u− xi)CW,σ(xi)

, u ∈ W. (8)

# Applying (7) to ‘longleaf’ data.

R> d4 <- density(longleaf,sigma = bw.ppl(longleaf),weights =marks(longleaf))R> plot(d4,main = ””,ribwid=0.04,ribsep=0.02)R> plot(longleaf,add=T)

22

Page 24: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Weighted kernel estimates

The diameter-weighted intensity is the average total diameter of trees perunit area of forest.

0.2

0.4

0.6

0.8

11.

2

Figure: Weighted estimated intensity for longleaf data. Weights are diameter of trees.23

Page 25: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

More examples to describe weighted kernel estimate

∙ There are cases where each data point represents one or more eventsthat occurred at the same spatial location, such as multiple disease casesat the same residence. It is then appropriate to weight each residentiallocation by the number of cases, so that the intensity would be theaverage total number of cases per unit area, not the number of affectedresidences per unit area.

∙ If weight is the number of vehicles involved in the traffic accident thatoccurred at locations, then the weighted intensity estimate is thespatially-varying number of vehicles involved in accidents per unit length.

24

Page 26: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Relative risk

In spatial relative risk estimation, data points are classified into differenttypes, and we seek to estimate the spatially-varying relative frequency ofeach type of point.

For simplicity, assume there are only two types of points, and we observetwo point patterns x; y containing the points of the first and second typesrespectively, on the same window W. The goal is to estimate the logarithmicrelative risk

ρ(u) = logλX(u)λY(u)

, u ∈ W, (9)

where λX and λY are the intensity functions of the underlying pointprocesses X; Y of points of each type.

25

Page 27: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application of relative risk

Note: It is recommended to use a common bandwidth to estimatenumerator and denominator in (9). See R package ‘sparr’.

R> library(spatstat)R> library(sparr)R> antstypes <- split(ants)R> cmbw <- LSCV.risk(antstypes$Cataglyphis,antstypes$Messor,method =”hazelton”)R> dCataglyphis <- density.ppp(antstypes$Cataglyphis,sigma = cmbw)R> dMessor <- density.ppp(antstypes$Messor,sigma = cmbw)R> plot(dMessor/dCataglyphis,main = ””,ribwid=0.04,ribsep=0.02)R> npoints(antstypes$Messor)/npoints(antstypes$Cataglyphis)R> [1] 2.344828

26

Page 28: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application of relative risk

Messor

Cataglyphis

22.

53

3.5

Figure: Left: Ants point pattern. Right: Estimated relative risk for the two differenttypes of ants using the ratio of two estimated intensities.

27

Page 29: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

K-function

A very popular technique for analysing spatial correlation in point patterns.

The inhomogeneous K-function for point processes in R2 is defined as

Kinhom(r) = E

∑xi∈X

1{0 < ∥u− xi∥ ≤ r}λ(xi)

∣∣∣∣∣∣u ∈ X

. (10)

For Poisson processes in R2, Kinhom(r) = πr2 and for Poisson processes onnetworks Kinhom(r) = r.

Note: K > πr2(K > r) is an indication of clustering behaviour whileK < πr2(K < r) denote inhibition between points.

Note: K-function for multi-type patters, replicated patterns, patterns onnetworks, etc is different. However, it somehow keeps the sameinterpretation after adaption to the new space/condition. We do not discussthat here!

Note: There are different estimators for K-function. We do not discuss themhere.

28

Page 30: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

R> d3 <- density.lpp(chicago,sigma = 100)R> kchig <- linearKinhom(chicago,lambda = d3,normpower = 2)R> plot(kchig,main=””)

R> kcells <- Kinhom(cells,normpower=2)R> plot(kcells,main = ””)

R> kants <- envelope(ants,fun = Kinhom,nsim=200,normpower=2)R> plot(kants,main = ””)

R> klong <- envelope(longleaf,Kinhom,normpower=2,nsim=200)R> plot(klong,main=””)

29

Page 31: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0 200 400 600 800 1000

020

040

060

080

010

00

r (feet)

KL,

inho

m(r

)

KL, inhom(r)KL, inhom

theo (r)

0.00 0.05 0.10 0.15 0.20 0.25

0.00

0.05

0.10

0.15

0.20

r

Kin

ho

m(r

)

Kinhom

iso(r)

Kinhom

trans(r)

Kinhom

bord(r)

Kinhom

bordm(r)

Kinhompois (r)

Figure: Estimated K-function for; Left: chicago data. Right: cell data.

30

Page 32: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0 50 100 150

0e+

002e

+04

4e+

046e

+04

8e+

041e

+05

r (one unit = 0.5 feet)

Kin

ho

m(r

)

Kinhom

obs(r)

Kinhomtheo (r)

Kinhom

hi(r)

Kinhom

lo(r)

0 10 20 30 40 50

020

0040

0060

0080

00r (metres)

Kin

ho

m(r

)

Kinhom

obs(r)

Kinhomtheo (r)

Kinhom

hi(r)

Kinhom

lo(r)

Figure: Estimated K-function together with simulation envelopes; Left: ants data.Right: longleaf data.

31

Page 33: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Pair correlation function

An alternative tool is the pair correlation function g(r) which containscontributions only from inter-point distances equal to r.

ginhom(r) =K′

inhom(r)πr2 (11)

where K′(r) is the derivative of the K-function with respect to r.

Simply speaking: g(r) is the probability of observing a pair of points of theprocess separated by a distance r, divided by the corresponding probabilityfor a Poisson process.

Note: ginhom(r) > 1 indicates clustering behaviour whereas ginhom(r) < 1shows inhibition.

32

Page 34: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

R> gchig <- linearpcfinhom(chicago,lambda = d3,normpower = 2)R> plot(gchig,main=””)

R> gcells <- pcfinhom(cells,normpower=2)R> plot(gcells,main=””)

R> gants <- envelope(ants,pcfinhom,nsim=200,normpower=2)R> plot(gants,main=””)

R> glong <- envelope(longleaf,pcfinhom,nsim=200,normpower=2)R> plot(glong,main=””)

33

Page 35: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0 200 400 600 800 1000

0.8

0.9

1.0

1.1

1.2

r (feet)

gL(r

)

gL, inhom(r)gL, inhom

pois (r)

0.00 0.05 0.10 0.15 0.20 0.25

0.0

0.5

1.0

1.5

r

gin

ho

m(r

)

ginhom

Ripley(r)

ginhom

Trans (r)

ginhompois (r)

Figure: Estimated g-function; Left: chicago data. Right: cells data.

34

Page 36: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Application

0 50 100 150

05

1015

2025

r (one unit = 0.5 feet)

gin

ho

m(r

)

ginhom

obs (r)ginhom

theo (r)

ginhom

hi (r)

ginhom

lo (r)

0 10 20 30 40 50

24

68

r (metres)

gin

ho

m(r

)

ginhom

obs (r)ginhom

theo (r)

ginhom

hi (r)

ginhom

lo (r)

Figure: Estimated g-function together with simulation envelopes; Left: ants data.Right: longleaf data.

35

Page 37: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

more to know

Page 38: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

What we did not discuss...

∙ Estimating intensity function parametrically.∙ Adaptive estimators.∙ Adaptive smoothing.∙ Other bandwidth selectors.∙ Space-time point processes.∙ Marked space-time point processes.∙ Higher-order summary statistics.∙ Details of point processes on linear networks.∙ Point processes on sphere.∙ Replicated point patterns.∙ And many other things ;)

Note: For more details, see Diggle (2013) and Baddeley, et al (2015).

37

Page 39: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

references

Page 40: An introduction to spatial point processesgeotec.uji.es/wp-content/uploads/2018/01/introduction-spatial-point.pdf · an introduction to spatial point processes Mohammad Mehdi Moradi

Reference

∙ Baddeley, A., Rubak, E., & Turner, R. (2015). Spatial point patterns:methodology and applications with R. CRC Press.

∙ Baddeley, A., & Turner, R. (2005). Spatstat: an R package for analyzingspatial point patterns. Journal of statistical software, 12(6), 1-42.

∙ Davies, T. M., Hazelton, M. L., & Marshall, J. C. (2011). Sparr: analyzing spatialrelative risk using fixed and adaptive kernel density estimation in R.Journal of Statistical Software, 39(i01).

∙ Diggle, P. J. (2013). Statistical analysis of spatial and spatio-temporal pointpatterns. CRC Press.

39