地球統計学 -kriging and...

32
地球統計学 -Kriging and Simulation- 斎藤 広隆 Environmental Water Resources Engineering Department of Civil & Environmental Engineering The University of Michigan

Upload: others

Post on 18-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

地球統計学-Kriging and Simulation-

斎藤広隆

Environmental Water Resources EngineeringDepartment of Civil & Environmental Engineering

The University of Michigan

Page 2: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

GEOSTATISTICS?Georges Matheron (1962)

“ GEOSTATITICS, in their most general acceptation, are concerned with the study of the distribution in space of useful values for mining engineers and geologists, such as grade, thickness, or accumulation, including a most important practical application to the problems arising in ore-deposit evaluation”

空間・時間に分布・変動するデータ(情報)を統計論的・決定論的に分析・モデリングするための道具

Page 3: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

どのような分野で応用されているのか?

• 鉱物探査,石油工学,地球物理,地球化学• 土壌科学,林学,農学• 水文学,海洋学,気象学• リモートセンシング,GIS,環境学• 疫学

日本語訳:地球統計学 (新井, 1985)

Page 4: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

どんなジャーナルを見ればいいのか?

• Mathematical Geology, Computers & Geosciences• Geoderma• Soil Science, Soil Science Society of America Journal• J. of Hydrology, WRR• geoENV, GEOSATISTICS (proceedings)• 本はたくさん出ている (注:日本語の本はなし)

Page 5: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,
Page 6: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Deterministic vs. StochasticPr

obab

il it y

Z

Transfer function)Z(Y F=

P ro b

abil i

t y

Y

例:放射性廃棄物が貯蔵庫から浸透して地下水に到達する

時間の推定

Page 7: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Cumulative Distribution Function)}(|)(Pr{))(|;( nzZnzF ≤= uu

Dioxin concentration (ppb)

Prob

abili

ty

2 3 4 50

0.5

1

Soft indicatorHard indicator

Single spoon sample: 3.47 ppb

Da

ta

va

lu

e

bi

li

ty

050 010 0 015 0 0

0

0 .5 1C cdfmode lRandom Variable ( 確率変数 )各 観 測(realization) とみなす .タ セrealization の�.

Page 8: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

GSLIBGeostatistical Software Library

• Programs developed at Stanford– SCRF: Stanford Center of Reservoir Forecasting

(Andre G. Journel)• All source codes available in ANSI Standard

Fortran 77 (www.gslib.com)• Public domain, open source, no support• Manual with CD-Rom (GSLIB User’s Guide)

Page 9: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Walker Lake Data SetTrue map

East

Nor

th

0.0 260.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Locations of Data

0. 50. 100. 150. 200. 250.

0.

50.

100.

150.

200.

250.

300.

0.0

200.000

400.000

600.000

800.000

1000.00

78000 points on 260 x 300 grid 100 points are randomly sampled

See Isaaks and Srivastava (1989) for details

Page 10: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Univariate Description

• Summary statistics• Highly skewed

(median << mean)• No spatial information!• How to account for

data locations?

Freq

uenc

y

0. 400. 800. 1200. 1600.0.000

0.100

0.200

0.300

0.400

HistogramNumber of Data 100

mean 291.84std. dev. 402.77

coef. of var 1.38maximum 1594.11

upper quartile 515.32median 89.20

lower quartile 10.53minimum 0.00

Page 11: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

空間分布の記述

• Location mapも空間分布の記述方法の一つ

• もっと定量的に表わす方法はないのか?

• ある点から離れると値はどれくらい変るのか?

Locations of Data

0. 50. 100. 150. 200. 250.

0.

50.

100.

150.

200.

250.

300.

0.0

200.000

400.000

600.000

800.000

1000.00

データの相関を距離の関数として表わそう

Page 12: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Semivariogram

Measure of dissmilarity

{ } 2/)]()([)( 2huuh +−= ZZEγ

C(h)

γ(h)

Sill

C(0)

γ距離(h)のみの関数

hNugget effect

RangeCorrelogram

{ } 2)()()( mZZEC −+⋅= huuh

)()0()( hh CC −=γ

Page 13: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Experimental Semivariogram

∑=

+−=)(

1

2)]()([)(2

1)(h

huuh

hN

zzN α

ααγ

1. Compute experimental semivariogram (hは実際はある区間を取る)

Lag distance h+∆h

u ∆θ

•異方性の存在

2. Fit permissible semivariogram models

• Automatic fitting• Semi-automatic fitting

Page 14: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Univariate Spatial Description

γ

Distance

Experimental Semivariogram

0. 40. 80. 120.0.

40000.

80000.

120000.

160000.

200000.

Range (相関距離): 48m

Visually fitted semivariogram model

+=

48Sph000,125000,46)( hhγ

Page 15: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Indicator (指示) ApproachSpatial continuity of large or small values: Indicator approach

=otherwise0

)(if1);( k

k

zuzzui α

α

Indicator map (Z(u)<500)

0. 50. 100. 150. 200. 250.

0.

50.

100.

150.

200.

250.

300.Indicator map (Z(u)<10)

0. 50. 100. 150. 200. 250.

0.

50.

100.

150.

200.

250.

300.

10

Page 16: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Indicator Semivariogram∑

=

+−=)(

1

2)]()([)(2

1)(h

huuh

hN

I iiN α

ααγ

γ

Distance

Indicator Semivariogram

0. 40. 80. 120.0.000

0.050

0.100

0.150

0.200

γ10=kz

Distance

Indicator Semivariogram

0. 40. 80. 120.0.000

0.050

0.100

0.150

0.200

500=kz

+=

25Sph17.0024.0)( hhIγ

+=

39Sph125.007.0)( hhIγ

Page 17: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

値の推定Estimation of the unknown value

• Average + std. deviation• Thiessen polygons

– Estimated value = the closest observation

• Inverse distance– Linear combination of

neighboring data

• Splines– Set of polynomials

Locations of Data

0. 50. 100. 150. 200. 250.

0.

50.

100.

150.

200.

250.

300.

0.0

200.000

400.000

600.000

800.000

1000.00

Q. 以下の赤丸の場所の値は?

No account of the data support, spatial variability, or estimation error!!

Page 18: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Kriging (クリッギング)-Linear Regression Estimator-

• unknown z(u), data z(uα)• m(u) = E[Z(u)]• n(u) data within neighborhood

W(u)

Trend

[ ]∑=

−=−)(

1

* )()()()()(u

uuuuun

mzmzα

αααλKriging weight

Kriging estimate

u

un(u)

u3

u2

u1

W

Page 19: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Kriging WeightsDetermine kriging weights λα such that estimation variance is minimized under the unbiasedness constraint )}()(Var{Z)( *2 uuu ZK −=σ

0)}()(E{Z* =− uu Z

Objective

e.g. Kriging System (n(u) + 1 linear equations)

=

=−=−−

=

=)(

1

)(

1

1)(

)(,,1)()()()(

u

u

u

uuuuuuu

nOK

n

OKOK n

ββ

βαβαβ

λ

αγµγλ K

OKOKOK kuλK =)(

Page 20: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Kriging Estimate

True map

East

Nor

th

0.0 260.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Kriging Estimate

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Estimated on 50 x 50 grid

いくつも違う種類のクリッギング法が開発されている.

Page 21: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Indicator Kriging)}(|);({E)}(|)(Pr{ nzuInzuZ kk =≤

=otherwise0

)(if1);( k

k

zuzzuI α

α

Prob{Z(u)<10}

East

Nor

th

0.0 300.0000.0

300.000

0.0

0.2500

0.5000

0.7500

1.000

Prob{Z(u)<500}

East

Nor

th

0.0 300.0000.0

300.000

0.0

0.2500

0.5000

0.7500

1.000

Probability of not exceeding a given threshold value.

Page 22: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Kriging interpolation

• Smooth out details of the spatial variation.• Small values are overestimated, while large

values are underestimated.

Cannot assess spatial uncertainty.

Page 23: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Dealing with Uncertainty

• 不均一なものをすべて必要なスケールで描写するのは不可能(もし可能であればDeterministicなモデルで十分)

• Stochasitc(確率論的) モデル– Monte Carlo Simulation:各確率変数にある確率密度

(分布)関数を当てはめ、乱数を使いその分布から値をサンプリングする。1回のシミュレーションで得られる結果を“realization”と呼ぶ。シミュレーション毎に結果は異なっているので、100回、1000回とシミュレーションを走らせてその結果を統計的に処理する(例:平均でどれくらいの割合で10年以内に放射性物質が地下水に到達したか)。

Page 24: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Geostatistical Stochastic Simulation-Monte Carlo Method-

• Generate alternative representations (realizations or maps) of the spatial distribution of data values over the study area

• Conditional vs. unconditional

• Each realization (map) reproduces– Sample histogram (i.e. experimental variance)– Semivariogram model

シミュレーションもクリッギングのように数多くの方法が開発されている.

Page 25: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Simulation vs. Estimation

Realization #1

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Simulated on 50 x 50 grid

Kriging Estimate

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Data values are honored at their locations (conditional simulation).

Page 26: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Reproduction of Target StatisticsFr

eque

ncy

0. 400. 800. 1200. 1600.0.000

0.100

0.200

0.300

0.400

HistogramNumber of Data 100

mean 291.84std. dev. 402.77

coef. of var 1.38maximum 1594.11

upper quartile 515.32median 89.20

lower quartile 10.53minimum 0.00

γ

Distance

Normal Score Semivariograms

0. 40. 80. 120.0.00

0.20

0.40

0.60

0.80

1.00

1.20

100 observation

Freq

uenc

y

0. 400. 800. 1200. 1600.0.000

0.100

0.200

0.300

0.400

Histogram of simulated valuesNumber of Data 2500

mean 293.40std. dev. 398.00

coef. of var 1.36maximum 1599.76

upper quartile 567.22median 92.22

lower quartile 10.32minimum 0.00

2500 simulated values

Page 27: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Modeling the Spatial UncertaintyRealization #1

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Realization #2

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Realization #3

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Transfer function

)Z(Y F=

Each realization produces different output.

それぞれのマップでの統計量はサンプルの統計量に等しい

Page 28: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Summary of Spatial UncertaintySummary of 100 realizations of the spatial distribution of data

E-type estimate

East

Nor

th

0.0 300.0000.0

300.000

0.0

250.000

500.000

750.000

1000.00

Prob{z(u)>500} (SGSIM)

East

Nor

th

0.0 300.0000.0

300.000

0.0

0.2500

0.5000

0.7500

1.000

Local uncertainty: ccdf

Data value

Prob

abili

ty

0 500 1000 15000

0.5

1Ccdf model

Data value

Prob

abili

ty

0 500 1000 15000

0.5

1Ccdf model

Page 29: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

シミュレーションの利点

• Propagation of uncertainty– Local/global transfer function– Quantify the uncertainty from input parameters

to the model output• Change of support

– 測定したスケールからのup scaling, down scaling

Page 30: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Incorporation of Secondary Information: Multivariate Geostatistics

• 主変数以外の2次情報(Secondary Information)を使って推定やシミュレーションを行う

– 高価な測定+安価な情報:透水係数の測定は金がかかるが、リモートセンシングデータは安くに手に入る。

– 測定誤差、汚染源の位置、事前情報などなど

Page 31: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

参考文献

• Deutsch, C. V., and A. G., Journel, GSLIB: Geostatistical Software Library and Users Guide, Oxford University Press, 1998

• Goovaerts, P., Geostatistics for Natural Resources Evaluation, Oxford University Press, 1997

• Goovaerts, P., “Geostatistical modeling of uncertainty in soil science”, Gendarme, Vol. 103, 2001, pp 3-26

• Isaaks, E. H., and Srivastava, R. M., An Introduction to Applied Geostatistics, Oxford University Press, 1989

• Oliver, M. A., and R. Webster, “How geostatistics can help you”, Soil Use and Management, Vol. 7, No. 4, 1991, pp 206-217

• Wackernagel, H., Multivariate Geostatistics, Springer, 1998

Page 32: 地球統計学 -Kriging and Simulation-soil.en.a.u-tokyo.ac.jp/tutinoko/memorandum/020523...GEOSTATISTICS? Georges Matheron (1962) “ GEOSTATITICS, in their most general acceptation,

Questions?