makalah

7
Regional Conference on Applied and Engineering Mathematics 2010 Vol. 1, No. 33, pp. 185-190 Examining the Properties of the Estimators of the Spatial Unilateral Autoregressive Model by Bootstrapping Norhashidah Awang a and Latifah Rahayu b a,b School of Mathematical Sciences, Universiti Sains Malaysia, 11800 USM, Penang, Malaysia Email : [email protected] ABSTRACT Many methods and procedures have been developed and proposed to overcome the estimation problem in spatial modeling, for example, by defining classes of models called separable models and the unilateral models. A special type of spatial models that received much attention is the spatial unilateral autoregressive models denoted as AR(p1,1) model. Several procedures have been proposed to estimate the parameters of this model. These include the Yule-Walker, the least squares and the maximum likelihood methods. In this paper, we examine the properties of these estimators for the first-order model, i.e. the AR(1,1) model. The examination is done by measuring the accuracy of these estimators for AR(1,1) model based on the value of the standard error of the estimates. To achieve this objective, bootstrap method based on resampling the residuals is used to obtain the standard error of the estimates. Keywords: Bootstrap, spatial modeling, spatial autoregressive model, standard error. 1.0 INTRODUCTION Spatial models are used to model the events or observations which are referenced by location coordinates or observed over a lattice. There are several spatial models that have been proposed to study the correlation of spatial data. Two classes of spatial models that have attracted many researchers are the separable models and the unilateral models. A special characteristic of separable models is that it has a product correlation structure, which in turn simplifies the estimation, whereas, the unilateral models can be analyzed using extension of time series theory in some special cases. Of the unilateral models, the spatial unilateral autoregressive model received much attention. This model is denoted as AR (p1,1) and is defined by ij j p i p j i j i ij Y Y Y Y ε α α α + + + + = - - - - 1 , 1 , 1 , 01 , 1 10 1 1 (1) where ij Y is an associated random variable and ij ε is an independent and identically random variable with ( 29 0 = ij E ε and ( 29 2 σ ε = ij Var at site labeled (i,j) and ij α s are parameters to be estimated for processes on rectangular grid of size m×n. Many procedures have been developed to estimate the parameters of this model. Tjøstheim (1978) discussed about the extension of the Yule-Walker method in time series analysis to spatial series. However, Guyon (1982), Basu and Reinsel (1992) and Ha and Newton (1993) showed that the autocovariance function used in this Yule-Walker estimate is asymptotically biased and proposed the unbiased version of the estimate. Basu (1991) discussed about two methods of the conditional least squares procedure for estimating the parameters of the AR(1,1) model. Awang (2005) introduced an alternative method using the maximum likelihood method with certain modification at the border to obtain the estimate of the parameters of the AR(p1,1) model. In this paper, we examine the properties of the estimators of the first-order spatial unilateral autoregressive model using the bootstrap method. Bootstrap is a computer-based method which helps to simplify the theoretical analysis of the estimator. Our specific objective is to compare the accuracy of the Yule-Walker, the unbiased version of Yule-Walker, the least squares and the maximum likelihood estimators of the AR(1,1) model defined by ) , ( ) 1 , 1 ( 11 ) 1 , ( 01 ) , 1 ( 10 j i j i j i j i ij Y Y Y Y ε α α α + + + = - - - - . (2) The standard error of the estimators is used as the measure of accuracy. To achieve this objective, bootstrap method based on resampling the residuals is used to obtain the standard error of the estimates. The next section reviews the estimation methods for the AR (p1,1) model, namely the Yule Walker method, the maximum likelihood method and the least squares method. Section 3 briefly discussed about the bootstrap method while in Section 4, the methodology applied in our analysis is given in detail. Section 5 presents the results of the analysis and in Section 6 the numerical example, some conclusions and direction for future research are given in section 7. 2.0 ESTIMATING THE PARAMETERS OF THE SPATIAL UNILATERAL AUTOREGRESSIVE MODEL 2.1 Yule Walker Method

Upload: mega-purnama-zainal

Post on 10-Apr-2016

218 views

Category:

Documents


0 download

DESCRIPTION

dfghjk

TRANSCRIPT

Page 1: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

Examining the Properties of the Estimators of the Spatial Unilateral Autoregressive Model by Bootstrapping

Norhashidah Awanga and Latifah Rahayub

a,bSchool of Mathematical Sciences,Universiti Sains Malaysia, 11800 USM, Penang, Malaysia

Email : [email protected]

ABSTRACT

Many methods and procedures have been developed and proposed to overcome the estimation problem in spatial modeling, for example, by defining classes of models called separable models and the unilateral models. A special type of spatial models that received much attention is the spatial unilateral autoregressive models denoted as AR(p1,1) model. Several procedures have been proposed to estimate the parameters of this model. These include the Yule-Walker, the least squares and the maximum likelihood methods. In this paper, we examine the properties of these estimators for the first-order model, i.e. the AR(1,1) model. The examination is done by measuring the accuracy of these estimators for AR(1,1) model based on the value of the standard error of the estimates. To achieve this objective, bootstrap method based on resampling the residuals is used to obtain the standard error of the estimates.

Keywords: Bootstrap, spatial modeling, spatial autoregressive model, standard error.

1.0 INTRODUCTION

Spatial models are used to model the events or observations which are referenced by location coordinates or observed over a lattice. There are several spatial models that have been proposed to study the correlation of spatial data. Two classes of spatial models that have attracted many researchers are the separable models and the unilateral models. A special characteristic of separable models is that it has a product correlation structure, which in turn simplifies the estimation, whereas, the unilateral models can be analyzed using extension of time series theory in some special cases.

Of the unilateral models, the spatial unilateral autoregressive model received much attention. This model is denoted as AR (p1,1) and is defined by

ijjpipjijiij YYYY εααα ++++= −−−− 1,1,1,01,110 11 (1)

where ijY is an associated random variable and ijε is an

independent and identically random variable with ( ) 0=ijE ε

and ( ) 2σε =ijVar at site labeled (i,j) and ijα s are parameters

to be estimated for processes on rectangular grid of size m×n.

Many procedures have been developed to estimate the parameters of this model. Tjøstheim (1978) discussed about the extension of the Yule-Walker method in time series analysis to spatial series. However, Guyon (1982), Basu and Reinsel (1992) and Ha and Newton (1993) showed that the autocovariance function used in this Yule-Walker estimate is asymptotically biased and proposed the unbiased version of the estimate. Basu (1991) discussed about two methods of the conditional least squares procedure for estimating the parameters of the AR(1,1) model. Awang (2005) introduced an alternative method using the maximum likelihood method with certain modification at the border to obtain the estimate of the parameters of the AR(p1,1) model.

In this paper, we examine the properties of the estimators of the first-order spatial unilateral autoregressive model using the bootstrap method. Bootstrap is a computer-based method which helps to simplify the theoretical analysis of the estimator. Our specific objective is to compare the accuracy of the Yule-Walker, the unbiased version of Yule-Walker, the least squares and the maximum likelihood estimators of the AR(1,1) model defined by

),()1,1(11)1,(01),1(10 jijijijiij YYYY εααα +++= −−−− . (2)

The standard error of the estimators is used as the measure of accuracy. To achieve this objective, bootstrap method based on resampling the residuals is used to obtain the standard error of the estimates.

The next section reviews the estimation methods for the AR (p1,1) model, namely the Yule Walker method, the maximum likelihood method and the least squares method. Section 3 briefly discussed about the bootstrap method while in Section 4, the methodology applied in our analysis is given in detail. Section 5 presents the results of the analysis and in Section 6 the numerical example, some conclusions and direction for future research are given in section 7.

2.0 ESTIMATING THE PARAMETERS OF THE SPATIAL UNILATERAL AUTOREGRESSIVE MODEL

2.1 Yule Walker Method

Page 2: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

Tjøstheim (1978) considered spatial Yule-Walker estimators to estimate the parameters of the spatial AR (p1, p2) models. The biased sample autocovariance function at lag (s,t) and (s,-t) for s ≥ 0 and t ≥ 0 is defined by

∑∑−

=

=++=

sm

i

tn

jtjsiijYY

mntsR

1 1,

1),(ˆ (3)

and

∑ ∑−

= +=−+=−

sm

i

n

tjtjsiijYY

mntsR

1 1,

1),(ˆ

(4)

For a spatial unilateral AR(p1,p2) model, the spatial analogue of the one-dimensional Yule-Walker equation as in time series is given as,

∑∑= =

−−=1 2

0 0

),(),(p

k

p

lkl ltksRtsR α )0,0( ≥≥ ts . (5)

If we define

,)',,,,,,,,(21211 ,,01,010,10 ppppp αααααα =α

( ) '),(,),,0(,),1,(,,),1,0(),0,(,),0,1( 21211 ppRpRpRRpRR =r ,

and

−−

−−−−

=

)0,0(),2(),1(

),2()0,0()0,1(

),1()0,1()0,0(

2121

21

21

RppRppR

ppRRR

ppRRR

R ,

then, the spatial Yule Walker estimator of α is given by

1ˆ −=α R r . (6)

The Yule-Walker equations are then be solved with the R̂ ’s replacing the R’s. The resulting estimators, denote by α̂ , are called the Yule-Walker estimators. Guyon (1982) compares

),(ˆ tsR with the unbiased estimator of ),(),( , tjsiijYYEts ++=γ

R (s,t) = mn ),(ˆ tsR / (m-s) (n-t), and claimed that the unbiased estimator is preferred.

In the Yule-Walker and unbiased Yule-Walker methods, for AR (1,1) model as defined in equation (2), the matrices α, r, and R take the form

( ) ',, 110110 ααα=α , ( ) ')1,1(),1,0(),0,1( RRR=r and

−=

)0,0()0,1()1,0(

)0,1()0,0()1,1(

)1,0()1,1()0,0(

RRR

RRR

RRR

R .

Then, the spatial Yule-Walker estimator of α is given by equation (6). To obtain the unbiased Yule-Walker estimate, the divisor mn is replaced by (m-s)(n-t).

2.2 Least Squares Method

Two types of conditional least squares estimation may be used to estimates the parameters of the spatial unilateral AR model (see Basu, 1991). For Type 1, for estimating the parameters of the AR(1,1) model, we assume that the unobserved border values are all zeros, that is

( ) 0Yb == −− 010000,10,1 ,,,,,,,,' mnn YYYYYY . The least

squares estimate of ( )110110 ,,' ααα=α is given as

( ) YX'XX''α 1−=ˆ , (7)

where

( ) ',,,,,,,,,,,, 212222111211 mnmmnn YYYYYYYYY =Y

and X is a matrix of dimension (mn) ×3 given as,

Page 3: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

=

−−−−

−−

−−

−−

1,11,,1

1,11,2,1

1,1

1,21,32

213122

21

1,11,21

112112

11

1,1

11

00

00

00

00

00

000

nmnmnm

mmm

m

nnn

nnn

n

YYY

YYY

Y

YYY

YYY

Y

YYY

YYY

Y

Y

Y

X

In Type 2, the conditional least squares estimates are obtained by conditioning on the given observed border,

( ) ',,,,,,,, 2111211'

mnmmn YYYYYY =oY . Then, the

estimator is given as,

( ) ( )1o1

ooo Y'XX'Xα −=ˆ (8)

where

( ) ),,,,,,,,,( 2442332 mnmnn YYYYYY ='1Y ,

and 0X is a matrix of dimension (m-2)(n-1) × 3 defined as,

=

−−−−

−−

−−

−−

1,11,,1

1,112,1

1,31,43

314132

1,21,32

213122

nmnmnm

mmm

nnn

nnn

YYY

YYY

YYY

YYY

YYY

YYY

0X

2.3 Maximum Likelihood Method

The spatial autoregressive models can be estimated by the method of maximum likelihood (see Awang, 2005 for details). For AR(1,1) model, the estimate of the parameters can be obtained by solving the equation

=

11

01

10

1

11'1111

'0111

'10

01'1101

'0101

'10

10'1110

'0110

'10

11

01

10

'

'

'

ˆ

ˆ

ˆ

ZY

ZY

ZY

ZZZZZZ

ZZZZZZ

ZZZZZZ

ααα

. (9)

Here, YWZYWZ 01011010 , == and YWZ 1111 = . The matrices

110110 and, WWW are the N×N weight matrices given as

===

0D0000

0000D0

00000D

000000

W

D00000

000D00

0000D0

00000D

W

0I0000

0000I0

00000I

000000

W

1 0,

1 0,

1 0

I is an n×n identity matrix and D is an n×n matrix defined by

010000

000010

000001

000000

.

3.0 BOOTSTRAP

The bootstrap is a general methodology for answering how accurate an estimator is. This method was first introduced by Efron (1979) as a method to estimate the standard error of an arbitrary estimator. For independent data, a bootstrap sample is a random sample of size n taken with replacement from

data y , that is nyyy ,,, 21 and assigns probability mass

of n1 on each observation. These steps are repeated B times.

Here, the non-parametric bootstrap is used to estimate the standard error and confidence intervals of the estimators. In the parametric bootstrap, the process of resampling is

performed on the observed data nyyy ,,, 21 which come

from a parametric model. For dependent data, the procedure has different context of sampling and there is no obvious way

to estimate a general joint density for nyyy ,,, 21 .

In this paper, we discuss about the bootstrap methods for examining the properties of the estimators of the spatial AR(1,1) model. We apply the non-parametric bootstrap of the residuals for estimating the standard error of the estimates. This method is an extension of the bootstrap method used in time series analysis (refer to Efron and Tibshirani, 1986).

4.0 METHODOLOGY

Page 4: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

The following steps are applied to obtain the bootstrap estimate of the standard error of the AR(1,1) parameters:

1. The grid size, m x n and value of parameters are chosen. The parameters must satisfy the stationary conditions stated in Basu and Reinsel (1993). This model is stationary if and only if

1) ,1,, 110110 <ααα

2) ,1 1101102

01 αααα +>−

3) ( ) ( ) 041 2110110

2211

201

210 >+>−−+ αααααα .

2. The series { }ijε , i =1, 2, …, m and j = 1, 2, …,n will then be generated from independent standard normal with

mean 0 and variance 1. The border values of { }ijY will

then be determined by assuming that the cells bordering the lattice have fixed values of zeroes. Then the remaining values of { }ijY are obtained recursively from equation (2).

3. The estimates of the parameters will be obtained by the estimation procedures as discussed in section 2.

4. The estimate of residuals { }ijε̂ will be obtained from

ijijij YY ˆˆ −=ε , where 1,1111,01,110 ˆˆˆˆ

−−−− ++= jijijiij YYYY ααα.

5. A bootstrap sample { }*ijY will be created from { }*

ijε ,

where { }*ijε is obtained by sampling with replacement

from the residual { }ijε̂ .

6. The parameter will be reestimated from { }*ijY by the

same estimation procedure as in step (3). The estimated will be denoted as ( )*

1,*10

*

1,, pααα = .

7. The steps 1-7 will be repeated B times (B = 10, 50, 100, 200, 500, 1000 and 1500).

8. Finally, the standard deviation of the estimate is

calculated by * *

ˆ

( )

1s Bαα α−

= −� .

5.0 RESULTS

This aims of this research are to examine the properties of the bootstrap estimates for the parameter of AR(1,1) model. Comparison is made among the estimates obtained from the Yule-Walker method, the least squares and the maximum likelihood methods. The comparison is made based on the size of standard error of the estimates. The programmes to perform the bootstrapping are written in S-Plus.

The results show that, for B = 10, B = 50 and B = 100, the standard errors are large but as B increases, the standards errors become smaller. For B = 200, the standard errors become more stable and when B = 500, 1000 and B = 1500, the standard errors are not too different from the standard errors of B = 200. Therefore, we decide to present the results for B = 200 and B = 500 because of the stability of the standard error value and the distribution of the standard errors are more symmetric when B equals 500 and larger.

The bootstrap replication are performed for the grid size (10×6), (8×8), (10×8), (15×6), (10×10), (20×5), (20×10), (15×15), (20×15), (20×16), (30×12), (25×15), and (20×20), and the α-values chosen are (i) 2.0,2.0,3.0 110110 === ααα ;

(ii) 1.0,3.0,5.0 110110 === ααα ;

(iii) 6.0,7.0,8.0 110110 −=== ααα . The grid sizes are chosen in such a away that its represent the small, moderate and large grid sizes and these grids have been used by previous researchers (Basu and Reinsel, 1992). Additional grid sizes such as (10×10), (20×10), (15×15) and (20×15) are added to represent moderate and square grid sizes. Three set of α-values selected satisfy all stationary conditions and these values also have been used by Basu and Reinsel (1992).

Figure 1 displays the bootstrap estimate of the standard errors for α’ = (0.3, 0.2, 0.2) and B = 200. We can see that the Yule-

Page 5: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

Walker estimate, especially for 11α has smallest standard errors, followed by the maximum likelihood estimate; whereas the least squares estimate has largest standard errors. Generally, the standard error is large for small grid sizes but as the grid size increases, the standard error become smaller.

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450

grid size

std

. de

v

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450grid size

std

.de

v

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450

grid size

std

.de

v

Figure 1: Bootstrap estimate of the standard error for 10α ,

01α and 11α with B = 200 and α’ (0.3, 0.2, 0.2), ( :

Biased yw, : unbiased yw, = MLE, × : least squares )

Figures 2 is the plot of bootstrap estimate for standard errors with B = 200 and α’ = (0.5, 0.3, 0.1). It can also be seen that the Yule-Walker estimates, especially for 11α has smallest standard errors and the least square estimates has largest standard errors. Again, as the grid size increases, the standard error getting smaller.

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450

grid size

std

.dev

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450

grid size

std

dev

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

50 100 150 200 250 300 350 400 450

grid size

std

.dev

Figure 2: Bootstrap estimate of the standard error for 10α , 01α

and 11α with B = 200 and α’= (0.5, 0.3, 0.1), ( :

Biased yw, : unbiased yw, = MLE, ×: least squares)

Figure 3 is the plot of bootstrap estimate standard errors with

B = 200 for α’ = (0.8, 0.7, -0.6), we can see that for 10α , the

maximum likelihood estimates has smallest standard error and unbiased Yule-Walker estimates has largest standard

error, but for 01α the maximum likelihood estimates has

smallest standard errors and the least squares estimates has

largest standard errors. For 11α , the Yule-Walker estimates

has smallest standard error and the unbiased Yule-Walker estimates has largest standard error.

0

0 .02

0 .04

0 .06

0 .08

0 .1

0 .12

0 .14

0 .16

50 100 150 200 250 300 350 400 450

g rid s ize

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

50 100 150 200 250 300 350 400 450

grid size

std

. de

v

0

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

0.2

50 100 150 200 250 300 350 400 450

grid size

std

.dev

Figure 3: Bootstrap estimate of the standard error for

10α , 01α and 11α with B = 200 and α’= (0.8,

0.7, -0.6), ( : Biased yw, : unbiased yw, = MLE, ×: least square )

The results also show that the standard errors for B = 500 are not too different from the standard errors for B = 200 for all parameters and grid sizes. However, the distribution of the bootstrap estimate for B = 500 is more symmetric than the distribution of the bootstrap estimate when B = 200, indicating that the distribution of the estimate will be more symmetric if B increases (refer to the histogram plots in figures 4 and 5).

From the results above, we conclude that when the grid size increases, the standard error becomes smaller and if the number of bootstrap replications is very small (less than 100), the standard error is large. When the number of replications is more than 100, the standard error is stable (does not change much) and we conclude that B = 200 is enough for estimating the standard error. However, when B = 200 and less, the distribution of the bootstrap estimate is slightly skewed, and symmetric distribution can only be attained when we increase the number of replications. In this paper, we present the results for B = 200 and B = 500 for the purpose of comparing the distribution of the bootstrap estimates. The results for

)2.0,2.0,3.0(=α and )1.0,3.0,5.0(=α shows that the Yule-Walker estimate have smallest standard error followed by maximum likelihood estimate, unbiased Yule-Walker and lastly by least squares estimate. However for

)6.0,7.0,8.0( −=α especially for 10α , the maximum likelihood estimate has smallest standard error followed by least square estimate, Yule-Walker estimate and lastly by

unbiased Yule-Walker estimate. For 01α , the maximum

likelihood estimate has smallest standard error followed by Yule-Walker estimate, unbiased Yule-Walker estimate and lastly by least squares estimate. For 11α , the Yule-Walker estimate has smallest standard error, followed by maximum likelihood estimate, least square estimate and lastly the unbiased Yule-Walker estimate.

Page 6: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

B = 200Grid size = 20x20

Bootstrap Yule-Walker method Bootstrap Unbiased Yule-Walker method α10 = 0.8 α01 = 0.7 α11 = -0.6 α10 = 0.8 α01 = 0.7 α11 = -0.6

0.60 0.65 0.70 0.75 0.80

010

20

30

40

alphatstar[i, ]

0.45 0.50 0.55 0.60 0.65

010

2030

40

alphatstar[i, ] -0.55 -0.50 -0.45 -0.40 -0.35 -0.30

010

2030

alphatstar [i, ] 0.70 0.75 0.80 0.85

01

02

03

04

0

alphatstar[i, ]

0.60 0.65 0.70 0.75

010

2030

40

alphatstar[i, ]

-0.7 -0.6 -0.5 -0.4

02

04

06

0

alph at star [i, ]

Bootstrap Least Square method Bootstrap Maximum Likelihood method α10 = 0.8 α01 = 0.7 α11 = -0.6 α10 = 0.8 α01 = 0.7 α11 = -0.6

0.70 0.75 0 .80 0.8 5

01

02

03

04

05

0

rh hatstar[i, ]

0.50 0.55 0.60 0.6 5 0. 70

01

02

03

04

0

rh hatstar[i, ]

-0.7 -0.6 -0.5 -0.4

02

04

06

0

rhha tstar[i, ] 0.70 0. 75 0.80 0. 85

01

02

03

04

05

0

rhhatstar[ i, ]

0 .55 0.60 0.65 0.70

01

02

03

04

0

rh hatstar[i, ]

-0.7 -0.6 - 0.5 -0.4

020

4060

80

rhhatstar[i, ]

Figure 4 : Histogram of B = 200 bootstrap replications of 10α , 01α

and 11α , respectively for α = (0.8, 0.7, -0.6) and 20×20

grid size.

B = 500Grid size = 20x20

Bootstrap Yule-Walker method Bootstrap Unbiased Yule-Walker method α10 = 0.8 α01 = 0.7 α11 = -0.6 α10 = 0.8 α01 = 0.7 α11 = -0.6

0.55 0.60 0.6 5 0.70 0.7 5 0.80

02

04

06

08

01

00

alpha t star [i, ]

0.4 5 0.50 0.55 0.60 0.65 0.70

02

04

06

08

01

00

alphat star [i, ]

-0.55 -0.5 0 -0.45 -0. 40 -0 .35 -0.30

02

04

06

08

0

alpha t star [i, ] 0.65 0.70 0.75 0.80 0.85

020

40

60

80

100

120

alphatstar[i, ]

0.50 0.5 5 0.60 0.6 5 0.70 0.7 5 0.80

02

04

06

08

01

00

alpha tst ar[i, ]

-0 .7 -0.6 -0.5 -0.4

02

04

06

08

0

alpha tst ar[i, ]

Bootstrap Least Square method Bootstrap Maximum Likelihood method α10 = 0.8 α01 = 0.7 α11 = -0.6 α10 = 0.8 α01 = 0.7 α11 = -0.6

0.65 0.70 0.75 0.80 0.85

020

4060

8010

0

rhhatstar[i, ]

0.45 0.5 0 0.55 0.60 0.65 0.70 0 .75

02

04

06

08

01

00

r hhatstar[i, ]

-0.7 -0.6 -0.5 -0.4 -0.3

050

100

150

rhhatstar[i, ] 0.65 0.70 0.75 0.80 0.85

020

4060

8010

0

rhhatstar[i, ]

0.50 0.55 0.60 0.65 0.70 0.75

020

4060

8010

0

rhhats tar[i, ]

-0.70 -0.65 -0.60 -0.55 -0.50 -0.45 -0.40

020

4060

8010

0

rhhatstar[i, ]

Figure 5: Histogram of B = 500 bootstrap replications of 10α , 01α

and 11α , respectively for α = (0.8, 0.7, -0.6) and 20×20

grid size.

6.0 NUMERICAL EXAMPLE

The numerical example is presented here to illustrate the procedure of the bootstrap estimate of the standard error of the parameters by fitting the AR(1,1) models to real data sets. The data set is the yield of wheat on 20×25 regular grid. We obtain this data set from Cressie (1991) but the original version is presented in Mercer and Hall (1911). The analysis is started by estimating the parameters using the above methods, namely the Yule-Walker, the unbiased Yule-Walker, the least squares and the maximum likelihood methods. The comparison among the estimates from these methods will then be made based on the value of the standard error which is obtained by bootstrapping method with B = 200 and 500.

Table 1 displays the value of estimates of the Yule-Walker, unbiased Yule-Walker, Least squares and Maximum likelihood methods with its standard error (in bracket). It shows that the Yule-Walker estimator has smallest standard

error as compared to unbiased Yule-Walker, maximum likelihood and least squares estimators. Figures 6 and 7 display the histograms of the estimates. It is clear that the distribution of the standard errors for B = 500 is more symmetric than the distribution of the standard errors of B = 200. This also indicates that the distribution will be more symmetric if B increases.

Table 1 : Estimates of the parameters with it estimated standard error (in bracket) from bootstrapping for wheat data.

Bootstrapreplication

Estimationmethod 10α̂ 01α̂

11α̂

B = 200

YWUnbiased YWLSML

0.2127 (0.0411)0.2116 (0.0430)0.2284 (0.0476)0.2228 (0.0443)

0.4693 (0.0352)0.4923 (0.0448)0.5218 (0.0413)0.5060 (0.0398)

-0.0696 (0.0432)-0.0707 (0.0513)-0.1031 (0.0437)-0.0927 (0.0433)

B = 500

YWUnbiased YWLSML

0.2127 (0.0440)0.2116 (0.0456)0.2284 (0.0442)0.2228 (0.0451)

0.4693 (0.0400)0.4923 (0.0386)0.5218 (0.0410)0.5060 (0.0378)

-0.0696 (0.0416)-0.0707 (0.0478)-0.1031 (0.0471)-0.0927 (0.0458)

B = 200 Bootstrap Yule-Walker method Bootstrap Unbiased Yule-Walker method

0 .1 0 0.1 5 0.2 0 0.2 5 0.3 0

010

2030

est ar[ i, ]

0.35 0.40 0.45 0.50

010

20

30

40

estar[i, ]

-0.15 -0.10 -0.05 0.0 0.05

010

20

30

40

estar[i, ] 0.10 0.15 0.20 0.25 0.30

010

20

30

40

estar[i, ]

0.35 0.40 0.45 0.50 0.55 0.60

010

20

30

estar[i, ]

-0.2 -0.1 0.0 0.1

020

40

60

estar[i, ]

Bootstrap Least Square method Bootstrap Maximum Likelihood method

0.10 0.15 0.20 0.25 0.30 0.35

010

2030

estar[i, ]

0.40 0.45 0.50 0.55 0.60 0.65

010

2030

40

estar[i, ]

-0.25 -0.20 - 0.15 -0.10 -0.05 0.0

010

2030

estar[i, ] 0.15 0.20 0.25 0.30

010

2030

estar[i, ]

0.40 0.45 0.50 0.55 0.60

010

2030

40

estar[i, ]

-0.20 -0.15 - 0.10 -0.05 0.0 0.05

010

2030

4050

es tar[i, ]

Figure 6: Histogram of the distribution of the bootstrap replications

of 10α , 01α and 11α , respectively for wheat data (B =

200).

B = 500 Bootstrap Yule-Walker method Bootstrap Unbiased Yule-Walker method

0.05 0.10 0.15 0.20 0.25 0.30 0.35

020

4060

8010

0

estar[i, ] 0.35 0.40 0.45 0.50 0.55

020

4060

8010

0

estar[i, ]

-0.20 -0.15 -0.10 -0.05 0.0 0.05

020

4060

8010

0

es tar[i, ] 0.05 0.10 0.15 0.20 0.25 0.30 0.35

020

4060

80

estar[i, ]

0.40 0.45 0.50 0.55 0.60

020

4060

8010

0

estar [i, ]

- 0.20 -0.15 -0.10 -0.05 0.0 0.05

020

4060

80

estar[i, ]

Bootstrap Least Square method Bootstrap Maximum Likelihood method

0.10 0.15 0.20 0.25 0.30 0.35 0.40

020

4060

80

estar[i, ]

0.40 0.45 0.50 0.55 0.60 0.65

020

40

60

80

100

estar[i, ]

-0.2 -0.1 0.0

020

4060

80

estar[i , ] 0.10 0.15 0.20 0.25 0.30 0.35

020

40

60

80

100

estar[i, ]

0.40 0.45 0.50 0.55 0.60

020

40

60

80

100

estar[i, ]

- 0.2 -0.1 0.0

020

4060

80

estar[i, ]

Figure 7: Histogram of the distribution of the bootstrap replications

of 10α , 01α and 11α , respectively for wheat data (B =

500).

7.0 CONCLUSION

In this paper, we have applied the bootstrapping procedure to obtain the standard error of the estimates of the parameters of the spatial unilateral AR(1,1) model. We make comparison among the estimates obtained from the Yule-Walker method, the least squares and the maximum likelihood methods based on their standard error value. The results show that, generally the Yule-Walker estimate has smallest standard error and the least square estimate has largest standard error. For

Page 7: makalah

Regional Conference on Applied and Engineering Mathematics 2010Vol. 1, No. 33, pp. 185-190

illustration, we apply the procedure to wheat data and make comparison among the estimators.

REFERENCES

Awang, N and Shitan, M. (2008), Maximum likelihood estimation for the non-separable spatial unilateral autoregressive model, Proceeding of The 3rd

International Conference on Mathematics and Statistics (ICoMS-3), Institut Pertanian Bogor, Indonesia.

Basu, S., and Reinsel, G. C. (1992). A note on the properties of spatial Yule-walker estimators. Journal of Statistical Computing and Simulation, 41, 243-255.

Basu, S. and Reinsel, G. C. (1993), Properties of the spatial unilateral first order ARMA model, Advance in Applied Probability, 25, 631-648.

Cressie, N. A. C. (1991), Statistics for Spatial Data, New York : Wiley.

Davison, A. C. and Hinkley D. V. (1997), Bootstrap Methods and Their Application, Cambridge University Press, USA.

Efron, B. and Tibshirani, R. J. (1993), An Introduction to the Bootstrap. New York : Chapman & Hall.

Guyon, X. (1982), Parameter estimation for a stationary process on a d-dimensional lattice, Biometrika, 69, 95-105.

Ha, E. and Newton, H. J. (1993). The bias of estimators of causal spatial autoregressive processes, Biometrika, 80, 1, pp. 242-5.

Mercer, W.B. and Hall, A.D. 91911). The experimental error of field trials, Journal of Agriculture Science, 4, pp. 107-132.

Tjøstheim, D. (1978), Statistical spatial series modelling, Advances in Applied Probability, 10, 130-154.