electrical load forecasting in r - r: the r project for · pdf file ·...

24

Upload: dangcong

Post on 30-Mar-2018

218 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

Electrical Load Forecasting in R

Corinne Walz, Franziska Ziemer

University of Würzburg

The R User Conference

Rennes, France, July 9, 2009

University of Würzburg, Germany ORS Roddi, Italy

Prof. Dr. Rainer Göb Daniele Amberti, PhD

Page 2: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Table of contents

1 Italian electricity market

2 Forecasting procedure

3 Time series models

4 Using R

Page 3: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Table of contents

1 Italian electricity market

2 Forecasting procedure

3 Time series models

4 Using R

Page 4: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Liberalisation of the Italian electricity market

Introducing liberalisation of the Italian electricity sector

(Italy: Legislative Decree 79/99)

Creating conditions more conducive to fair competition and

putting in place a true internal market

(EU: Directive 2003/54/EC)

Opening up of the internal market allows customers to

choose the most attractive electricity suppliers.

Page 5: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Liberalised Italian electricity market

Power system: grid system

Appropriate energy balance in the network

Grid managers penalise the energy suppliers which do not

contribute to the local grid with as much energy as needed

by their own customers

Necessity of an e�ective energy load model to make

medium term forecasts on an hourly basis

Page 6: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Six market zones

Source: GME (2004)

Page 7: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Table of contents

1 Italian electricity market

2 Forecasting procedure

3 Time series models

4 Using R

Page 8: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Forecasting procedure

Page 9: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Forecasting procedure

Page 10: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Exemplary electricity consumption (1 year)

Obvious in�uence of

day of the week

hour

holidays

Page 11: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Table of contents

1 Italian electricity market

2 Forecasting procedure

3 Time series models

4 Using R

Page 12: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Time series models

We have

An univariate time series of aggregated electricity consumption

Y1, . . . ,Yn

A multivariate time series of the external regressors

x1, . . . , xnwith xt = (xt,1, . . . , xt,k)′ for t = 1, . . . , n

We need

A model that connects the time series

Yt = Yt(xt,1, . . . , xt,k ,Yt−1,Yt−2, . . .)

Page 13: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Time series models

1 General model

Yt = x′tβ + Wt

2 Autoregressive model with external regressors

Yt = x′tβ +p∑

i=1

φiYt−i + εt , ε1, . . . , εn i.i.d. N(0, σ2)

3 Regression model with autoregressive error

Yt = x′tβ +Wt , Wt =p∑

i=1

φiWt−i + εt , ε1, . . . , εn i.i.d. N(0, σ2)

Page 14: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

1 General model

Model

Yt = β1xt,1 + . . .+ βkxt,k︸ ︷︷ ︸external regressors

+ Wt︸︷︷︸error

, Wt not speci�ed

Exponential smoothing with external regressors

(prediction-orientated, model is not estimated)

unknown error Wt is predicted with exponential smoothing:

Wt+1 = αWt + (1− α)Wt

Least squares approach, suggested by Wang (2006)∑t

(Yt − Yt)2 → min!

α,β

Page 15: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

2 Autoregressive model with external regressors

Model

Yt = β1xt,1 + . . .+ βkxt,k︸ ︷︷ ︸external regressors

+φ1Yt−1 + . . .+ φpYt−p︸ ︷︷ ︸AR term

+ εt︸︷︷︸error

The R function arima() assumes this model.

The order p of the AR process has to be known.

The regression coe�cients β = (β1, . . . , βk)′ and the AR

parameters φ = (φ1, . . . , φp)′ are estimated simultaneously

by linear regression.

Page 16: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

3 Regression model with autoregressive error

Model

Yt = x′tβ + Wt , Wt =p∑

i=1

φiWt−i + εt , εt i.i.d. N(0, σ2)

Y = Xβ + W, W is AR process, W ∼ N(0, Γ(φ, σ2))

unknown:

order p of the AR process

AR parameters φ = (φ1, . . . , φp)′

regression coe�cients β = (β1, . . . , βk)′

variance of white noise σ2

Page 17: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

3 Regression model with autoregressive error

Parameter estimation of φ, β, σ2 (p assumed to be known)

Extension of the iterative Cochrane-Orcutt procedure

Step 0:

Set Γ(0) := I

Step i:

Calculate β(i)

= βGLS(Γ(i−1))

Let φ(i)

be the ML estimates of φ in �tting an AR model

to W(i)t = Yt − x′tβ

(i)

Calculate the covariance matrix Γ(i) = Γ(φ(i)

)

Step i is repeated until no further change occurs in the

parameter estimates.

Page 18: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

3 Regression model with autoregressive error

Order selection

Choosing the order p of the AR process

Deciding which of the regression coe�cients are signi�cant

AIC, AICC, BIC, FPE

New development: FPE* (allows external regressors)

Page 19: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Forecasting process

General model Regression model

(exp. smoothing) with AR error

Model Y = X′β +W Y = X

′β +W,

W is AR process

Unknown α, β p, φ, β

parameters

Minimisation of

Estimation method First Step Maximum likelihood

Prediction Error

Order selection External regressors External regressors,

AR length p

Page 20: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Table of contents

1 Italian electricity market

2 Forecasting procedure

3 Time series models

4 Using R

Page 21: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Using R

How we use R

Automated model selection

- Implementation of the extended Cochrane-Orcuttalgorithm

- Comparison of order selection criteria

Data simulations to test the automated model selection

Future steps

Implementation of the Wang algorithm (exponential

smoothing)

Forecasting and prediction intervals

Page 22: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Exemplary graphical output(comparison of order selection criteria)

graphic

Page 23: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

References

Amberti, Pievatolo, Ruggeri (2006): Two-stage modelling in electrical load forecasting, with

application to customer management by power distribution utilities, presented at ENBIS 6Conference, Wroclaw, Poland

Brockwell, Davis (2002): Introduction to Time Series and Forecasting, Springer, New York

GME (2004): Il Mercato Elettrico del GME: �nalità, organizzazione e funzionamento,

published by GME

Hamilton (1994): Time Series Analysis, MIT Press

Harvey (1990): The Econometric Analysis of Time Series, Princeton University Press

Wang (2006): Exponential Smoothing for Forecasting and Bayesian Validation of Computer

Models, PhD thesis at Georgia Institute of Technology

Page 24: Electrical Load Forecasting in R - R: The R Project for · PDF file · 2010-05-18Electrical Load Forecasting in R Corinne Walz, Franziska Ziemer University of Würzburg The R User

ElectricalLoad

Forecastingin R

CorinneWalz,

FranziskaZiemer

University ofWürzburg

Italianelectricitymarket

Forecastingprocedure

Time seriesmodels

Generalmodel

AR modelwith externalregressors

RM with ARerror

Forecastingprocess

Using R

References

Thank you for your attention.