on-line load forecasting services

Upload: vineet-kumar-singh

Post on 05-Apr-2018

231 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/2/2019 On-Line Load Forecasting Services

    1/40

    Pattern Recognition Technologies (PRT), Inc.

    On-LineLoad Forecasting Services

    Al Khotanzad, Ph.D., P.E.

    President

    PRT, Inc.

    17950 Preston Road, Suite 916

    Dallas, Texas 75252

    (214) 692-5252

    [email protected]

    www.prt-inc.com

    ERCOT Load Forecasting ForumJanuary 24, 2007

  • 8/2/2019 On-Line Load Forecasting Services

    2/40

    PRT, Inc. 2

    Corporate Profile Founded in 1994

    Products & Services Online load and price forecasting services

    Stand-alone load and price forecasting software

    Custom forecasting solutions

    Clients

    Over 90 energy firms consisting of

    Utilities in North America & Overseas

    ISOs, Municipalities, Coops. Government Agencies

    Power marketing and trading organizations

    The Electric Power Research Institute (EPRI)

    First company to develop a commercial neural network based load

    forecaster in the early 90s ANNSTLF for EPRI

  • 8/2/2019 On-Line Load Forecasting Services

    3/40

    PRT, Inc. 3

    Load Forecasting

    Accurate forecast of future demand required by all entities involved

    in the energy markets

    Electric Utilities

    Independent System Operators

    Power Marketers

    Different forecast horizons

    Long Term: Several years outrequired for planning purposes

    Mid Term: Several weeks to monthsscheduling maintenance,

    planning fuel supply, transactions

    Short Term: Next hour to next weekdaily operation, energytransactions, reliability studies

  • 8/2/2019 On-Line Load Forecasting Services

    4/40

    PRT, Inc. 4

    Short Term Load Forecasting

    Hourly or sub-hourly forecasts starting from next hour to next seven

    to ten days

    Forecasts used for:

    Unit commitment

    selection of generators in operation

    start up/shut down of generation to minimize operation cost Hydro scheduling to optimize water release from reservoirs

    Generator type coordination to determine the least cost operation

    mode (optimum mix)

    Interchange scheduling and energy purchase

    Transmission line loading

    Power system security assessment

    Accuracy has significant economic impact

    Even a 0.5% improvement in accuracy can result in thousands of

    dollars in savings

  • 8/2/2019 On-Line Load Forecasting Services

    5/40

    PRT, Inc. 5

    Factors Affecting Short Term Load

    Factors affecting short-term load are:

    Mix of customer in the service area (residential, commercial,

    industrial)

    Weather condition (temperature, humidity, cloud cover, wind

    speed)

    Seasonal effects & recent load trends

    Time of day (morning, afternoon, night)

    Day of week (weekdays, weekends)

    Holidays (Christmas, New Years)

    Special events (popular sporting events or TV shows)

    Demand side management

    Random disturbances

  • 8/2/2019 On-Line Load Forecasting Services

    6/40

    PRT, Inc. 6

    Example of Load and Temperature

  • 8/2/2019 On-Line Load Forecasting Services

    7/40

    PRT, Inc. 7

    Major STLF Techniques

    Any STLF technique attempts to model the relationship between the

    load and factors that affect itthese relationships are nonlinear andcomplex

    Regression models

    Stochastic time series

    Spectral decomposition

    Similar-day search

    Intelligent system based models

    Superiority of intelligent system based techniques have been

    demonstrated in many studies

  • 8/2/2019 On-Line Load Forecasting Services

    8/40

    PRT, Inc. 8

    PRTs LF Technologies

    Products & services are based on cutting-edge intelligent systemtechnologies of:

    Artificial Neural Networks

    Fuzzy Logic

    Genetic Algorithms/Evolutionary Computing

  • 8/2/2019 On-Line Load Forecasting Services

    9/40

    PRT, Inc. 9

    Artificial Neural Networks (ANNs)

    Neurologically inspired systems consisting of highly interconnected

    elementary computational units (neurons)

    Distributed processing by neurons results in intelligent outcome

    ANNs learn to perform a desired task directly from examplesusing special training algorithms

    ANNs can generalize; after training, they can produce good results

    for data that only broadly resembles the data they were trained on

    originally

    ANNs are nonlinear systems, well suited for real world problems

    that are often nonlinear

  • 8/2/2019 On-Line Load Forecasting Services

    10/40

    PRT, Inc. 10

    Forecasting Using ANNs

    A key feature of ANNs is their ability to learn a complex pattern

    mapping, i.e., model the underlying relationship between a set ofvariables and an outcome that is a function of them

    Future LoadFunction of past loads and weather, recent loadtrends, upcoming weather, calendar effects

    Train with historical data (examples of the underlyingrelationship)

    A properly trained ANN can predict the outcome of the modeledprocess based on the available observations

    ANN based predictors employed in a wide variety of forecasting

    applications such as prediction of: electric load, weather, gasconsumption, stock market, economic trends time series data,future sales, traffic patterns and grade point average of students

  • 8/2/2019 On-Line Load Forecasting Services

    11/40

    PRT, Inc. 11

    Unique Aspects of PRT ANN Forecasters

    Architecture of ANN specifically designed for electric loadforecasting

    Optimal set of inputs selected for load forecasting application

    No need for frequent re-training

    Quick response to deviations between forecast and actual load

    Special algorithms for unusual days, e.g., weekday holidays

  • 8/2/2019 On-Line Load Forecasting Services

    12/40

    PRT, Inc. 12

    Fuzzy Logic

    Fuzzy logic (FL) is a means to transform subjective/expertknowledge about a process expressed in the form of linguistic rules

    into computer algorithms.

    FL employs fuzzy sets, fuzzy membership functions and fuzzy if-

    then rules to model the uncertainty in nature, and express theknowledge

    A fuzzy set is a set without a crisp, clearly defined boundary, and

    can contain fuzzy variables with a partial degree of membership

  • 8/2/2019 On-Line Load Forecasting Services

    13/40

    PRT, Inc. 13

    Fuzzy Rule & Membership Function

    An example of a typical fuzzy IF-Then rule :

    IF next-day temperature is hot, and todays temperature is hot,

    THEN next-day load is high

    Subjective interpretation of hot temperature or high load

    Characterized by fuzzy membership functionan example shown

  • 8/2/2019 On-Line Load Forecasting Services

    14/40

    PRT, Inc. 14

    Fuzzy Logic Based Load Forecaster

    Develop applicable fuzzy membership functions

    Extract relevant IF-THEN rules from historical data There

    could be hundreds of such rules

    During the forecasting phase several of the rules become activatedalong with some of the fuzzy membership function

    Fuzzy inference engine converts all this information into a final

    crisp forecast

  • 8/2/2019 On-Line Load Forecasting Services

    15/40

    PRT, Inc. 15

    Genetic Algorithms (GAs)

    Genetic Algorithms (GAs) are optimization algorithms that arebased on the concept of natural evolution

    GAs can find the optimal solution quickly and efficiently, especially

    when there is little information about the solution available.

    GAs emulate natural evolution, and make use of four operators,

    including reproduction, crossover, mutation, and survival of the

    fittest to produce and keep the optimal solutions.

  • 8/2/2019 On-Line Load Forecasting Services

    16/40

    PRT, Inc. 16

    GA Based Forecaster

    Create M sets of forecasts (in random) for a given set of actualhistorical data

    Sort based on accuracy

    Retain the top K most accurate sets (stronger solutions) and discard

    the rest (weaker solutions)survival of the fittest

    Use the retained K sets as parents to create a second generation of Msolutions through mutation & crossoverrepeat the process

    After several generation, the top K solutions converge toward a

    single solutionStrongest solution

    This is the optimal solution used as the final forecasting model

  • 8/2/2019 On-Line Load Forecasting Services

    17/40

    PRT, Inc. 17

    PRTs e-ISOForecastPrice & Load

    Forecasting Service

    e-ISOForecast is an on-line real-time price & load forecastingservice that has been set up for all wholesale power markets/ISOsin North America

    ERCOT, PJM, NY-ISO, ISO-NE, MISO, CA-ISO, ONTARIOIESO, ALBERTA AESO

    Hourly forecasts for current day and six days beyond Hourly load forecasts for one year out using various simulated

    weather scenarios

    Forecasts are posted on www.onlineforecast.com

    Subscribers use a Web browser to access and download the

    forecastsavailable 24/7 Forecasts are updated every hour or faster based on the most

    recent price/load/weather data that become available

    Weather forecasts are used in the models - updated several timesper day

  • 8/2/2019 On-Line Load Forecasting Services

    18/40

    PRT, Inc. 18

    e-ISOForecastPrice & Load Forecasts

    ERCOT

    System-Wide & Congestion Zone Load Forecasts

    Zonal Market Clearing Price Forecasts

    PJM

    System-Wide, Regional and Zonal Load Forecasts

    Real-Time & Day-Ahead LMP Price Forecasts

    ISO New England (ISO-NE)

    System-Wide & Zonal Load Forecasts

    Zonal Real-Time & Day-Ahead LMP Price Forecasts

    New York ISO (NYISO)

    System-Wide & Zonal Load Forecasts

    Zonal Real-Time & Day-Ahead LMP Price Forecasts

  • 8/2/2019 On-Line Load Forecasting Services

    19/40

    PRT, Inc. 19

    e-ISOForecastPrice & Load Forecasts

    Midwest ISO (MISO)

    System-Wide Load Forecast

    Real-Time & Day-Ahead LMP Price Forecasts for Five Hubs and

    Various CPNs

    California ISO

    System-Wide Load Forecast Zonal Supplemental Real-Time Price Forecast s

    ONTARIO EISO

    System-Wide Load Forecast

    System-Wide Price Forecast

    ALBERTA AESO

    System-Wide Load Forecast

    System-Wide Price Forecast

  • 8/2/2019 On-Line Load Forecasting Services

    20/40

    PRT, Inc. 20

    Forecasting Engines

    Multiple models based on different technologies run in parallelgenerating independent forecasts

    A top layer of intelligence decides to:

    Select one of the forecasts as the final forecast

    Combine multiple forecasts (Combination of Experts) into a

    final forecast

    Accuracy is improved over use of a single modeling technique

  • 8/2/2019 On-Line Load Forecasting Services

    21/40

    PRT, Inc. 21

    Weather Data

    PRT has affiliations with two major weather service providers,

    WSI and Meteorlogix

    Most free internet based weather forecast services simply provide

    forecasts generated by NWS or other computer models

    Weather service providers bring human meteorologists in the loop

    who scrutinize/edit computer generated forecasts

    Weather forecasts updated several times throughout the day

    Actual temperature updated every hour and with every update,

    new load forecasts are generated

  • 8/2/2019 On-Line Load Forecasting Services

    22/40

    PRT, Inc. 22

    Access via the Web

    Forecasts are posted to a dedicated password protected page

    Can be accessed using any standard Web browser from anycomputer

    Provides easy access for all in the company

    Forecasts are displayed in tabular and graphical forms

    Actual data of previous day and any available data of current day

    are displayed

    Forecasts can be downloaded in EXCEL format

    Other statistics including actual prices of past week, similar day

    comparisons and price bands are provided

  • 8/2/2019 On-Line Load Forecasting Services

    23/40

    PRT, Inc. 23

    e-ISOForecast Main Page

  • 8/2/2019 On-Line Load Forecasting Services

    24/40

    PRT, Inc. 24

    e-ISOForecast PJM Segment

  • 8/2/2019 On-Line Load Forecasting Services

    25/40

    PRT, Inc. 25

    e-ISOForecast Load Forecast View

  • 8/2/2019 On-Line Load Forecasting Services

    26/40

    PRT, Inc. 26

    e-ISOForecast LF View - Graphical

    ISOF t LF P f f 2006

  • 8/2/2019 On-Line Load Forecasting Services

    27/40

    Market After-the-Fact

    CurrentDay

    NextDay

    Day 3 Day 4 Day 5

    ERCOT Load 1.51/1.84 1.81/2.69 2.99/3.48 3.50/3.87 3.99/4.59 4.54/5.13

    Temp 1.38/1.73 2.14/1.98 2.41/2.13 2.86/2.68 3.21/3.02

    PJMEast

    Load 1.24/1.33 1.32/1.91 2.49/2.64 2.88/2.93 3.25/3.45 3.67/3.81

    Temp 1.48/2.00 2.56/2.46 2.73/2.78 3.20/3.46 3.68/4.05

    ISONE Load 1.70/1.60 1.24/1.88 2.30/2.32 2.73/2.91 3.04/3.31 3.34/3.60

    Temp 1.49/2.00 2.47/2.57 2.76/2.93 3.27/3.62 3.78/4.32NYISO Load 1.15/1.28 2.21/2.40 2.56/2.59 2.73/2.74 2.93/3.05 3.26/3.47

    Temp 2.72/2.81 3.04/2.99 3.22/3.23 3.53/3.60 3.98/4.30

    MISO Load 1.21/1.39 1.21/1.83 2.29/2.54 2.79/3.05 3.20/3.53 3.54/3.87

    Temp 1.29/1.70 2.15/2.32 2.37/2.48 2.82/3.05 3.32/3.57

    e-ISOForecast LF Performance for 2006

    Forecasts Recorded at 8 am CT

    Load: Hourly MAPE/ Daily Peak Load MAPE

    Temperature: Hourly MAD/Daily Peak Temp MAD

  • 8/2/2019 On-Line Load Forecasting Services

    28/40

    PRT, Inc. 28

    e-ISOForecast Performance for Forecast of

    Next-Day ERCOT Total Load2006i

    Forecasts Recorded at 3:00 PM of Previous Day

    Month Load

    MAPE

    Temp

    MAD

    Month Load

    MAPE

    Temp

    MAD

    Jan 2.10/2.02 2.13 Jul 2.51/2.77 1.71

    Feb 3.01/3.18 3.14 Aug 2.70/2.81 2.06

    Mar 2.52/2.85 2.42 Sep 3.86/5.03 2.35

    Apr 3.17/4.11 1.78 Oct 3.53/5.06 2.36

    May 3.05/3.57 1.83 Nov 2.21/2.25 2.21

    Jun 2.70/2.92 1.62 Dec 2.45/3.49 2.14

  • 8/2/2019 On-Line Load Forecasting Services

    29/40

    Market Period By CurrentDay

    NextDay

    Day 3 Day 4 Day 5

    ERCOT 1/1-12/31

    PRT 1.81/2.69 2.99/3.48 3.50/3.87 3.99/4.59 4.54/5.13

    ISO 2.28/2.96 3.22/3.45 3.75/4.08 4.56/4.79 5.04/5.40

    PJMEast

    1/1-12/31

    PRT 1.32/1.91 2.49/2.64 2.88/2.93 3.25/3.45 3.67/3.81

    ISO 1.70/2.00 3.30/2.91 3.32/3.23 3.79/3.60 4.27/4.13

    ISONE 1/1-12/31

    PRT 1.24/1.88 2.30/2.32 2.73/2.91 3.04/3.31 3.34/3.60

    ISO 3.08/1.77 3.23/2.15 - - -

    NYISO 12/5-12/31

    PRT 0.64/1.06 1.51/1.54 1.74/1.85 1.99/2.29 2.10/2.34

    ISO 2.54/2.62 2.54/2.62 2.22/2.09 2.12/1.59 2.08/1.43

    Comparison of PRT and ISO LF Performance

    Forecasts Recorded at 8 am CT

    Hourly MAPE/ Daily Peak Load MAPE

  • 8/2/2019 On-Line Load Forecasting Services

    30/40

    PRT, Inc. 30

    e-LoadForecast Service

    An online load forecast service for company-specific load data

    Standard Service: Hourly/sub hourly forecasts for current day andsix days beyond

    Extended Service: Additional Hourly/sub hourly forecasts forseveral months and years out

    User only needs to:

    Provide historical load data for initial model training Upload the most recent actual load data as it becomes available

    (via FTP, e-mail, provided Excel interface)

    All the required actual and forecast weather data acquired by PRTfrom

    Load and weather data quality checked and validated

    Forecasts posted to a dedicated and secure website in tabular andgraphical forms

  • 8/2/2019 On-Line Load Forecasting Services

    31/40

    PRT, Inc. 31

    e-LoadForecast Service, Cont

    Forecasts are updated every hour with preceding hours actualobserved weather

    Forecasts are updated any time an actual load data is uploaded byuser

    24/7 access through

    Via Internet at any location An Excel Interface with built-in functions enabling user to

    remotely interact with the forecasting system

    FTP

    E-Mail

    ERCOT uses this service for forecast of its eight weather zones

  • 8/2/2019 On-Line Load Forecasting Services

    32/40

    PRT, Inc. 32

    Forecasting Engines

    Multiple models based on different technologies run in parallelgenerating independent forecasts

    A top layer of intelligence decides to:

    Select one of the forecasts as the final forecast

    Combine multiple forecasts (Combination of Experts) into a

    final forecast

    Accuracy is improved over use of a single modeling technique

  • 8/2/2019 On-Line Load Forecasting Services

    33/40

    PRT, Inc. 33

    Weather Data

    PRT has affiliations with two major weather service providers,

    WSI and Meteorlogix

    Most free internet based weather forecast services simply provide

    forecasts generated by NWS or other computer models

    Weather service providers bring human meteorologists in the loop

    who scrutinize/edit computer generated forecasts

    Weather forecasts updated several times throughout the day

    Actual temperature updated every hour and with every update,

    new load forecasts are generated

  • 8/2/2019 On-Line Load Forecasting Services

    34/40

    PRT, Inc. 34

    Other Features

    The provided Excel Interface allows user to:

    Modify forecasted temperatures and generate corresponding

    load forecastsWhat-If scenarios

    Modify predicted morning and/or afternoon peak loads.

    Forecasts for other hours are reshaped accordingly

    View load and temperature of three most similar days

    (temperature wise) in the history

  • 8/2/2019 On-Line Load Forecasting Services

    35/40

    PRT, Inc. 35

    Access via the Web - View & Download

    Forecasts are posted to a dedicated password protected page

    Can be accessed using any standard Web browser from anycomputer

    Provides easy access for all in the company

    Forecasts are displayed in tabular and graphical forms

    Actual data of previous day and any available data of current day

    are displayed

    Forecasts can be downloaded in EXCEL format

  • 8/2/2019 On-Line Load Forecasting Services

    36/40

    PRT, Inc. 36

    Access via Excel Interface

    View, Download & Interact

    An Excel interface with easy-to-use built-in features

    Download and view most current load and temperature

    forecasts in tabular and graphical forms

    Modify forecasted temperatures and generate corresponding

    load forecasts

    Modify predicted peak loads and reshape load forecasts

    accordingly

    Download and view three most similar days

    Upload actual load updates to PRTs servers

  • 8/2/2019 On-Line Load Forecasting Services

    37/40

    PRT, Inc. 37

    Profile Based Forecasting

    Retailers operating in deregulated markets work with individual accounts

    that may not be metered hourly (e.g., residential load)

    Energy transactions and settlements are done based on hourly demand

    Hourly load is simulated using pre-specified standard load profiles for

    client type

    To forecast their retail load, load profile for each account must be scaled

    appropriately to account for pattern of usage by that account

    Profile based module ofe-LoadForecastUser provides:

    List of current accounts in the portfolio along with their corresponding

    profile type

    The historical usage data for each account

    Backcasted profiles for corresponding profile types are used to develop aprofile multiplier (scale factor) for each account using historical meter

    reads.

    Forecasted standard profiles are multiplied by the scale factor to get the

    final hourly forecast

  • 8/2/2019 On-Line Load Forecasting Services

    38/40

    PRT, Inc. 38

    Mid-Term/Long-Term Module

    Optional service includes mid-term/long-term hourly load forecast

    Forecast horizon can be extended to five years out ANN technology is usedModels are different from those used for short-

    term forecasting

    Impact of load growth is considered

    Weather forecast is needed for the forecast horizon

    Simulated using historical weather data

    Three scenarios of Normal, Hot, and Cold available for each

    month in forecast horizon

    Additional scenarios for generating High Load and Low Load

    cases

    Two statistical methods available for simulation of scenarios from

    historical weather data

    Tools are provided for easy manipulation of simulated weatheruser can

    build heat waves/cold fronts

  • 8/2/2019 On-Line Load Forecasting Services

    39/40

    PRT, Inc. 39

    Quality Control

    Extensive quality control system in place

    Actual load and temperature data continually quality checked

    Detected anomalies such as spikes and gaps corrected

    Every day accuracy of load and temperature forecasts for various

    forecasts horizons are computed and reviewed by our experienced staff

    Corrective action taken if degradation in quality detected

    Analysis of the cause Calibrate forecasting models

    Use of different kind of forecasting engines

  • 8/2/2019 On-Line Load Forecasting Services

    40/40

    PRT I 40

    Forecasting ServiceAdvantages

    Uses state-of-the-art load forecasting models

    More accurate forecasts than in-house systems

    More economical than maintaining an in-house system

    Frees up valuable manpower & resources

    No data hassles, IT overhead, software maintenance & upgrade

    Performance continuously monitored by specialists with extensiveexperience and background in forecasting

    Models are continually calibrated and upgraded

    Convenient access to forecasts for all who need it in the

    organization

    Unlimited use by all in the organization