online detection of shutdown periods in chemical plants: a case study

34
Online Detection of Shutdown Periods in Chemical Plants: A Case Study Manuel Martín Salvador a , Bogdan Gabrys a , Indrė Žliobaitė b a Faculty of Science and Technology, Bournemouth University, United Kingdom b Dept. of Information and Computer Science, Aalto University, Finland KES2014, Gdynia, Poland Background picture is Creative Commons by Paul Joyce

Upload: manuel-martin

Post on 01-Dec-2014

139 views

Category:

Data & Analytics


1 download

DESCRIPTION

In process industry, chemical processes are controlled and monitored by using readings from multiple physical sensors across the plants. Such physical sensors are also supplemented by soft sensors, i.e. adaptive predictive models, which are often used for computing hard-to-measure variables of the process. For soft sensors to work well and adapt to changing operating conditions they need to be provided with relevant data. As production plants are regularly stopped, data instances generated during shutdown periods have to be identified to avoid updating these predictive models with wrong data. We present a case study concerned with a large chemical plant operation over a 2 years period. The task is to robustly and accurately identify the shutdown periods even in case of multiple sensor failures. State-of-the-art methods were evaluated using the first half of the dataset for calibration purposes and the other half for measuring the performance. Results show that shutdowns (i.e. sudden changes) can be quickly detected in any case but the detection delay of startups (i.e. gradual changes) is directly related with the choice of a window size.

TRANSCRIPT

Page 1: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Manuel Martín Salvadora, Bogdan Gabrysa, Indrė Žliobaitėb

aFaculty of Science and Technology, Bournemouth University, United KingdombDept. of Information and Computer Science, Aalto University, Finland

KES2014, Gdynia, PolandBackground picture is Creative Commons by Paul Joyce

Page 2: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Outline

1. INFER Project2. Motivation3. Data Preparation4. Shutdown Identification

4.1. What is a shutdown period?4.2. Problems and solutions4.3. Shutdown and startup phases4.4. Multi-sensor change-point detection methods4.5. Our method

5. Evaluation6. Results7. Conclusion

Page 3: Online Detection of Shutdown Periods in Chemical Plants: A Case Study
Page 4: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

MotivationMotivation

Company goal: To improve the production of acrylic acid.

Acrylic acid molecule (C3H4O2) is used for plastics, coatings, adhesives, elastomers, floor polishes and paints.

Page 5: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

MotivationMotivation

Company goal: To improve the production of acrylic acid.

Initial status: Process monitoring is carried out by human operators to control the production.

Concentration of acrylic acid is measured in the laboratory by taking samples every 4 hours.

Pic

ture

is C

rea

tive

Com

mo

ns b

y Jm

3

Acrylic acid molecule (C3H4O2) is used for plastics, coatings, adhesives, elastomers, floor polishes and paints.

Page 6: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

MotivationMotivation

Company goal: To improve the production of acrylic acid.

Initial status: Process monitoring is carried out by human operators to control the production.

Concentration of acrylic acid is measured in the laboratory by taking samples every 4 hours.

Research goal: To build a soft sensor for predicting acrylic acid concentration every minute.

Pic

ture

is C

rea

tive

Com

mo

ns b

y Jm

3

Acrylic acid molecule (C3H4O2) is used for plastics, coatings, adhesives, elastomers, floor polishes and paints.

Page 7: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Data Preparation

The chemical plant contains hundreds of sensors, but only 53 of them were selected with the help of experts.

Page 8: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Data Preparation

The chemical plant contains hundreds of sensors, but only 53 of them were selected with the help of experts.

Collected every minute within the period from May 2010 to November 2012 (1,268,582 instances).

Page 9: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Data Preparation

The chemical plant contains hundreds of sensors, but only 53 of them were selected with the help of experts.

Collected every minute within the period from May 2010 to November 2012 (1,268,582 instances).

● Target back-shifting● Handling of missing values● Shutdown identification● Detecting and handling outliers● Steady state identification● Finding variable delays and synchronization● Adding new variables

Data pre-processing tasks:

Page 10: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Shutdown Identification

Task: To robustly and accurately identify the shutdown periods even in case of multiple sensor failures.

Why? To avoid the updating of soft sensors with irrelevant data.

Page 11: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

What is a shutdown period?

A shutdown period is an undefined period of time in which the production plant is stopped.

Page 12: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Problems and solutions

Page 13: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Solution: Monitor a sensor and detect abrupt changes.

Problems and solutions

Page 14: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Solution: Monitor a sensor and detect abrupt changes.

Problem: A single sensor may fail.

Problems and solutions

Page 15: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Solution: Monitor a sensor and detect abrupt changes.

Problem: A single sensor may fail.

Solution: Monitor multiple sensors at the same time.

Problems and solutions

Page 16: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Solution: Monitor a sensor and detect abrupt changes.

Problem: A single sensor may fail.

Solution: Monitor multiple sensors at the same time.

Problem: There are delays between sensors due to physical location in the plant.

Problems and solutions

Page 17: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Problem: There is no single variable indicating on/off.

Solution: Monitor a sensor and detect abrupt changes.

Problem: A single sensor may fail.

Solution: Monitor multiple sensors at the same time.

Problem: There are delays between sensors due to physical location in the plant.

Solution: Synchronize variables (not easy) or use right change-point detection methods.

Problems and solutions

Page 18: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Shutdown and startup phases

Only 11 flow sensors were selected because they are the most responsive.

Page 19: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Multi-Sensor Change-Point Detection Methods

T=inf {t : st (X t)⩾τ}

time input data

detection threshold

statisticshutdownchange-point

Page 20: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Multi-Sensor Change-Point Detection Methods

T=inf {t : st (X t)⩾τ }

time input data

detection threshold

statisticshutdownchange-point

T=inf {t : st (X t)<τ }

startupchange-point

Page 21: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Multi-Sensor Change-Point Detection Methods

Incremental Sliding window

st (X0… t) st(X t−r…t)

Memory requirements:

Page 22: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Multi-Sensor Change-Point Detection Methods

Incremental Sliding window

st (X0… t) st(X t−r…t)

Memory requirements:

Sensors relevance:

Fixed Dynamic

st (W X t) st (W t X t)

Page 23: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Our method

binary weight for sensor n

number of outliers in the window

● Sliding window● Dynamic weights● Based on control charts

Thresholds by Hampel identifier:Median ± 3*MAD

Quick detection for shutdowns and deferred detection for

startups

Page 24: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

binary weight for sensor n

number of outliers in the window

● Sliding window● Dynamic weights● Based on control charts

Thresholds by Hampel identifier:Median ± 3*MAD

2000 2200 2400 2600 2800 3000 3200 3400

-2

0

2

DATA

2000 2200 2400 2600 2800 3000 3200 34000

10

20

30SGZ

t

st

Our method

Quick detection for shutdowns and deferred detection for

startups

Page 25: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Evaluation

5 Multi-sensor change-point detection methods have been evaluated: 4 based on likelihood and 1 on control charts.

TV: Tartakovsky, A. & Veeravalli, V., 2008. Asymptotically Optimal Quickest Change Detection in Distributed Sensor Systems. Sequential Analysis, 27(4), pp.441–475MEI: Mei, Y., 2010. Efficient scalable schemes for monitoring a large number of data streams. Biometrika, 97(2), pp.419–433XS1, XS2: Xie, Y. & Siegmund, D., 2013. Sequential multi-sensor change-point detection. The Annals of Statistics, 41(2), pp.670–692SGZ: Salvador, M.M., Gabrys, B. & Žliobaitė, I., 2014. Online Detection of Shutdown Periods in Chemical Plants: A Case Study. Procedia Computer Science, 35, pp.580–588

Page 26: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Evaluation

5 Multi-sensor change-point detection methods have been evaluated: 4 based on likelihood and 1 on control charts.

44 change points in totalDataset split: 50% train, 50% test

TV: Tartakovsky, A. & Veeravalli, V., 2008. Asymptotically Optimal Quickest Change Detection in Distributed Sensor Systems. Sequential Analysis, 27(4), pp.441–475MEI: Mei, Y., 2010. Efficient scalable schemes for monitoring a large number of data streams. Biometrika, 97(2), pp.419–433XS1, XS2: Xie, Y. & Siegmund, D., 2013. Sequential multi-sensor change-point detection. The Annals of Statistics, 41(2), pp.670–692SGZ: Salvador, M.M., Gabrys, B. & Žliobaitė, I., 2014. Online Detection of Shutdown Periods in Chemical Plants: A Case Study. Procedia Computer Science, 35, pp.580–588

Page 27: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Evaluation

5 Multi-sensor change-point detection methods have been evaluated: 4 based on likelihood and 1 on control charts.

44 change points in totalDataset split: 50% train, 50% test

Goal: Detect all the change points while minimizing both the (positive) detection delay and the number of false detections.

TV: Tartakovsky, A. & Veeravalli, V., 2008. Asymptotically Optimal Quickest Change Detection in Distributed Sensor Systems. Sequential Analysis, 27(4), pp.441–475MEI: Mei, Y., 2010. Efficient scalable schemes for monitoring a large number of data streams. Biometrika, 97(2), pp.419–433XS1, XS2: Xie, Y. & Siegmund, D., 2013. Sequential multi-sensor change-point detection. The Annals of Statistics, 41(2), pp.670–692SGZ: Salvador, M.M., Gabrys, B. & Žliobaitė, I., 2014. Online Detection of Shutdown Periods in Chemical Plants: A Case Study. Procedia Computer Science, 35, pp.580–588

Page 28: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Results

1800 2000 2200 2400 2600 2800 3000 3200 3400-4

-2

0

2

DATA

t

1800 2000 2200 2400 2600 2800 3000 3200 34000

500

1000XS1

t

st

1800 2000 2200 2400 2600 2800 3000 3200 34000

10

20

30

40XS2

t

st

1800 2000 2200 2400 2600 2800 3000 3200 34000

10

20

30

40MEI

t

st

1800 2000 2200 2400 2600 2800 3000 3200 34000

10

20

30

40TV

t

st

1800 2000 2200 2400 2600 2800 3000 3200 34000

10

20

30SGZ

t

st

Snapshot of the observed data and st values for r=25

Page 29: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Results

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100-40

-20

0

20

40

60

80

Window s izeD

elay

Startups ' me dian de lay

TVMEIXS1XS2SGZ

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 1000

2

4

6

8

10

12

14

Window s ize

Del

ay

Shutdowns ' me dian de lay

TVMEIXS1XS2SGZ

Window size doesn't affect too much the shutdown detection. However, it has a considerable impact in the startup detection.

Page 30: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Results

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100-40

-20

0

20

40

60

80

Window s izeD

elay

Startups ' me dian de lay

TVMEIXS1XS2SGZ

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 1000

2

4

6

8

10

12

14

Window s ize

Del

ay

Shutdowns ' me dian de lay

TVMEIXS1XS2SGZ

MEI is a quick detector but also raises false alarms

Page 31: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Results

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100-40

-20

0

20

40

60

80

Window s izeD

elay

Startups ' me dian de lay

TVMEIXS1XS2SGZ

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 1000

2

4

6

8

10

12

14

Window s ize

Del

ay

Shutdowns ' me dian de lay

TVMEIXS1XS2SGZ

The method that presents lower positive delay both in shutdowns and startups while minimizing the memory requirements (i.e. window size) is XS1.

Page 32: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Results

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100-40

-20

0

20

40

60

80

Window s izeD

elay

Startups ' me dian de lay

TVMEIXS1XS2SGZ

20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 1000

2

4

6

8

10

12

14

Window s ize

Del

ay

Shutdowns ' me dian de lay

TVMEIXS1XS2SGZ

Our method has a slightly higher detection delay but on the other hand is robust against sensor failures.

Page 33: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Conclusion

State-of-the-art multi-sensor change-point detection methods have been compared in a real case scenario which is novel in the literature.

Shutdown and startups have to be treated differently.

Our method is prepared for sensor failures.

Next step is to study the impact of the shutdown detection on the soft sensor performance.

Page 34: Online Detection of Shutdown Periods in Chemical Plants: A Case Study

Thanks!

Slides available in http://slideshare.net/draxus

Source code available in https://github.com/draxus/online-shutdown-identification

[email protected]