process mining - chapter 8 - mining additional perspectives

37
Chapter 8 Mining Additional Perspectives prof.dr.ir. Wil van der Aalst www.processmining.org

Upload: wil-van-der-aalst

Post on 07-Nov-2014

1.089 views

Category:

Business


5 download

DESCRIPTION

Slides supporting the book "Process Mining: Discovery, Conformance, and Enhancement of Business Processes" by Wil van der Aalst. See also http://springer.com/978-3-642-19344-6 (ISBN 978-3-642-19344-6) and the website http://www.processmining.org/book/start providing sample logs.

TRANSCRIPT

Page 1: Process Mining - Chapter 8 - Mining Additional Perspectives

Chapter 8Mining Additional Perspectives

prof.dr.ir. Wil van der Aalstwww.processmining.org

Page 2: Process Mining - Chapter 8 - Mining Additional Perspectives

Overview

PAGE 1

Part I: Preliminaries

Chapter 2 Process Modeling and Analysis

Chapter 3Data Mining

Part II: From Event Logs to Process Models

Chapter 4 Getting the Data

Chapter 5 Process Discovery: An Introduction

Chapter 6 Advanced Process Discovery Techniques

Part III: Beyond Process Discovery

Chapter 7 Conformance Checking

Chapter 8 Mining Additional Perspectives

Chapter 9 Operational Support

Part IV: Putting Process Mining to Work

Chapter 10 Tool Support

Chapter 11 Analyzing “Lasagna Processes”

Chapter 12 Analyzing “Spaghetti Processes”

Part V: Reflection

Chapter 13Cartography and Navigation

Chapter 14Epilogue

Chapter 1 Introduction

Page 3: Process Mining - Chapter 8 - Mining Additional Perspectives

Mining additional perspectives(one type of enhancement, cf. repair in context of conformance checking)

PAGE 2

software system

(process)model

eventlogs

modelsanalyzes

discovery

records events, e.g., messages,

transactions, etc.

specifies configures implements

analyzes

supports/controls

enhancement

conformance

“world”

people machines

organizationscomponents

businessprocesses

Page 4: Process Mining - Chapter 8 - Mining Additional Perspectives

Replay: Connecting events to model elements is essential for process mining

PAGE 3

event log process model

Play-In

event logprocess model

Play-Out

event log process model

Replay

• extended model showing times, frequencies, etc.

• diagnostics• predictions• recommendations

Page 5: Process Mining - Chapter 8 - Mining Additional Perspectives

A

B

C

DE

p2

end

p4

p3p1

start

Remember: Replay!

PAGE 4

A B C D

Page 6: Process Mining - Chapter 8 - Mining Additional Perspectives

A

B

C

DE

p2

end

p4

p3p1

start

Replay can detect problems

PAGE 5

AC D

Problem!missing token

Problem!token left behind

Page 7: Process Mining - Chapter 8 - Mining Additional Perspectives

A

B

C

DE

p2

end

p4

p3p1

start

Replay can extract timing information

PAGE 6

A5B8 C9 D13

5

8

9

13

3

4

5

43

265

8

764

7

74

3

Page 8: Process Mining - Chapter 8 - Mining Additional Perspectives

A

B

C

DE

p2

end

p4

p3p1

start

Decision mining: “Red” cases

PAGE 7

A B C D

Page 9: Process Mining - Chapter 8 - Mining Additional Perspectives

A

B

C

DE

p2

end

p4

p3p1

start

Decision mining: “Blue” cases

PAGE 8

A E D If red then B+C;If blue then E;

Page 10: Process Mining - Chapter 8 - Mining Additional Perspectives

Starting point: connected event log and model

PAGE 9

...

process case

activity activity instance

event

attribute

timestamp

resource*

1

*1

*

1

*1

1

**1

1

*a

b

c

d

e

f g

h

i

event level

costs

trans- action

model level

instance level

j

k

Page 11: Process Mining - Chapter 8 - Mining Additional Perspectives

Process

PAGE 10

software system

(process)model

eventlogs

modelsanalyzes

discovery

records events, e.g., messages,

transactions, etc.

specifies configures implements

analyzes

supports/controls

enhancement

conformance

“world”

people machines

organizationscomponents

businessprocessesthe initial

process model is made by

hand or discovered from

the event logevents have

attributes relating to

various perspectives

conformance checking is used to relate the initial

model and event log

1

2

3

4

the model is extended using the additional information in the

event log

5

integrated model showing multiple

perspectives

Page 12: Process Mining - Chapter 8 - Mining Additional Perspectives

Attributes in event logs

PAGE 11

Page 13: Process Mining - Chapter 8 - Mining Additional Perspectives

Cases may also have attributes

PAGE 12

Page 14: Process Mining - Chapter 8 - Mining Additional Perspectives

Helicopter view: Dotted charts

PAGE 13

time can be absolute or relative and real or logical

time

class

each line corresponds to a class, e.g., a case, a

resource, a customer, or an activity

each dot corresponds to an event

the color and shape of a dot may depend on attributes of the

event

activity : decidetype : starttime : 06-01-2011:11.18resource : Saracost : -custid : 9911name : Smithtype : goldregion : southamount : 989.50

Page 15: Process Mining - Chapter 8 - Mining Additional Perspectives

Dotted chart for a process of a housing agency using absolute time

PAGE 14

Page 16: Process Mining - Chapter 8 - Mining Additional Perspectives

Zooming in

PAGE 15

Page 17: Process Mining - Chapter 8 - Mining Additional Perspectives

Same log, relative time

PAGE 16

Page 18: Process Mining - Chapter 8 - Mining Additional Perspectives

Organizational mining

PAGE 17

Page 19: Process Mining - Chapter 8 - Mining Additional Perspectives

Resource-activity matrix

PAGE 18

mean number of times a resource performs an activity per case

Activity a is executed exactly once for each case (take the sum of the first column). Pete, Mike, and Ellen are the only ones executing this activity. In 30% of the cases, a is executed by Pete, 50% is executed by Pete, and 20% is executed by Ellen. Activities e and f are always executed by Sara. Activity e is executed, on average, 2.3 times per case. Etc.

Page 20: Process Mining - Chapter 8 - Mining Additional Perspectives

Social network analysis

PAGE 19

relationship

organizational entity (resource, person, role, department, etc.)

x z

y the size of the oval indicates the weight of the entity

the thickness of the arc indicates the weight of the relationship

w=0.90

w=0.30 w=0.35

w=0.98

w=0.80

w=0.15

w=0.08

Page 21: Process Mining - Chapter 8 - Mining Additional Perspectives

Handover of work matrix

PAGE 20

Count the number of times work is handed over from one resource to another (on average per case).

The causal dependencies in the process model are used to count handovers in the event log.

Page 22: Process Mining - Chapter 8 - Mining Additional Perspectives

Social network based on handover of work (threshold of 0.1)

PAGE 21

Pete

Mike

Ellen

Sue

Sean

Sara

In this figure only the thickness of the arcs is based on frequencies.

Page 23: Process Mining - Chapter 8 - Mining Additional Perspectives

Handover of work at role level

PAGE 22

w=1.5

w=0.5

w=3.45

w=1.15

w=2,95

w=0.65w=1.3

Assistantw=5.45

Expertw=1.15

Managerw=3.6In this figure also

the size of each node is based on frequencies.

Page 24: Process Mining - Chapter 8 - Mining Additional Perspectives

Profile

PAGE 23

Page 25: Process Mining - Chapter 8 - Mining Additional Perspectives

Social network based on similarity of profiles

PAGE 24

Pete

Mike Ellen

SueSean

Sara

Resources that execute similar collections of activities are related. Sara is the only resource executing e and f . Therefore, she is not connected to other resources. Self-loops are suppressed as they contain no information (self-similarity)

Page 26: Process Mining - Chapter 8 - Mining Additional Perspectives

Discovering organizational structures

PAGE 25

astart register

request

bexamine

thoroughly

cexamine casually

dcheck ticket

decide

pay compensation

reject request

reinitiate request

e

g

h

f

end

p3p1

p2 p4

p5

PeteMike Ellen

Sue SeanSara

Assistant

ManagerExpert

Page 27: Process Mining - Chapter 8 - Mining Additional Perspectives

Another example

PAGE 26

a1

a2

a4

r1

process model

a3

a5

oe1

oe2 oe3

oe4 oe5

oe6 oe7 oe8

organizational model resources

r2

r3

r4

r5

r6

r7

r8

r9

Page 28: Process Mining - Chapter 8 - Mining Additional Perspectives

Analyzing resource behavior, e.g., Yerkes-Dodson law of arousal

PAGE 27

Page 29: Process Mining - Chapter 8 - Mining Additional Perspectives

Learning time and probabilities

• Replay, as before, but now considering timestamps.• Let us replay the first three cases in the event log:

− case 1 starts at time 12 and ends at time 54, − case 2 starts at time 17 and ends at time 73, − case 3 starts at time 25 and ends at time 98.

PAGE 28

Page 30: Process Mining - Chapter 8 - Mining Additional Perspectives

PAGE 29

astart register

request

bexamine

thoroughly

cexamine casually

dcheck ticket

decide

pay compensation

reject request

reinitiate request

e

g

h

f

end

p3p1

p2 p4

p5

1,c:191,s:12

2,c:232,s:17

3,c:303,s:25

1,c:321,s:25

3,c:653,s:60

2,c:382,s:30

3,c:353,s:32

1,c:331,s:26

2,c:322,s:28

3,c:403,s:35

3,c:673,s:62

3,c:553,s:50

1,c:401,s:35

2,c:592,s:50

3,c:503,s:45

3,c:873,s:80

1,c:541,s:50

2,c:732,s:70

3,c:983,s:90

1:6

2:7

3:2

3:5

1:10

2:11

3:0

3:3

1:3

2:12

3:10

3:15

1:7

2:5

3:5

3:7

1:2

2:18

3:5

3:13

1:12

2:17

3:25

1:54

2:73

3:98

7

6

5

7

5

8

33

8

5

7

5

9

4

5

5

5

7

4

Page 31: Process Mining - Chapter 8 - Mining Additional Perspectives

Another view on the timed replay of the first three cases

PAGE 30

abd

eh

0 10 20 30 40 50 60 70 80 90

ac

de

g

ab

cd d

e e

g

case 1

case 2

case 3

f

time

Page 32: Process Mining - Chapter 8 - Mining Additional Perspectives

Timed replay projected onto resources

PAGE 31

a

b

d

e

h0 10 20 30 40 50 60 70 80 90

a

c

d

e

g

a

b

c

d

d

e e

g

f

Pete

Mike

EllenSue

Sean

Sara

time

Page 33: Process Mining - Chapter 8 - Mining Additional Perspectives

Decision mining

PAGE 32

astart register

request

bexamine

thoroughly

cexamine casually

d

check ticket

decide

pay compensation

reject request

reinitiate request

e

g

h

f

end

c1

c2

c3

c4

c5

decision point #1

decision point #2

Page 34: Process Mining - Chapter 8 - Mining Additional Perspectives

Example: XOR-split

PAGE 33

x

y

z

type region amount activity

gold south 987.30 z

type=gold and amount<500

type=silver or amount≥500

silver north 178.70 z

gold south 211.50 y

silver west 587.70 z

x

y

z

type=gold and amount<500

type=silver or amount≥500

x

y

z

type=gold and amount<500

type=silver or amount≥500

silver east 224.70 z

silver south 278.50 z

gold north 488.50 y

silver west 443.20 z

silver south 673.70 z

gold west 413.50 y

silver south 687.70 z

gold south 987.30 z

silver north 378.80 z

gold south 314.50 y

silver north 537.70 z

silver west 158.70 z

gold east 344.50 y

... ... ... ...

A classification technique like decision tree learning can be used to find such rules: :explain response variable (dependent variable) in terms of predictor variables (independent variables).

What are the “features” (predictor variables) influencing the decision?

Page 35: Process Mining - Chapter 8 - Mining Additional Perspectives

Example: OR-split

PAGE 34

x

y

z

type region amount activity

gold south 987.30 y and z

type=gold or amount<500

type=silver or amount≥500

silver north 178.70 y and z

gold south 211.50 just y

silver west 587.70 just z

x

y

z

type=gold or amount<500

type=silver or amount≥500

silver east 224.70 y and z

silver south 278.50 y and z

gold north 488.50 just y

silver west 443.20 y and z

silver south 673.70 just z... ... ... ...

Page 36: Process Mining - Chapter 8 - Mining Additional Perspectives

Classification in process mining

• The application of classification techniques like decision tree learning is not limited to decision mining based on event/case data only.

• Additional predictor variables may be used:− behavioral information (count number of loops)− performance information (processing times)− contextual information (weather, queues, etc.)

• Alternative response variables can be analyzed:− uncover reasons for non-conformance (split

instances in two groups)− uncover reasons for delays

PAGE 35

Page 37: Process Mining - Chapter 8 - Mining Additional Perspectives

Bringing it all together

PAGE 36

astart register

request

bexamine

thoroughly

cexamine casually

d

check ticket

decide

pay compensation

reject request

reinitiate request

e

g

h

f

end

c1

c2

c3

c4

c5

A

A

A

A

A

E

M

M

Pete

Mike

Ellen

Role A:Assistant

Sue

Sean

Role E:Expert

Sara

Role M:Manager

Step 2: create or discovera process model

Step 1: obtain an event log

Step 3: connect events in the log to activities in the

model

Step 4: extend the model

add

orga

niza

tiona

l pe

rspe

ctiv

e

add

time

pers

pect

ive

add

case

pers

pect

ive

add

othe

r pe

rspe

ctiv

es

Step 5: return integrated model

astart register

request

bexamine

thoroughly

cexamine casually

d

check ticket

decide

pay compensation

reject request

reinitiate request

e

g

h

f

end

c1

c2

c3

c4

c5

A

A

AM

eventlog