conformance checking of processes based on monitoring real...
TRANSCRIPT
![Page 1: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/1.jpg)
Conformance Checking of Processes Based on Monitoring Real Behavior
Ronny Mans
![Page 2: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/2.jpg)
Department of Technology Management PAGE 124-4-2009
Conformance Checking
Prof. Wil van der AalstAnne
![Page 3: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/3.jpg)
Department of Technology Management PAGE 224-4-2009
Motivation
How to check whether interacting parties stick to what they agreed upon?
insurance company
car rental agency
hotel chain
travel agency
airline
![Page 4: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/4.jpg)
Department of Technology Management PAGE 324-4-2009
Outline
• Introduction Process Mining• Conformance Checking
• Fitness• Appropriateness
• Application to Web Services• Feasibility Study• Conclusion
![Page 5: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/5.jpg)
Department of Technology Management PAGE 424-4-2009
1. Introduction Process Mining
• analyze run-time data• possibly relate to existing
models and/or requirements• process mining!
processdesign
implementation/configuration
processenactment
diagnosisprocesscontrol
![Page 6: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/6.jpg)
Department of Technology Management PAGE 524-4-2009
2. Conformance Checking
Objectives:•quantitatively measure conformance (i.e., metrics)•locate deviations
Conformance?
![Page 7: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/7.jpg)
Department of Technology Management PAGE 624-4-2009
2.1 Conformance Checking - Fitness
![Page 8: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/8.jpg)
Department of Technology Management PAGE 724-4-2009
2.1 Conformance Checking - Fitness
![Page 9: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/9.jpg)
Department of Technology Management PAGE 824-4-2009
2.1 Measuring fitness: Log replay analysis
missing tokensremaining tokens
= 0= 0
= 0= 1
consumed tokensproduced tokens
![Page 10: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/10.jpg)
Department of Technology Management PAGE 924-4-2009
2.1 Measuring fitness: Log replay analysis
= 1= 2
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 11: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/11.jpg)
Department of Technology Management PAGE 1024-4-2009
2.1 Measuring fitness: Log replay analysis
= 2= 4
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 12: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/12.jpg)
Department of Technology Management PAGE 1124-4-2009
2.1 Measuring fitness: Log replay analysis
= 3= 5
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 13: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/13.jpg)
Department of Technology Management PAGE 1224-4-2009
2.1 Measuring fitness: Log replay analysis
= 5= 6
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 14: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/14.jpg)
Department of Technology Management PAGE 1324-4-2009
2.1 Measuring fitness: Log replay analysis
= 6= 7
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 15: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/15.jpg)
Department of Technology Management PAGE 1424-4-2009
2.1 Measuring fitness: Log replay analysis
= 7= 7
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 16: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/16.jpg)
Department of Technology Management PAGE 1524-4-2009
2.1 Measuring fitness: Log replay analysis
= 9= 9
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 17: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/17.jpg)
Department of Technology Management PAGE 1624-4-2009
2.1 Measuring fitness: Log replay analysis
= 9= 9
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 18: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/18.jpg)
Department of Technology Management PAGE 1724-4-2009
2.1 Measuring fitness: Log replay analysis
= 0= 1
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 19: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/19.jpg)
Department of Technology Management PAGE 1824-4-2009
2.1 Measuring fitness: Log replay analysis
= 1= 2
= 0= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 20: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/20.jpg)
Department of Technology Management PAGE 1924-4-2009
2.1 Measuring fitness: Log replay analysis
= 2= 4
= 1= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 21: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/21.jpg)
Department of Technology Management PAGE 2024-4-2009
2.1 Measuring fitness: Log replay analysis
= 3= 5
= 1= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 22: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/22.jpg)
Department of Technology Management PAGE 2124-4-2009
2.1 Measuring fitness: Log replay analysis
= 4= 6
= 1= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 23: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/23.jpg)
Department of Technology Management PAGE 2224-4-2009
2.1 Measuring fitness: Log replay analysis
= 6= 7
= 1= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 24: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/24.jpg)
Department of Technology Management PAGE 2324-4-2009
2.1 Measuring fitness: Log replay analysis
= 7= 8
= 1= 0
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 25: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/25.jpg)
Department of Technology Management PAGE 2424-4-2009
2.1 Measuring fitness: Log replay analysis
= 8= 8
= 1= 1
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 26: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/26.jpg)
Department of Technology Management PAGE 2524-4-2009
2.1 Measuring fitness: Log replay analysis
= 8= 8
= 1= 1
missing tokensremaining tokens
consumed tokensproduced tokens
![Page 27: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/27.jpg)
Department of Technology Management PAGE 2624-4-2009
2.1 Measuring fitness: Log replay analysis
![Page 28: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/28.jpg)
Department of Technology Management PAGE 2724-4-2009
2.1 Measuring fitness: Log replay analysis
f = 1.0 f ≈ 0.540f ≈ 0.955
![Page 29: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/29.jpg)
Department of Technology Management PAGE 2824-4-2009
2.2 Conformance Checking - Appropriateness
100 % fitnessbut not sufficiently specific from behavioral point of view.
100 % fitnessbut not represented instructurally suitable way.
![Page 30: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/30.jpg)
Department of Technology Management PAGE 2924-4-2009
3. Application to Web Services
• Service-oriented systems are composed of services that are:• independently developed and operated• interact with one another exclusively through
message exchanges➡ Expected behavior may deviate
• e.g., service receives reply of the wrong type, messages may be received in the wrong order, ...
Question: “Do all services in a service-oriented system operate as expected?”
![Page 31: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/31.jpg)
Department of Technology Management PAGE 3024-4-2009
3. Application to Web Services - Approach
ServicesServicesabstractBPEL
process
Petri netmodel
1.
SOAPMessages
Event Log
Services
Monitoring /Correlation
Conformance?
2.
ConformanceChecking!
Translation
![Page 32: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/32.jpg)
Department of Technology Management PAGE 3124-4-2009
3.1 From BPEL to Petri Nets
![Page 33: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/33.jpg)
Department of Technology Management PAGE 3224-4-2009
3.1 From BPELto Petri Nets
Translation isfeature-complete:
➡ maps all BPELaspects on a Petri-net model
C. Ouyang, W.M.P. van der Aalst, S. Breutel, M. Dumas, A.H.M. ter Hofstede, and H.M.W. Verbeek. Formal Semantics and Analysis of Control Flow in WS-BPEL (Revised version). BPM Center Report BPM-05-15, BPMcenter.org, 2005.
![Page 34: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/34.jpg)
Department of Technology Management PAGE 3324-4-2009
3.2 Monitoring and Correlating Messages
From SOAP messages to Event log:• Process instance (PI)• Label denoting the BPEL communication
action (MT)
![Page 35: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/35.jpg)
Department of Technology Management PAGE 3424-4-2009
Service Behavior
4. Feasibility Study - Overview
abstractBPEL
process
BPEL2PNML+
WofBPEL
WF-net
1.
SOAPMessages
ConformanceChecker(ProM)
3.
MXMLEvent Log
OracleBPELServer
OracleBPELServer
Conformance?
2.
TCP tunneling +Conversion
![Page 36: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/36.jpg)
Department of Technology Management PAGE 3524-4-2009
4.1 From BPEL to WF-nets (1)
• Translation: BPEL2PNML
![Page 37: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/37.jpg)
Department of Technology Management PAGE 3624-4-2009
4.1 From BPEL to WF-nets (2)
• Reduction: WofBPEL
![Page 38: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/38.jpg)
Department of Technology Management PAGE 3724-4-2009
4.2 Observing Service Behavior
Implementation via Oracle BPEL:• Supplier service• Customer service
➡could have been implementedon any other platform! (e.g., Java, .NET, etc.)
Service Behavior
SOAPMessages
MXMLEvent Log
OracleBPELServer
OracleBPELServer
TCP tunneling +Conversion
Result: Observation of one out of many possible communication scenarios
![Page 39: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/39.jpg)
Department of Technology Management PAGE 3824-4-2009
4.3 Conformance Checking
• Desirable and undesirable scenarios for the supplier service execution
![Page 40: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/40.jpg)
Department of Technology Management PAGE 3924-4-2009
4.3 Conformance Checking
• Analysis scenario 8: (orderResponse)
![Page 41: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/41.jpg)
Department of Technology Management PAGE 4024-4-2009
4. Conclusion
• Conformance checking particularly relevant in a service-based environment due to the independence of services
• Feasible to check conformance of an abstract BPEL process using existing tool chain (BPEL2PNML, WofBPEL, ProM Conformance Checker)
W.M.P. van der Aalst, M. Dumas, C. Ouyang, A. Rozinat, and H.M.W. Verbeek. Choreography Conformance Checking: An Approach based on BPEL andPetri Nets (extended version). BPM Center Report BPM-05-25, BPMcenter.org, 2005.
![Page 42: Conformance Checking of Processes Based on Monitoring Real ...julien/Julien_at_Nijmegen/DWFTT09_files/ronny_DWFTT.… · = 2 = 0 = 0 missing tokens remaining tokens consumed tokens](https://reader031.vdocuments.net/reader031/viewer/2022011923/605a61d74edf2844df43eaec/html5/thumbnails/42.jpg)
Department of Technology Management PAGE 4124-4-2009
Thank you very much!
Questions?