optimizing the performance for concurrent rdf stream processing queries...
TRANSCRIPT
![Page 1: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/1.jpg)
Optimizing the Performance for
Concurrent RDF Stream Processing
Queries
Chan Le Van, Feng Gao, Muhammad Intizar Ali
The INSIGHT Centre for Data Analytics – NUI Galway, Ireland
May, 2017
![Page 2: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/2.jpg)
OutlineI. Introduction
II. Foundations
III. Optimization of Concurrent CQELS Queries
IV. Evaluations
V. Conclusion and Future Works
2
![Page 3: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/3.jpg)
Data Streams are Everywhere !
3
![Page 4: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/4.jpg)
RDF Stream Processing
4
![Page 5: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/5.jpg)
RDF Stream Processing• RDF Stream Processing(RSP) Engines: C-
SPARQL, SPARQL-stream, CQELS
4
![Page 6: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/6.jpg)
RDF Stream Processing• RDF Stream Processing(RSP) Engines: C-
SPARQL, SPARQL-stream, CQELS
• Concurrent Query Processing is still a challenge
with these engines
4
![Page 7: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/7.jpg)
RDF Stream Processing• RDF Stream Processing(RSP) Engines: C-
SPARQL, SPARQL-stream, CQELS
• Concurrent Query Processing is still a challenge
with these engines
• CQELS+: Extension of CQELS aiming at
optimizing the multiple-query processing
4
![Page 8: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/8.jpg)
II. Foundations
5Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 9: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/9.jpg)
II. Foundations• CQELS – RDF Stream Processing Framework
5Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 10: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/10.jpg)
II. Foundations• CQELS – RDF Stream Processing Framework
• Multi-way Join Operator
5Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 11: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/11.jpg)
II. Foundations• CQELS – RDF Stream Processing Framework
• Multi-way Join Operator
• Shared Join Operator
5Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 12: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/12.jpg)
II. Foundations• CQELS – RDF Stream Processing Framework
• Multi-way Join Operator
• Shared Join Operator
• Network of Shared Join Operators(NSJO)
5Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 13: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/13.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61313
![Page 14: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/14.jpg)
• Accepting CQELS-declarative
language(extended from SPARQL
language)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61414
![Page 15: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/15.jpg)
• Accepting CQELS-declarative
language(extended from SPARQL
language)
• Following eager-execution approach
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61515
![Page 16: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/16.jpg)
• Accepting CQELS-declarative
language(extended from SPARQL
language)
• Following eager-execution approach
• Can process both static and RDF stream
data
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61616
![Page 17: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/17.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61717
![Page 18: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/18.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61818
S1 S3 S2
CQELS
![Page 19: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/19.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
61919
S1 S3 S2
Q1(S1, S2, S3)CQELS
![Page 20: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/20.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62020
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)CQELS
![Page 21: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/21.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62121
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)CQELS
![Page 22: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/22.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62222
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)CQELS
![Page 23: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/23.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62323
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q2(S2, S3)
CQELS
![Page 24: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/24.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62424
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q2(S2, S3)
j
B22 B2
3
CQELS
![Page 25: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/25.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62525
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q2(S2, S3)
j
B22 B2
3
CQELS
![Page 26: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/26.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62626
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q3(S1, S3)
Q2(S2, S3)
j
B22 B2
3
CQELS
![Page 27: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/27.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62727
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q3(S1, S3)
Q2(S2, S3)
j
B22 B2
3
j
B31 B3
3
CQELS
![Page 28: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/28.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62828
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q3(S1, S3)
Q2(S2, S3)
j
B22 B2
3
j
B31 B3
3
CQELS
![Page 29: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/29.jpg)
CQELS – RDF Stream Processing Framework
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
62929
J
j
B11 B1
2 B13
S1 S3 S2
Q1(S1, S2, S3)
Q3(S1, S3)
Q2(S2, S3)
j
B22 B2
3
j
B31 B3
3
CQELS
![Page 30: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/30.jpg)
Multi-way Join Operator
7Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 31: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/31.jpg)
Multi-way Join Operator
7Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 32: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/32.jpg)
Multi-way Join Operator
7
• Incremental evaluation
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 33: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/33.jpg)
Multi-way Join Operator
7
(indexed)
• Incremental evaluation
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 34: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/34.jpg)
Multi-way Join Operator
7
(indexed)
(indexed)
• Incremental evaluation
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 35: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/35.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 36: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/36.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 37: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/37.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 38: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/38.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 39: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/39.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 40: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/40.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 41: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/41.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 42: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/42.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 43: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/43.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 44: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/44.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 45: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/45.jpg)
8
Shared Join Operator
Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 46: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/46.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 47: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/47.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 48: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/48.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 49: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/49.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 50: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/50.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 51: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/51.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 52: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/52.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 53: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/53.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 54: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/54.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 55: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/55.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 56: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/56.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 57: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/57.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 58: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/58.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
![Page 59: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/59.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
Join
Graph
![Page 60: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/60.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
Join
Graph
Join
Graph
![Page 61: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/61.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
Join
Graph
Join
Graph
Join
Graph
![Page 62: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/62.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
Join
Graph
Join
Graph
Join
Graph
Join
Graph
![Page 63: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/63.jpg)
Network of Shared Join Operators(NSJO)
9Reference: D. Le-Phuoc. A Native and Adaptive Approach for Linked Stream Data Processing. PhD thesis, National University of
Ireland Galway, IDA Business Park, Lower Dangan, Galway, Ireland, 2012.
Join
Graph
Join
Graph
Join
Graph
Join
Graph
• Join Graph contains the best-cost join
sequences of the involved queries
• Join Sequence = order of joined data buffers
![Page 64: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/64.jpg)
III. Optimization of Concurrent CQELS queries
10
![Page 65: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/65.jpg)
III. Optimization of Concurrent CQELS queries
• CQELS+: Extending CQELS with the network of
shared join operators
10
![Page 66: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/66.jpg)
III. Optimization of Concurrent CQELS queries
• CQELS+: Extending CQELS with the network of
shared join operators
o Output reutilization Heuristic over Join Graph
o Join graph Example
10
![Page 67: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/67.jpg)
III. Optimization of Concurrent CQELS queries
• CQELS+: Extending CQELS with the network of
shared join operators
o Output reutilization Heuristic over Join Graph
o Join graph Example
• Load Balancing for Parallel CQELS+ Instances
10
![Page 68: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/68.jpg)
III. Optimization of Concurrent CQELS queries
• CQELS+: Extending CQELS with the network of
shared join operators
o Output reutilization Heuristic over Join Graph
o Join graph Example
• Load Balancing for Parallel CQELS+ Instances
o Rotation
o Minimal Average Latency
o Minimal Buffer Size
10
![Page 69: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/69.jpg)
11
Output Reutilization Heuristic
![Page 70: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/70.jpg)
CQELS+: Join Graph – Example
12Reference: Conference scenario: Integrating physical stream with online profiles Manfred Hauswirth Danh Le-Phuoc, Josiane Xavier Parreira. Linked stream data processing. 2012.
![Page 71: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/71.jpg)
CQELS+: Join Graph – Example
12
QUERY 1: inform a participant about the name and description of the location he just entered.
Reference: Conference scenario: Integrating physical stream with online profiles Manfred Hauswirth Danh Le-Phuoc, Josiane Xavier Parreira. Linked stream data processing. 2012.
![Page 72: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/72.jpg)
CQELS+: Join Graph – Example
12
QUERY 1: inform a participant about the name and description of the location he just entered.
QUERY 2:notify two people when they can reach each other from two different and directly connected (nearby) locations.
Reference: Conference scenario: Integrating physical stream with online profiles Manfred Hauswirth Danh Le-Phuoc, Josiane Xavier Parreira. Linked stream data processing. 2012.
![Page 73: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/73.jpg)
CQELS+: Join Graph – Example
12
QUERY 1: inform a participant about the name and description of the location he just entered.
QUERY 2:notify two people when they can reach each other from two different and directly connected (nearby) locations.
QUERY 3:notify an author of his co-authors who have been in his current location during the last 5 seconds.
Reference: Conference scenario: Integrating physical stream with online profiles Manfred Hauswirth Danh Le-Phuoc, Josiane Xavier Parreira. Linked stream data processing. 2012.
![Page 74: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/74.jpg)
CQELS+: Join Graph – Example
12
QUERY 1: inform a participant about the name and description of the location he just entered.
QUERY 2:notify two people when they can reach each other from two different and directly connected (nearby) locations.
QUERY 3:notify an author of his co-authors who have been in his current location during the last 5 seconds.
QUERY 4:count the number of co-authors appearing in nearby locations in the last 30 seconds grouped by location.
Reference: Conference scenario: Integrating physical stream with online profiles Manfred Hauswirth Danh Le-Phuoc, Josiane Xavier Parreira. Linked stream data processing. 2012.
![Page 75: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/75.jpg)
CQELS+: Join Graph – Example
13
![Page 76: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/76.jpg)
CQELS+: Join Graph – Example
13
![Page 77: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/77.jpg)
CQELS+: Join Graph – Example
13
![Page 78: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/78.jpg)
CQELS+: Join Graph – Example
13
![Page 79: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/79.jpg)
CQELS+: Join Graph – Example
13
![Page 80: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/80.jpg)
CQELS+: Join Graph – Example
13
![Page 81: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/81.jpg)
CQELS+: Join Graph – Example
14
![Page 82: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/82.jpg)
CQELS+: Join Graph – Example
14
![Page 83: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/83.jpg)
CQELS+: Join Graph – Example
14
![Page 84: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/84.jpg)
CQELS+: Join Graph – Example
14
![Page 85: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/85.jpg)
CQELS+: Join Graph – Example
14
![Page 86: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/86.jpg)
CQELS+: Join Graph – Example
14
![Page 87: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/87.jpg)
CQELS+: Join Graph – Example
14
![Page 88: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/88.jpg)
CQELS+: Join Graph – Example
14
![Page 89: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/89.jpg)
CQELS+: Join Graph – Example
14
![Page 90: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/90.jpg)
CQELS+: Join Graph – Example
14
![Page 91: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/91.jpg)
Load Balancing for Parallel CQELS+ Instances
15
![Page 92: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/92.jpg)
Load Balancing for Parallel CQELS+ Instances
15
![Page 93: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/93.jpg)
Load Balancing for Parallel CQELS+ Instances
15
![Page 94: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/94.jpg)
Load Balancing for Parallel CQELS+ Instances
15
![Page 95: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/95.jpg)
Load Balancing for Parallel CQELS+ Instances
15
![Page 96: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/96.jpg)
Load Balancing for Parallel CQELS+ Instances
15
Register query using Load-balancing strategies:
![Page 97: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/97.jpg)
Load Balancing for Parallel CQELS+ Instances
15
Register query using Load-balancing strategies:
1. Rotation: Round-robin
registration
![Page 98: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/98.jpg)
Load Balancing for Parallel CQELS+ Instances
15
Register query using Load-balancing strategies:
1. Rotation: Round-robin
registration
2. Minimum
Average Latency:
Choose the engine
with the lowest
average latency to
register
![Page 99: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/99.jpg)
Load Balancing for Parallel CQELS+ Instances
15
Register query using Load-balancing strategies:
1. Rotation: Round-robin
registration
2. Minimum
Average Latency:
Choose the engine
with the lowest
average latency to
register
3. Minimum Average
Buffer Size: Choose
the engine with the
lowest average buffer
size to register
![Page 100: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/100.jpg)
IV. Evaluation
• Shared Join Operator Evaluation
• Load Balancing over CQELS+ engines
• Query Registration Time
16
![Page 101: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/101.jpg)
Query 3
Query 5Query 6
Query 2
Join Performance between CQELS and CQELS+
17Experimentation: https://github.com/chanlevan/CqelsplusExperiment
Source code: https://github.com/chanlevan/CQELSPLUS
![Page 102: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/102.jpg)
Query 3
Query 5Query 6
Query 2
Join Performance between CQELS and CQELS+
17Experimentation: https://github.com/chanlevan/CqelsplusExperiment
Source code: https://github.com/chanlevan/CQELSPLUS
Query 5
![Page 103: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/103.jpg)
Load Balancing
18
Scale instances Scale Streams
Experimentation: https://github.com/chanlevan/CqelsplusLoadBalancingExperiment
Source code: https://github.com/chanlevan/CPFederation
![Page 104: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/104.jpg)
Query Registration Time
19Experimentation: https://github.com/chanlevan/CqelsplusLoadBalancingExperiment
Source code: https://github.com/chanlevan/CPFederation
![Page 105: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/105.jpg)
VI. Conclusion and Future Works
20
![Page 106: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/106.jpg)
VI. Conclusion and Future Works
Better Performance of handling multiple queries
Federating CQELS+ engines with different load-
balancing strategies
20
![Page 107: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/107.jpg)
VI. Conclusion and Future Works
Better Performance of handling multiple queries
Federating CQELS+ engines with different load-
balancing strategies
CQELS+:Reduce Query Registration Time
Distributed model: More efficient load-balancing
strategies
20
![Page 108: Optimizing the Performance for Concurrent RDF Stream Processing Queries …translectures.videolectures.net/site/normal_dl/tag=1117914/eswc2017_le... · Chan Le Van, Feng Gao, Muhammad](https://reader033.vdocuments.net/reader033/viewer/2022051607/6033db0d91c0275aea074593/html5/thumbnails/108.jpg)
VI. Conclusion and Future Works
Better Performance of handling multiple queries
Federating CQELS+ engines with different load-
balancing strategies
CQELS+:Reduce Query Registration Time
Distributed model: More efficient load-balancing
strategies
20