apache big_data europe event: "integrators at work! real-life applications of apache big data...
TRANSCRIPT
![Page 1: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/1.jpg)
BIG DATA EUROPE: PILOTS & APPLICATIONSApache Big Data Europe, Seville, Spain
![Page 2: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/2.jpg)
Different uses of the BDE components
Adaptation of an existing non-parallel algorithm.
Management and preparation of data for an existing infrastructure.
Reimplementation of a parallel version of an algorithm in a Big Data processing system language.
1 mai 2023
![Page 3: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/3.jpg)
SC4: Traffic conditions estimation
1 mai 2023www.big-data-europe.eu
Transport
• Estimation of real-time traffic conditions in Thessaloniki
• Combines:• Traffic modelling from
historical data• Current measurements
from a taxi fleet of 1200 vehicles
![Page 4: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/4.jpg)
SC4 Pilot Architecture
1 mai 2023www.big-data-europe.eu
![Page 5: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/5.jpg)
SC5: Climate modelling
1 mai 2023www.big-data-europe.eu
Climate
• Discovering and re-using previously computed derivatives• Lineage annotation: datasets
and model parameters used to compute derivative datasets
• Finding appropriate past runs avoids repeating weeks-long modelling runs
• Preparing modelling experiments• Slicing, transforming, combining datasets into
new datasets• Submission to and retrieval from modelling
infrastructure
![Page 6: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/6.jpg)
SC5 Pilot Architecture
1 mai 2023www.big-data-europe.eu
![Page 7: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/7.jpg)
SC7: Change detection & verification
1 mai 2023www.big-data-europe.eu
Secure Societie
s
• Automatically detect land cover evolution, caused by physical or human activities, and alert user accordingly. • Events are extracted from text
published by news agencies and on social media.
• Events are geo-located and relevant changes are detected by comparing current and previous satellite images
![Page 8: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/8.jpg)
SC7 Pilot Architecture
1 mai 2023www.big-data-europe.eu
![Page 9: Apache Big_Data Europe event: "Integrators at work! Real-life applications of Apache Big Data components: Pilots and Applications"](https://reader035.vdocuments.net/reader035/viewer/2022062822/5883ecec1a28ab34428b5505/html5/thumbnails/9.jpg)
WEB: www.big-data-europe.euEMAIL: [email protected]
Questions & Contactswww.big-data-europe.eu
1 mai 2023#BigDataEurope