big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… ·...

28
Big data @ magyar telekom Budapest Data 2016

Upload: others

Post on 06-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Big data @ magyar telekom

Budapest Data 2016

Page 2: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Gergely vItárIus

CLASSIC BI DEVELOPMENT & OPERATIONS

NEXT GENERATION BI TOOLS BIG DATA TECHNOLOGIES

ADVANCED / REALTIME ANALYTICS

BI innovation center HEAD OF BI INNOVATION CENTER

IT DIRECTORATE MAGYAR TELEKOM PLC.

Page 3: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Big data fever (2013/14)

Page 4: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Event based churn (teradata / marketing)

Big data fever (2013/14)

Page 5: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Event based churn (teradata / marketing)

Social media command center (hadoop / T-SYSTEMS)

Big data fever (2013/14)

Page 6: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Event based churn (teradata / marketing)

Location based ads (EMC / product house)

Social media command center (hadoop / T-SYSTEMS)

Big data fever (2013/14)

Page 7: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Event based churn (teradata / marketing)

Location based ads (EMC / product house)

Social media command center (hadoop / T-SYSTEMS)

DPI reporting (CLOUDERA hadoop / IT)

Big data fever (2013/14)

Page 8: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

DPI REPORTING PILOT (2014)

Page 9: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

9

DPI REPORTING PILOT (2014)

4bn records per day (1,5 TB raw data)

Page 10: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

10

DPI REPORTING PILOT (2014)

Original report: once a year, 3 months delay

4bn records per day (1,5 TB raw data)

Page 11: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

11

DPI REPORTING PILOT (2014)

Original report: once a year, 3 months delay

Classic DWH trial: 1 day of data aggregated in 3 days

4bn records per day (1,5 TB raw data)

Page 12: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

12

DPI REPORTING PILOT (2014)

Original report: once a year, 3 months delay

Classic DWH trial: 1 day of data aggregated in 3 days

4bn records per day (1,5 TB raw data)

Hadoop trial: 1 day of data aggregated in 15 secs

Page 13: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM
Page 15: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

What is important?

„BIG DAtA analytics is the future of our company”

Page 16: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

„FIrst FIX tHE bASICS, BIG DATA and other fancy things can come after that”

What is important?

„BIG DAtA analytics is the future of our company”

Page 17: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

„FIrst FIX tHE bASICS, BIG DATA and other fancy things can come after that”

What is important?

„BIG DAtA analytics is the future of our company”

„I have to wait too much for data, i need self service tools”

Page 18: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

FUTURE architecture

Self-service framework

Analytical excellence

Data monetization

BI governance

Bingo structure

Page 19: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Future architecture

Data warehouse platform upgrade

SAS environment upgrade

Introduce etl tool

Big data infrastructure

Data quality monitoring

Page 20: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Bi governance

Agile delivery model

Bi governance framework

data governance

Household data model

Page 21: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

21

Self-service bi

Business sandbox model

Data discovery tool

Automation framework

Unified Bi portal

Page 22: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

governance security privacy

Key challenges

Page 23: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Hadoop in action?

Page 24: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Build data lake

Hadoop in action?

Page 25: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Build data lake Build use cases

Hadoop in action?

Page 26: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Example use case: network customer experience

Page 27: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

takeaways

One Data Lake is

essential Develop classic

BI and next generation BI simultaneously

Holistic view of

Big Data is a must for success

Business

should be driving

Page 28: Big data @ magyar telekombiconsulting.hu/letoltes/2016budapestdata/vitarius_mtelekom_budap… · BIG DATA TECHNOLOGIES ADVANCED / REALTIME ANALYTICS BI ... IT DIRECTORATE MAGYAR TELEKOM

Thank you

Gergely Vitárius Head of BI Innovation Center [email protected]