trends in big data
Post on 11-Apr-2017
53 Views
Preview:
TRANSCRIPT
Trends in Big Data Selvaraaju Murugesan
https://www.linkedin.com/in/selvaraaju/
Overview• Big data evolution and role of data• Big data ecosystem and tools• Demo of MapR cluster• Trends in next 5 years• My personal recommendations• Conclusion
When big data was small ?• Most of the transactional data was/(is) stored in
databases• Social media was getting some traction• Mobile phone penetration was very low• Managers made decision on reports that is based on
static data (there is no live feed of data that influences their decision at right time)
Big data landscape has changed !
Old Vs New Paradigm
Distributed Storage
Big data ≠ Hadoop
Main players
MapR Converged Data Platform
David vs Goliath
https://www.dezyre.com/article/cloudera-vs-hortonworks-vs-mapr-hadoop-distribution-comparison-/190
Ecosystem tools
Big data process
Ingestion Storage Analysis Presentation
Data Ingestion : Flume / Streamsets / Impala
Hive / Hue
Self-Service Data Exploration
Data Agility with Less IT Required
Single SQL Interface for Structured and Semi-Structured Data
Data Exploration
Data Analytics – R / Spark R
Operationalise – Spark
Trends in next 5 years• Every home will not have super computers but powerful nodes that
can do distributed computing and storage• Analysing data and decision making will be performed by 5 year old
using standard AI libraries and cheap hardware• Big data will empower deep learning• Bots will try to mimic human services
What is after big data ?
Recommendation• Big data platform can be implemented in many ways ; Hadoop is not
the only option !• Analyse important data bytes that is relevant to make business
decisions• Beware of cloud providers and their traps• Data driven decision making but hunch is very important
Creativity > big data
top related