many (big) data projects start in agile mode - home | ba4all in the cloud the... · many (big) data...

Hadoop in the cloud: the pragmatic start Joris Van den Borre, director, Tropos.io

Many (big) data projects start in Agile mode

Our key driver is growth

Cloud provides the building blocks

Gartner ranks AWS as a leader

* Covers all of our current and futurestorage & computing needs* Hadoop components as-a-service* High rate of innovation* Enterprise-ready with global presence

Store data

Process data

Hadoop is modular by nature

Source: www.Hortonworks.com

Split architecture for fast and high volume data

S3 is a fast, scaleable storage service

EMR is Hadoop-as-a-service

Extending architecture for real-time reporting

Optionally make a link with the DWH world

Configure & manage your cloud via web + api interfaces

Next step: iterate on your cluster design and/or go hybrid

Custom EC2 instances

(Hadoop distros)

(NoSQL db’s)

(notebooks)

(data manipulation/access)

Joris Van den Borre

Director, Tropos.io

http://www.tropos.io

@jvdborre

http://www.linkedin/in/jvdborre