converging big data and application infrastructure by steven poutsy

25

Upload: big-data-spain

Post on 16-Apr-2017

155 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 2: Converging Big Data and Application Infrastructure by Steven Poutsy

Converging Big Data and Application InfrastructureSteven PoustyOpenShift/Red Hat@TheSteve0 on Twitter, IRC, SmugMug, Github,Ingress, Instagram, Skype, and

Page 3: Converging Big Data and Application Infrastructure by Steven Poutsy

Goals

1. Brief introduction to how things have evolved

2. Talk about what we have now

3. Demo of this in practice

4. Have fun!

Page 4: Converging Big Data and Application Infrastructure by Steven Poutsy

Assumptions

1. You have written a web app at some point in your life

2. You know some basics of Spark and such

Page 5: Converging Big Data and Application Infrastructure by Steven Poutsy

Where are we coming from

Page 6: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 7: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 8: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 9: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 10: Converging Big Data and Application Infrastructure by Steven Poutsy

What about Apps?

Page 11: Converging Big Data and Application Infrastructure by Steven Poutsy

This page intentionally left blank

Page 12: Converging Big Data and Application Infrastructure by Steven Poutsy

Next Era

Page 13: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 14: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 15: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 16: Converging Big Data and Application Infrastructure by Steven Poutsy

Welcome to Paradise

Page 17: Converging Big Data and Application Infrastructure by Steven Poutsy

We have had some great developments1. People figured out how to make commodity hardware do great things

2. Distributed software has gotten better

3. Programming languages have gotten easier

4. CS has put effort into statistical libraries

5. The browser has grown up

Page 18: Converging Big Data and Application Infrastructure by Steven Poutsy

Example framework

Docker Containers

Kubernetes (via OpenShift)

Node.JS and Python

Spark (via Oshinko)

Page 19: Converging Big Data and Application Infrastructure by Steven Poutsy
Page 20: Converging Big Data and Application Infrastructure by Steven Poutsy

WINNING!

Page 21: Converging Big Data and Application Infrastructure by Steven Poutsy

See it in Action

Page 22: Converging Big Data and Application Infrastructure by Steven Poutsy

Wrap up

Page 23: Converging Big Data and Application Infrastructure by Steven Poutsy

We are luckyWe can still do analysis on our desktop if we want

But now we can easily integrate

1. Data or APIs

2. Statistics and Machine Learning

3. Interactive Web Applications

Page 24: Converging Big Data and Application Infrastructure by Steven Poutsy

To Do this on your own:1. To run your own OpenShift either:

https://www.openshift.org/vm/Or

oc cluster up (get oc here - https://github.com/openshift/origin/releases )

2. To get Oshinko:https://github.com/radanalyticsio then you need oshinko-rest and oshinko-console

3. For the word analysis app get it here: https://github.com/ophicleide

We LOVE pull requests

Page 25: Converging Big Data and Application Infrastructure by Steven Poutsy

Fin!