couchbase 105: realtime analytics and reporting using couchbase with elastic search + kibana, and...

20

Upload: couchbase

Post on 12-Jul-2015

859 views

Category:

Software


4 download

TRANSCRIPT

Page 1: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js
Page 2: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Part I

People Love Monkeys

Page 3: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Lowly Code Monkey

Page 4: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

More Experienced Code Monkey

Page 5: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Mighty Code Ape

Page 6: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Mostly Human Software Architect

@DavidOstrovskySenior Solutions Architect @ Couchbase

Co-author of:“Pro Couchbase Server” – Apress Media 2014

“Essentials of Developing Windows Store Apps Using C#”

“Advanced Windows Store App Development Using C#”

Big data and NoSQL nerd

CodeHardBlog.azurewebsites.net

Page 7: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Part II

Doing Something Useful

Page 8: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

What is this all about?

Couchbase + ElasticSearch + Kibana = Awesome

Page 9: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Why use Couchbase Server?

Document database

Scales easily

Built for performance

High throughput

Low latency

Cross-cluster replication

Page 10: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Why use ElasticSearch?

Fast full-text searches

Supports over a hundred languages

Geo-querying, scoring, faceting

Easy to deploy, use and scale

Huge number of plug-ins

High buzzword count

Page 11: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Why these two in particular?

Both use JSON documents

Complimenting strengths:

ElasticSearch for flexible search, geolocation, analytics tools, and more

Couchbase for efficient data storage and retrieval, extremely fast response times

Couchbase uses XDCR to push data to ElasticSearch

Lower latency than polling, e.g. with River

Page 12: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Demo

Demo time!

Page 13: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Common use cases

Ad-hoc querying an existing Couchbase database

Geospatial searches on data

Real-time analytics of Couchbase data

Page 14: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Demo

More demo time!

Page 15: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Kibana is a dashboard for real-time visualization of streaming data

Talks directly to ElasticSearch

Drag-and-drop dashboard construction

No coding required

Why use Kibana?

Page 16: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Putting it all together

A typical Couchbase-ElasticSearch deployment uses a 2:1 or 3:1 ratio of nodes

ElasticSearch only stores indexed data

Source data stored in Couchbase

All CRUD operations go to Couchbase

CouchbaseElasticSearch KibanaServer ClientCouchbase

Couchbase

Page 17: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Demo

So many demos!

Page 18: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js
Page 19: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Summary

Connecting Couchbase to ElasticSearch and Kibana is awesome!

Lets developers and analysts focus on what each does best

Provides a resilient, scalable data storage and BI solution

Fast and inexpensive

Page 20: Couchbase 105: Realtime analytics and reporting using Couchbase with Elastic Search + Kibana, and Node.js

Questions