using couchbase and elasticsearch for real-time data analytics

@DavidOstrovsky

Senior Architect @ SelaCo-author of:

“Pro Couchbase Server” – Apress Media 2014“Essentials of Developing Windows Store Apps Using C#”“Advanced Windows Store App Development Using C#”

CodeHardBlog.azurewebsites.net

What’s up?

Why ElasticSearch and Couchbase?How do I connect the two?What can I do with this?Does it scale?

Why use ElasticSearch?

If you don’t know this, you might be in the wrong room.

Why use Couchbase Sever?

High performance key-value store.Easy to deploy and use.Easy to scale.High availability.High <insert buzzword here>.

Why these two in particular?

Both use JSON documents.Complimenting strength.

ElasticSearch for flexible search, geolocation, analytics tools, and more.Couchbase for efficient data storage and retrieval, extremely fast response times.

Couchbase uses XDCR to push data to ElasticSearch.

Lower latency than polling, e.g. with River.

Demo

Demo time!

Common use-cases

Ad-hoc querying an existing Couchbase database.Geospatial searches on data.Real-time analytics of Couchbase data.

Demo

More demo time!

Is this production ready?

A typical Couchbase-ElasticSearch deployment uses a 2:1 or 3:1 ratio of nodes.

ElasticSearch only stores indexed data.Source data stored in Couchbase.

Used by multiple companies in Israel and abroad.

Demo

So many demos!

Questions