elasticsearch and mongodb on microsoft azure in 5 minutes

ELASTICSEARCH AND MONGODBon Microsoft Azure in 5 minutes

Ivan Fioravanti

4wardCTO

co-founder

WHO?

http://www.4ward.it

http://www.4ward365.com

@ivanfioravanti

ivan.fioravanti(at)4ward.it

2 PARTS

MONGODBReplicaSet

Sharded ClusterPerformance

ELASTICSEARCHSharded Cluster

Scale OutPerformance

4ward365: AZURE + OPENSOURCEIt’s a kind of magic

FIRST MAGIC: AZURE MONGODB REPLICASET

Photo  by  Nasa  (http://www.nasa.gov/mission_pages/station/multimedia/gallery/iss030e078095.html)

East Coast... USA...

Virginia... Azure “G”

GODZILLA!

REPLICASET?Group of servers that maintain the same data set.

PRIMARY SECONDARY SECONDARY

20 GB 20 GB 20 GB

REPLICASET?

AVAILABILITY

Group of servers that maintain the same data set.

PRIMARY SECONDARY SECONDARYPRIMARY

20 GB 20 GB 20 GB

DEMO REPLICASET ON AZURE

REPLICASET WITH MMS

1 Azure Subscription

Azure Command Line

MongoDB MMS Account

GitHub: http://bit.ly/1LJw5X4

SECOND MAGIC: AZURE MONGODB SHARDINGEasy and in less than 5 minutes J

SHARDING?

SCALABILITY

Dataset distributed on more servers or replica sets

SHARD A200GB

SHARD B200GB

CONFIG SERVERS

400GB

Router MONGOS

DEMO SHARDING ON AZURE

1 DEV-TESTSERVER

No MMS, only scripting

Single Server with

1 config server

4 mongod server

1 mongos

AZURE TYPE “G” + MONGODB = PERFORMANCE!Up to:32 Core448 GB di RAM6.144 GB di SSD

HOW TO TEST IT?...

IDEA! SIOPE DATA IN REALTIME!

Same used in soldipubblici.gov.it

DEMO AZURE PERFORMANCE

LET’S CONTINUE OUR JOURNEY WITH...

ELASTICSEARCH?

DOCUMENT BASEDFULL TEXT SEARCH

REAL-TIME DATA AND ANALYTICS

AWESOME!MY OPINION on ELASTICSEARCH?

DEMO ELASTICSEARCH ON AZURE

LET’S START!

Powered by

WHAT HAVE WE CREATED?

What? OFFICE 365 REPORTING AND MANAGEMENT

Open sourceLinux, MongoDB, AngularJS,

Bootstrap, Elasticsearch

AzureServiceBus, Scheduler, Redis,

Web/Worker Roles, Web Sites, VM, Virtual Network,

Machine Learning (coming soon)

FINAL RESULT DEMO

Q&A E LINKSeasy-azure-opensourcehttps://github.com/ivanfioravanti/easy-azure-opensource

4ward365 http://www.4ward365.com

@ivanfioravantiivan.fioravanti(at)4ward.it

AZURE LOVES OPENSOURCE