elasticsearch - jordi · pdf file5 elasticsearch whatiselasticsearchfor?...

17
Cloud Computing & Big Data FIB-UPC Master MEI ElasticSearch Nacho Valencia December-2012

Upload: phungtu

Post on 12-Feb-2018

241 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

Cloud Computing

& Big Data

FIB-UPC Master MEI

ElasticSearch

Nacho ValenciaDecember-2012

Page 2: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

2

ElasticSearch

Introduction

•Cloud Computing

•Big Data

•Apache Lucene

•REST

Page 3: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

3

ElasticSearch

The problem

•Shay Banon

•Engine Framework

•Compass Project

SCALABILITY??

Page 4: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

4

ElasticSearch

What is ElasticSearch?

•Distributed

•RESTful

•Free/open source SEARCH SERVER

•Based on Apache Lucene

•Developed in Java

•By Shay Banon

Page 5: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

5

ElasticSearch

What is ElasticSearch for?

•Search all kind of documents

•Scalable search solution

•Near real-time search

•Support for multitenancy

•“ElasticSearch is distributed, which means that indices can be

divided into shards and each shard can have zero or more replicas. Each node hosts one or more shards, and acts as a coordinator to delegate operations to the correct shard(s). Rebalancing and routing are done automatically”

Page 6: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

6

ElasticSearch

Big Data?

• Search a word

on a book

Page 7: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

7

ElasticSearch

How it works?

•Simple

•Fast

•Linux or Mac environment

•Perfect for try at Amazon AWS EC2 :)

•Tries to make all features available through JSON and JAVA API

Page 8: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

8

ElasticSearch

Demo

•Download and Start elasticsearch

Page 9: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

9

ElasticSearch

Demo

•Check it’s running OK

Page 10: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

10

ElasticSearch

Demo

•Index some data like user name, or posts in a blog

Page 11: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

11

ElasticSearch

Demo

•We check operations were succesfull

Page 12: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

12

ElasticSearch

Demo

•We check operations were succesfull

Page 13: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

13

ElasticSearch

Demo

•Let’s search!

Page 14: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

14

ElasticSearch

Demo

Page 15: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

15

ElasticSearch

Demo

Page 16: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

16

ElasticSearch

More info

• www.elasticsearch.org

• www.elasticsearch.com

• en.wikipedia.org/wiki/elasticsearch

• stackoverflow.com/questions/10213009/solr-vs-elasticsearch

• blog.socialcast.com/realtime-search-solr-vs-elasticsearch

• www.elasticsearchtutorial.com

• https://s3-eu-west-1.amazonaws.com/cc-mei/presentacion/CC-MEI-elasticsearch-ignaciovalencia.pdf

Page 17: ElasticSearch - Jordi · PDF file5 ElasticSearch WhatisElasticSearchfor? •Searchallkindofdocuments •Scalablesearchsolution •Nearreal-time search •Supportformultitenancy •“ElasticSearchisdistributed,

17

ElasticSearch

Questions?