aws webcast - getting started with cloudsearch: add powerful search to your web application

Post on 15-Jan-2015

1.115 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

In this webinar we'll show you how you can use Amazon CloudSearch to add search capabilities to your website or app without the administrative burdens of setting up, operating, and scaling a search engine. We'll explain details about using the service, review the key components, and show you how search can be integrated into a sample application. You will learn how to create an Amazon CloudSearch search domain, upload your data, and submit search requests. Additional topics covered include: Getting documents into CloudSearch Tuning and debugging search results Using facets to create a better user experience Personalizing search results by tailoring ranking for each search request Using field weighting to boost results into the best order.

TRANSCRIPT

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Getting Started With Amazon CloudSearch:

Add Powerful Search To Your Web Application

Jon Handler

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

What is Search

Shoes

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Do You Want Search With That?

Build your own – database, home-rolled, site search

Open source

Legacy enterprise search

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Search Challenges

Complex, expertise required

Costly, often with up-front expenditure

Long time to market, innovation and experimentation are

slowed

Operational overhead is undifferentiated work

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Amazon CloudSearch

Pay for infrastructure you need when you need it

Low cost

No need to guess capacity

Experiment fast with low risk

We do the undifferentiated heavy lifting

Go global in minutes

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Amazon CloudSearch Architecture

DNS / Load Balancing AWS Query

Search API Console Config

API

Command

Line Tools Console Doc

Svc API

Command

Line Tools Console

SEARCH SERVICE DOCUMENT SERVICE CONFIG SERVICE

Search Domain

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Automatic Scaling

SEARCH INSTANCE Index Partition n

Copy 1

SEARCH INSTANCE Index Partition 2

Copy 2

SEARCH INSTANCE Index Partition n

Copy 2

SEARCH INSTANCE Index Partition 2

Copy n

SEARCH INSTANCE

DATA Document Quantity and Size

TRAFFIC Search Request Volume and Complexity

Index Partition n Copy n

SEARCH INSTANCE Index Partition 1

Copy 1

SEARCH INSTANCE Index Partition 2

Copy 1

SEARCH INSTANCE Index Partition 1

Copy 2

SEARCH INSTANCE Index Partition 1

Copy n

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

SEARCH INSTANCE

Index Partition n Copy 1

SEARCH INSTANCE

Index Partition 2 Copy 2

SEARCH INSTANCE

Index Partition n Copy 2

SEARCH INSTANCE

Index Partition 2 Copy n

SEARCH INSTANCE

Index Partition n Copy n

SEARCH INSTANCE

Index Partition 1 Copy 1

SEARCH INSTANCE

Index Partition 2 Copy 1

SEARCH INSTANCE

Index Partition 1 Copy 2

SEARCH INSTANCE

Index Partition 1 Copy n

Compute

Storage

Load Balancing

Security

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Text Search

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Highly Relevant Results

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Faceted

Drilldown

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Integer Range

Searching

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Complex Queries

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Query

564

726

123

Ranking

564

726

123

Sorting Filtering Matching

Search Query Processing

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Reference Architecture

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Create An Amazon CloudSearch Domain

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Text fields for

matching user terms

Result enabled to

retrieve source data

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Literal fields for

Faceting

Facet enabled to

retrieve facets

Search enabled for

narrowing

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Integer fields for

ranking, narrowing

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Configure the Domain

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Data Preparation and Upload

Search

Documents

SDF

Batch

Amazon

CloudSearch

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

CloudSearch SDF [{"type":"add",

"id": "b007oznzg0",

"version": 1,

"lang": "en",

"fields": {

"title":"Kindle Paperwhite",

"description":"World's most advanced e-reader",

"category": ["Electronics","eBook Readers"],

"price":11900

} }, ...]

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Document Service API

http(s)://< document service endpoint >/2011-02-

01/documents/batch Accept: application/json

Content-Length: 1176

Content-Type: application/json

Host: doc.imdb-movies-rr2f34ofg56xneuemujamut52i.us-east-1.cloudsearch.amazonaws.com

[{ ,"id":"b007oznzg0","version": 1,"lang": "en","fields": {"title":"Kindle

Paperwhite","description":"World's most advanced e-reader","category":["Electronics","eBook

Readers"],"price":11900} },

{ , "id": "tt0434409", "version": 1337648735 } ]

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Search Service API

http(s)://< search service endpoint>/2011-02-01/search?

Simple searches • q= text

Boolean combination of fields • bq= (or field:'value1' (and field:'value2' field:'value3'))

Faceting • facet= comma separated list of facet fields

Pagination • start=, size=

Customized ranking • rank= sort results based on the rank expression provided

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Search Results

{"rank": "-text_relevance",

"match-expr": "(label 'kindle paperwhite')",

"hits": { "found": 204, "start": 0,

"hit": [ { "id": "sontsst12cf5f88b42" },

{ "id": "sopvopr12ab017f082" },

{ "id": "sorzrpw12ac468a13b" },

] },

...

}

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

IMDB DATA DEMO

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Pricing

Get started for just $2.40/day; $75/month

AWS Calculator

http://calculator.s3.amazonaws.com/calc5.html

Free Trial

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Wrap Up

Powerful search is a critical component of today's

applications

Amazon CloudSearch makes adding search easy

Create a domain, POST documents, GET search results

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Resources and Q&A

Amazon CloudSearch Overview Page

http://aws.amazon.com/cloudsearch/

• FAQs

• Community Forum

• Documentation & Getting Started Tutorial (IMDb)

Demos and Tutorials

• What Is Amazon CloudSearch

• Introducing Amazon CloudSearch (Features)

• Building a Search Application Using Amazon CloudSearch

© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.

Thank You

Jon Handler / handler@amazon.com

top related