bargento 2014 : conférence smile « elasticsearch booste la recherche magento »
DESCRIPTION
Conférence Smile au Bargento 2014 Intervenants : Farid Aït Abdeslam, Consultant ecommerce Smile et Aurélien Foucret, expert technique Smile. Lorsqu’un moteur de recherche interne à un site fonctionne, les visiteurs deviennent plus facilement des acheteurs : le parcours de navigation est raccourci, la réponse à leur problématique est immédiate. Smile met en œuvre aux côtés de Magento une technologie de recherche innovante basée sur ElasticSearch, améliorant les performances et ouvrant également la voie vers de nombreuses fonctionnalités telles que la recherche contextuelle, la recherche floue, la percolation, et des capacités de merchandising avancées… le tout Open Source.TRANSCRIPT
SMILE - 07/10/2014
Boost your Searchandising
with ElasticSearch
2
SPEAKERS
FARID AIT ABDESLAMeCommerce Consultant
@faitabdeslam
AURÉLIEN FOUCRETR&D Manager
@afoucret
October 2014
Bargento
3
October 2014
Bargento
SMILE IN A FEW FIGURES
Leading European open source integrator
More than 20
More than 35
More than 50
YEARS EXPERIENCEIN OPEN SOURCE
PARTNERSIN OPEN SOURCE
MILLION EUROSIN TURNOVER IN 2013
700OPEN SOURCE
EXPERTS
25%INCREASE IN TURNOVER
PER YEAR
4
17 OFFICES
IN 7 COUNTRIES
October 2014
Bargento
5
WHAT DO WE DO FOR YOU ?
October 2014
Bargento
CONSULTINGProject Framework / Audits / Benchmark
DIGITALVisual identity/ Ergonomics
Accessibility / Editorial
Strategy / SEO
HOSTINGHosting / Corrective and
upgrade Maintenance /
Support
TRAININGChange management
Intra and inter company training
ENGINEERINGConception / Development /
Configuration
A 360°
SERVICE FOR YOUR
PROJECTS
7
OUR EXPERTISE AND OUR BELIEFS
October 2014
Bargento
ARE DETAILED IN OUR WHITE PAPERS
Web Culture
System
E-business
Content Management and DMS
ERP et Business Intelligence
OVER100 000
DOWNLOADS PER YEAR
8
OUR REFERENCES
October 2014
Bargento
70%OF CAC 40
COMPANIES HAVE TRUSTED US
9
SMILE IS THE LEADING EUROPEAN
SMILE IS THE BIGGEST OPEN SOURCE PLAYER IN EUROPE
700 employees, 17 offices, 300 new projects per year
MULTI-TECHNOLOGIES, A UNIQUE EXPERTISE
More than 35 technological partnerships, the highest level of recognition for most
October 2014
Bargento
OPEN SOURCE INTEGRATOR
10
SMILE & MAGENTO
150 trained engineers
15 certified developers
80 projects
6 years of experience
45 000 man days produced
Gold Partner
PARTNER OF THE YEAR
October 2014
Bargento
11
SMILE OPEN SOURCE SOLUTIONS
We did it first :)
Integration of key solutions to Magento
LAND OF INNOVATION
October 2014
Bargento
https://github.com/Smile-SA
12
ELASTICSEARCH
MATURE & EFFICIENT
October 2014
Bargento
13
ELASTICSEARCH
Distributed RESTful search & analytics server
Build on top of Apache Lucene
Drop in replacement for SolR
Open Source License
Apache 2
Unique features
Percolation
Aggregations
Hadoop Integration
Quick learning curves & deployment
WHAT IS IT ?
October 2014
Bargento
Full text search
Schemaless
Real time indexing
Real time analytics
Distributed & High availability
14
ELASTICSEARCH INC.
THE COMPANY BEHIND ELASTICSEARCH
October 2014
Bargento
2 HQ
US : Los Altos (California)
EU : Amsterdam (Netherlands)
Offices in France
Other Open Source projects (ELK) :
Big momentum on the market
8+ million downloads since 2010
> 500 000 downloads per month avg.
90 employees
Revenue growth : 400% last 6 months
Bu
sin
ess
Mo
de
l •Sales support and training for ElasticSearch
•3 levels of support (Silver, Gold, Premium). Per node
•Up to 24/7 SLA
Inv
est
ors •Benchmark Capital
$10M Series A, 2012
•Index Ventures$24M Series B, 2013With participation from Benchmark Capital
•New Enterprise Associates $70MSeries C, 2014With participation from Benchmark Capital and Index Ventures
ElasticSearch KibanaLogstash
15
ELASTICSEARCH
WHO IS USING IT ?
October 2014
Bargento
16
SEARCHANDISING
LESSONS LEARNED
October 2014
Bargento
17
SEARCHANDISING
What is Searchandising ?
1 - Search
o Up to 70% of the visitors use the search bar
2 - Merchandising
o new
o special offer
o promotion
o destocking
LESSONS LEARNED
October 2014
Bargento
18
SEARCHANDISING – LESSONS LEARNED
Fulltext relevancy
What field is used into search ?
How are field analyzed ? What are their respective weight ?
Fulltext is only a small part of what matter when dealing with an
eCommerce website
Other parameters of relevance are :
Business rules
Customer behavior
WHAT IS RELEVANCE FOR AN ECOMMERCE WEBSITE ?
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
RELEVANCE = FULLTEXT RELEVANCE + EXTERNAL SIGNAL RELEVANCE
19
SEARCHANDISING – LESSONS LEARNED
Data can help you to make better decision from insights on customer
behavior
Find new relevant optimization based on trends, sales, …
Is your search engine able to apply rules on insights ?
Search optimization is an Iterative process :
FOCUS ON CUSTOMER BEHAVIOR
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
Collectdata
Analyzebehavior
Optimizeengine
20
SEARCHANDISING – LESSONS LEARNED
Rich autocomplete
Get the user to the right content directly
Multiple content type : products, category, …
Rich faceting features
Multiple select facets
Range sliders
…
Category built on search engine rules
Personalization / Contextualization
Experiment optimization through A/B testing
OTHER IMPROVEMENT AREA
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
21
SEARCHANDISING – LESSONS LEARNED
Use self-hosted search engine instead of SaaS solution
Weak network introduces latency and less security
Customization
The editor have his own roadmap
No way to have your own
Indexing
Most of the platforms does not provide real time indexing leading to inconsitencies between database
and search engine
Inconsistencies lead to the « holes into product list syndrom »
Retroaction on the platform not smoothly managed (Magento caches,Varnish ,…)
Unconsistent features
Most external searchandising are not well integrated into Magento
2 admin interface ; one for Magento, one for the searchandising
Useless feature : not consistent with the way Magento works.
WHAT ABOUT EXTERNAL SEARCH ENGINES ?
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
22
MAGENTO
& ELASTICSEARCH
October 2014
Bargento
23
MAGENTO & ELASTICSEARCH
An Open Source module
Smile Magento ES a.k.a Smile Searchandising Suite
Integration of ES into Magento
Drop-in replacement for SolR
Combining our long experience with OSS Search Engine
High quality implementation
Does not break Magento standard feature
Built for extensibility
Upgradable : our module is upgraded with every new Magento version
The ultimate goal : give merchant tools to improve conversion with state of art features
OUR MODULE GOAL
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
24
MAGENTO & ELASTICSEARCH
Fulltext Search improvements
Fine control on what fields are used in search and their respective weight
Fuzzy search : search for « Frankenshten » and get the results for « Frankenstein »
KEY FEATURES – FULLTEXT SEARCH
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
Rich faceting toolkit
Multiselect facets implementation
Price ranges, rating filters, …
Easier customization of the facets logic and templating by developers
SEO optimizations
Autocomplete framework
Autocomplete popular searches, products and categories
Customizable templates (e.g. : display product images and prices)
Pluggable models allowing developpers to easily add their own autocomplete (store, CMS, …)
25
MAGENTO MODULE
Behavorial data collect : get richer from your clients
Our module collects all your clients behavior and creates a knowledge database you can query at will
Real time data refresh : don’t miss the trends
Use it into merchandising optimizations rules
KEY FEATURES – MERCHANDISING
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
Smart categories
Build categories by defining search engines queries and not by
picking products one by one
o Ex : « All discounted products that are in stock »
Nice UI for rules administration
Optimizations tunning – Rules based relevancy
Append business rules to your catalog to modify relevancy
o « Boost all products which are in stock »
o « Boost all products of category HighTech »
Pluggable system : developers can append new models easily
26
MAGENTO MODULE
Built for Magento, into Magento
Deep Magento integration.
Operate everything from Magento admin. No additional back-office.
Optimized data indexing. Get your catalog updated in real time and reduce your time
to market.
KEY FEATURES
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
ElasticSearch : a scalable and secured backend
Scale over many servers when your catalog or your business grow
Avoid downtime with : automated failover when a server fails or during maintenance
Snapshot and restore in minutes the whole cluster. Easy to backup.
Monitoring tools available from ElasticSearch Inc. (Marvel)
Designed for extensibility
Your business is unique. Your search engine should be too.
Many extension hooks shipped by default (templating, custom optimizations models, and new features)
Index what you need in custom indices (stores, cms content, …)
Demo time
28
ELASTICSEARCH & MAGENTO
Technology stack :
GLOBAL ARCHITECTURE
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
Website Users
Search Queries
Catalog IndexBehavorial Data Index
Website Usage Collect Data
Smile Webtracker
Product Data Indexing User Behavior Indexing
Smile_ElasticSearch
Smile_VirtualCategories Smile_Tracker
Smile_SearchOptimizer
Smile_Modules :
29
ELASTICSEARCH & MAGENTO
First release : technical core containing
Indexing, search and autocomplete
Available as soon as Friday on our GitHub
Compatibility :
Magento EE 1.13.x & 1.14.x and Magento CE 1.8.x & 1.9.x
ElasticSearch : 1.2.x & 1.3.x
Later this year release of more modules :
Virtual categories & Search optimizers
New features (see roadmap)
OPEN SOURCE RELEASE
07 Oct. 2014
Bargento - Boost your searchandising with ElasticSearch
http://github.com/Smile-SA/
30
ROADMAP
October 2014
Bargento
HIGHLIGHTS
31
ROADMAP HIGHLIGHTS
Collected data will allow us to build recommenders into our
module :
Cart recommendations
User recommendations
People who viewed this products are also interested by this product
Recurring bought products
…
Machine learning algorithms :
From Spark Mlib
Customizable
Other :
More like this into ES (avoid cold start)
Manual recommendations by the merchandiser
RECOMMENDATIONS
October 2014
Bargento
32
ROADMAP HIGHLIGHTS
Search relevance is matter of context
Two kinds of context :
User related :
o A customer looking only at « Women products »
o A customer buying only products with size « M »
Navigation related :
o An user has launched a search from the « Book » category
In both case we should be able to influence relevancy from these
contexts buy boosting product matching the context
The more an user is using your website, the better his shopping experience is
SEARCH CONTEXTUALIZATION
October 2014
Bargento
33
ROADMAP HIGHLIGHTS
SalesRules in Magento :
Defined by rules (just like VirtualCategories)
Can be associated to banners
Goals :
Better relay of your promotional operation
Trigger the right banner when an user is « near » a promotion
Based on the defined rules
Display tags and labels on products if it match a promotion
To provide this features we will use an feature that is unique to
ElasaticSearch : the percolator
PROMOTION TOOLKIT
October 2014
Bargento
34
ROADMAP HIGHLIGHTS
Magento catalog is products centric
It’s great for your eCommerce main
offer
Need for an additional layer into
Magento : the offer
You want to sell produts for other merchants
You are a retailer with many point of sales
ElasticSearch will be central in our
effort to integrate the cross-channel /
marketplace logic and present offers
CROSS CHANNEL / MARKETPLACE
October 2014
Bargento
Product (eCommerce)
Offer Paris Store
OfferMerchant 1
Offer London Store
OfferMerchant 2
35
ROADMAP HIGHLIGHTS
Will the module be outdated with Magento 2 ?
Our module will be updated with Magento
This include Magento 2
MAGENTO 2 SUPPORT
October 2014
Bargento