webinar: building customer-targeted search with fusion
TRANSCRIPT
![Page 1: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/1.jpg)
Building Customer-Targeted Search with Fusion
Andrew Oliver
March 22, 2017
![Page 2: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/2.jpg)
![Page 3: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/3.jpg)
Based in San Francisco
Offices in Bangalore, Bangkok, New York City, Raleigh, Munich
Over 300 customers across the Fortune 1000
Fusion, a Solr-powered platform for search-driven apps
Consulting and support for organizations using Solr
Produces the world’s largest open source user conference dedicated to Lucene/Solr
Lucidworks is the primary sponsor of the Apache Solr project
Employs over 40% of the active committers on the Solr project
Contributes over 70% of Solr's open source codebase
40%
70%
![Page 4: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/4.jpg)
![Page 5: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/5.jpg)
• Over 50 connectors to integrate all your data
• Robust parsing framework to seamlessly ingest all your document types
• Point and click Indexing configuration and iterative simulation of results for full control over your ETL process
• Your security model enforced end-to-end from ingest to search across your different datasources
![Page 6: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/6.jpg)
ExperienceManagement
![Page 7: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/7.jpg)
Operational Simplicity
![Page 8: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/8.jpg)
SECURITY BUILT-IN
Shards Shards
Apache Solr
Apache Zookeeper
ZK 1
Leader Election
Load Balancing
Shared Config Management
Worker Worker
Apache SparkCluster
Manager
RE
ST A
PI
Admin UI
Lucidworks View
LOGS FILE WEB DATABASE CLOUD
HD
FS
(Op
tio
nal
)
Core Services
• • •
ETL and Query Pipelines
Recommenders/Signals
NLP
Machine Learning
Alerting and Messaging
Security
Connectors
Scheduling
Fusion Simplifies the Deployment
![Page 9: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/9.jpg)
Core Services
• • •
NLP
Recommenders / Signals
Blob Storage
Pipelines
Scheduling
Alerting / Messaging
Connectors
RE
ST A
PI
Admin UI
Lucidworks View
LOGS FILE WEB DATABASE CLOUD
• Seamless integration of your entire search & analytics platform
• All capabilities exposed through secured API's, so you can use our UI or build your own.
• End-to-end security policies can be applied out of the box to every aspect of your search ecosystem.
• Distributed, fault-tolerant scaling and supervision of your entire search application
![Page 10: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/10.jpg)
Conversational Search: “The principle behind conversational search
is that a user can speak a sentence into a device, and that device can respond with a
full sentence.” -Technopedia
![Page 11: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/11.jpg)
A Pathway to Better Search
•Better Query Parsers
•Similarity
•Collaborative Recommendations
•Personalization
![Page 12: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/12.jpg)
Dismax / Extended Dismax
•Searches and scores multiple fields
•Scores aren’t simply added
![Page 13: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/13.jpg)
Similarity / More Like This
• Fusion Pipeline Stage takes a document as an argument, returns like documents
• BM25 Similarity
• https://en.wikipedia.org/wiki/Okapi_BM25
![Page 14: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/14.jpg)
Collaborative Recommendations
• Boost results users commonly click on
• Based on “Signals” - built into Fusion
• https://www.youtube.com/watch?v=0AwLSdcrJSc&sns=tw - Demonstrated in last Webinar
![Page 15: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/15.jpg)
Recommendations
![Page 16: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/16.jpg)
Personalization
•Signals on a more per-user basis
•Boost things that I click on often
•Boost results like the ones I’ve clicked on
•More on this next time!
![Page 17: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/17.jpg)
Language
![Page 18: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/18.jpg)
• Easier and more accurate than Natural Language
• Domain phrases PE Ratio, Stock Price, SKU
• Entities: GE, IBM, etc
Domain Specific Language
![Page 19: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/19.jpg)
Spoken Language
•Speech to text
•Text-to-speech
•Mainly the latter is just UI.
![Page 20: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/20.jpg)
• Donald Bot
• Alexa
• Deep Drumpf
Conversational
![Page 21: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/21.jpg)
https://www.messenger.com/t/thedonaldbot/
![Page 22: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/22.jpg)
• https://twitter.com/deepdrumpf
• http://karpathy.github.io/2015/05/21/rnn-effectiveness/
![Page 23: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/23.jpg)
Alexa
Cortona
Assistant
Etc
•Speech to text
•Search Engine
•UI Answers
![Page 24: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/24.jpg)
• Tagging
• Faceting
• Domain Language (Finance)
Open Calais
![Page 25: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/25.jpg)
Demo
![Page 26: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/26.jpg)
• Speech to Text enabled Search
• Plugged into Fusion Query Pipeline
• https://lucidworks.com/2016/10/13/lucidworks-integrates-ibm-watson-into-fusion-enterprise-discovery-platform/
Watson
![Page 27: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/27.jpg)
Demo
![Page 28: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/28.jpg)
RTFMBot
•Based on Chatterbot
•NLTK
•Train on Slack
•Answer Questions generally with Fusion search results
![Page 29: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/29.jpg)
RTFMBot
![Page 30: Webinar: Building Customer-Targeted Search with Fusion](https://reader031.vdocuments.net/reader031/viewer/2022022413/58ed3dde1a28abc44a8b4617/html5/thumbnails/30.jpg)
Questions?
Building Customer-Targeted Search: March 15 @ 11am PThttps://lucidworks.com/webinar/building-customer-targeted-search-with-fusion/
Upcoming Webinars: