regalix productsnap
DESCRIPTION
Regalix ProductSnapTRANSCRIPT
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Regalix ProductSnapCo-innovate with Companies to Launch New Products and Accelerate Revenue Growth
1
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap
Recognizes products from print collateral and product packaging when a user takes a
picture
Recognizes products from snapshots of 3D items (“ProductSnap 3D”) where reference
images from multiple perspectives are available
Optimizes product searching for the mobile user experience: photos instead of text
Links offline marketing spend with trackable mobile commerce
Provides valuable stream of trackable transaction & behavioral data
2
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
What is Visual Search?
3
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Retail Example: “I like that hat!”
4
One snap:• more info• quick purchase• bookmark• social integration• comparison shop• and more…
With Visual Search
Hotspots = image + location + metadata
Nine West Hat
Large Brim Felt
Women
ID: 737624
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Multiple Matches Possible from a Single Display
Single images may contain multiple hotspots that are targets for discovering related, online information
5
• Nine West Hat
• Large Brim Felt
• Women
• ID: 737624
Hotspots = image + location + metadata
• Pink Shawl
• Women
• ID: 637364
• Black belt
• Women
• ID: 923746
• Go boots
• Women
• ID: 923746
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Visual Search User Flow
6
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
User Takes a
Photo: User can
focus in on a single
item within a multi-
item presentation
Photo is searched
against the
company’s
product database
User is taken to the
snapped item’s
detail page:User can view reviews,
product bundles,
discounted specials,
and add the item to
their shopping cart2
3
Visual Search User Flow
1
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap Applications and
Examples for your Mobile App
8
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap Applications
ProductSnap 2D - Customers can snap a picture from any promotional material such as catalogs, newspaper or
magazine inserts, posters, product packaging, in-store displays
ProductSnap 2D Pro - Customers can snap any promotional material or product packaging from any source, any
brand, any merchant to invoke comparative shopping from within Advertiser’s catalog, Affiliate-merchants or other
partners
ProductSnap 3D - Customers can snap products from in-store sections to learn, share and buy products
ProductSnap 3D Pro - Customers can snap products from within stores, at home or in other stores to invoke
comparative shopping from within Advertiser’s catalog, affiliate-merchants or other partners
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Adding ProductSnap to Your Mobile App
Extend your mobile app with ProductSnap to additionally introduce:
• Search by photographing item [ProductSnap]
• Search by scanning barcode
10
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Snap Item
Shopper can photograph item directly on the shelf at a physical store –
either one of your retail stores or even any other location, if you so
desire – by using your app.
Shopper can also switch to barcode scan view (for greater
precision/accuracy) if desired.
11
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Product Matched
If the photographed item matches product images in your database,
ProductSnap can pull up the appropriate content (e.g., your product
page) and/or any related actions.
• Shopper can:
o ‘Like’ or bookmark the item
o Place the item in a wish-list
o Share the item on social networks
o Add the item to their shopping cart.
• Shopper can also:
o Scan a barcode
o Snap another photo
o Explore other items related to the matched product page.
12
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Adding to Your Cart
Shopper can add the matched item to their online shopping
cart using your current app experience.
• Shopper can also continue shopping by:
• Snapping more photos
• Scanning more barcodes
13
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Recognize Items from
Print Sources
User snaps a photo from
either your printed
catalog, signs, labels,
banners and billboards
to look up items online.
There they can learn
more about the item,
share it with friends, and
also purchase it.
14
Catalog Item Match
Once ProductSnap
identifies the item,
your user can be
taken to the snapped
item’s page on your
mobile site or app to
complete the
transaction
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
User can view item
details and choose
customizations --
sizes, colors, etc.,
based on availability
or inventory --
before completing
the transaction.
15
Extend Search to Partner
Sites
If the item is not found
in your own product
database, the user can
be given the option to
automatically search
your partner
catalog/sites for
matches.
Select Item Details
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap Visual Search Technology
16
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 17
Imagedatabase
Metadatadatabase
Authoring
• Index any 2D image
• 3D matches possible with images from many perspectives
• Virtual layers can be applied to tag multiple items per image
• Assign online content
Indexing/Recognition
• Adding documents to your image database
• Recognizing query images
• Hosted in the cloud
Client Apps
• User experience
• Delivery of online information
Main Elements of the Technology
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission. 18
Products Distinctive ClothingLogos
What ProductSnap can Recognize
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap Visual Search Platform
19
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Visual Search Authoring: Content Association
Using our Web-based Portal, online content is associated with images
via “hotspots”
• Hotspot contains links to online content
• Link can be URL, video, audio, tweet, phone number, SMS, etc. or custom type (JSON or XML string)
Two ways to create hotspots:
• Single hotspot per image
o Contains one or more links inside
• Multiple hotspots per Imageo Create unique experience in specific regions of image
o Each hotspot contains one or more links inside
Batch mode: use scripts to populate your content association database
• Upload images plus metadata content, e.g. XML
• Automatically generates single hotspot per image
20
Sample Image
Single Hotspot
Multiple Hotspots
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Product Authoring: Assign Digital Experiences
21
Social
Coupons
Info
Info
Social
Games
eComm
Games
Video
Coupons
Info
GAME
Social
Info
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Product Authoring: Deliver Digital Experiences
22
Info
Social
Games
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
ProductSnap Web Services Platform
RESTful APIs for indexing, recognition and metadata retrieval
Supports a variety of OS’s: Android, iOS, Windows, desktop, etc.
Developers & content owners interact with Web-based Portal to manage database
Client apps interact with fast Gateway servers to submit queries and get results
Analytics can provide valuable data on usage patterns
23
Desktop
Developers & Content
Owners
FeaturePhone
Windows 8 iPhone Android
Client Apps
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Collection API: Recognition & Indexing
• Recognition:o Captured query image submitted to server for recognitiono Server returns match result, includes unique identifier associated
with source image
Store API: Metadata Storage & Retrieval
• Unique identifier used to retrieve digital content associated with
source image
• Association done via authoring interface• Developer controls end-user experience by formatting metadata in
the app• Or, bypass Store server; connect directly to your own server
instead to retrieve metadata
24
ProductSnap API Descriptions
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Your App Retains Full Control of Metadata and User Experience
25
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
1cSubmit Image
via Collection API
1bRetrieve Metadata:
XML/JSON string
represents links to web
content or database
query
2b
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
2a
Present Content:
Metadata formatted for mobile
& integrated into UI
3
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
3rd Party Data
26
Capture:
snap or
hover
1a
Image
Recognized:
Unique label
returned
1cSubmit Image
via Collection API
1b
Request from 3rd party:
Use unique label to request
metadata from 3rd party server
(e.g., eBay)
3a3rd Party Web
Service
Retrieve Metadata:
XML/JSON string
represents links to web
content or database
query
2b
Request
Metadata:
Use unique label to
download
metadata from
visual search
server
2aRetrieve
Metadata3b
Present Content:
Metadata formatted
for mobile &
integrated into UI
4
O P T I O N A L
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Common Implementation Questions
Index Creation Process / Scalability
• We can run scripts against a copy of your product DB or your API
• Currently supports >1MM images
• Recommendation: phase in by subsets of ~500k SKUs each to progressively tune, optimize and scale
Query speeds
• Response time < 1 sec on WiFi; longer if images uploaded over 3G/LTE
Integration with your Mobile App
• Via integration with RESTful APIs + additional supporting app logic
27
© 2014 Regalix Inc. Confidential. All Rights Reserved. Please do not share without permission.
Discussion & Next StepsContact us at | [email protected] | Phone: 650-331-1167
28