twilio signal 2016 how to build next generation speech analytics

25
a HOW TO BUILD NEXT GENERATION SPEECH ANALYTICS INTO ANY MULTI-PARTY PLATFORM NISHA GEORGE / TWILIO & JAY BLAZENSKY / VOICEBASE

Upload: twilio-inc

Post on 23-Jan-2017

69 views

Category:

Software


2 download

TRANSCRIPT

Page 1: Twilio Signal 2016 How to Build Next Generation Speech Analytics

a

HOW TO BUILD NEXT GENERATION SPEECH ANALYTICS INTO ANY MULTI-PARTY PLATFORM

NISHA GEORGE / TWILIO & JAY BLAZENSKY / VOICEBASE

Page 2: Twilio Signal 2016 How to Build Next Generation Speech Analytics

5%

Page 3: Twilio Signal 2016 How to Build Next Generation Speech Analytics

CALL CENTERS ONLY LISTEN TO 5% OF CALLS

Page 4: Twilio Signal 2016 How to Build Next Generation Speech Analytics

100%

Page 5: Twilio Signal 2016 How to Build Next Generation Speech Analytics
Page 6: Twilio Signal 2016 How to Build Next Generation Speech Analytics

NEW INNOVATION

Page 7: Twilio Signal 2016 How to Build Next Generation Speech Analytics

TWILIO PROGRAMMABLE VOICE

RECORDING

CONFERENCING TWIML

TRANSCRIPTION

QUEUES

PSTN WEBRTC SIP

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 8: Twilio Signal 2016 How to Build Next Generation Speech Analytics

MONO CHANNEL RECORDING

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 9: Twilio Signal 2016 How to Build Next Generation Speech Analytics

DUAL CHANNEL RECORDING

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 10: Twilio Signal 2016 How to Build Next Generation Speech Analytics

<Dial> Calls

ENABLE DUAL-CHANNEL RECORDING

<RESPONSE> <DIAL RECORD=“RECORD-FROM-ANSWER-DUAL">+14155551234</DIAL> </RESPONSE>

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 11: Twilio Signal 2016 How to Build Next Generation Speech Analytics

Outbound API Calls

ENABLE DUAL-CHANNEL RECORDING CURL -XPOST HTTPS://API.TWILIO.COM/2010-04-01/ACCOUNTS/

AC7559B06DE2B7BC53CC8616F248DE4B73/CALLS.JSON \ -D “URL=WWW.MYTWIML.COM” \ -D "METHOD=GET" \ -D "TO=%2B19153564260" \ -D "FROM=%2B13234585586" \ -D "RECORD=TRUE" \ -D "RECORDINGCHANNELS=DUAL" \ -U ‘{ACCOUNTSID}:{AUTHTOKEN}’

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 12: Twilio Signal 2016 How to Build Next Generation Speech Analytics

VOICEBASE RECORDING ANALYTICS

Page 13: Twilio Signal 2016 How to Build Next Generation Speech Analytics

THE PERFECT STORM

SPEECH TECH & MACHINE LEARNING

TELECOM APIs (access to recordings)

SCALE

COST

MASSIVE OPPORTUNITY

SPEECH ANALYTICS

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Page 14: Twilio Signal 2016 How to Build Next Generation Speech Analytics

A NEW DAY

JAY BLAZENSKY | @JAYBLAZENSKY

MACHINE TRANSCRIPTION

ACCURACY

COST

SPEED

SCALABILITY

NISHA GEORGE | @NEGEORGE

PCI / PII REDACTION

CUSTOM VOCABULARY

PRIORITY QUEUING

PARALLEL PROCESSING

Page 15: Twilio Signal 2016 How to Build Next Generation Speech Analytics

USE CASES

!!!!!!!!!!!!!!!!!!!!!!!

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Lead Scoring

ComplianceAgent Monitoring

Voice of the Customer

Keyword Spotting

Page 16: Twilio Signal 2016 How to Build Next Generation Speech Analytics

USE CASES

!!!!!!!!!!!!!!!!!!!!!!!

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Keywords (client)

Lead Scoring Voice of the Customer

Keywords (Agent)

ComplianceAgent Monitoring

Page 17: Twilio Signal 2016 How to Build Next Generation Speech Analytics

USE CASES

!!!!!!!!!!!!!!!!!!!!!!!

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Human Call Scoring (Tagging)

Hot Lead Pre-churn Non-prospect Upsell Opportunity

Auto Call Scoring (Predictive Analytics)

Hot Lead Pre-churn Non-prospect Upsell Opportunity

Page 18: Twilio Signal 2016 How to Build Next Generation Speech Analytics

Auto score 100% of your calls with better accuracy at a fraction of the cost3

HOT LEAD APPOINTMENT 1ST TIME CALLER PRE-CHURN

VoiceBase creates 10K - 20K columns of data and applies machine learning 2

Upload pre-tagged call data where event is present and not present 1

Hot Lead

Not Hot Lead

BUILDING A PREDICTIVE MODEL

Appointment

Not Appointment

Event ‘X’ Present

Event ’X’ Not Present

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Confidence scores4

Page 19: Twilio Signal 2016 How to Build Next Generation Speech Analytics

DEMO

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

Page 20: Twilio Signal 2016 How to Build Next Generation Speech Analytics

MARKETECTURE

caller& agent&

Twilio&(Dual&Channel)&

REST%API%

File%

f1% f2% fn%.%.% .%.%

Transcript*Keywords*Predic2ons*

RESULTS'

JSON%%%%callback%URL%%%%TXT,%RTF,%SRT%%%%billing/usage%

Applica'on*

B*I*

DW*

……..#..…….#

Business#Decision#Maker#

CRM$

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 21: Twilio Signal 2016 How to Build Next Generation Speech Analytics

Send your recording to the VoiceBase API

ENABLE VOICEBASE

CURL -X POST HTTPS://APIS.VOICEBASE.COM/V2-BETA/MEDIA \ --HEADER "AUTHORIZATION: BEARER $TOKEN” \ --FORM MEDIA=HTTP//API.TWILIO.COM/RE1234 \ --FORM [email protected] \

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 22: Twilio Signal 2016 How to Build Next Generation Speech Analytics

{ "CONFIGURATION":{ "INGEST":{ "CHANNELS":{ "LEFT":{ "SPEAKER":"AGENT" }, "RIGHT":{ "SPEAKER":"CALLER" } } }, "PUBLISH":{ "CALLBACKS":[ { "URL":"HTTPS://WWW.YOUR-URL.COM", "METHOD":"POST", "INCLUDE":[ "TRANSCRIPTS", "KEYWORDS", "TOPICS", "METADATA" ] } ] } } }

Specify your configuration

ENABLE VOICEBASE

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 23: Twilio Signal 2016 How to Build Next Generation Speech Analytics

"KEYWORDS":{ "WORDS":[ { "T":{ "CALLER":[ "203.89", "234.31" ], "AGENT":[ "290.12" ] }, "NAME":"INSTALLATION" }, { "T":{ "CALLER":[ "100.82", "199.71" ] }, "NAME":"INTERESTED" }, { "T":{ "AGENT":[ "90.39", "201.33" ] }, "NAME":"CONTRACT" } ] }

Review your results

ENABLE VOICEBASE

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY

Page 24: Twilio Signal 2016 How to Build Next Generation Speech Analytics

SUMMARY

JAY BLAZENSKY | @JAYBLAZENSKYNISHA GEORGE | @NEGEORGE

!!!!!!!!!!!!!!!!!!!!!!!

“The one with with the most data (information) wins”

AD

MIT

ON

E

Section

Row

Seat

Event

23

F

W7

DE

Opportunity UNLIMITED

BIG VOICEAPI Key

5d294h8c23r99KX26Uj23j486h31

Com

plim

ents

of

TWIL

IO +

VO

ICEB

ASE

Page 25: Twilio Signal 2016 How to Build Next Generation Speech Analytics

NISHA GEORGE JAY BLAZENSKY

NISHA GEORGE | @NEGEORGE JAY BLAZENSKY | @JAYBLAZENSKY