TheUnreasonableEffectivenessofProductSense

ShubhaNabar,SalesforceEinstein

Background

• SeniorDirector,DataScience,Salesforce

• StaffDataScientist,LinkedIn

• EngineeringManager,Microsoft

• Ph.D.,StanfordUniversity,2008

Outline

• Dataproductmyths

• Buildingproductsense

Myth#1

Dataproductsareaboutdisplayingdata!

10%40%

50%

LeftTurnStraightAheadRightTurn

50%GoStraight

LeftTurn StraightAhead RightTurn

50%

LiveTraffic i

LeftTurn StraightAhead RightTurn

50%

WeekendTraffic i

LeftTurn StraightAhead RightTurn

50%

WeekdayTraffic i

LeftTurn StraightAhead RightTurn

50%

Sunny i

LeftTurn StraightAhead RightTurn

50%

Raini

0

10

20

30

40

50

60

Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

LeftTurnStraightAheadRightTurn

MonthlyBreakdowni

DataProduct

Usedatatoprovidehighlypersonalizedexperiencesandtangiblevaluetousers.

Myth#1

Dataproductsareaboutdisplayingdata!

Myth#2

Userswillbehaveasexpected

Myth#2

Userswillbehaveasexpected

Myth#3

Optimizeforclicks

“Leftunchecked,alloptimizationleadstogamblingandporn.”

Myth#3

Optimizeforclicks

Myth#4

Complexalgorithmsbeatsimplealgorithms

TweetProcessor

Tweet

Nam

e

Handle

Date

GenderClassifier

@mentions

M/F

Graph

HandleFriends

FeatureVector

TravelManifest BookingCode

SentimentAnalysis

Tweetstream Queue

EntityResolution

Myth#4

Complexalgorithmsbeatsimplealgorithms

Myth#5

Userswanttoconfigurethingsforthemselves

Myth#5

Userswanttoconfigurethingsforthemselves

ProductSense

• Knowingwhattobuildandwhy.

• Knowingyourusers.

• Userfirstapproachtrumpsmachinelearningfirstapproach!

BuildingProductSense

Intuition?

LearnByDoing

TalktoUsers

TalktoUsers

TalktoUsers

EatYourOwnDogfood

KnowtheCompetitiveLandscape

BeDataDriven

BeDataDriven

AbandonedQueries

SpellingMistakes

NotinIndex

QueryUnderstanding

Ranking

ThankYou!