uk giaf summer 2015 - from data science to data impact

54
Kinran @HAStark

Upload: lauren-cormack

Post on 19-Mar-2017

567 views

Category:

Data & Analytics


2 download

TRANSCRIPT

Kinran@HAStark

‹#›

2015 © All rights reserved to

From Data Science to Data Impact:On many ways to segment your players

Volodymyr (Vlad) KazantsevHead of Data Science at Product Madness

[email protected]

‹#›

Heart of Vegas in (public) Numbers

iPad US - #13 top grossingiPhone US - #32 top grossingAndroid - #44 top grossing

US (games) AustraliaiPad - #1 top grossingiPhone - #1 top grossingAndroid -#3 top grossing

[email protected] volodymyrk

‹#›

Data Impact Team

Ad-hoc analytics; dashboards

Deep dive analysis; Predictive analytics

ETL, R&D

[email protected] volodymyrk

‹#›

Data Impact Team

Insights

Data

Science

Data

Engineering

7 people; 4 in London office

[email protected] volodymyrk

Ad-hoc analytics; dashboards

Deep dive analysis; Predictive analytics

ETL, R&D

‹#›

Ad-hoc analytics; dashboards

Deep dive analysis; Predictive analytics

ETL, R&D

Data Impact Team

Insights

Data

Science

Data

Engineering

7 people; 4 in London office

We Are Hiring [email protected]

[email protected] volodymyrk

‹#›

Technology Stack

ETL orchestration

Transformation& Aggregation

SQL

Data Products

Reports

Dashboards

+

‹#›

few examples ..

A B

A/B TestsCustomer Lifetime Value

days

$ va

lue

Segmentation

group 1 group 2 group 3 group 4

‹#›

Segmentation Basics

1

‹#›

Successful segmentation is the product of a detailed understanding of your market and will therefore take time

- Market Segmentation: How to Do it and Profit from it, 4th edition: Malcolm McDonald

‹#›

Basics

Customers have different needs and meansSegmentation can help to understand those differencesWhich can help to deliver on those needsAnd drive higher profitability

‹#›

What is a Player Segment?

A segment is a group of customers who display similarities to each other...

Customers move in and out of segments over time

‹#›

How many segments are there?

There is no one right way to segment (not should there be):

Many different approaches and techniques

Mix of art, science, common sense, experience and practical knowledge

Depends on business needs and availability of data

Don’t aim to build one holistic model to meet all needs

‹#›

Strategic Management

Product Development

Marketing Operations

Comments

Geography /Demographics

Loyalty / Length of Relationship

Behavioural

Needs-based

Value Based

‹#›

Strategic Management

Product Development

Marketing Operations

Comments

Geography /Demographics

✭✭ ✭✭ ✭✭Separates players by country, city, city-district, distance from land-based casinos. By generational profile: boomers, Gen-Y, Gen-X.

Loyalty / Length of Relationship

✭✭✭ ✭ ✭✭✭ New players, on-boarding, engaged, lapsed, re-engaged, cross-promoted.

Behavioural ✭ ✭✭✭ ✭✭✭Based on identifying player’s behaviour characteristics that help to understand why customer behave the way they do

Needs-based ✭ ✭✭✭ ✭ Divide customers based on needs which are being fulfilled by playing Online Slots

Value Based ✭✭✭ ✭ ✭✭ Based on present and future value of the customer (RFM/CLV)

‹#›

Land-based Slots Player segmentation

<10%

>50%

‹#›

Segmentation = building a taxonomy

All Players

New(<28 days)

Established (>28d)

Payer Non Payer0-2 days 3-7d 8-27

<30 spins >30 … High V Med V Low V Engaged Casual…VIP Concierge

‹#›

..and simplifying it daily use

All Players

New(<28 days)

Established (>28d)

Payer Non Payer0-2 days 3-7d 8-27

<30 spins >30 … High V Med V Low V Casual…

New High Value Med Value Low Value Engaged Casual

Engaged

‹#›

How to profit from Segmentation?

2

‹#›

Clients of Segmentation

○ Strategy and Finance

○ Product development

○ Marketing operations

‹#›

Strategy and Finance

This Month

high-value med-value low-value super free-rider casual slotter recently lapsed

high-value 55.27% 30.06% 4.81% 5.54% 2.00% 2.32%

med-value 11.11% 42.50% 25.25% 10.92% 6.20% 4.02%

low-value 0.59% 7.72% 36.02% 30.59% 17.12% 7.96%

super free-rider 0.04% 0.30% 2.76% 70.50% 22.22% 4.18%

casual slotter 0.01% 0.10% 0.96% 8.98% 51.37% 38.58%

recently lapsed 0.05% 0.22% 1.01% 8.93% 13.00% n/a

New 0.01% 0.08% 0.67% 3.22% 31.05% 64.97%

This Month 0.15% 0.54% 2.13% 21.56% 31.22% 23.03%

Last Month 0.11% 0.43% 2.03% 21.09% 37.19% 27.20%

Last

Mon

th

‹#›

Strategy and Finance

This Month

high-value med-value low-value super free-rider casual slotter recently lapsed

high-value 6.80% -0.45% -1.66% -2.39% -1.07% -1.24%

med-value 3.09% 2.60% -2.81% -2.12% -0.60% -0.16%

low-value 0.11% 0.90% -1.63% 1.99% -0.54% -0.82%

super free-rider 0.01% 0.05% -0.05% -2.05% 2.58% -0.54%

casual slotter 0.00% 0.02% 0.05% -1.26% 2.71% -1.54%

recently lapsed -0.01% -0.05% -0.35% -4.21% -8.43% N/A

New 0.01% 0.04% 0.36% 1.59% 16.17% 1.21%Manage transitions, not churn

Last

Mon

th

‹#›

Product Development

New Slot Game Released

Coins Spent

‹#›

Product Development

Geo: AustraliaValue: Low-valueBehaviour: Prefer Medium bet

New Slot Game Released

Coins Spent

‹#›

Marketing

Objective Behavioral RFM/CLV geo/demographic Lifecycle

Sale Events

Monetization campaigns

Retention campaigns

Re-engagement

VIP management

‹#›

How to actually do segmentation?

3

‹#›

Pillars of Successful Segmentation Project

Business knowledge

Data knowledge

Analytical skillsPeople

Process

Technology

ETL

Machine Learning

Business Intelligence

Product Integration

Marketing

Product

Data Services

‹#›

Top-down approach to segmentation

1. Define objectives and therefore customer characteristicsa.dd

2. Choice method to split usersa.d

3. Prioritise segments to targeta.d

4. Operationalise segmentationa.s

5. ‘land’ the segmentation within the organization

‹#›

Bottom-up approach

360o player view

Segmentation

Player transitions

Tailored interventions

Prioritisation and testing

● Build database to provide 360o view of the customer● Demographic, behavioural, payments, etc.● Add predictive attributes, such as conversion probability, churn risk, LTV, etc.

● Segment customers by desired attributes: more than one approach● Use robust statistical techniques for clustering or validation of empirical segmentation● Ensure segmentation is intuitive for the business and can be used across business functions

● Identify how players are moving from one segment to another (segment transition matrix)● Determine value levers and identify potential improvement ideas

● Create tailored interventions (CRM, push ..), aimed at moving customers to more valuable segments● Build predictive models to detect best offer and prevent undesirable transitions

● Prioritise interventions based on expected LTV uplift and ease of implementation● Test interventions through experimentation

‹#›

How to actually do segmentation?

Just Look at Data Clustering Decision Trees

Player Attributes

de-correlate

Normalise Scale

‹#›

de-correlate and normalise

Player 1 more similar to Player 2 ?Player 3 more similar to Player 2 ?

Weekly Play Summary

‹#›

de-correlate and normalise

Weekly Play Summary

‹#›

de-correlate and normalise

Player 1 more similar to Player 2 !

‹#›

de-correlate and normalise

Player 1 more similar to Player 2 !

‹#›

de-correlate and normalise

Player 1 more similar to Player 2, isn’t he?

‹#›

de-correlate and normalise

Player 3 more similar to Player 2 !

‹#›

What now?

K-meansHierarchical ClusteringDecision Trees.. and many more

‹#›

Decision Tree for Clustering

All Payers500 (next month>$100): 4.7%

10000 did not: 95.3%

Last_months_dollars <=$22 (next month>$100): 0.04%

5000 did not: 99%

Last_months_dollars >$2498 (next month>$100) > $100: 9%

5000 did not: 91%

Transactions <=10243 (next month>$100): 5.5%

4200 did not: 94.5%

Transactions > 10255 (next month>$100): 24%

800 did not: 76%

‹#›

Decision Tree for Clustering

All Payers500 (next month>$100): 4.7%

10000 did not: 95.3%

Last_months_dollars <=$22 (next month>$100): 0.04%

5000 did not: 99%

Last_months_dollars >$2498 (next month>$100) > $100: 9%

5000 did not: 91%

Transactions <=10243 (next month>$100): 5.5%

4200 did not: 94.5%

Transactions > 10255 (next month>$100): 24%

800 did not: 76%

Low Value

Medium ValueHigh Value

‹#›

Segmentation at Product Madness

4

‹#›

Lifestage Segmentation

On-Boarding

Disengaged

Engaged

not played game

Churned

‹#›

On-boarding segment

On-Boarding

Disengaged

Engaged

not played game

Churned

‹#›

On-boarding segment

On-Boarding

Disengaged

Engaged

not played game

Churned

‹#›

Lifestage Segmentation

On-Boarding

Disengaged

Engaged low riskhigh risk

low riskhigh risk

low riskhigh risk

not played game

churned

churned

Churned

‹#›

Behavioural Segmentation

Average BetGifts per DayBonuses per DayMachine StickinessDays PlayedSpins per DayPreference for New Machines%% of spin on High-Roller machinesBig Win Stickinessetc.

Hierarchical Clustering

‹#›

Behavioural Segmentation

‹#›

Infrastructure

Data Warehouse

Segmentation Engine

CRM Email GAME Reporting Ad Hoc Analytics

Predictive Analytics

‹#›

Segmentation for A/B tests

A B

‹#›

Segmentation for A/B tests

A B

‹#›

Bonferroni correction:

Bayesian Hierarchical Model

Combine stats with Market Intuition!

Adjustment for multiple testing

𝛼adjustted = 𝛼desired/M

‹#›

2015 © All rights reserved to

Thank You!

[email protected]@productmadness.com

volodymyrk

JOIN IN THE CONVERSATION PARTICIPATE IN THE NEXT GIAF

Analytics for Games www.deltadna.com/giaf

[email protected]

#UKGIAF