experiment design - strategy and markets determine what you should test

Yo doc! Let’s talk Experiment Design.

Firmhouse

firmhouse.com

Skill Nation

We take innovators & entrepreneurs from idea to first revenue.

2. Strategy1. Market types

3. Experiments

Strategyeats Lean Startup for breakfast.

Well, not that

‘Lean’ English

breakfast.

Stop ignoring markets & competition.

Uber entered an existing market.

Airbnb, new market and product.

iPhone, re-segmented the mobile industry

80% of the work is knowing your next moves.

Seems like a bad idea

Great idea

SWEETSPOT

ACalibrate first!

Develop your plan

Business Model CanvasValue Proposition Map

(or whatever floats your boat)

Don’t re-invent the wheel

Analogs Antilogs“Competition that failed at building the company that

you’re aiming to build.”

“Competition successful in the market you are

trying to conquer.”

You always have toomany options to test.

You can’t test all your options, experiment with the options that you have no data for.

Fastest way of failing at experimenting: start with a landing page.

01100110 01100001 01101001 01101100

(hard to understand what it says?)

ConfirmLearn- Problem interviews - Observation - Desk research

- Solution pitching - Competitor usability - Smoke testing

http://skillnation.coCompetitive Skill Gaming

Market typeExisting (young) market.

http://skillnation.co

Competitive Skill Gaming

Strategy1) Proof engagement through competition 2) Develop long-tail revenues for Game Developers 3) Position as main platform for discovering games

http://skillnation.co

Competitive Skill Gaming

Analogs• Gamer Duel • Game Center

Antilogs• Skillz.com • cashplay.co

http://skillnation.co

Competitive Skill Gaming

Confirm: 1:1 on Skill gaming Duels

Learn: what competitive elements matter?

http://skillnation.co

Learn: what games? How can we segment the gaming market?

Confirm: Skill gaming tournaments

Competitive Skill Gaming

You can’t learn

KUNG-FU by watching BRUCE LEE movies.

bit.ly/experiment-design

Robbert van Geldrop | @rvangeldrop

Bob Jansen | @jansn

Find the guide online

http://firmhouse.com