designing to learn: creating effective mvp experiments - lean ux nyc 2014

Download Designing To Learn: Creating Effective MVP Experiments - Lean UX NYC 2014

Post on 11-Aug-2014

3.681 views

Category:

Design

0 download

Embed Size (px)

DESCRIPTION

Designing MVP workshop for Lean UX NYC 2014.

TRANSCRIPT

  • Designing to Learn Creating Eective MVP Experiments Melissa Perri @lissijean
  • Consultant Lean Product Manager UX Designer Teacher Twitter addict (@lissijean) Blogger (melissaperri.com) Hi! Im Melissa.
  • @lissijean What is an MVP (and why should we care)? Setting Up MVP Experiments Types of MVPs and How to Choose Iterating on MVPs Agile + MVP: How does it work together? Agenda
  • @lissijean Why MVP?
  • @lissijean Match your taste with the exceptional nds of industry insiders.
  • @lissijean
  • @lissijean
  • My way is faster. This isnt what I needed. I dont know how to use it. The information I want to see isnt on here. @lissijean
  • @lissijean
  • @lissijean
  • @lissijean Validate Before Building
  • @lissijean Build Measure Learn
  • @lissijean Iterate your way to Product/Market Fit your users
  • @lissijean MVPMinimum Viable Product
  • @lissijean MVPSmallest amount of work you can do to test your idea.
  • @lissijean
  • @lissijean
  • @lissijean
  • @lissijean
  • @lissijean LEARN
  • @lissijean MVP = Minimum Feature Set Agile Methodology MVPs
  • @lissijean Focus on problem not features.
  • @lissijean MYTH
  • @lissijean Crappy products Crappy products everywhere
  • @lissijean Good MVPs oer a great experience to the customer.
  • @lissijean
  • @lissijean MVP = Experiment
  • @lissijean Experiment Process Set Up ! Design ! Run ! Feedback ! Iterate
  • @lissijean
  • @lissijean Setting up MVP Experiments PART I
  • @lissijean 1. Dene Customer & Problem 2. Investigate assumptions 3. Design a test 4. Measure customer behavior 5. Evaluate success 6. Pivot or persevere Process
  • @lissijean
  • @lissijean Dene Dene
  • @lissijean Customers want twitter-like messages in their feed.
  • @lissijean Customers want twitter-like messages in their feed. Not a problem.
  • @lissijean Real Problem Customers dont think the curators are authentic.
  • @lissijean Investigate
  • @lissijean Assumptions Shoppers care that curators are authentic. Shoppers will engage more with real messages on site. Shoppers think tweets are authentic.
  • @lissijean Riskiest Assumption Shoppers care that curators are authentic. Shoppers will engage more with curator messages on site. Shoppers think tweets are authentic.
  • @lissijean Design a Test
  • @lissijean Setting up a test 1. What do we want to learn? 2. How do we measure that? 3. Whats the least we can build to learn?
  • @lissijean Will shoppers engage more with curator messages? What do we want to learn?
  • @lissijean Engagement Clicks, purchases, added to cart How do we measure that?
  • @lissijean What is the least we can build to learn? Wizard of Oz Looks real to the customer, completely manual on the backend.
  • @lissijean
  • @lissijean
  • @lissijean Measure
  • @lissijean How do we measure engagement?
  • @lissijean Clicks on product. Purchases. Add to cart.
  • @lissijean What do we consider successful?
  • @lissijean Minimum Success Criteria What is the minimum number we need to hit to consider this validated?
  • @lissijean Time Salary# Peoplex x Cost to build completely
  • @lissijean Minimum Success Criteria Improvement needed to justify cost to build.
  • @lissijean 25% increase in engagement in A/B test.
  • @lissijean
  • @lissijean Evaluate
  • @lissijean
  • @lissijean 0% change over other products.
  • @lissijean INVALIDATED
  • @lissijean But why?
  • @lissijean Why didnt users engage? What do we want to learn?
  • @lissijean User Testing Sessions watch them use it. How do we nd that out?
  • @lissijean Emails.
  • @lissijean Pivot
  • @lissijean strategic change in direction based on learning. Pivot
  • @lissijean Riskiest Assumption Shoppers will engage more with curator messages.
  • @lissijean Will shoppers engage more with curator messages through email? What do we want to learn?
  • @lissijean Engagement Opens, Click throughs, purchases. How do we measure that?
  • @lissijean What is the least we can build to learn?
  • @lissijean How do we determine success? 30% increase in engagement over other emails.
  • @lissijean Success! 2x Open Rate 3x Purchases
  • @lissijean Now, we automate. Now, we invest.
  • @lissijean workshop one: Setting up MVP Experiments
  • @lissijean
  • @lissijean Weve recently received a urry of complaints from Macys shoppers.
  • @lissijean Every time I come into Macys, I spend HOURS I dont have and can never seem to nd what Im looking for. I know exactly what type of item I want, but options are all over the place. Its daunting.
  • @lissijean I needed a blue tie to go with my suit for a friends wedding, so I went to nd it but there were too many options. Where do I even start? I dont even know how to choose.
  • @lissijean Who is the customer?
  • @lissijean OpenSky shoppers who visit the site at least once a month, but rarely buy.
  • @lissi