[warm gun 2014] docusign >> aviva rosenstein, "thought experiments for data-driven...
DESCRIPTION
Aviva Rosenstein UX Research Lead, DocuSign @avivaUXTRANSCRIPT
![Page 1: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/1.jpg)
What Happens If..? vs. What The Heck Just Happened? Thoughts about Customer Feedback Data
@avivaux
![Page 2: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/2.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 2
![Page 3: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/3.jpg)
3M Frito-Lay, a unit of PepsiCo Amdahl Hewlett-Packard Amoco IBM Avon Products Intel Boeing Johnson & Johnson Bristol-Myers Squibb Kmart Caterpillar Maytag Dana McDonald’s Data General Merck Delta Air Lines National Semiconductor Digital Equipment Procter & Gamble The Walt Disney Co. Raychem Dow Chemical Schlumberger DuPont Texas Instruments Eastman Kodak Wal-Mart Stores Emerson Electric Wang Labs
Based on interviews with:""
Aviva Rosenstein @avivaux W
armG
un 2014 3
![Page 4: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/4.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 5
![Page 5: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/5.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 6
![Page 6: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/6.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 7
![Page 7: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/7.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 8
![Page 8: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/8.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 9
![Page 9: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/9.jpg)
GOOD INTENTIONS PAVING
Aviva Rosenstein @avivaux W
armG
un 2014 10
![Page 10: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/10.jpg)
Make it easy for the user: just give them a text field box...
Simplify development; !email the text entries to a shared team alias…!
Aviva Rosenstein @avivaux W
armG
un 2014 11
![Page 11: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/11.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 12
![Page 12: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/12.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 13
![Page 13: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/13.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 14
![Page 14: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/14.jpg)
Most users don’t care about a company’s organizational structure or internal divisions of labor. They will communicate their needs through any channel available. And they usually expect organizations to share that information internally.
Aviva Rosenstein @avivaux W
armG
un 2014 15
![Page 15: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/15.jpg)
Data “User Experience Design is not data-driven, it’s insight-driven. Data is just raw material for insight.”
Andrew Hinton (@inkblurt), 2009
Aviva Rosenstein @avivaux W
armG
un 2014 16
![Page 16: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/16.jpg)
Insight: an understanding of cause and effect, based on recognition of relationships and behaviors within a specific context
Aviva Rosenstein @avivaux W
armG
un 2014 17
![Page 17: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/17.jpg)
Listen Interpret
Act Monitor
Aviva Rosenstein @avivaux W
armG
un 2014 18
![Page 18: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/18.jpg)
Customers don’t care about a company’s organizational structure or internal divisions of labor. They will communicate their needs through any channel available, and they expect organizations to share that information internally.
Collecting customer feedback, by itself, has no ROI. Value comes fromderiving useful insights and closing the loop with the customer.
Aviva Rosenstein @avivaux W
armG
un 2014 19
![Page 19: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/19.jpg)
Image credit: TruScribe for Weird Al Yankovic’s Mission Statement: http://www.youtube.com/watch?v=GyV_UG60dD4
HOW IN-PRODUCT FEEDBACK HELPS STARTUPS!
Aviva Rosenstein @avivaux W
armG
un 2014 20
![Page 20: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/20.jpg)
ACQUIRE!RETAIN!UPSELL!
Aviva Rosenstein @avivaux W
armG
un 2014 21
![Page 21: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/21.jpg)
Users’ feedback is usually about: • Billing or account problems • Problems using the system • Suggestions for improving the product Once in a
while, they even say nice things: !
This was the easiest signing program I have ever had to use. It was totally fast and I didn't have to call the customer service support and stay on the phone with a rep. for hours to get my document signed and sent. WONDERFUL program!!!!!!
Actual User
Feedback!
Aviva Rosenstein @avivaux W
armG
un 2014 22
![Page 22: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/22.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 23
![Page 23: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/23.jpg)
Other approaches to getting user feedback:
Phone or email conversations with
customers
Social Media
Ad hoc surveys and focus groups
Aviva Rosenstein @avivaux W
armG
un 2014 24
![Page 24: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/24.jpg)
My Top Goals for Collecting Feedback � Validity Produces unbiased, trustworthy data � Delivery Easy to share insights with team members � Retention Knowledge retained in the company � Usability Won’t pollute the user experience � Scalability Easy to implement, uses resources efficiently � Contextual Channel accessible from within the service "
Aviva Rosenstein @avivaux W
armG
un 2014 25
![Page 25: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/25.jpg)
Validity Delivery Retention Usability Scalability Contextual
"" ""
"" """"
" "" ""
"" "" "" "" ""
"" "" ""
Social Media
Customer Calls
Focus Groups
In Product Surveys
Ad Hoc Surveys
Aviva Rosenstein @avivaux W
armG
un 2014 26
![Page 26: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/26.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 27
![Page 27: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/27.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 28
![Page 28: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/28.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 29
![Page 29: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/29.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 30
![Page 30: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/30.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 31
![Page 31: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/31.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 32
![Page 32: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/32.jpg)
Compliments
Aviva Rosenstein @avivaux W
armG
un 2014 33
![Page 33: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/33.jpg)
Complaints
Aviva Rosenstein @avivaux W
armG
un 2014 34
![Page 34: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/34.jpg)
Positive Feedback
Aviva Rosenstein @avivaux W
armG
un 2014 35
![Page 35: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/35.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 36
![Page 36: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/36.jpg)
Open Ended feedback + metadata
Parsed into custom
variables
Imported as record by
survey tool
Live Reporting/Dashboard
Alert Logic (to PM)
Imported to customer
record in CRM Alert Logic
(to AM)
Aviva Rosenstein @avivaux W
armG
un 2014 37
![Page 37: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/37.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 38
![Page 38: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/38.jpg)
Idea Development Launch
Aviva Rosenstein @avivaux W
armG
un 2014 39
![Page 39: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/39.jpg)
What just happened? vs. What happens if...?
Aviva Rosenstein @avivaux W
armG
un 2014 40
![Page 40: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/40.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 41
![Page 41: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/41.jpg)
Aviva Rosenstein @avivaux W
armG
un 2014 42
![Page 42: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/42.jpg)
September, 2014
101 Startup Failure Post-Mortems
Aviva Rosenstein @avivaux W
armG
un 2014 43
![Page 43: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/43.jpg)
42%
29% 23%
19% 18% 17% 17% 14% 14% 13% 13% 13%
10% 9% 9% 8% 8% 8% 8% 7%
Top 20 Reasons Startups Fail
Aviva Rosenstein @avivaux W
armG
un 2014 44
![Page 44: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/44.jpg)
13%
14%
17%
17%
42%
Product Mis-Timed
Ignored Customers
Need/Lack Business Model
Poor Product Quality or Usability
No Market Need for Solution
Primary driver of startup failure: Lacking insights into customers’ needs
Aviva Rosenstein @avivaux W
armG
un 2014 45
![Page 45: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/45.jpg)
Find Out Who is
Affected
Identify Themes
and Patterns
Collect Data
Map Causes and Effects
Rapid testing
User Feedback
Measure Impact
Refine Strategy
Definition Discovery Develop Deliver
What To Do & Why How To Do It
Launch Idea or Vision
Opportunity Aligned to Objectives
READY AIM FIRE
Aviva Rosenstein @avivaux W
armG
un 2014 46
![Page 46: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/46.jpg)
Sign"and"photo"credit:"Kingston"Crea3ons,"available"on"Etsy.com"
Aviva Rosenstein @avivaux W
armG
un 2014 47
![Page 47: [WARM GUN 2014] DocuSign >> Aviva Rosenstein, "Thought Experiments for Data-Driven Design"](https://reader036.vdocuments.net/reader036/viewer/2022070323/559b4beb1a28ab057d8b45d1/html5/thumbnails/47.jpg)
Idea
HELP STOP PREMATURE IMPLEMENTATION!
Development Launch
Occasional nerdery: @avivaux
Thank you for listening!
Aviva Rosenstein @avivaux W
armG
un 2014 48