user research full fat to lean

45
USER RESEARCH: FROM FULL FAT TO LEAN BEN BYWATER

Upload: ben-bywater

Post on 05-Jul-2015

512 views

Category:

Design


1 download

DESCRIPTION

Reporting on how user researchers are working and how this may have changed over the last 5 years Presented at Collaborate Bristol on 12/11/14

TRANSCRIPT

Page 1: User research full fat to lean

USER RESEARCH: FROM FULL FAT TO LEAN BEN BYWATER

Page 2: User research full fat to lean

INPUTS 10 INTERVIEWS 30 SURVEY RESPONDENTS

(me) Client-side

Agency-side

75% had 10+ years experience.

6 survey respondents were also interviewees.

Page 3: User research full fat to lean

FORCES AT PLAY AGILE SQUEEZING TIME MORE ‘IN HOUSE’ UX MORE COLLABORATION CONTINOUS DELIVERY LEAN UX MINDSET MORE MOBILE NEW TECH & PACE OF CHANGE MORE DATA

Page 4: User research full fat to lean

HOW WE’RE RESPONDING BEING MORE PRAGMATIC HUSTLING FOR THE BIG PICTURE ADAPTING SERVICE OFFERINGS USING MORE INP[UTS MEASURING UX MORE GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA SOCIALISING & MANAGING INSIGHTS BETTER

Page 5: User research full fat to lean

BEING MORE PRAGMATIC

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 6: User research full fat to lean

BEING MORE PRAGMATIC

 INSIGHT    RESOURCE  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 7: User research full fat to lean

BEING MORE PRAGMATIC THINKING  ABOUT  5  YEARS  AGO,  IS  THERE  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  TIME  TO  DO  THE  RESEARCH?    

MORE  

LESS  

SAME  

0%   50%   100%  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 8: User research full fat to lean

BEING MORE PRAGMATIC THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  HAVING  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  INFLUENCE  ON  THE  FINAL  PRODUCT  OR  SERVICE?  

MORE  

LESS  

SAME  

0%   50%   100%  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 9: User research full fat to lean

BEING MORE PRAGMATIC

I  FIND  MYSELF  PUSHING  PEOPLE  TO  BE  A  BIT  LESS  IDEALISTIC  AND  A  BIT  MORE  PRAGMATIC  ABOUT  WHAT  THEIR  TIME  IS  BEST  SPENT  ON.  

RESEARCH  MANAGER,  CLIENT-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 10: User research full fat to lean

BEING MORE PRAGMATIC

THE  LEAN  MOVEMENT  HAS  DRASTICALLY  CHANGED  ATTITUDES.  WE  ARE  ALL  MORE  ‘TRY  AND  LEARN’  THAN  5  YEARS  AGO  WHEN  WE  WANTED  TO  LEARN,  THEN  CAREFULLY  LEARN.  THE  ADVENT  OF  THE  MVP  IS  CAUSING  US  TO  EVOLVE.  

RESEARCH  MANAGER,  AGENCY-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 11: User research full fat to lean

BEING MORE PRAGMATIC

LEAN  START-­‐UP  IS  THE  BANE  OF  MY  LIFE!  RESEARCH  MANAGER,  CLIENT-­‐SIDE  

“  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 12: User research full fat to lean

BEING MORE PRAGMATIC

BEST  PRAGMATIC  METHOD  AWARD:  USER  TESTING!  

http://blog.mailchimp.com/remote-usability-testing-on-mobile-devices/

Page 13: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

Page 14: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  DOING  MORE,  LESS  OR  THE  SAME  AMOUNT  OF  STRATEGIC    ‘UP-­‐STREAM’  TYPE  RESEARCH?  

MORE  

LESS  

SAME  

0%   50%   100%  

Page 15: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

CASE  STUDY:  A  REVOLT  

Page 16: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

WE  REBELLED!  AND  IN  THE  END  THE  PRODUCT  OWNER  TOLD  THE  HEAD  OF  DIGITAL  “WE  JUST  CAN’T  DO  IT  LIKE  THAT.  IT  DOESN’T  WORK…  BASICALLY  F*@%  OFF  WITH  YOUR  THEORY”…  AND  HE’S  A  NICE  GUY  SO  HE  SAID  “DO  IT  HOW  YOU  WANT  IF  IT  WORKS  BETTER”.  SO  WE  DID  A  ‘THIN  SLICE’...  TO  MAKE  SURE  THE  END  TO  END  WORKED  AND  NOW  WE  ARE  GOING  INTO  DEEP  DIVES.    

USER  RESEARCHER,  CLIENT-­‐SIDE  

“  

Page 17: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

CASE  STUDY:  FIELD  STUDIO  

Page 18: User research full fat to lean

HUSTLING FOR THE BIG PICTURE

http://1hdwallpapers.com/wallpapers/big_city_view.jpg

BEST  BIG  PICTURE  APPROACH  AWARD:  LEAN  SLICES  

Page 19: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

Page 20: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

AS  COMPANIES  HAVE  GOTTEN  SMARTER  ABOUT  DESIGN,  AND  RECOGNISED  IT’S  A  COMPETENCY  THEY  NEED  INTERNALLY,  THEY’VE  BECOME  LESS  COMFORTABLE  OUTSOURCING  IT.    

“  PETER  MERLHOLZ,  ADAPTIVE  PATH  CO-­‐FOUNDER  

Page 21: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

AS  COMPANIES  HAVE  GOTTEN  SMARTER  ABOUT  DESIGN,  AND  RECOGNISED  IT’S  A  COMPETENCY  THEY  NEED  INTERNALLY,  THEY’VE  BECOME  LESS  COMFORTABLE  OUTSOURCING  IT.    

“  PETER  MERLHOLZ,  ADAPTIVE  PATH  CO-­‐FOUNDER  

(IN  SILICON  VALLEY,  ANYWAY)  

Page 22: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

CASE  STUDY:  COACHING  BY  AN  AGENCY  

Page 23: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

I  CAN  LEAVE  [THE  CLIENT  TEAM]  TO  IRON  OUT  THE  INTERFACE  LEVEL  USABILITY  THINGS,  HAVING  GOT  THE  BIGGER  ISSUES  OUT  OF  THE  WAY...  USABILITY  IS  BEING  COMMODITISED.  

“  USER  RESEARCH,  AGENCY-­‐SIDE  

Page 24: User research full fat to lean

ADAPTING SERVICE OFFERINGS

PIC BY TIM GEOGHEGAN

BEST  ADAPTATION  AWARD:  COACHING  IN  HOUSE  UX  

Page 25: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

Page 26: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

I  TEND  TO  HAVE  TO  CONSIDER  MORE  RESEARCH  SOURCES  PER  PROJECT  [THESE  DAYS].  FOR  EXAMPLE,  STATS,  ANALYTICS,  MARKET  RESEARCH  DATA  MINING,  UX  RESEARCH,  DESK  RESEARCH,  INTERVIEWS  WITH  OTHER  AGENCIES,  TEAMS  AND  SOURCES.  

“  USER  RESEARCHER,  AGENCY-­‐SIDE  

Page 27: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  DOING  MORE,  FEWER  OR  THE  SAME  NUMBER  OF  RESEARCH  METHODS  AND  INPUTS?      

MORE  

LESS  

SAME  

0%   50%   100%  

Page 28: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

MY  PERCEPTION  IS  THAT  USER  RESEARCH  AND  CONSUMER  INSIGHT  OR  MARKET  RESEARCH  ARE  GOOD  AT  DIFFERENT  THINGS  AT  THE  MOMENT…  WHAT  I  AM  EXCITED  ABOUT  AT  THE  MOMENT  IS  THERE  IS  A  LOT  OF  STUFF  THAT  IS  CUTTING  EDGE  IN  CONSUMER  INSIGHT  THAT  I  AM  NOT  HEARING  ABOUT  IN  USER  RESEARCH  BUT  IS  ENTIRELY  APPLICABLE.    

“  USER  RESEARCHER,  AGENCY-­‐SIDE  

Page 29: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

CASE  STUDY:  CAMPFIRE  (LONG  TERM  COMMUNITIES)  

Page 30: User research full fat to lean

USING MORE INPUTS

http://conwaycustom.com.au/workshop/586/

BEST  NEW  INPUT  AWARD:  LONG  TERM  COMMUNITIES  

Page 31: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

Page 32: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

THE  MEASUREMENT  OF  UX  EFFECTIVENESS  WITH  ANALYTICS  IS  BIG  NOW.  

“  USER  RESERCHER,  FREELANCE  

Page 33: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

CASE  STUDY:  BOARD  ROOM  CATNIP  

Page 34: User research full fat to lean

MEASURING UX MORE

http://www.prodality.com/measurement-the-key-to-startup-success/

IT  WAS  LIKE    TOTAL  CATNIP  TO  THEM  BECAUSE  …  IT  LET  US  JUMP  FROM  THE  BIG  PICTURE  OF  ‘THIS  SERVICE  HAS  THIS  ONE  BIG  CHALLENGE’  TO  THE  MINUTE  DETAIL  OF  [HOW  WE  WERE  FIXING  IT].  

“  USER  RESERCHER,  FREELANCE  

Page 35: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

Page 36: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

IF  THE  COST  OF  EXTRACTING  OUTWEIGHS  THE  VALUE  OF  EXTRACTION  YOU’RE  NOT  GOING  TO  BOTHER.  I  PREDICT  A  DOUBLING  DOWN  OF  QUALITATIVE  AS  THE  MORE  HOLISTIC  APPROCH  THAT  GIVES  YOU  MOST  OF  WHAT  YOU  WANT  IN  A  WAY  THAT’S  ACTIONABLE…  IN  THE  SHORT  AND  MEDIUM  TERM  I  PREDICT  A  GOLDEN  AGE  OF  ETHNOGRAPHY.    

“  HEAD  OF  RESEARCH,  AGENCY-­‐SIDE  

Page 37: User research full fat to lean

GETTING OUT OF THE LAB & MAKING SENSE OF THE DATA

http://www.travelization.net/wp-content/uploads/2012/07/elephant-going-trought-jungle-wallpapers-1366x768.jpg

CASE  STUDY:  MORE  DATA  =  MORE  ETHNO  

Page 38: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

Page 39: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

THE  CORE  RESEARCH  PRACTICES  ARE  EXACTLY  THE  SAME  [AS  THEY  WERE  5  YEARS  AGO].  IT’S  THE  ANCILLARY  STUFF  THAT  HAS  CHANGED…  THE  BIG  THING  IS  MAKING  IS  HAPPEN  IN  THE  TEAM  &  KEEPING  IT  USER-­‐CENTRED.  75%  OF  MY  JOB  IS  COMMUNICATION.  

“  HEAD  OF  RESEARCH,  CLIENT-­‐SIDE  

Page 40: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

WHAT  TAKES  MOST  OF  YOUR  TIME  AND  ENERGY  WITH  USER  RESEARCH?  

ELICITING  RESEARCH  NEEDS  FROM  CLIENTS  AND  STAKEHOLDERS  

PLANNING  AND  CONDUCTING  THE  RESEARCH  

5  YEARS  AGO  TODAY  

COMMUNICATING  AND  SOCIALISING  THE  INSIGHTS  FROM  THE  RESEARCH  

0%   50%   100%  

Page 41: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/

THINKING  ABOUT  THE  LAST  5  YEARS,  ARE  YOU  GETTING  BETTER,  WORSE  OR  IS  THERE  NO  CHANGE  IN  ‘MANAGING  INSIGHT’?  

BETTER  

WORSE  

SAME  

0%   50%   100%  

Page 42: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

THE  BEST  WAY  TO  MANAGE  INSIGHT  IS  TO  MAKE  SURE  THAT  LOTS  OF  PEOPLE  TAKE  PART  IN  THE  RESEARCH  SO  THAT  THEY  ALL  GET  IT  .  “  

HEAD  OF  RESEARCH,  CLIENT-­‐SIDE  

Page 43: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

THE  BEST  REPORT  IS  NO  REPORT…  THE  BEST  RESEARCH  PROJECT  IS  NOT  HAVING  TO  DO  THE  RESEARCH  PROJECT.  “  

HEAD  OF  RESEARCH,  AGENCY-­‐SIDE  

Page 44: User research full fat to lean

SOCIALISING AND MANAGING INSIGHTS BETTER

http://www.bowmast.com/case-study-craft-brewing/ 0%   50%   100%  

BEST  ‘INSIGHT  HOLDER’  (OTHER  THAN  PEOPLE):  VIDEO!  

Page 45: User research full fat to lean

THANKS @JAMMINJARJAM