appsheet: crowdsourcing decision support efficiently alex quinn, tom yeh, ben bederson
TRANSCRIPT
![Page 1: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/1.jpg)
Appsheet:Crowdsourcing Decision Support Efficiently
Alex Quinn, Tom Yeh, Ben Bederson
![Page 2: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/2.jpg)
![Page 3: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/3.jpg)
Ideal
![Page 4: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/4.jpg)
![Page 5: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/5.jpg)
![Page 6: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/6.jpg)
![Page 7: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/7.jpg)
![Page 8: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/8.jpg)
![Page 9: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/9.jpg)
![Page 10: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/10.jpg)
Example
Task: Help management choose a city for the new company headquarters."Anna"
(analyst)
![Page 11: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/11.jpg)
Diagram based on Managerial Decision Modeling with Spreadsheets by Balakrishnan, Render, & Stair. © 2007 Pearson Education
Interviews to determine problem structure, relevant attributes, weights
Define the Problem
Develop a Model
Acquire Input Data
Develop a Solution
Test the Solution
1. climate2. workers3. affordability4. health insurance costs5. employee preference6. rent7. transportation8. labor laws9. sales tax10.distance to other offices11.distance to CEO
hometown12.availability of skilled
labor13.availability of office
space…50. employee satisfaction
![Page 12: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/12.jpg)
Diagram based on Managerial Decision Modeling with Spreadsheets by Balakrishnan, Render, & Stair. © 2007 Pearson Education
Define the Problem
Develop a Model
Acquire Input Data
Develop a Solution
Test the Solution
Select method: Weighted Sums Model
![Page 13: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/13.jpg)
Diagram based on Managerial Decision Modeling with Spreadsheets by Balakrishnan, Render, & Stair. © 2007 Pearson Education
Define the Problem
Develop a Model
Acquire Input Data
Develop a Solution
Test the Solution
Select method: Weighted Sums ModelEnter formulas
Simplified
![Page 14: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/14.jpg)
Diagram based on Managerial Decision Modeling with Spreadsheets by Balakrishnan, Render, & Stair. © 2007 Pearson Education
Define the Problem
Develop a Model
Acquire Input Data
Develop a Solution
Test the Solution
Strategies:•Recruit co-workers•Mechanical Turk•Acquire selectively
Simplified
![Page 15: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/15.jpg)
Diagram based on Managerial Decision Modeling with Spreadsheets by Balakrishnan, Render, & Stair. © 2007 Pearson Education
Define the Problem
Develop a Model
Acquire Input Data
Develop a Solution
Test the Solution
Strategies:•Recruit co-workers•Mechanical Turk•Acquire selectively
Simplified
Appsheet
![Page 16: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/16.jpg)
Appsheet: Getting started
![Page 17: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/17.jpg)
Appsheet: Getting started
Mockup
![Page 18: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/18.jpg)
Appsheet: ASK formulas
=ASK(1, 1, 10)
cost minimum value maximum value Mockup
![Page 19: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/19.jpg)
Appsheet: Starting Input Acquisition
Mockup
![Page 20: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/20.jpg)
Appsheet: Data collection
Mockup
![Page 21: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/21.jpg)
Appsheet: Savings
Mockup
![Page 22: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/22.jpg)
Appsheet: Savings
Mockup
Conclusive decision with only 5 of the 9 inputsSavings: 44% of the human effort
![Page 23: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/23.jpg)
Prioritization
Standard plan: A1, B1, C1, D1
cost minimum value maximum value
![Page 24: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/24.jpg)
Prioritization
Standard plan: A1, B1, C1, D1Appsheet plan: B1, [A1 only if B1 ≤ 4], (C1 or D1)
cost minimum value maximum value
![Page 25: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/25.jpg)
Prioritization
Standard plan: A1, B1, C1, D1Appsheet plan: B1, [A1 only if B1 ≤ 4], (C1 or D1)Expected savings: 37%
cost minimum value maximum value
![Page 26: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/26.jpg)
Next steps• Account for varying confidence in inputs
• Sharing of models themselves
• Construct web-based tools using spreadsheets
![Page 27: Appsheet: Crowdsourcing Decision Support Efficiently Alex Quinn, Tom Yeh, Ben Bederson](https://reader036.vdocuments.net/reader036/viewer/2022062712/56649c7c5503460f9493160e/html5/thumbnails/27.jpg)
Take-home lessons
• Use crowdsourcing to gather data for decisions
• Human effort is expensive
• Leverage computation to reduce human effort
• Blend crowdsourcing with social computing
Alex Quinn & Ben BedersonContact: [email protected]