managing product growth experiments with jira and confluence - zane salim
DESCRIPTION
Experiments and A/B tests are at the heart of innovation at Twitter. A culture of experimentation empowers the organization to try new things with minimal downside. Twitter uses Confluence and JIRA to manage hundreds of experiments at any given time. Learn Twitter's philosophy on experimentation, how we enhance organizational learning, and uncover deeper insights that help everyone become smarter with every new experiment.TRANSCRIPT
![Page 1: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/1.jpg)
#atlassian
![Page 2: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/2.jpg)
NOTES:
• Your main title goes in the large blue
font.
• If you have a title that naturally splits
into a subtitle, use the smaller green
font for the subtitle. If not, delete the
subtitle
PHOTO
1. Place your photo at around the
same size as the example photo
2. (Keynote users:) Move your photo
onto the blue shape below Select both
photo and shape and then choose
“Mask with selected shape” from the
menu. Double click the photo to edit
the scale and crop position.
ZANE SALIM • SENIOR TECHNICAL PM • TWITTER • @ZANES
Scaling Product Experimentation with JIRA and Confluence
![Page 3: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/3.jpg)
Technology is wiping out companies faster than ever
![Page 4: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/4.jpg)
![Page 5: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/5.jpg)
Companies that stop innovating die… fast
![Page 6: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/6.jpg)
NOTES:
• If you want to divide your talk
into chapters, use this slide for
Chapter titles
How are you innovating?
![Page 7: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/7.jpg)
1. Our approach @twitter
2. Challenges at scale 3. How we scaled 4. What got better
5. Final takeaways
![Page 8: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/8.jpg)
1. Our approach @Twitter
![Page 9: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/9.jpg)
NOTES:
• If you want to divide your talk
into chapters, use this slide for
Chapter titles
@Twitter we innovate through experimentation
![Page 10: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/10.jpg)
Anyone can launch an experiment
![Page 11: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/11.jpg)
Unleashes creativity
![Page 12: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/12.jpg)
Drives user insights at scale
![Page 13: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/13.jpg)
100s every quarter
![Page 14: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/14.jpg)
Experimentation is the new black
![Page 15: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/15.jpg)
… and the old black
“Negative results are just what I want. They’re just as valuable to me as positive results. I can never find the thing that does the job best until I find the ones that don’t.”
― Thomas Edison, Harper’s Magazine (Vol. 165, p 405)
“We must conduct research and then accept the results. If they don't stand up to experimentation, Buddha's own words must be rejected.”
― Dalai Lama XIV, A Policy of Kindness (p 31)
“There must be some ability to experiment to advance the state of the art… In the early days of aviation there was a great deal of experimentation and a high death rate. We don't want that … but by the same token we can't have a situation where no deaths are ever allowed, because that would put innovation in a coffin too.”
– Elon Musk, L.A. Times interview (August 1, 2012)
“There’s a wonderful thing about learning as a group. A fundamental part of that is making mistakes together. There’s no learning without trying lots of ideas and failing lots of times.”
― Jony Ive, Telegraph interview (May 23, 2012)
![Page 16: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/16.jpg)
Both refinement and exploration
![Page 17: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/17.jpg)
Example: which drives more clicks?
![Page 18: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/18.jpg)
Example: which drives more retention?
![Page 19: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/19.jpg)
2. Challenges at scale
![Page 20: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/20.jpg)
Visibility
![Page 21: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/21.jpg)
Learning
![Page 22: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/22.jpg)
Collaboration
![Page 23: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/23.jpg)
Rigor
![Page 24: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/24.jpg)
3. How we scaled
![Page 25: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/25.jpg)
COMMON JIRA WORKFLOW FOR COLLABORATION
![Page 26: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/26.jpg)
Lifecycle of an Experiment
![Page 27: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/27.jpg)
Lifecycle of an Experiment in JIRA
![Page 28: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/28.jpg)
Lifecycle of an Experiment in JIRA
![Page 29: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/29.jpg)
KNOWLEDGE MANAGEMENT IN
CONFLUENCE
![Page 30: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/30.jpg)
Confluence: Knowledge Management
![Page 31: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/31.jpg)
Confluence: Experiment Brief Templates
![Page 32: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/32.jpg)
Confluence: Experiment Brief Templates
Experiment Brief Experiment Write-up Retrospective Analysis
Describe the problem Describe the experiment Present retrospective analysis
Define a hypothesis Present the results Present the results
Design the experiment Offer take-away’s Offer take-away’s
![Page 33: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/33.jpg)
Confluence: Reviewed Experiments & Learning
![Page 34: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/34.jpg)
HYPOTHESIS TREES
![Page 35: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/35.jpg)
Visualizing Focus Areas & Insights
![Page 36: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/36.jpg)
4. What got better
![Page 37: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/37.jpg)
Doubled completed experiments
![Page 38: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/38.jpg)
Reduced cycle time up to 50%
![Page 39: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/39.jpg)
Learning org à smarter experiments
![Page 40: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/40.jpg)
5. Final takeaways
![Page 41: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/41.jpg)
Experimentation drives innovation
![Page 42: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/42.jpg)
Collaboration & learning essential
![Page 43: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/43.jpg)
Smart use of tools can make you 4x more effective
![Page 44: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/44.jpg)
Thank you!
ZANE SALIM • SENIOR TECHNICAL PM • TWITTER • @ZANES
![Page 45: Managing Product Growth Experiments With JIRA and Confluence - Zane Salim](https://reader034.vdocuments.net/reader034/viewer/2022050804/547b9fa3b379596a2b8b4e22/html5/thumbnails/45.jpg)
Example: <made up example experiment>