computer vision made simple - matroid.com · reza zadeh elva stainthorp pete sonsini ryan wong...
TRANSCRIPT
![Page 1: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/1.jpg)
Computer Vision Made Simple
Reza Zadeh & Everyone at MatroidTwitter: @Reza_Zadeh, @Matroid
#scaledmlconf
![Page 2: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/2.jpg)
Computer Vision Made Simple
Millions of detectors and streams as easy as this
![Page 3: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/3.jpg)
Outline
Overview of Infrastructure
Matroid Live Demo
New Announcements
![Page 4: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/4.jpg)
Overview of Infrastructure
![Page 5: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/5.jpg)
Kubernetes
Basic unit: Pod
Pods contain one or more containers
Pods are scalable & fault tolerant by K8s
![Page 6: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/6.jpg)
Kubernetes Simplified
Minion
Pod Pod Pod
Minion
Pod Pod Pod
Minion
Pod Pod Pod
Master
![Page 7: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/7.jpg)
Kubernetes Architecture
Source: https://github.com/GoogleCloudPlatform/kubernetes/blob/master/DESIGN.md
![Page 8: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/8.jpg)
Matroid Kubernetes PodsOne pod for each of these services
![Page 9: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/9.jpg)
Video Ingest
Each video stream is a kafka topic
![Page 10: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/10.jpg)
Web Server
nginx routes HTTPS and RTMP
![Page 11: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/11.jpg)
Training & Inference
Deep Learning framework from Google Brain
Happy coincidence: A Matroid is a generalization of a Tensor
Matroid incorporated Oct 2015TensorFlow released Nov 2015
![Page 12: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/12.jpg)
Convolutional Network
Slide a two-dimensional patch over pixels.
Specialized Chips we’ll see presented today.
![Page 13: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/13.jpg)
GPU Machines
Can ask Kubernetes to schedule a pod on a machine with dedicated GPU as of v1.5
Multi-GPU machine support added in v1.6
Auto-scaled based on load
![Page 14: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/14.jpg)
Spot Prices
One pod is always watching out for workers that are going to be evicted because of Spot
Instance marketplace
Brings them up as reserved instance if they are needed to handle load
![Page 15: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/15.jpg)
Matroid
Product is a studio for creating and using “detectors”
Detectors are first class citizens in Matroid
![Page 16: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/16.jpg)
Live Demo
Use Detectors
Create Detectors
Combine Detectors
![Page 17: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/17.jpg)
Elements
A studio for creating and using detectors.
An ever-growing detector library.
Video player with Computer Vision core.
Tight feedback loop for detector iteration.
An extensive API and stream monitoring.
Work-sharing amongst users, with privacy.
![Page 18: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/18.jpg)
Combining DetectorsCombine & chain detectors
Sliding detectors
Import TF Models
Improve on existing detectors
Auto-label with existing detectors
Free TensorFlow Model Hosting
![Page 19: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/19.jpg)
Stream MonitoringIngestion support RTMP, RTSP, Snapshots,
and many others
Same ingestion mechanism as Ustream, Twitch, Youtube Live, typical VMS, etc
Opened to all today – matroid.com/streams
![Page 20: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/20.jpg)
Two new products
![Page 21: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/21.jpg)
Camera Partner
Computer Vision solution for Intel Chips
Compress detector to fit on jointly-developed camera
Camera runs detectors onboard without internet
![Page 22: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/22.jpg)
Matroid On-PremWorkstation disconnected from the internet,
runs Matroid webserver internally
Can monitor streams & make detectors, same as matroid.com
Great for cost-sensitive and privacy-conscious users
![Page 23: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/23.jpg)
Matroid
$13.5 million in funding from world-class partners
![Page 24: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/24.jpg)
Open Source Contributions
![Page 25: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/25.jpg)
Thanks toRyan Tobin
John Goddard
Dong Wang
Deepak Menghani
Medi Monam
Reza Zadeh
Elva Stainthorp
Pete Sonsini
Ryan Wong
Danny Jeck
Julian Bouma
Erfan Noury
Michael Brown
Michael Duignan
Michael Suyat
Kathie Lee
Connie Hikida
Bharath Ramsundar
Brooke Wenig
Sameer Farooqui
Nikhil Parthasarathy
Sagar Vare
Vishakh Hegde
Penny Chronis
![Page 26: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/26.jpg)
Special thanks to
![Page 27: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/27.jpg)
Special thanks to
![Page 28: Computer Vision Made Simple - matroid.com · Reza Zadeh Elva Stainthorp Pete Sonsini Ryan Wong Danny Jeck Julian Bouma ErfanNoury Michael Brown Michael Duignan Michael Suyat Kathie](https://reader031.vdocuments.net/reader031/viewer/2022021912/5c65470609d3f2b26e8c72a3/html5/thumbnails/28.jpg)
Thank you for your attention
Available right now on matroid.com