telemetry onboarding
TRANSCRIPT
Telemetry OnboardingRoberto Vitillo - Firefox Data Engineering Team
Ask a question
Get the data
Analyse the data
Report
TELEMETRY 101
(Base Telemetry)
(Extended Telemetry)
https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/index.html
Real-time
https://pipeline-cep.prod.mozaws.net/
Need help?
S3
Ask a question
Get the data
Analyse the data
Report
Step 1: Ask a question
Step 2: Get the data
Data exists Data exists
Step 2: Get the data
Data exists Data exists
dashboard
KPIs
https://metrics.services.mozilla.com/
https://telemetry.mozilla.org/new-pipeline/dist.html
Performance Need help?
Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o
Datasets
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/choosing_a_dataset.md
Client ID A B
“X” FALSE 42
“Y” TRUE null
“X” FALSE 40
12/12/2016
21/12/2016
01/12/2016
main_summary
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/MainSummary.md
Need help?
longitudinalClient ID A B
“X” [FALSE, FALSE, TRUE] [42, 40, 41]
“Y” [TRUE] [null]
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/Longitudinal.md
Need help?
cross_sectional
Client ID A B
“X” FALSE 41
“Y” TRUE null
mode mean
Need help?
client_countClients A
{“3”} FALSE
{“1”, “2} TRUE
Need help?
crash_aggregates#crashes A B
42 GPU X OSX
12 GPU Y WIN
Need help?
https://github.com/mozilla/telemetry-batch-view/blob/master/docs/CrashAggregateView.md
Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o a.t.m.o
S3
https://wiki.mozilla.org/Telemetry/Custom_analysis_with_spark
Need help?
Step 2: Get the data
Data exists Data exists
dashboard s.t.m.o a.t.m.o add a probe
https://docs.google.com/document/d/11wM2RJkHAqYF-4xgL5tHwA621IUQEaf4vecuC-hqnzk/edit#heading=h.tkrw9ahjfrcp
New ping?
Need help?
https://gecko.readthedocs.io/en/latest/toolkit/components/telemetry/telemetry/collection/scalars.html
https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Adding_a_new_Telemetry_probe
Need help?
Need help?
http://alerts.telemetry.mozilla.org
https://wiki.mozilla.org/Firefox/Data_Collection
https://www.mozilla.org/en-US/privacy/
Owner: Benjamin Smedberg Peers: Chenxia Liu, François Marier, Ally Naagktgeboren, Rebecca Weiss
Ask a question
Get the data
Analyse the data
Report
Ask a question
Get the data
Analyse the data
Report
#datapipeline#telemetry
https://wiki.mozilla.org/Telemetryhttps://wiki.mozilla.org/CloudServices/DataPipeline