logging instrumentation dashboards alerts - for developersinstrumentation most often forgotten...
TRANSCRIPT
![Page 1: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/1.jpg)
Logging
Instrumentation
Dashboards
Alerts
- for developers
![Page 2: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/2.jpg)
WONDERING WHO
IS THAT GUY?
HENRY BEEN
Independent Devops & Azure Architect
E: [email protected]: @henry_beenL: linkedin.com/in/henrybeenW: henrybeen.nl
![Page 3: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/3.jpg)
Very boring part
Pretty boring part
Maybe boring part
Amazing part
Really amazing part
Mindblowing part
LOGGING, INSTRUMENTATION, DASHBOARDS & ALERTS
![Page 4: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/4.jpg)
A bit of monitoring theory
What to monitor
Demo’s!
LOGGING, INSTRUMENTATION, DASHBOARDS, ALERTS
![Page 5: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/5.jpg)
MONITORING
-or-
KNOWING WHAT BE HAPPENING
![Page 6: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/6.jpg)
InstrumentationMost often forgotten
Concerned with metrics
• (Timestamp, value) tuples
• Events & values
• Dimensions
• Used for Dashboards & Alerts
Rolled up over time
LoggingOften combined with tracing
Concerned with state changes
• When
• By who
• What changed
• Can a source of metrics
Retained for longer or indefinitly
TracingUsed for troubleshooting
What we developers call logging
• When
• Code location
• Very, very verbose message
• Can a source of metrics
Retained for a limited time
MONITORING
![Page 7: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/7.jpg)
VM / container
TimeseriesDatabase
Application Instance AgentSDK
LoggingDatabase
Https endpoint
Visualization Engine
Your Dashboards
Query Engine
Your Alerts
Streaming Data Engine
![Page 8: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/8.jpg)
BUT HEY THAT STUFFIS OPERATIONS…
WHY WOULD I CARE?
![Page 9: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/9.jpg)
DEVOPS POWERRRR
![Page 10: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/10.jpg)
• DevOps is the union of people, process, and products to enable continuous delivery of value to your end users.
“
”
DEVOPS
![Page 11: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/11.jpg)
OKAY, OKAY I CARE…NOW, WHAT TO MONITOR?
![Page 12: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/12.jpg)
OKAY, OKAY I CARE…NOW, WHAT NOT TO MONITOR?
![Page 13: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/13.jpg)
WHAT NOT TO DO
FOCUS ON AVERAGESAverages are lying cheats and hide real issues!
• Use dimensions to find outliers
• Use maximums or percentiles to identify spread
FOCUS ON YOUR SYSTEMSDo you think your users care? At all?
• Is the amount of disk IO really interesting?
• Does page file usage predict conversion?
To add some nuance:
- Some system metrics are handy, just don’t start there maybe
- Same goes for averages
![Page 14: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/14.jpg)
0
20
40
60
80
100
120
Database load(%)
DO WE HAVE AN ISSUE?
Proposed alert
![Page 15: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/15.jpg)
ARE MY USERS HAPPY?
0
20
40
60
80
100
120
140
160
Average response time
![Page 16: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/16.jpg)
0
200
400
600
800
1000
1200
Average response time and maximum response time
Average response time Maximum response time
ARE MY USERS HAPPY?
![Page 17: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/17.jpg)
0
100
200
300
400
500
600
700
800
900
Average response time and response time per operation
Average response time View item AddToBasket
ARE MY USERS HAPPY?
![Page 18: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/18.jpg)
PERCENTILES!
PERCENTILES!
PERCENTILES!
![Page 19: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/19.jpg)
MEASURE THINGSTHE USER CARES ABOUT
AND THINK IT THROUGH!
![Page 20: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/20.jpg)
Let’s do a Quick Demo!
Demo
![Page 21: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/21.jpg)
A VERY GOOD BOOKALSO QUITE THIN
![Page 22: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/22.jpg)
FOR THOSE USING AZUREHOW WOULD YOU DO IT?
![Page 23: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/23.jpg)
DEMO TIME!A Todo Application…
ALMOST
![Page 24: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/24.jpg)
POST UrlShortner AddAliasProcessor
SQL Database
GET UrlShortner
![Page 25: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/25.jpg)
VM / container
TimeseriesDatabase
Application Instance AgentSDK
LoggingDatabase
Https endpoint
Visualization Engine
Your Dashboards
Query Engine
Your Alerts
Streaming Data Engine
![Page 26: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/26.jpg)
Two more things
“YOU CAN USE THE DEMOS!”
“AND YOU CAN USE THE DEMOS!”
“EVERYBODY CAN USE THE DEMOS!”
DASHBOARDS AND ALERTS
AS CODE
![Page 27: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/27.jpg)
Questions?
Now is the time!
![Page 28: Logging Instrumentation Dashboards Alerts - for developersInstrumentation Most often forgotten Concerned with metrics •(Timestamp, value) tuples •Events & values •Dimensions](https://reader033.vdocuments.net/reader033/viewer/2022042314/5ee46429ad6a402d666d825d/html5/thumbnails/28.jpg)
DO TRY THIS AT HOME!
HENRY BEEN
Independent Devops & Azure Architect
E: [email protected]: @henry_beenL: linkedin.com/in/henrybeenW: henrybeen.nl