monitoring at scale over diverse data sources @ paypal ... · monitoring at scale over diverse data...
TRANSCRIPT
![Page 1: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/1.jpg)
Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB,
Hadoop Grafanacon, December 1, 2016
Senthil Pandurangan - Platform Architect
Abhishek Sant – Senior Software Engineer
![Page 2: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/2.jpg)
Agenda
©2016 PayPal Inc. Confidential and proprietary.
• Introduction
• Monitoring Platform Architecture
• Grafana Druid Plugin
• Q & A
![Page 3: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/3.jpg)
PayPal Command Center
Powered by Monitoring Team
3
![Page 4: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/4.jpg)
PayPal Monitoring Ecosystem - Sherlock
4
APIs
LogsProcessing
MetricProcessing
InsightsEngine
Alerts
Visualiza7on
EventsStream
MetricsStream
Topology
LogsStream
Pools&Hosts
PaaS
IaaS
Network
Databases
CAL(Logging)
Remedia7onOrchestra7onConfigura7on
Sherlock is a unified monitoring, alerting and logging platform that exposes real time data and insights, enabled by an extensible visualization platform.
Developers
Analysts
CommandCenter
SRE
![Page 5: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/5.jpg)
Tools & Technologies
©2016 PayPal Inc. Confidential and proprietary.
Storage
Processing
Visualization
![Page 6: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/6.jpg)
Ingest Queue Process Store Query
PayPal Monitoring Platform - Architecture
6
Message B
us
App
Logs
App
A
pp
Servi ces
DB
LB
N
O
SQ L
Met
rics
Stream processing
Met
rics
Logs
Log Views
Hadoop Reports
Custom Visualizations
Alerts
![Page 7: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/7.jpg)
Agenda
©2016 PayPal Inc. Confidential and proprietary.
• Introduction
• Monitoring Platform Architecture
• Grafana Druid Plugin
• Q & A
![Page 8: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/8.jpg)
Grafana Druid Plugin
https://grafana.net/plugins/abhisant-druid-datasource/installation
©2016 PayPal Inc. Confidential and proprietary.
![Page 9: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/9.jpg)
Grafana - Adding Druid Data source
©2016 PayPal Inc. Confidential and proprietary.
![Page 10: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/10.jpg)
Grafana Druid Plugin – Query Editor
©2016 PayPal Inc. Confidential and proprietary.
![Page 11: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/11.jpg)
Druid Query Types
©2016 PayPal Inc. Confidential and proprietary.
Time Series
Top N
Group by
Select
![Page 12: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/12.jpg)
Multiple Data sources
©2016 PayPal Inc. Confidential and proprietary.
Time Series
Top N
Group by
Select
TSDB
Druid
Hadoop Reports
![Page 13: Monitoring at Scale over diverse data sources @ PayPal ... · Monitoring at Scale over diverse data sources @ PayPal – Druid, TSDB, Hadoop Grafanacon, December 1, 2016 Senthil Pandurangan](https://reader033.vdocuments.net/reader033/viewer/2022060315/5f0beea77e708231d432ee0d/html5/thumbnails/13.jpg)
Thank You
©2016 PayPal Inc. Confidential and proprietary.