managing thousands of databases
TRANSCRIPT
![Page 1: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/1.jpg)
MANAGING THOUSANDS OF DATABASE SERVERSEmre Hasegeli
![Page 2: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/2.jpg)
2
TOPICS
2
1
3
4
Configuration
Monitoring
Backups & Replication
Problems
![Page 3: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/3.jpg)
3
![Page 4: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/4.jpg)
4
Debian 8 Jessie
PostgreSQL 9.5 - 9.6
Community packages (dep, rpm)
`puppetlabs-postgresql` module
INSTALLATION
![Page 5: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/5.jpg)
5
INSTALLATION & CONFIGURATION
![Page 6: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/6.jpg)
6
INSTALLATION & CONFIGURATION
![Page 7: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/7.jpg)
7
INSTALLATION & CONFIGURATION
![Page 8: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/8.jpg)
8
INSTALLATION & CONFIGURATION
![Page 9: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/9.jpg)
9
INSTALLATION & CONFIGURATION
![Page 10: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/10.jpg)
10
INSTALLATION & CONFIGURATION
![Page 11: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/11.jpg)
11
INSTALLATION & CONFIGURATION
![Page 12: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/12.jpg)
12
INSTALLATION & CONFIGURATION
![Page 13: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/13.jpg)
13
INSTALLATION & CONFIGURATION
![Page 14: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/14.jpg)
14
INSTALLATION & CONFIGURATION
![Page 15: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/15.jpg)
15
MONITORING
![Page 16: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/16.jpg)
16
MONITORING
https://bucardo.org/wiki/Check_postgres
![Page 17: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/17.jpg)
17
MONITORING
![Page 18: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/18.jpg)
18
MONITORING
![Page 19: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/19.jpg)
19
MONITORING
![Page 20: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/20.jpg)
20
MONITORING
![Page 21: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/21.jpg)
21
MONITORING
![Page 22: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/22.jpg)
22
MONITORING
![Page 23: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/23.jpg)
23
MONITORING
https://labs.consol.de/nagios/check_logfiles/index.html
![Page 24: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/24.jpg)
24
BACKUP & REPLICATION
![Page 25: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/25.jpg)
25
BACKUP & REPLICATION
![Page 26: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/26.jpg)
26
BACKUP & REPLICATION
http://www.pgbarman.org
![Page 27: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/27.jpg)
27
BACKUP & REPLICATION
http://www.repmgr.org
![Page 28: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/28.jpg)
28
CONNECTION POOLING
https://pgbouncer.github.io
![Page 29: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/29.jpg)
29
CONNECTION POOLING
![Page 30: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/30.jpg)
30
CONNECTION POOLING
![Page 31: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/31.jpg)
31
CONNECTION POOLING
![Page 32: Managing thousands of databases](https://reader033.vdocuments.net/reader033/viewer/2022051520/587b36dc1a28ab057d8b73a9/html5/thumbnails/32.jpg)
32
PROBLEMS
Bloat
Unexpected WAL increase
Long running database migrations
Complex failover
pg_upgrade