webinar slides: clustercontrol 1.4: the mysql replication & mongodb edition - live demo

Confidential

ClusterControl 1.4.0

Feb 2016

Johan Andersson

CTO, Severalnines

[email protected]

Confidential

Customers

2

Copyright Severalnines AB

Confidential

What Problems do we Address?

3

Copyright 2012 Severalnines AB

Manage Scale

Monitor Deploy

Confidential

Management - Beyond Monitoring

4


Confidential

ClusterControl DSL - Automation Programs

5


Confidential

What’s new in 1.4.0?

¤  MySQL Replication

¤  ProxySQL Support

¤  Group Replication (BETA)

¤  MongoDB

¤  ..and a number of other things

6


Confidential

MySQL Replication

¤  Create Master – Slave, Multi-Master setups

¤  Automatic and Manual Failover

¤  Rebuild failed replication slaves

¤  Reconfiguration of the topology.


7

M1

S1 S2

Confidential

MySQL Replication - Deploy


8

Data Center 1 Data Center 2

M1 M2

S1 S2

•  M1 is the active master and WRITABLE

•  S1 and S2 are read only slaves

•  M2 is a stand by in case DC1 fails hard. Read only.

Confidential

ClusterControl - Tips

¤  Manual operations (outside ClusterControl): Disable Node/Cluster Recovery, Enter Maintenance Mode. ¤  Now you can do manual changes

¤  ClusterControl manages the Cluster (e.g read-only settings) ¤  If you want to manage the read-only settings

then set ‘auto_manage_readonly=0’ in /etc/cmon.d/cmon_x.cnf and restart cmon.

9


Confidential

MySQL Replication - Failover

¤  Failover is automatic or manual ¤  Control with “Enable Cluster Recovery”

¤  On = Automatic ¤  Off = Manual

¤  One attempt to failover is made

¤  Checks for errant transactions ¤  Aborts failover if detected

¤  Elects a new master among the slave(s) ¤  Elect the slave with the least lag,

least problems, and most data. ¤  If no slave found, then failover will not happen.


10

M1

S1 S2

Confidential

MySQL Replication – Failover – More Control!

¤  Fine tune the failover behavior: ¤  replication_stop_on_error = 1 (default)

Ignore errors like errant transactions and force the failover ¤  replication_failover_blacklist=<comma separated list of nodes>

Comma separated list of hostname:port pairs. Blacklisted servers will not be considered as a candidate during failover. Ignored if replication_failover_whitelist is set.

¤  replication_failover_whitelist=<comma separated list of nodes> Comma separated list of hostname:port pairs. Only whitelisted servers will be considered as a candidate during failover. Takes precedence over replication_failover_blacklist.

¤  replication_failover_wait_to_apply_timeout=-1 (Default), candidate will wait forever to try and apply outstanding transactions from another slave and relay log in case of failover. 0 means failover immediately, else specify a time limit in seconds.

¤  These options are set in /etc/cmon.d/cmon_x.cnf. Restart cmon.


11

Confidential

MySQL Replication – Rebuild Slave


12

Data Center 1

M1

S1 S2

•  If a slave gets corrupted then it can be rebuilt by a user command

•  An xtrabackup is taken from the selected

server and streamed to the slave

•  The backup is applied on the slave

•  Replication is started (CHANGE MASTER, START SLAVE)

Confidential

MySQL Replication – Topology Change


13

Data Center 1

M1

S1 S2

Data Center 1

M1

S1

S2

Confidential

MySQL Replication – Topology Change (Switchover)


14

Data Center 1

M1

S1 S2

Data Center 1

S2

S1 M1

Confidential

ProxySQL Support

¤  ProxySQL is a highly customizable, high performing load balancer for MySQL supporting MySQL Replication, Galera, Group Replication

¤  Integrates with ClusterControl-triggered failover of MySQL Replication

¤  Deployment

¤  Monitoring (phase 1)


15

Confidential

ProxySQL – Deploy with Ease!


16

Confidential

Group Replication (BETA)

¤  Create a Group Replication Cluster ¤  Similar to Galera with a

slight difference: ¤  One writable master, the

rest are super_read_only=true and read_only = true

¤  Add replication slaves

¤  Experimental support for ¤  Rebuilding failed group

replication servers ¤  Automatic failure

handling


17

Data Center 1

M1 S1 S2

Virtual synchronous (like Galera)

•  M1 writable (read_only=false super_read_only=false)

•  S1 read_only=true super_read_only=true

•  S2 read_only=true super_read_only=true

Confidential

MongoDB

¤  Deploy in an automated and secure way ¤  Single node / Replica Set /Shard

¤  Scale ¤  Add nodes to the Replica Set ¤  Convert a Replica Set to a Sharded

Cluster ¤  Add / Remove Shards ¤  Add/ Remove Mongos/Routers to a

Sharded Cluster

¤  Additional features includes: ¤  Backup/Restore ¤  Step down or Freeze a node ¤  New Advisors


18

P

P – PRIMARY, Sx = SECONDARY

P

S1 S2

Confidential

MongoDB - Convert a Replica Set to a Sharded Cluster


19

P

S1 S2


P

S1 S2 Config Servers

Mongos/Routers …

Confidential

MongoDB – Scale With Shards


20


P

S1 S2 Config Servers

Mongos/Routers …

P

S1 S2

+

Confidential

MongoDB - Advisors


21

Confidential

MongoDb - Advisors

¤  Security ¤  Is Authentication enabled? ¤  Too Permissive passwords?

¤  Replication ¤  Is the Secondaries lagging?

¤  Connections ¤  Concurrency tickets ¤  # connections

¤  Sharding ¤  Are all collections sharded, and which ones are not?


22

Confidential

Other

¤  Backup ¤  New Improved UI

¤  New Operational Report: ¤  Packages upgrade report ¤  Get information if there are new database packages and other

security packages available (MySQL based clusters)

¤  Activity Viewer

¤  Send Clear notification when Cluster Fail/Node Fails have been resolved.

¤  Maintenance Mode – Schedule maintenance. ¤  Silences alarm ¤  Best Practice: Disable Node/Cluster Recovery if you plan to make

manual changes.

23


Confidential

24


Confidential

Getting Started ¤  Dedicated VM for the controller

¤  Specs ¤  2 CPU cores ¤  2-4GB RAM ¤  20GB diskspace

¤  No agents ¤  Host stats gathered via SSH

¤  Installation ¤  YUM/APT ¤  Setup SSH access from the Controller to the DB nodes ¤  https://severalnines.com/download-clustercontrol-database-

management-system

25


Confidential

QA

26


Confidential

Resources

¤  ClusterControl product pages: https://severalnines.com/product/clustercontrol

¤  Download ClusterControl: https://severalnines.com/download-clustercontrol-database-management-system

¤  ClusterControl Documentation: https://severalnines.com/docs/

¤  Severalnines YouTube Channel: https://www.youtube.com/channel/UCIwrdGe5hOTmI9oG_ye8hOA

¤  Severalnines Blog: https://severalnines.com/blog


27

webinar slides: clustercontrol 1.4: the mysql replication & mongodb edition - live demo

Internet