redisconf 2016 - redis usage and ecosystem

28
Redis usage & ecosystem insights Looking at our data at

Upload: francois-guillaume-ribreau

Post on 16-Jan-2017

272 views

Category:

Technology


2 download

TRANSCRIPT

Redis usage & ecosystem insights

Looking at our data at

An online service for administrating and monitoring Redis servers and Redis clusters

Data & batch atomic (CAS) editor Redis Monitoring & Alerting Modern contextual terminal

Built for and ensure safe production Cloud ready

Redis LUA Editor, Real-time data-viz Slowlog, client list, cluster nodes,

configuration with inline-documentation…

10,000 developers and companies trust us from 2 155 cities around the globe.

Connecting Redis servers to Redsmin

TLS encrypted connection

Internet

Two ways to connect your Redis servers to Redsmin

Internet

Two ways to connect your Redis servers to Redsmin

Option A Accessible from internet,

direct connection

Azure Redis Cache (TLS/SSL)

Self hosted on EC2 (e.g. plain text)

Redis on DBaaS (plain text or TLS)

Internet

Two ways to connect your Redis servers to Redsmin

Option A Accessible from internet,

direct connection

Option B Behind the firewall, proxied

connection with Redsmin Proxy

Azure Redis Cache (TLS/SSL)

Self hosted on EC2 (e.g. plain text)

Redis on DBaaS (plain text or TLS) Your own server

on a private network

Redsmin Proxy daemon

Amazon Elasticache

Redsmin Proxy daemon

From your laptop

Redsmin Proxy daemon

Internet

Redis Ecosystem

Version distributionMajor/Minor versions

3.0 42 %

2.8 57 %

2.6 1 %

Uptime in years

4 2 %

3 14 %

2 18 %

<1 66 %

Redis 3.0 Beta 1 was released on 2014/02/11, Redis 2.8 2013/08/21, considering Redis amazing uptime there may be a correlation between the two.

Fun fact: we excluded one result, a Redis server reported us an uptime of 44 years

Data from publicly available and behind the firewall Redis servers

Redis Security

Security

Data from publicly available Redis servers

Security

Data from publicly available Redis servers

Redis Connection

8 %

92 %

Plain text SSL/TLS

SecurityRedis authentication

40 %

60 %

without AUTH with AUTH

Data from publicly available Redis servers

Redis Connection

8 %

92 %

Plain text SSL/TLS

SecurityRedis authentication

40 %

60 %

without AUTH with AUTH

Data from publicly available Redis servers

Redis Connection

8 %

92 %

Plain text SSL/TLS

Feedback: 60% of the Redis servers we handle are opened to internet without auth. Hopefully v3.2 introduces Redis protected mode!

Any slow command pattern?

Slow commands

Data from publicly available and behind the firewall Redis servers

Slow commands

Slowlog Disabled 39 %

Slowlog enabled 61 %

Data from publicly available and behind the firewall Redis servers

Slow commands

Slowlog Disabled 39 %

Slowlog enabled 61 %

9% of servers have KEYS command in their slowlog

Data from publicly available and behind the firewall Redis servers

Slow commands

Slowlog Disabled 39 %

Slowlog enabled 61 %

9% of servers have KEYS command in their slowlog

Slow commands were most of the time long variadic or

synchronous commands.

Data from publicly available and behind the firewall Redis servers

Memory optimization

“Redis compiled with 32 bit target uses a lot less memory per key, since pointers are small, but such an instance will be limited to 4 GB of maximum memory usage.“ — http://redis.io/topics/memory-optimization

Data from publicly available and behind the firewall Redis servers

“Redis compiled with 32 bit target uses a lot less memory per key, since pointers are small, but such an instance will be limited to 4 GB of maximum memory usage.“ — http://redis.io/topics/memory-optimization

Redis servers

32 bit 1 %

64 bit 99 %

Data from publicly available and behind the firewall Redis servers

“Redis compiled with 32 bit target uses a lot less memory per key, since pointers are small, but such an instance will be limited to 4 GB of maximum memory usage.“ — http://redis.io/topics/memory-optimization

Redis servers

32 bit 1 %

64 bit 99 %

64 bit Redis used memory

More than 4 GB 3 %

Less than 4 GB 97 %

Fact: 97% of Redis servers are using less than 4Gb but are running on 64 bit.

Data from publicly available and behind the firewall Redis servers

Unbounded Memory?

MaxMemory

Data from publicly available and behind the firewall Redis servers

MaxMemorymaxmemory overview

set 9 %

not set 91 %

maxmemory values

32-180Go 15 %16-32Go

2 %

11-16Go 19 %

5-10Go 19 %

1-4Go 44 %

Data from publicly available and behind the firewall Redis servers

MaxMemorymaxmemory overview

set 9 %

not set 91 %

maxmemory values

32-180Go 15 %16-32Go

2 %

11-16Go 19 %

5-10Go 19 %

1-4Go 44 %

Feedback: why not warn users to set max-memory? Memory is not unlimited. Then if maxmemory is set up to <4Go and arch=64bit,

why not recommend the use of 32 bit Redis instead of 64 bit?Data from publicly available and behind the firewall Redis servers

Redis usage & ecosystem insights

Thanks for listening!

Redsmin (Redis GUI) redsmin.com Redis Weekly redisweekly.com

@FGRibreau