新浪 杨海朝 redis运维之道
DESCRIPTION
中国互联网运维高峰论坛TRANSCRIPT
![Page 2: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/2.jpg)
议题
1.redis应用历程2.redis部署场景3.运维道与术4.挑战
![Page 3: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/3.jpg)
redis规模
国际上最大的redis用户?
![Page 4: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/4.jpg)
数据结构需求
Data Structure需求越来越多:listhashessetssort sets
Memcached,MemcacheDB某些场合成为历史
![Page 5: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/5.jpg)
性能需求
Scale-upScale-outScale-up MySQL又遇到瓶颈
<1%的Cache miss >> MySQL集群能支持的最大并发
多次Query带来的性能消耗越来越凸现
![Page 6: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/6.jpg)
可靠性需求
Cache的“雪崩”问题让人纠结
Cache面临着快速恢复的挑战
![Page 7: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/7.jpg)
开发成本需求
Cache和DB的一致性维护成本越来越高
开发需要跟上不断涌入的产品需求
![Page 8: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/8.jpg)
redis部署场景
![Page 9: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/9.jpg)
redis部署场景
Application Redis
![Page 10: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/10.jpg)
redis部署场景
MySQL Mytrigger Multi Redis
![Page 11: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/11.jpg)
redis部署场景
MySQLMytriggerQQueue ProcesorMulti Redis
![Page 12: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/12.jpg)
redis部署场景
Redis MySQL
![Page 13: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/13.jpg)
运维的道与术
![Page 14: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/14.jpg)
sharding问题
多端口规划避免sharding
增加replication的filter功能
![Page 15: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/15.jpg)
replication问题
基于rdb的replication基于position的rdb + aof方式aof文件大小可以定制aof文件可以自动过期(避免bgrewriteaof)
![Page 16: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/16.jpg)
performance和load问题
sorted sets限制数据类型: filed int, score int内存结构直接存入rdb
hashes内存结构直接存入rdb
rediscounterkey: hash处理 value: int (16bit)
![Page 17: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/17.jpg)
php客户端
改善phpredis, rediska的长连接问题redisproxy:
php(socket) redisproxy server(长连接)redis
![Page 18: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/18.jpg)
failover问题
master/slaves
多套部署
开发监控系统
实现cron bgsave
![Page 19: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/19.jpg)
其他改进
bgsave带来aof写入很慢fdatasync在做bgsave时不做sync aof
多核利用问题taskset
统计信息total_read_requeststotal_write_requests
![Page 20: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/20.jpg)
挑战
![Page 21: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/21.jpg)
挑战
Cache还是Store?
![Page 22: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/22.jpg)
挑战
完全代替Memcached?
![Page 23: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/23.jpg)
挑战
不可避免的sharding问题如何优雅处理?
![Page 24: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/24.jpg)
挑战
双写的容灾机制导致基础设施成本增加?
![Page 25: 新浪 杨海朝 Redis运维之道](https://reader034.vdocuments.net/reader034/viewer/2022050704/54b799794a7959d2628b45ac/html5/thumbnails/25.jpg)
挑战
规模越来越大时如何减少运维成本?