Redis集群简介
通过前面三篇博客的介绍《Redis基础认识及常用命令使用(一)--技术流ken》，《Redis基础知识补充及持久化、备份介绍(二)--技术流ken》，《Redis主从复制、多实例、高可用(三)--技术流ken》，现在已经对redis的基础知识，常用命令，持久化，备份，主从复制，多实例的安装以及redis的高可用熟练掌握了。本篇博客将介绍redis cluster集群，也是一个比较复杂的内容，本篇博客将采用较为简洁的方式来呈现redis集群。
有关redis集群的介绍可以参考下面我摘自redis官网的简介。
Redis 集群是一个可以在多个 Redis 节点之间进行数据共享的设施（installation）。
Redis 集群不支持那些需要同时处理多个键的 Redis 命令， 因为执行这些命令需要在多个 Redis 节点之间移动数据， 并且在高负载的情况下， 这些命令将降低 Redis 集群的性能， 并导致不可预测的行为。
Redis 集群通过分区（partition）来提供一定程度的可用性（availability）： 即使集群中有一部分节点失效或者无法进行通讯， 集群也可以继续处理命令请求。
Redis 集群提供了以下两个好处：
- 将数据自动切分（split）到多个节点的能力。
- 当集群中的一部分节点失效或者无法进行通讯时， 仍然可以继续处理命令请求的能力。 --摘自redis官网
总而言之，redis集群实现了数据的共享以及去中心化。
Redis集群实现
实现redis集群，现在采用一台服务器安装6个redis实例，有关如果安装多实例的详细讲解请参考我上篇博客《Redis主从复制、多实例、高可用(三)--技术流ken》
6个多实例，三个为主节点，三个为从节点
环境：
CentOS Linux release 7.5.1804 (Core)
redis-4.0.11
创建多实例
第一步：创建多实例数据目录
1root@ken ~]# mkdir /ken 2[root@ken ~]# cd /ken 3[root@ken ken]# mkdir 6379 6380 6381 6382 6383 6384 4[root@ken ken]# ls 56379 6380 6381 6382 6383 6384
第二步：上传redis安装包
这里使用的是redis-4.0.11的版本，可以在redis官方网站进行下载https://redis.io/
[root@ken ~]# rz
第三步：解压安装包
[root@ken ~]# tar xf redis-4.0.11.tar.gz
第四步：复制解压安装包的配置文件到6379目录下
[root@ken ~]# cp redis-4.0.11/redis.conf /ken/6379/
第五步：移动redis解压包至/usr/local/redis下
[root@ken ~]# mv redis-4.0.11 /usr/local/redis
第六步：编译安装
1[root@ken ~]# cd /usr/local/redis[root@ken redis]# make && make install 2 3[root@ken ~]# ln /usr/local/redis/src/ /bin -s
第七步：修改配置文件
1[root@ken ~]# grep -E -v "^#|^$" /ken/6379/redis.conf 2bind 10.220.5.137 #绑定本机ip地址 3protected-mode yes 4port 6379 #监听端口 5tcp-backlog 511 6timeout 0 7tcp-keepalive 300 8daemonize yes #后台运行 9supervised no 10pidfile /ken/6379/redis_6379.pid #pid文件保存位置 11loglevel notice 12logfile "" 13databases 16 14always-show-logo yes 15save 900 1 16save 300 10 17save 60 10000 18stop-writes-on-bgsave-error yes 19rdbcompression yes 20rdbchecksum yes 21dbfilename dump.rdb 22dir /ken/6379/ #rdb文件保存位置 23slave-serve-stale-data yes 24slave-read-only yes 25repl-diskless-sync no 26repl-diskless-sync-delay 5 27repl-disable-tcp-nodelay no 28slave-priority 100 29lazyfree-lazy-eviction no 30lazyfree-lazy-expire no 31lazyfree-lazy-server-del no 32slave-lazy-flush no 33appendonly no 34appendfilename "appendonly.aof" 35appendfsync everysec 36no-appendfsync-on-rewrite no 37auto-aof-rewrite-percentage 100 38auto-aof-rewrite-min-size 64mb 39aof-load-truncated yes 40aof-use-rdb-preamble no 41lua-time-limit 5000 42cluster-enabled yes #开启集群 43cluster-config-file nodes-6379.conf #集群文件名称 44cluster-node-timeout 15000 #集群超时时间 45slowlog-log-slower-than 10000 46slowlog-max-len 128 47latency-monitor-threshold 0 48notify-keyspace-events "" 49hash-max-ziplist-entries 512 50hash-max-ziplist-value 64 51list-max-ziplist-size -2 52list-compress-depth 0 53set-max-intset-entries 512 54zset-max-ziplist-entries 128 55zset-max-ziplist-value 64 56hll-sparse-max-bytes 3000 57activerehashing yes 58client-output-buffer-limit normal 0 0 0 59client-output-buffer-limit slave 256mb 64mb 60 60client-output-buffer-limit pubsub 32mb 8mb 60 61hz 10 62aof-rewrite-incremental-fsync yes
第八步：把上面这个修改过的文件复制到其他的实例数据目录之下
1[root@ken ~]# cp /ken/6379/redis.conf /ken/6380/ 2[root@ken ~]# cp /ken/6379/redis.conf /ken/6381/ 3[root@ken ~]# cp /ken/6379/redis.conf /ken/6382/ 4[root@ken ~]# cp /ken/6379/redis.conf /ken/6383/ 5[root@ken ~]# cp /ken/6379/redis.conf /ken/6384/
第九步:修改配置文件
只要使用sed即可进行修改
1[root@ken ~]# sed -i 's/6379/6380/g' /ken/6380/redis.conf 2[root@ken ~]# sed -i 's/6379/6381/g' /ken/6381/redis.conf 3[root@ken ~]# sed -i 's/6379/6382/g' /ken/6382/redis.conf 4[root@ken ~]# sed -i 's/6379/6383/g' /ken/6383/redis.conf 5[root@ken ~]# sed -i 's/6379/6384/g' /ken/6384/redis.conf
第十步：启动各个实例
1[root@ken ~]# redis-server /ken/6380/redis.conf 2[root@ken ~]# redis-server /ken/6381/redis.conf 3[root@ken ~]# redis-server /ken/6382/redis.conf 4[root@ken ~]# redis-server /ken/6383/redis.conf 5[root@ken ~]# redis-server /ken/6384/redis.conf 6[root@ken ~]# ss -tnl 7State Recv-Q Send-Q Local Address:Port Peer Address:Port 8LISTEN 0 128 10.220.5.137:16380 *:* 9LISTEN 0 128 10.220.5.137:16381 *:* 10LISTEN 0 128 10.220.5.137:16382 *:* 11LISTEN 0 128 10.220.5.137:16383 *:* 12LISTEN 0 128 10.220.5.137:16384 *:* 13LISTEN 0 128 *:10050 *:* 14LISTEN 0 128 *:10051 *:* 15LISTEN 0 128 10.220.5.137:6379 *:* 16LISTEN 0 128 10.220.5.137:6380 *:* 17LISTEN 0 128 10.220.5.137:6381 *:* 18LISTEN 0 128 10.220.5.137:6382 *:* 19LISTEN 0 128 10.220.5.137:6383 *:* 20LISTEN 0 128 *:111 *:* 21LISTEN 0 128 10.220.5.137:6384 *:* 22LISTEN 0 128 *:22 *:* 23LISTEN 0 128 10.220.5.137:16379 *:* 24LISTEN 0 128 :::10050 :::* 25LISTEN 0 128 :::10051 :::* 26LISTEN 0 70 :::3306 :::* 27LISTEN 0 128 :::111 :::* 28LISTEN 0 128 :::80 :::* 29LISTEN 0 128 :::22 :::*
安装ruby2.3
实现redis cluster功能，依赖redis-trib.rb，而这个工具是依赖一个ruby开发工具包的，所以需要安装ruby环境，并安装依赖包
第一步:上传解压安装包
1[root@ken ~]# rz 2[root@ken ~]# tar xf ruby-2.3.5.tar.gz
第二步：编译安装
建议虚拟机内存至少1个G以上
1[root@ken ~]# cd ruby-2.3.5/ 2[root@ken ruby-2.3.5]# ./configure --prefix=/usr/local/ruby && make && make install
第三步：安装redis-trib.rb的依赖
1[root@ken ~]# ln -s /usr/local/ruby/bin/gem /bin 2[root@ken ~]# gem install -l redis-3.3.0.gem 3Successfully installed redis-3.3.0 4Parsing documentation for redis-3.3.0 5Installing ri documentation for redis-3.3.0 6Done installing documentation for redis after 0 seconds 71 gem installed[root@ken ~]# ln -s /usr/local/ruby/bin/ruby /bin
获取集群帮助
只需要输入redis-trib.rb回车即可
1[root@ken ~]# redis-trib.rb 2Usage: redis-trib <command> <options> <arguments ...> 3 4 create host1:port1 ... hostN:portN 5 --replicas <arg> 6 check host:port 7 info host:port 8 fix host:port 9 --timeout <arg> 10 reshard host:port 11 --from <arg> 12 --to <arg> 13 --slots <arg> 14 --yes 15 --timeout <arg> 16 --pipeline <arg> 17 rebalance host:port 18 --weight <arg> 19 --auto-weights 20 --use-empty-masters 21 --timeout <arg> 22 --simulate 23 --pipeline <arg> 24 --threshold <arg> 25 add-node new_host:new_port existing_host:existing_port 26 --slave 27 --master-id <arg> 28 del-node host:port node_id 29 set-timeout host:port milliseconds 30 call host:port command arg arg .. arg 31 import host:port 32 --from <arg> 33 --copy 34 --replace 35 help (show this help) 36 37For check, fix, reshard, del-node, set-timeout you can specify the host and port of any working node in the cluster.
创建redis集群
命令的意义如下：
- 给定
redis-trib.rb程序的命令是create， 这表示我们希望创建一个新的集群。 - 选项
--replicas 1表示我们希望为集群中的每个主节点创建一个从节点。 - 之后跟着的其他参数则是实例的地址列表， 我们希望程序使用这些地址所指示的实例来创建新集群。
简单来说， 以上命令的意思就是让 redis-trib 程序创建一个包含三个主节点和三个从节点的集群。
接着， redis-trib 会打印出一份预想中的配置给你看， 如果你觉得没问题的话， 就可以输入 yes ， redis-trib 就会将这份配置应用到集群当中：
1[root@ken ~]# redis-trib.rb create --replicas 1 10.220.5.137:6379 10.220.5.137:6380 10.220.5.137:6381 10.220.5.137:6382 10.220.5.137:6383 10.220.5.137:6384 2>>> Creating cluster 3>>> Performing hash slots allocation on 6 nodes... 4Using 3 masters: 510.220.5.137:6379 610.220.5.137:6380 710.220.5.137:6381 8Adding replica 10.220.5.137:6383 to 10.220.5.137:6379 9Adding replica 10.220.5.137:6384 to 10.220.5.137:6380 10Adding replica 10.220.5.137:6382 to 10.220.5.137:6381 11>>> Trying to optimize slaves allocation for anti-affinity 12[WARNING] Some slaves are in the same host as their master 13M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 14 slots:0-5460 (5461 slots) master 15M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 16 slots:5461-10922 (5462 slots) master 17M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 18 slots:10923-16383 (5461 slots) master 19S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 20 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 21S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 22 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 23S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 24 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 25Can I set the above configuration? (type 'yes' to accept): yes #输入yes 26>>> Nodes configuration updated 27>>> Assign a different config epoch to each node 28>>> Sending CLUSTER MEET messages to join the cluster 29Waiting for the cluster to join..... 30>>> Performing Cluster Check (using node 10.220.5.137:6379) 31M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 32 slots:0-5460 (5461 slots) master 33 1 additional replica(s) 34M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 35 slots:10923-16383 (5461 slots) master 36 1 additional replica(s) 37M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 38 slots:5461-10922 (5462 slots) master 39 1 additional replica(s) 40S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 41 slots: (0 slots) slave 42 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 43S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 44 slots: (0 slots) slave 45 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 46S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 47 slots: (0 slots) slave 48 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 49[OK] All nodes agree about slots configuration. 50>>> Check for open slots... 51>>> Check slots coverage... 52[OK] All 16384 slots covered.
Redis集群测试
测试 Redis 集群比较简单的办法就是使用 redis-rb-cluster 或者 redis-cli ， 接下来将使用 redis-cli 为例来进行演示：
第一步：登录集群中
一定要加个-c，后面输入哪个端口都可以，这就是redis的区中心化思想
[root@ken ~]# redis-cli -c -h 10.220.5.137 -p 6379
第二步：创建key
可以发现创建的key被分配到了不同的节点
110.220.5.137:6379> keys * 2(empty list or set) 310.220.5.137:6379> set name ken 4-> Redirected to slot [5798] located at 10.220.5.137:6380 5OK 610.220.5.137:6380> set addr jiangsu 7-> Redirected to slot [12790] located at 10.220.5.137:6381 8OK 910.220.5.137:6381> set tel 123445 10-> Redirected to slot [7485] located at 10.220.5.137:6380 11OK 1210.220.5.137:6380> set ege 25 13OK 1410.220.5.137:6380> set gender male 15-> Redirected to slot [15355] located at 10.220.5.137:6381 16OK 1710.220.5.137:6381> keys * 181) "addr" 192) "gender"
第三步：获取key
在端口6381的节点之上没有tel这个key,但是我们仍然可以使用get tel获取到值，这就实现了redis集群的数据共享
110.220.5.137:6381> keys * 21) "addr" 32) "gender" 410.220.5.137:6381> get tel 5-> Redirected to slot [7485] located at 10.220.5.137:6380 6"123445"
在集群中添加新的节点
第一步：创建一个新的实例
1[root@ken ~]# mkdir /ken/6385 2[root@ken ~]# cp /ken/6379/redis.conf /ken/6385/ 3[root@ken ~]# sed -i 's/6379/6385/g' /ken/6385/redis.conf 4[root@ken ~]# redis-server /ken/6385/redis.conf 510461:C 15 Nov 21:21:11.646 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 610461:C 15 Nov 21:21:11.646 # Redis version=4.0.11, bits=64, commit=00000000, modified=0, pid=10461, just started 710461:C 15 Nov 21:21:11.646 # Configuration loaded
第二步：添加该节点到集群中
命令中的 add-node 表示我们要让 redis-trib 将一个节点添加到集群里面， add-node 之后跟着的是新节点的 IP 地址和端口号， 再之后跟着的是集群中任意一个已存在节点的 IP 地址和端口号， 这里我们使用的是 10.220.5.137:6379 。
1[root@ken ~]# redis-trib.rb add-node 10.220.5.137:6385 10.220.5.137:6379 2>>> Adding node 10.220.5.137:6385 to cluster 10.220.5.137:6379 3>>> Performing Cluster Check (using node 10.220.5.137:6379) 4M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 5 slots:0-5460 (5461 slots) master 6 1 additional replica(s) 7M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 8 slots:10923-16383 (5461 slots) master 9 1 additional replica(s) 10M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 11 slots:5461-10922 (5462 slots) master 12 1 additional replica(s) 13S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 14 slots: (0 slots) slave 15 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 16S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 17 slots: (0 slots) slave 18 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 19S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 20 slots: (0 slots) slave 21 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 22[OK] All nodes agree about slots configuration. 23>>> Check for open slots... 24>>> Check slots coverage... 25[OK] All 16384 slots covered. 26>>> Send CLUSTER MEET to node 10.220.5.137:6385 to make it join the cluster. 27[OK] New node added correctly.
第三步:查看
通过 cluster nodes 命令， 我们可以确认新节点10.220.5.137:6385 已经被添加到集群里面了
110.220.5.137:6379> CLUSTER nodes 257753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379@16379 myself,master - 0 1542288244000 1 connected 0-5460 3daf9464ef45d0c73e1ee18f7cc7ddbc7d9719f2d 10.220.5.137:6385@16385 master - 0 1542288242824 0 connected 4ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381@16381 master - 0 1542288244000 3 connected 10923-16383 53a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380@16380 master - 0 1542288242000 2 connected 5461-10922 6640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383@16383 slave 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 0 1542288242000 5 connected 7b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384@16384 slave ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 0 1542288244852 6 connected 81bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382@16382 slave 57753754f4c89054ab14e8ec517604c4fc4c8ed5 0 1542288243844 4 connected
第四步：使添加的新节点为从节点
如果我们打算让新节点成为 10.220.5.137:6379 的从节点， 那么我们只要用客户端连接上新节点， 然后执行以下命令就可以了
1[root@ken ~]# redis-cli -c -h 10.220.5.137 -p 6385 210.220.5.137:6385> CLUSTER REPLICATE 57753754f4c89054ab14e8ec517604c4fc4c8ed5 3OK 4 5其中57753754f4c89054ab14e8ec517604c4fc4c8ed5是主节点10.220.5.137:6379的id
对redis中的数据做重新分片
[root@ken ~]# redis-trib.rb reshard 10.220.5.137:6379
你只需要指定集群中其中一个节点的地址， redis-trib 就会自动找到集群中的其他节点。
How many slots do you want to move (from 1 to 16384)? 1000
我们将打算移动的槽数量设置为 1000 个。
What is the receiving node ID? 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d
定目标需要使用节点的 ID ， 而不是 IP 地址和端口。 比如说， 我们打算使用集群的第一个主节点来作为目标， 它的 IP 地址和端口是 10.220.5.137:6380 ， 而节点 ID 则是3a9aa9592afc594c7e4206cc82ffb37d46a5b23d ， 那么我们应该向 redis-trib 提供节点的 ID
Source node #1:ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8
接着， redis-trib 会向你询问重新分片的源节点（source node）， 也即是， 要从哪个节点中取出 1000 个哈希槽， 并将这些槽移动到目标节点上面。
1Source node #2:done 2 3Do you want to proceed with the proposed reshard plan (yes/no)? yes
输入 yes 并使用按下回车之后， redis-trib 就会正式开始执行重新分片操作， 将指定的哈希槽从源节点一个个地移动到目标节点上面
1Moving slot 12905 from 10.220.5.137:6381 to 10.220.5.137:6380: 2Moving slot 12906 from 10.220.5.137:6381 to 10.220.5.137:6380: 3Moving slot 12907 from 10.220.5.137:6381 to 10.220.5.137:6380: 4Moving slot 12908 from 10.220.5.137:6381 to 10.220.5.137:6380: 5Moving slot 12909 from 10.220.5.137:6381 to 10.220.5.137:6380: 6Moving slot 12910 from 10.220.5.137:6381 to 10.220.5.137:6380: 7Moving slot 12911 from 10.220.5.137:6381 to 10.220.5.137:6380: 8Moving slot 12912 from 10.220.5.137:6381 to 10.220.5.137:6380: 9Moving slot 12913 from 10.220.5.137:6381 to 10.220.5.137:6380: 10Moving slot 12914 from 10.220.5.137:6381 to 10.220.5.137:6380: 11Moving slot 12915 from 10.220.5.137:6381 to 10.220.5.137:6380: 12Moving slot 12916 from 10.220.5.137:6381 to 10.220.5.137:6380: 13Moving slot 12917 from 10.220.5.137:6381 to 10.220.5.137:6380: 14Moving slot 12918 from 10.220.5.137:6381 to 10.220.5.137:6380: 15Moving slot 12919 from 10.220.5.137:6381 to 10.220.5.137:6380: 16Moving slot 12920 from 10.220.5.137:6381 to 10.220.5.137:6380: 17Moving slot 12921 from 10.220.5.137:6381 to 10.220.5.137:6380: 18Moving slot 12922 from 10.220.5.137:6381 to 10.220.5.137:6380:
在重新分片操作执行完毕之后， 可以使用以下命令来检查集群是否正常
1[root@ken ~]# redis-trib.rb check 10.220.5.137:6379 2>>> Performing Cluster Check (using node 10.220.5.137:6379) 3M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 4 slots:0-5460 (5461 slots) master 5 2 additional replica(s) 6S: daf9464ef45d0c73e1ee18f7cc7ddbc7d9719f2d 10.220.5.137:6385 7 slots: (0 slots) slave 8 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 9M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 10 slots:12923-16383 (3461 slots) master 11 1 additional replica(s) 12M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 13 slots:5461-12922 (7462 slots) master 14 1 additional replica(s) 15S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 16 slots: (0 slots) slave 17 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 18S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 19 slots: (0 slots) slave 20 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 21S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 22 slots: (0 slots) slave 23 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 24[OK] All nodes agree about slots configuration. 25>>> Check for open slots... 26>>> Check slots coverage... 27[OK] All 16384 slots covered.
删除节点
如果节点中有slot，那么需要先将slot 执行reshard给其他节点，然后才能执行删除操作
1. 删除空slot
删除10.220.5.137:6385
1[root@ken ~]# redis-trib.rb check 10.220.5.137:6379 2>>> Performing Cluster Check (using node 10.220.5.137:6379) 3M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 4 slots:0-5460 (5461 slots) master 5 2 additional replica(s) 6S: daf9464ef45d0c73e1ee18f7cc7ddbc7d9719f2d 10.220.5.137:6385 7 slots: (0 slots) slave 8 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 9M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 10 slots:12923-16383 (3461 slots) master 11 1 additional replica(s) 12...
执行如下命令
1[root@ken ~]# redis-trib.rb del-node 10.220.5.137:6379 daf9464ef45d0c73e1ee18f7cc7ddbc7d9719f2d 2>>> Removing node daf9464ef45d0c73e1ee18f7cc7ddbc7d9719f2d from cluster 10.220.5.137:6379 3>>> Sending CLUSTER FORGET messages to the cluster... 4>>> SHUTDOWN the node.
查看发现6385节点已经被移除
1[root@ken ~]# redis-trib.rb check 10.220.5.137:6379 2>>> Performing Cluster Check (using node 10.220.5.137:6379) 3M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 4 slots:0-5460 (5461 slots) master 5 1 additional replica(s) 6M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 7 slots:12923-16383 (3461 slots) master 8 1 additional replica(s) 9M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 10 slots:5461-12922 (7462 slots) master 11 1 additional replica(s) 12S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 13 slots: (0 slots) slave 14 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 15S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 16 slots: (0 slots) slave 17 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 18S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 19 slots: (0 slots) slave 20 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 21[OK] All nodes agree about slots configuration. 22>>> Check for open slots... 23>>> Check slots coverage... 24[OK] All 16384 slots covered. 25 262.删除带有slot的节点提示有数据报错 27 28[root@ken ~]# redis-trib.rb del-node 10.220.5.137:6379 ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 29>>> Removing node ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 from cluster 10.220.5.137:6379 30[ERR] Node 10.220.5.137:6381 is not empty! Reshard data away and try again.
需要重新分片
1[root@ken ~]# redis-trib.rb reshard 10.220.5.137:6379 2>>> Performing Cluster Check (using node 10.220.5.137:6379) 3M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 4 slots:0-5460 (5461 slots) master 5 1 additional replica(s) 6M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 7 slots:12923-16383 (3461 slots) master 8 1 additional replica(s) 9M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 10 slots:5461-12922 (7462 slots) master 11 1 additional replica(s) 12S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 13 slots: (0 slots) slave 14 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 15S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 16 slots: (0 slots) slave 17 replicates ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 18S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 19 slots: (0 slots) slave 20 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 21[OK] All nodes agree about slots configuration. 22>>> Check for open slots... 23>>> Check slots coverage... 24[OK] All 16384 slots covered. 25How many slots do you want to move (from 1 to 16384)? 3461 26What is the receiving node ID? 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 27Please enter all the source node IDs. 28 Type 'all' to use all the nodes as source nodes for the hash slots. 29 Type 'done' once you entered all the source nodes IDs. 30Source node #1:ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 31Source node #2:done
再检查slot已经为空
1>>> Performing Cluster Check (using node 10.220.5.137:6379) 2M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 3 slots:0-5460 (5461 slots) master 4 1 additional replica(s) 5M: ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 10.220.5.137:6381 #已经为空 6 slots: (0 slots) master 7 0 additional replica(s) 8M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 9 slots:5461-16383 (10923 slots) master 10 2 additional replica(s) 11S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 12 slots: (0 slots) slave 13 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 14S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 15 slots: (0 slots) slave 16 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 17S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 18 slots: (0 slots) slave 19 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 20[OK] All nodes agree about slots configuration. 21>>> Check for open slots... 22>>> Check slots coverage... 23[OK] All 16384 slots covered.
再执行删除操作
1[root@ken ~]# redis-trib.rb del-node 10.220.5.137:6379 ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 2>>> Removing node ffadc66b51b6c87ad3c5a33dc9ec39f984bb80e8 from cluster 10.220.5.137:6379 3>>> Sending CLUSTER FORGET messages to the cluster... 4>>> SHUTDOWN the node.
再次查看。6381节点已经被删除
1[root@ken ~]# redis-trib.rb check 10.220.5.137:6379 2>>> Performing Cluster Check (using node 10.220.5.137:6379) 3M: 57753754f4c89054ab14e8ec517604c4fc4c8ed5 10.220.5.137:6379 4 slots:0-5460 (5461 slots) master 5 1 additional replica(s) 6M: 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 10.220.5.137:6380 7 slots:5461-16383 (10923 slots) master 8 2 additional replica(s) 9S: 640bb3a62565a0bb74980852fee7e8636cf238bc 10.220.5.137:6383 10 slots: (0 slots) slave 11 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 12S: b8214c9e4b617c7992e71a2fa07a4a64cfeddf58 10.220.5.137:6384 13 slots: (0 slots) slave 14 replicates 3a9aa9592afc594c7e4206cc82ffb37d46a5b23d 15S: 1bc40ffc4c54099f8cf47efdeb82a9f42e717bf6 10.220.5.137:6382 16 slots: (0 slots) slave 17 replicates 57753754f4c89054ab14e8ec517604c4fc4c8ed5 18[OK] All nodes agree about slots configuration. 19>>> Check for open slots... 20>>> Check slots coverage... 21[OK] All 16384 slots covered.