LVS+keepalived构建PXC高可用集群

1 高可用安装

1.1 集群信息

主机

组件

bdc212

192.168.13.212

LVS:ipvsadm-1.27-7.el7.x86_64.rpm

Keepalived: keepalived-1.2.4.tar.gz

应用：Percona-XtraDB-Cluster

bdc213

192.168.13.213

LVS:ipvsadm-1.27-7.el7.x86_64.rpm

Keepalived: keepalived-1.2.4.tar.gz

应用：Percona-XtraDB-Cluster

bdc214

192.168.13.214

应用：Percona-XtraDB-Cluster

1.2 安装准备

keepalived-1.2.4.tar.gz

(http://www.keepalived.org/software/keepalived-1.2.4.tar.gz)

安装组件所需依赖包

yum install openssl-devel popt-devel libnl* -y

1.3 安装LVS+keepalived

在两台Director Server上分别安装LVS+Keepalived，BACKUP服务器与MASTER服务器一致，先安装lvs再安装keepalived。

1.3.3 安装LVS

Ipvs(IP Virtual Server)是整个负载均衡的基础，没有这个基础，故障隔离与失败切换就毫无意义了。

yum install ipvsadm –y

1.3.4 安装keepalived

解压包：

tar zxvf keepalived-1.2.4.tar.gz

初始化：

1cd keepalived-1.2.4
2./configure --prefix=/usr/local/keepalived 
3
4Keepalived configuration
5------------------------
6Keepalived version       : 1.2.4
7Compiler                 : gcc
8Compiler flags           : -g -O2
9Extra Lib                : -lpopt -lssl -lcrypto  -lnl
10Use IPVS Framework       : Yes
11IPVS sync daemon support : Yes
12IPVS use libnl           : Yes
13Use VRRP Framework       : Yes
14Use VRRP VMAC            : Yes
15Use Debug flags          : No

编译并安装：

1make&&make install
2
3Make complete
4make -C keepalived install
5make[1]: Entering directory `/root/Desktop/keepalived-1.2.1/keepalived'
6install -d /usr/local/keepalived/sbin
7install -m 700 ../bin/keepalived /usr/local/keepalived/sbin/
8install -d /usr/local/keepalived/etc/rc.d/init.d
9install -m 755 etc/init.d/keepalived.init /usr/local/keepalived/etc/rc.d/init.d/keepalived
10install -d /usr/local/keepalived/etc/sysconfig
11install -m 755 etc/init.d/keepalived.sysconfig /usr/local/keepalived/etc/sysconfig/keepalived
12install -d /usr/local/keepalived/etc/keepalived/samples
13install -m 644 etc/keepalived/keepalived.conf /usr/local/keepalived/etc/keepalived/
14install -m 644 ../doc/samples/* /usr/local/keepalived/etc/keepalived/samples/
15install -d /usr/local/keepalived/share/man/man5
16install -d /usr/local/keepalived/share/man/man8
17install -m 644 ../doc/man/man5/keepalived.conf.5 /usr/local/keepalived/share/man/man5
18install -m 644 ../doc/man/man8/keepalived.8 /usr/local/keepalived/share/man/man8
19make[1]: Leaving directory `/root/Desktop/keepalived-1.2.1/keepalived'
20make -C genhash install
21make[1]: Entering directory `/root/Desktop/keepalived-1.2.1/genhash'
22install -d /usr/local/keepalived/bin
23install -m 755 ../bin/genhash /usr/local/keepalived/bin/
24install -d /usr/local/keepalived/share/man/man1
25install -m 644 ../doc/man/man1/genhash.1 /usr/local/keepalived/share/man/man1
26make[1]: Leaving directory `/root/Desktop/keepalived-1.2.1/genhash'

1.4 配置路由转发

1> 更改配置文件

vi /etc/sysctl.conf

net.ipv4.ip_forward = 1

2> 刷新系统配置

sysctl -p

1.5 配置keepalived.cnf

keepalived的配置分为三类：全局配置（global configuration），VRRPD配置，LVS配置。

全局配置就是对整个keepalived起效的配置，不管是否使用LVS。VRRPD是keepalived的核心，LVS配置只在要使用keepalived来配置的管理LVS时需要使用，如果仅仅使用keepalived来做HA，LVS的配置是不需要的。如果在只有一个负载均衡器的场合，就不须 VRRP 实例定义块。

1mkdir /etc/keepalived
2vi /etc/keepalived/keepalived.conf
3
4! Configuration File for keepalived
5
6global_defs {
7   router_id LVS_MASTER            #BACKUP  LVS_BACKUP
8}
9
10vrrp_instance VI_1 {
11    state MASTER                   #BACKUP  BACKUP
12    interface eno16777736
13    virtual_router_id 51
14    priority 100                   #BACKUP  80
15    advert_int 1
16    nopreempt
17    authentication {
18        auth_type PASS
19        auth_pass 1111
20    }
21    virtual_ipaddress {
22        192.168.252.199
23    }
24}
25  
26virtual_server 192.168.252.199 3306 {
27    delay_loop 6
28    lb_algo rr
29    lb_kind NAT
30#   persistence_timeout 5
31    protocol TCP
32
33    real_server 192.168.252.159 3306 {
34        weight 3
35        TCP_CHECK {
36            connect_timeout 3
37            nb_get_retry 3
38            delay_before_retry 3
39            connect_port 3306
40        }
41    }
42   
43
44    real_server 192.168.252.160 3306 {
45        weight 3
46        TCP_CHECK {
47            connect_timeout 3
48            nb_get_retry 3
49            delay_before_retry 3
50            connect_port 3306
51        }
52    }
53
54    real_server 192.168.252.161 3306 {
55        weight 3
56        TCP_CHECK {
57            connect_timeout 3
58            nb_get_retry 3
59            delay_before_retry 3
60            connect_port 3306
61        }
62    }
63}

注：配置backup的/etc/keepalived/keepalived.conf，只需将批注部分改一下即可。

2 keepalived集群启动

2.1 master节点启动

/usr/local/keepalived/sbin/keepalived start

检查虚拟IP启动情况

方法1：

1tail -30 /var/log/message
2
3Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Interface queue is empty
4Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: No such interface, virbr0
5Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: No such interface, virbr0-nic
6Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering Kernel netlink reflector
7Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering Kernel netlink command channel
8Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Registering gratuitous ARP shared channel
9Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Opening file '/etc/keepalived/keepalived.conf'.
10Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Configuration is using : 61916 Bytes
11Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: Using LinkWatch kernel netlink reflector...
12Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
13Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
14Jun 15 16:24:25 localhost Keepalived_healthcheckers[54296]: Activating healthchecker for service [192.168.252.199]:3306
15Jun 15 16:24:25 localhost Keepalived_vrrp[54297]: VRRP_Instance(VI_1) Transition to MASTER STATE
16Jun 15 16:24:26 localhost Keepalived_vrrp[54297]: VRRP_Instance(VI_1) Entering MASTER STATE
17Jun 15 16:24:26 localhost avahi-daemon[768]: Registering new address record for 192.168.252.199 on eno16777736.IPv4.

方法2：

[root@localhost Desktop]#ip addr

2.2 backup节点启动

/usr/local/keepalived/sbin/keepalived start

2.3 查看路由分发情况

查看ipvsadm

[root@localhost Desktop]#ipvsadm

也能够通过mysqladmin查看本地mysql服务连接状况

/opt/percona/bin/mysqladmin -uroot -p123456 status

3 PXC故障测试

3.1 杀死mysql服务

杀死节点三上的mysql服务

kill -9 mysqld’s pid

3.2 查看ipvsadm

[root@localhost Desktop]# ipvsadm

注：负载均衡服务解除了节点三，只向节点一二分发包。

3.3 重启mysql服务

/usr/share/percona-xtradb-cluster/mysql.server start

3.4 再查看ipvsadm

[root@localhost Desktop]# ipvsadm

注：负载均衡服务重新把节点三放入了路由分发列表。

4 高可用测试

4.1 杀死master的KP服务

Kill -9 keepalived'pid

4.2 查看组建工作情况

1> VIP持有情况：

查看master ip：#ip add

Master释放了VIP：192.168.13.100

查看backup ip：#ip add

Backup接收了VIP：192.168.13.100,继续提供负载均衡服务

2> ipvsadm工作情况

查看master Ipvsadm:负载均衡没有工作

[root@localhost keepalived-1.2.4]# ipvsadm

查看backup ipvsadm:负载均衡仍然提供服务

[root@localhost keepalived-1.2.4]# ipvsadm

LVS+keepalived构建PXC高可用集群

1 高可用安装

2 keepalived集群启动

3 PXC故障测试

4 高可用测试

评论区

相关推荐