Home | 簡體中文 | 繁體中文 | 雜文 | 知乎專欄 | Github | OSChina 博客 | 雲社區 | 雲棲社區 | Facebook | Linkedin | 視頻教程 | 打賞(Donations) | About
知乎專欄多維度架構

1.6. Replication

1.6.1. Master Slave

1.6.1.1. Master

過程 1.1. Master 設置步驟

  1. 配置 my.cnf 檔案

    確保主伺服器主機上my.cnf檔案的[mysqld]部分包括一個log-bin選項。該部分還應有一個server-id=Master_id選項

    # vim /etc/mysql/my.cnf
    
    server-id               = 1
    log_bin                 = /var/log/mysql/mysql-bin.log
    expire_logs_days        = 10
    max_binlog_size         = 100M
    binlog_do_db            = test
    binlog_ignore_db        = mysql
    					

    bind-address預設是127.0.0.1你必須更改它,否則Slave將無法連結到 Master

    #bind-address		= 127.0.0.1
    bind-address		= 0.0.0.0
    					

    重啟伺服器

    neo@netkiller:~$ sudo /etc/init.d/mysql reload
     * Reloading MySQL database server mysqld          [ OK ]
    					

    建議使用reload,如果不起作用再用restart

    					
    mysql> SHOW GLOBAL VARIABLES like 'server_id';
    +---------------+-------+
    | Variable_name | Value |
    +---------------+-------+
    | server_id     | 1     |
    +---------------+-------+
    1 row in set (0.00 sec)
    					
    					
  2. 登錄slave伺服器,測試主庫3306工作情況,如果看到下面相關信息表示工作正常。

    					
    # telnet 192.168.1.246 3306
    Trying 192.168.1.246...
    Connected to 192.168.1.246.
    Escape character is '^]'.
    I
    5.1.61-0ubuntu0.11.10.1-log1W<gs/*'#}p<u[J=5//:
    					
    					
  3. 創建賬戶並授予REPLICATION SLAVE權限

    					
    mysql> GRANT REPLICATION SLAVE,REPLICATION CLIENT ON *.* TO 'replication'@'%.mydomain.com' IDENTIFIED BY 'slavepass';
    mysql> FLUSH PRIVILEGES;
    					
    					

    創建監控賬號monitor(可選項),monitor 使用SHOW MASTER STATUS和SHOW SLAVE STATUS命令但沒有複製權限

    GRANT REPLICATION CLIENT ON *.* TO monitor@'192.168.245.131' IDENTIFIED BY 'monitorpass'

  4. 鎖表禁止寫入新數據

    					
    mysql> FLUSH TABLES WITH READ LOCK;
    					
    					
  5. 查看Master 工作狀態

    					
    mysql> SHOW MASTER STATUS;
    +------------------+----------+--------------+------------------+
    | File             | Position | Binlog_Do_DB | Binlog_Ignore_DB |
    +------------------+----------+--------------+------------------+
    | mysql-bin.000002 |      106 | test         | mysql            |
    +------------------+----------+--------------+------------------+
    1 row in set (0.00 sec)
    					
    					

    如果顯示下面內容表示,配置不正確

    					
    
    mysql> SHOW MASTER STATUS;
    Empty set (0.02 sec)
    					
    					

    取得快照並記錄日誌名和偏移量後,可以在主伺服器上重新啟用寫活動

    					
    mysql> UNLOCK TABLES;
    					
    					

1.6.1.2. Slave

過程 1.2. Slave 設置步驟

  1. 配置my.cnf

    從伺服器的ID必須與主伺服器的ID不相同,如果設置多個從伺服器,每個從伺服器必須有一個唯一的server-id值,必須與主伺服器的以及其它從伺服器的不相同。

    # vim /etc/mysql/my.cnf
    
    [mysqld]
    server-id               = 2
    					
  2. # service mysql restart
    mysql start/running, process 22893
    					
  3. 指定 master 相關參數

    在從伺服器上執行下面的語句,用你的系統的實際值替換選項值

    					
    mysql> CHANGE MASTER TO
    	->     MASTER_HOST='master_host_name',
    	->     MASTER_USER='replication_user_name',
        ->     MASTER_PASSWORD='replication_password',
        ->     MASTER_LOG_FILE='recorded_log_file_name',
        ->     MASTER_LOG_POS=recorded_log_position;
    	   				
    					

    如果是全新伺服器,空資料庫可以忽略MASTER_LOG_FILE與MASTER_LOG_POS

    CHANGE MASTER TO MASTER_HOST='192.168.245.129', MASTER_USER='replication', MASTER_PASSWORD='slavepass';
    					

    如果是複製已經存在的資料庫需要MASTER_LOG_FILE與MASTER_LOG_POS選項

    首先到Master上運行 show master status 找到File與Position

    					
    mysql> show master status \G
    *************************** 1. row ***************************
                File: mysql-bin.000009
            Position: 3988
        Binlog_Do_DB:
    Binlog_Ignore_DB:
    1 row in set (0.00 sec)
    					
    					
    CHANGE MASTER TO
         MASTER_HOST='192.168.2.1',
         MASTER_USER='replication',
         MASTER_PASSWORD='kJZBTo3BjMx9AnmD9Ryn',
         MASTER_LOG_FILE='mysql-bin.000009',
         MASTER_LOG_POS=3988;
    					
  4. 啟動從伺服器綫程

    					
    mysql> START SLAVE;
    Query OK, 0 rows affected (0.00 sec)
    					
    					
  5. SLAVE STATUS

    					
    mysql> SHOW SLAVE STATUS\G
    *************************** 1. row ***************************
                 Slave_IO_State: Connecting to master
                    Master_Host: 192.168.245.129
                    Master_User: repl
                    Master_Port: 3306
                  Connect_Retry: 60
                Master_Log_File:
            Read_Master_Log_Pos: 4
                 Relay_Log_File: mysqld-relay-bin.000002
                  Relay_Log_Pos: 98
          Relay_Master_Log_File:
               Slave_IO_Running: Yes
              Slave_SQL_Running: Yes
                Replicate_Do_DB:
            Replicate_Ignore_DB:
             Replicate_Do_Table:
         Replicate_Ignore_Table:
        Replicate_Wild_Do_Table:
    Replicate_Wild_Ignore_Table:
                     Last_Errno: 0
                     Last_Error:
                   Skip_Counter: 0
            Exec_Master_Log_Pos: 0
                Relay_Log_Space: 98
                Until_Condition: None
                 Until_Log_File:
                  Until_Log_Pos: 0
             Master_SSL_Allowed: No
             Master_SSL_CA_File:
             Master_SSL_CA_Path:
                Master_SSL_Cert:
              Master_SSL_Cipher:
                 Master_SSL_Key:
          Seconds_Behind_Master: NULL
    1 row in set (0.00 sec)
    					
    					

1.6.1.3. Testing

  1. 登錄 master

    複製進程的信息

    SHOW PROCESSLIST語句可以提供在主伺服器上和從伺服器上發生的關於複製的信息

    mysql> SHOW PROCESSLIST\G
    *************************** 1. row ***************************
         Id: 62
       User: replication
       Host: ken-hx409.local:36465
         db: NULL
    Command: Binlog Dump
       Time: 679
      State: Has sent all binlog to slave; waiting for binlog to be updated
       Info: NULL
    *************************** 2. row ***************************
         Id: 64
       User: root
       Host: localhost
         db: NULL
    Command: Query
       Time: 0
      State: NULL
       Info: SHOW PROCESSLIST
    2 rows in set (0.00 sec)
    
    					
  2. 登錄從庫,查看複製綫程

    					
    mysql> SHOW PROCESSLIST\G
    *************************** 1. row ***************************
         Id: 273
       User: root
       Host: localhost
         db: NULL
    Command: Query
       Time: 0
      State: NULL
       Info: SHOW PROCESSLIST
    *************************** 2. row ***************************
         Id: 276
       User: system user
       Host:
         db: NULL
    Command: Connect
       Time: 2
      State: Waiting for master to send event
       Info: NULL
    *************************** 3. row ***************************
         Id: 277
       User: system user
       Host:
         db: NULL
    Command: Connect
       Time: 2
      State: Has read all relay log; waiting for the slave I/O thread to update it
       Info: NULL
    3 rows in set (0.00 sec)
    					
    					

    如果沒有複製進程,請使用start slave;啟動

    					
    mysql> SHOW PROCESSLIST\G
    *************************** 1. row ***************************
         Id: 273
       User: root
       Host: localhost
         db: NULL
    Command: Query
       Time: 0
      State: NULL
       Info: SHOW PROCESSLIST
    1 row in set (0.02 sec)
    
    mysql> start slave;
    Query OK, 0 rows affected (0.00 sec)
    					
    					
  3. 登錄 master

    					
    mysql> insert into foo(id,data) values(2,'Hello world!!!');
    Query OK, 1 row affected (0.00 sec)
    					
    					
  4. 登錄 slave

    					
    mysql> select * from foo;
    					
    					

    在master伺服器上插入一條記錄,你可以立刻在slave伺服器上看到變化。

1.6.1.4. 將現有資料庫遷移到主從結構資料庫

資料庫已經存在的情況下怎麼遷移

  1. Master 鎖表禁止寫入新數據

    					
    mysql> FLUSH TABLES WITH READ LOCK;
    					
    					
  2. Slave 停止複製進程

    					
    mysql> stop slave;
    					
    					
  3. 備份Master資料庫

    					
    mysqldump yourdb | gzip > yourdb.sql.gz
    					
    					
  4. 恢復資料庫

    如果使用mysqldump備份主伺服器的數據,將轉儲檔案裝載到從伺服器

    					
    # zcat yourdb.sql.gz | mysql -u root -p yourdb
    					
    					
  5. 啟動 Slave 複製進程

    					
    mysql> start slave;
    					
    					
  6. 解除 Master 表鎖定

    					
    mysql> UNLOCK TABLES;
    					
    					

MyIASM引擎可以採用下面方法

備份資料庫

# tar zcvf mysql-snapshot.tar.gz /var/lib/mysql/neo
			

複製給從資料庫

scp mysql-snapshot.tar.gz  neo@192.168.245.131:/tmp
			

snapshot 恢復

$ tar zxvf mysql-snapshot.tar.gz
$ cd /var/lib/mysql

$ mv /tmp/var/lib/mysql/neo .
$ sudo chown mysql.mysql -R neo
			

重新啟動Mysql

$ sudo /etc/init.d/mysql restart
			

有興趣可以看看mysqlhotcopy

1.6.1.5. 主從複製安全問題

複製帳號權限

grant replication slave on *.* to 'replication'@'192.168.1.%' identified by '000000';
			

主庫資料庫操作帳號權限

grant DELETE, INSERT, SELECT, UPDATE ON your_user.* to yourdb@'your_host' identified by 'password' with grant option;
			

從庫資料庫操作帳號權限

grant SELECT ON your_user.* to yourdb@'your_host' identified by 'password' with grant option;
			

從庫必須收回寫操作

1.6.2. Master Master(主主)

1.6.2.1. Master A

my.cnf 檔案加入下面的內容

cp /etc/mysql/my.cnf /etc/mysql/my.cnf.old
vim /etc/mysql/my.cnf

[mysqld]
server-id = 1
log-bin=/data/mysql/binlog/binlog
binlog-do-db = test
binlog-ignore-db=mysql

log-slave-updates
sync_binlog=1
auto_increment_offset=1
auto_increment_increment=2
replicate-do-db = test
replicate-ignore-db = mysql,information_schema
			

創建複製權限

grant replication slave on *.* to 'replication'@'192.168.1.%' identified by '000000';
flush privileges;
			
			
mysql>flush tables with read lock;

mysql> show master status\G
*************************** 1. row ***************************
File: binlog.000007
Position: 107
Binlog_Do_DB: test
Binlog_Ignore_DB: mysql
1 row in set (0.00 sec)
			
			

1.6.2.2. Master B

創建複製權限

grant replication slave on *.* to 'replication'@'192.168.1.%' identified by '000000';
flush privileges;
			

my.cnf 檔案加入下面的內容

[mysqld]
server-id = 2
log-bin = /data/mysql/binlog/binlog
replicate-do-db = test
replicate-ignore-db = mysql,information_schema

binlog-do-db = test
binlog-ignore-db=mysql
log-slave-updates
sync_binlog=1
auto_increment_offset=2
auto_increment_increment=2
			

B 與 A 配置檔案不同的兩處。

server-id = 2
auto_increment_offset=2
			
			
mysql> show master status\G
*************************** 1. row ***************************
File: binlog.000005
Position: 107
Binlog_Do_DB: test
Binlog_Ignore_DB: mysql
1 row in set (0.00 sec)
			
			

1.6.2.3. 將Master A 資料庫 同步到 Master B 兩端資料庫內容保持一致

Master A,首先鎖表為只讀狀態

			
mysqldump --databases test > /tmp/test.sql
			
			

Master B 創建一個與Master A同名的空資料庫,然後將備份檔案恢復到資料庫中

			
# mysql
mysql> CREATE DATABASE test;
mysql>\q

# scp 192.168.1.1:/tmp/test.sql ./
# mysql -uroot -p test < /tmp/test.sql
  			
			

1.6.2.4. Master A - B 同步兩端資料庫

master-A

			
mysql>change master to master_host='192.168.1.2', master_user='replication', master_password='000000', master_log_file='binlog.000005', master_log_pos=107;
			
			

master-B

			
mysql>change master to master_host='192.168.1.1', master_user='replication', master_password='000000', master_log_file='binlog.000007', master_log_pos=107;
			
			

1.6.2.5. Master A 資料庫解除只讀權限

Master A 解鎖

			
mysql> UNLOCK TABLES;
			
			

1.6.2.6. 查看主主的工作狀態

分別在Master A與B 上運行

			
mysql>show slave status\G;

Slave_IO_Running: Yes
Slave_SQL_Running: Yes
			
			

1.6.3. Semisynchronous Replication

1.6.3.1. Master

			
mysql> SHOW VARIABLES LIKE "have_dynamic_loading";
+----------------------+-------+
| Variable_name        | Value |
+----------------------+-------+
| have_dynamic_loading | YES   |
+----------------------+-------+
1 row in set (0.00 sec)

mysql>
			
			

Master 配置

mysql> install plugin rpl_semi_sync_master SONAME 'semisync_master.so';
mysql> set global rpl_semi_sync_master_enabled = 1; 
mysql> set global rpl_semi_sync_master_timeout = 30;
mysql> select * from mysql.plugin;
+----------------------+--------------------+
| name                 | dl                 |
+----------------------+--------------------+
| rpl_semi_sync_master | semisync_master.so |
+----------------------+--------------------+
1 row in set (0.00 sec)
			

狀態查看

mysql> SHOW VARIABLES LIKE "%semi%";
+------------------------------------+-------+
| Variable_name                      | Value |
+------------------------------------+-------+
| rpl_semi_sync_master_enabled       | ON    |
| rpl_semi_sync_master_timeout       | 10    |
| rpl_semi_sync_master_trace_level   | 32    |
| rpl_semi_sync_master_wait_no_slave | ON    |
+------------------------------------+-------+
4 rows in set (0.00 sec)			
			

1.6.3.2. Slave 配置

install plugin rpl_semi_sync_slave soname 'semisync_slave.so';
set global rpl_semi_sync_slave_enabled = 1;
stop slave io_thread;
start slave io_thread;			
			

Slave 狀態查看

show global status like 'rpl_semi%';
			

1.6.3.3. 卸載插件

卸載插件 UNINSTALL PLUGIN plugin_name

UNINSTALL PLUGIN rpl_semi_sync_master; 	
UNINSTALL PLUGIN rpl_semi_sync_slave; 			
			

1.6.3.4. my.cnf

編輯my.cnf加入

# On Master
[mysqld]
rpl_semi_sync_master_enabled=1
rpl_semi_sync_master_timeout=1000 # 1 second

# On Slave
[mysqld]
rpl_semi_sync_slave_enabled=1
			

1.6.4. multi-master replication

MySQL 5.7 以上版本才能使用

		
 master1  ---------> master2
    ^                   |
    |                   |
    |                   |
    |                   V
 master4  <--------- master3
 		
		

1.6.5. multi-source replication

MySQL 5.7 以上版本才能使用

		
 master1    master2    master3    master4
    |          |          |          |
    |          |          |          |
    |          |          |          |
    `--------------------------------'
                    |
                    V
                  Slave
 		
		

slave 配置

		
slave> change master to master_host="172.16.0.1", master_port=3306, master_user="replication",master_password="password" for channel="master1";
slave> change master to master_host="172.16.0.2", master_port=3306, master_user="replication",master_password="password" for channel="master2";

slave> start slave for channel="master1";
slave> start slave for channel="master2";
		
		

檢查從伺服器狀態

		
slave > SHOW SLAVE STATUS FOR CHANNEL="master1"\G
slave > SHOW SLAVE STATUS FOR CHANNEL="master2"\G
		
		

測試,分別在兩個主伺服器上創建資料庫,然後查看從資料庫同步結果.

		
master1 > create database master1;
master2 > create database master2;

slave > show databases like 'master%';
+--------------------+
| Database (master%) |
+--------------------+
| master1            |
| master2            |
+--------------------+

		
		

1.6.6. 與複製有關的問題

1.6.6.1. 主從不同步問題

執行下面語句

stop slave;
set global sql_slave_skip_counter =1 ;
start slave;

mysql> slave stop;
mysql> set GLOBAL SQL_SLAVE_SKIP_COUNTER=1;
mysql> slave start;
			

Seconds_Behind_Master 值從NULL變為大於等於0是表示已經同步

Seconds_Behind_Master: NULL
Seconds_Behind_Master: 8893
			

1.6.6.2. mysql-bin 清理問題

預設expire-logs-days為30天。這裡設為7天,可根據自己情況調整。

[mysqld]
expire-logs-days = 7
			

通過SQL刪除

刪除某個日誌:	mysql>PURGE MASTER LOGS TO ‘mysql-bin.015′;
刪除某天前的日誌:	mysql>PURGE MASTER LOGS BEFORE ’2010-10-25  14:00:00′;
			

1.6.6.3. 跳過 Last_Errno

修改mysql配置檔案 /etc/my.cnf 在 [mysqld]下加一行

[mysqld]
slave_skip_errors = 1062
			

跳過所有錯誤

slave-skip-errors=all			
			

1.6.6.4. 重置Slave

STOP SLAVE; 
RESET SLAVE; 
START SLAVE;			
			

1.6.7. GTID

5.6 新增功能

mysql> show global variables like '%gtid%';
+---------------------------------+-------+
| Variable_name                   | Value |
+---------------------------------+-------+
| binlog_gtid_simple_recovery     | OFF   |
| enforce_gtid_consistency        | OFF   |
| gtid_executed                   |       |
| gtid_mode                       | OFF   |
| gtid_owned                      |       |
| gtid_purged                     |       |
| simplified_binlog_gtid_recovery | OFF   |
+---------------------------------+-------+
7 rows in set (0.00 sec)		
		

1.6.7.1. Master

[root@master mysql]# vim my.cnf

binlog-format=ROW
log-slave-updates=true
gtid-mode=on
enforce-gtid-consistency=true
master-info-repository=TABLE
relay-log-info-repository=TABLE
sync-master-info=1
slave-parallel-workers=2

binlog-checksum=CRC32
master-verify-checksum=1
slave-sql-verify-checksum=1
binlog-rows-query-log_events=1
port=3306
report-host=192.168.1.21
report-port=3306
server_id = 1
			

創建有複製權限的用戶

GRANT REPLICATION SLAVE,REPLICATION CLIENT ON *.* TO 'replication'@'%.mydomain.com' IDENTIFIED BY 'slavepass';
FLUSH PRIVILEGES;						
			

1.6.7.2. Slave

[root@slave mysql]# vim my.cnf

relay-log = relay-log
relay-log-index = relay-log.index
binlog-format=ROW
log-slave-updates=true

gtid-mode=on
enforce-gtid-consistency=true

master-info-repository=TABLE
relay-log-info-repository=TABLE
sync-master-info=1
slave-parallel-workers=2

;binlog-checksum=CRC32
master-verify-checksum=1
slave-sql-verify-checksum=1

binlog-rows-query-log_events=1
report-port=3306
port=3306
report-host=192.168.1.22
server_id = 10	
			

登錄到Master併進行複製

CHANGE MASTER TO
     MASTER_HOST='192.168.2.1',
     MASTER_USER='replication',
     MASTER_PASSWORD='kJZBTo3BjMx9AnmD9Ryn',
     MASTER_AUTO_POSITION=1;     
			

就這麼簡單,你不再需要指定 MASTER_LOG_FILE='mysql-bin.000009', MASTER_LOG_POS=3988 兩個參數。