2024-02-01 9:06:04 0 [Note] WSREP: declaring 29de2213 at tcp://172.28.64.65:4567 stable 2024-02-01 9:06:04 0 [Note] WSREP: forgetting 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:04 0 [Note] WSREP: Node 29de2213 state prim 2024-02-01 9:06:04 0 [Note] WSREP: view(view_id(PRIM,29de2213,5) memb { 29de2213,0 2a1270f2,0 } joined { } left { } partitioned { 4d90a2d0,0 }) 2024-02-01 9:06:04 0 [Note] WSREP: save pc into disk 2024-02-01 9:06:04 0 [Note] WSREP: forgetting 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c from 1 (c2ostack01c) 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c from 0 (c2ostack01b) 2024-02-01 9:06:04 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 4, members = 2/2 (joined/total), act_id = 11511, last_appl. = 11393, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:06:04 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:06:04 22 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:06:04 22 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, view# 5: Primary, number of nodes: 2, my index: 1, protocol version 3 2024-02-01 9:06:04 22 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:04 22 [Note] WSREP: Assign initial position for certification: 11511, protocol version: 4 2024-02-01 9:06:04 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:09 0 [Note] WSREP: cleaning up 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:12 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') connection established to 25785048 tcp://172.28.64.64:4567 2024-02-01 9:06:12 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:06:12 0 [Note] WSREP: declaring 25785048 at tcp://172.28.64.64:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: declaring 29de2213 at tcp://172.28.64.65:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: Node 29de2213 state prim 2024-02-01 9:06:12 0 [Note] WSREP: view(view_id(PRIM,25785048,6) memb { 25785048,0 29de2213,0 2a1270f2,0 } joined { } left { } partitioned { }) 2024-02-01 9:06:12 0 [Note] WSREP: save pc into disk 2024-02-01 9:06:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 0 (c2ostack01a) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 1 (c2ostack01b) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 2 (c2ostack01c) 2024-02-01 9:06:12 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 5, members = 2/3 (joined/total), act_id = 11519, last_appl. = 11393, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:06:12 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:06:12 22 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:06:12 22 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519, view# 6: Primary, number of nodes: 3, my index: 2, protocol version 3 2024-02-01 9:06:12 22 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:12 22 [Note] WSREP: Assign initial position for certification: 11519, protocol version: 4 2024-02-01 9:06:12 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:14 0 [Note] WSREP: Member 0.0 (c2ostack01a) requested state transfer from '*any*'. Selected 2.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:06:14 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 11529) 2024-02-01 9:06:14 23 [Note] WSREP: IST request: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511-11519|tcp://172.28.64.64:4568 2024-02-01 9:06:14 23 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:14 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '172.28.64.64:4444/xtrabackup_sst//1' --local-port 3306 --socket '/var/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '1ff46609-c0de-11ee-99c3-924a324d6cbe:11511' --gtid-domain-id 0 --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1' 2024-02-01 9:06:14 23 [Note] WSREP: sst_donor_thread signaled with 0 2024-02-01 9:06:14 0 [Note] WSREP: async IST sender starting to serve tcp://172.28.64.64:4568 sending 11512-11519 WSREP_SST: [INFO] mariabackup IST started on donor (20240201 09:06:14.517) WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240201 09:06:14.601) WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240201 09:06:14.820) WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240201 09:06:14.825) WSREP_SST: [INFO] Streaming with mbstream (20240201 09:06:14.851) WSREP_SST: [INFO] Using socat as streamer (20240201 09:06:14.856) WSREP_SST: [INFO] Bypassing the SST for IST (20240201 09:06:14.867) WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'xtrabackup_galera_info' 'xtrabackup_ist' | socat -u stdio TCP:172.28.64.64:4444; RC=( ${PIPESTATUS[@]} ) (20240201 09:06:14.872) 2024-02-01 9:06:14 0 [Note] WSREP: 2.0 (c2ostack01c): State transfer to 0.0 (c2ostack01a) complete. 2024-02-01 9:06:14 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 11529) 2024-02-01 9:06:14 0 [Note] WSREP: Member 2.0 (c2ostack01c) synced with group. 2024-02-01 9:06:14 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 11529) 2024-02-01 9:06:14 20 [Note] WSREP: Synchronized with group, ready for connections 2024-02-01 9:06:14 20 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. WSREP_SST: [INFO] Total time on donor: 0 seconds (20240201 09:06:14.881) WSREP_SST: [INFO] mariabackup IST completed on donor (20240201 09:06:14.886) WSREP_SST: [INFO] Cleaning up temporary directories (20240201 09:06:14.894) 2024-02-01 9:06:15 0 [Note] WSREP: async IST sender served 2024-02-01 9:06:15 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') turning message relay requesting off 2024-02-01 9:07:30 0 [Note] WSREP: declaring 25785048 at tcp://172.28.64.64:4567 stable 2024-02-01 9:07:30 0 [Note] WSREP: forgetting 29de2213 (tcp://172.28.64.65:4567) 2024-02-01 9:07:30 0 [Note] WSREP: Node 25785048 state prim 2024-02-01 9:07:30 0 [Note] WSREP: view(view_id(PRIM,25785048,7) memb { 25785048,0 2a1270f2,0 } joined { } left { } partitioned { 29de2213,0 }) 2024-02-01 9:07:30 0 [Note] WSREP: save pc into disk 2024-02-01 9:07:30 0 [Note] WSREP: forgetting 29de2213 (tcp://172.28.64.65:4567) 2024-02-01 9:07:30 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd from 0 (c2ostack01a) 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd from 1 (c2ostack01c) 2024-02-01 9:07:30 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 6, members = 1/2 (joined/total), act_id = 12225, last_appl. = 12161, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:07:30 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:07:30 24 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:07:30 24 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225, view# 7: Primary, number of nodes: 2, my index: 1, protocol version 3 2024-02-01 9:07:30 24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:30 24 [Note] WSREP: Assign initial position for certification: 12225, protocol version: 4 2024-02-01 9:07:30 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:35 0 [Note] WSREP: cleaning up 29de2213 (tcp://172.28.64.65:4567) 2024-02-01 9:07:37 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') connection established to 587c02c7 tcp://172.28.64.65:4567 2024-02-01 9:07:37 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:07:38 0 [Note] WSREP: declaring 25785048 at tcp://172.28.64.64:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: declaring 587c02c7 at tcp://172.28.64.65:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: Node 25785048 state prim 2024-02-01 9:07:38 0 [Note] WSREP: view(view_id(PRIM,25785048,8) memb { 25785048,0 2a1270f2,0 587c02c7,0 } joined { } left { } partitioned { }) 2024-02-01 9:07:38 0 [Note] WSREP: save pc into disk 2024-02-01 9:07:38 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 0 (c2ostack01a) 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 1 (c2ostack01c) 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 2 (c2ostack01b) 2024-02-01 9:07:38 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 7, members = 1/3 (joined/total), act_id = 12243, last_appl. = 12161, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:07:38 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:07:38 24 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:07:38 24 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243, view# 8: Primary, number of nodes: 3, my index: 1, protocol version 3 2024-02-01 9:07:38 24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:38 24 [Note] WSREP: Assign initial position for certification: 12243, protocol version: 4 2024-02-01 9:07:38 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:40 0 [Note] WSREP: Member 2.0 (c2ostack01b) requested state transfer from '*any*'. Selected 1.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:07:40 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 12243) 2024-02-01 9:07:40 24 [Note] WSREP: IST request: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225-12243|tcp://172.28.64.65:4568 2024-02-01 9:07:40 24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:40 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '172.28.64.65:4444/xtrabackup_sst//1' --local-port 3306 --socket '/var/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '1ff46609-c0de-11ee-99c3-924a324d6cbe:12225' --gtid-domain-id 0 --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1' 2024-02-01 9:07:40 24 [Note] WSREP: sst_donor_thread signaled with 0 2024-02-01 9:07:40 0 [Note] WSREP: async IST sender starting to serve tcp://172.28.64.65:4568 sending 12226-12243 WSREP_SST: [INFO] mariabackup IST started on donor (20240201 09:07:40.669) WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240201 09:07:40.748) WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240201 09:07:40.931) WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240201 09:07:40.935) WSREP_SST: [INFO] Streaming with mbstream (20240201 09:07:40.960) WSREP_SST: [INFO] Using socat as streamer (20240201 09:07:40.964) WSREP_SST: [INFO] Bypassing the SST for IST (20240201 09:07:40.972) WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'xtrabackup_galera_info' 'xtrabackup_ist' | socat -u stdio TCP:172.28.64.65:4444; RC=( ${PIPESTATUS[@]} ) (20240201 09:07:40.976) 2024-02-01 9:07:40 0 [Note] WSREP: 1.0 (c2ostack01c): State transfer to 2.0 (c2ostack01b) complete. 2024-02-01 9:07:40 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 12246) 2024-02-01 9:07:40 0 [Note] WSREP: Member 1.0 (c2ostack01c) synced with group. 2024-02-01 9:07:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 12246) 2024-02-01 9:07:40 34 [Note] WSREP: Synchronized with group, ready for connections 2024-02-01 9:07:40 34 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. WSREP_SST: [INFO] Total time on donor: 0 seconds (20240201 09:07:40.985) WSREP_SST: [INFO] mariabackup IST completed on donor (20240201 09:07:40.989) WSREP_SST: [INFO] Cleaning up temporary directories (20240201 09:07:40.995) 2024-02-01 9:07:41 0 [Note] WSREP: (2a1270f2, 'tcp://172.28.64.66:4567') turning message relay requesting off 2024-02-01 9:07:41 0 [Note] WSREP: async IST sender served 2024-02-01 9:08:55 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown 2024-02-01 9:08:55 0 [Note] WSREP: Stop replication 2024-02-01 9:08:55 0 [Note] WSREP: Closing send monitor... 2024-02-01 9:08:55 0 [Note] WSREP: Closed send monitor. 2024-02-01 9:08:55 0 [Note] WSREP: gcomm: terminating thread 2024-02-01 9:08:55 0 [Note] WSREP: gcomm: joining thread 2024-02-01 9:08:55 0 [Note] WSREP: gcomm: closing backend 2024-02-01 9:08:55 0 [Note] WSREP: view(view_id(NON_PRIM,25785048,8) memb { 2a1270f2,0 } joined { } left { } partitioned { 25785048,0 587c02c7,0 }) 2024-02-01 9:08:55 0 [Note] WSREP: view((empty)) 2024-02-01 9:08:55 0 [Note] WSREP: gcomm: closed 2024-02-01 9:08:55 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-02-01 9:08:55 0 [Note] WSREP: Flow-control interval: [128, 160] 2024-02-01 9:08:55 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:08:55 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 12985) 2024-02-01 9:08:55 0 [Note] WSREP: Received self-leave message. 2024-02-01 9:08:55 0 [Note] WSREP: Flow-control interval: [0, 0] 2024-02-01 9:08:55 16 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3 2024-02-01 9:08:55 16 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:08:55 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2024-02-01 9:08:55 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 12985) 2024-02-01 9:08:55 0 [Note] WSREP: RECV thread exiting 0: Success 2024-02-01 9:08:55 16 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3 2024-02-01 9:08:55 16 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:08:55 0 [Note] WSREP: recv_thread() joined. 2024-02-01 9:08:55 0 [Note] WSREP: Closing replication queue. 2024-02-01 9:08:55 0 [Note] WSREP: Closing slave action queue. 2024-02-01 9:08:55 16 [Note] WSREP: applier thread exiting (code:0) 2024-02-01 9:08:55 14 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 37 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 29 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 19 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 20 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 24 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 15 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 33 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 36 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 13 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 35 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 21 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 30 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 25 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 34 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 10 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 27 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 39 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 32 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 31 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 38 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 9 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 12 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 23 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 22 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 26 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 11 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 28 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 2 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 18 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:55 17 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:08:57 1 [Note] WSREP: rollbacker thread exiting 2024-02-01 9:08:57 0 [Note] InnoDB: FTS optimize thread exiting. 2024-02-01 9:08:57 0 [Note] Event Scheduler: Purging the queue. 0 events 2024-02-01 9:08:57 0 [Note] WSREP: dtor state: CLOSED 2024-02-01 9:08:57 0 [Note] WSREP: mon: entered 12984 oooe fraction 0.00200246 oool fraction 0.000308071 2024-02-01 9:08:57 0 [Note] WSREP: mon: entered 12984 oooe fraction 0.0136322 oool fraction 0.000308071 2024-02-01 9:08:57 0 [Note] WSREP: mon: entered 13285 oooe fraction 0 oool fraction 7.52729e-05 2024-02-01 9:08:57 0 [Note] WSREP: cert index usage at exit 0 2024-02-01 9:08:57 0 [Note] WSREP: cert trx map usage at exit 56 2024-02-01 9:08:57 0 [Note] WSREP: deps set usage at exit 0 2024-02-01 9:08:57 0 [Note] WSREP: avg deps dist 79.2201 2024-02-01 9:08:57 0 [Note] WSREP: avg cert interval 0.0211029 2024-02-01 9:08:57 0 [Note] WSREP: cert index size 90 2024-02-01 9:08:57 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:08:57 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2024-02-01 9:08:57 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0.96056, misses: 138, in use: 0, in pool: 138 2024-02-01 9:08:57 0 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0.988193, misses: 112, in use: 0, in pool: 112 2024-02-01 9:08:57 0 [Note] WSREP: Flushing memory map to disk... 2024-02-01 9:08:57 0 [Note] InnoDB: Starting shutdown... 2024-02-01 9:08:57 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool 2024-02-01 9:08:57 0 [Note] InnoDB: Buffer pool(s) dump completed at 240201 9:08:57 2024-02-01 9:09:00 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2024-02-01 9:09:00 0 [Note] InnoDB: Shutdown completed; log sequence number 335061012283; transaction id 1019299213 2024-02-01 9:09:00 0 [Note] /usr/sbin/mysqld: Shutdown complete 240201 09:09:01 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended 240201 09:09:02 mysqld_safe Starting mariadbd daemon with databases from /var/lib/mysql/ 240201 09:09:02 mysqld_safe WSREP: Running position recovery with --disable-log-error --pid-file='/var/lib/mysql//c2ostack01c.dev.cnco1.tucows.cloud-recover.pid' 240201 09:09:03 mysqld_safe WSREP: Recovered position 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985 2024-02-01 9:09:03 0 [Note] Starting MariaDB 10.5.22-MariaDB-1:10.5.22+maria~ubu2004-log source revision 7e650253dc488debcb0898ebe6d385bf6dfa3656 as process 264 2024-02-01 9:09:03 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985 2024-02-01 9:09:03 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2024-02-01 9:09:03 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy loaded successfully. 2024-02-01 9:09:03 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2024-02-01 9:09:03 0 [Note] WSREP: Found saved state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985, safe_to_bootstrap: 0 2024-02-01 9:09:03 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe Seqno: 1 - 12985 Offset: 1280 Synced: 1 2024-02-01 9:09:03 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe, offset: 1280 2024-02-01 9:09:03 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/1073741848 bytes) complete. 2024-02-01 9:09:03 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (1073741848/1073741848 bytes) complete. 2024-02-01 9:09:03 0 [Note] WSREP: Recovering GCache ring buffer: Recovery failed, need to do full reset. 2024-02-01 9:09:03 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 172.28.64.66; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 160; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = 2024-02-01 9:09:03 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:09:03 0 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985, protocol version: -1 2024-02-01 9:09:03 0 [Note] WSREP: GCache history reset: 1ff46609-c0de-11ee-99c3-924a324d6cbe:0 -> 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985 2024-02-01 9:09:03 0 [Note] WSREP: Start replication 2024-02-01 9:09:03 0 [Note] WSREP: Connecting with bootstrap option: 0 2024-02-01 9:09:03 0 [Note] WSREP: Setting GCS initial position to 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985 2024-02-01 9:09:03 0 [Note] WSREP: Using CRC-32C for message checksums. 2024-02-01 9:09:03 0 [Note] WSREP: backend: asio 2024-02-01 9:09:03 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2024-02-01 9:09:03 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2024-02-01 9:09:03 0 [Note] WSREP: restore pc from disk failed 2024-02-01 9:09:03 0 [Note] WSREP: GMCast version 0 2024-02-01 9:09:03 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') listening at tcp://172.28.64.66:4567 2024-02-01 9:09:03 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') multicast: , ttl: 1 2024-02-01 9:09:03 0 [Note] WSREP: EVS version 1 2024-02-01 9:09:03 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '172.28.64.64:4567,172.28.64.65:4567,172.28.64.66:4567' 2024-02-01 9:09:03 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') connection established to 25785048-a7ab tcp://172.28.64.64:4567 2024-02-01 9:09:03 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') connection established to 587c02c7-86c3 tcp://172.28.64.65:4567 2024-02-01 9:09:03 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:09:04 0 [Note] WSREP: EVS version upgrade 0 -> 1 2024-02-01 9:09:04 0 [Note] WSREP: declaring 25785048-a7ab at tcp://172.28.64.64:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: declaring 587c02c7-86c3 at tcp://172.28.64.65:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2024-02-01 9:09:04 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:09:04 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,10) memb { 25785048-a7ab,0 587c02c7-86c3,0 8b94a91e-901b,0 } joined { } left { } partitioned { }) 2024-02-01 9:09:04 0 [Note] WSREP: save pc into disk 2024-02-01 9:09:04 0 [Note] WSREP: gcomm: connected 2024-02-01 9:09:04 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2024-02-01 9:09:04 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2024-02-01 9:09:04 0 [Note] WSREP: Opened channel 'openstack' 2024-02-01 9:09:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 0 (c2ostack01a) 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 1 (c2ostack01b) 2024-02-01 9:09:04 1 [Note] WSREP: Starting rollbacker thread 1 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 2 (c2ostack01c) 2024-02-01 9:09:04 0 [Warning] WSREP: Quorum: No node with complete state: Version : 6 Flags : 0x1 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 11512 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01a' Incoming addr: '172.28.64.64:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 12226 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01b' Incoming addr: '172.28.64.65:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : NON-PRIMARY Prim UUID : 00000000-0000-0000-0000-000000000000 Prim seqno : -1 First seqno : -1 Last seqno : 12985 Commit cut : 12985 Last vote : -1.0 Vote policy : 0 Prim JOINED : 0 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01c' Incoming addr: '172.28.64.66:3306' 2024-02-01 9:09:04 0 [Warning] WSREP: No re-merged primary component found. 2024-02-01 9:09:04 0 [Warning] WSREP: No bootstrapped primary component found. 2024-02-01 9:09:04 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_state_msg.cpp:gcs_state_msg_get_quorum():947: Failed to establish quorum. 2024-02-01 9:09:04 2 [Note] WSREP: Starting applier thread 2 2024-02-01 9:09:04 0 [Note] WSREP: Quorum results: version = 6, component = NON-PRIMARY, conf_id = -1, members = 0/3 (joined/total), act_id = -1, last_appl. = 12985, protocols = -1/-1/-1 (gcs/repl/appl), vote policy= 1, group UUID = 00000000-0000-0000-0000-000000000000 2024-02-01 9:09:04 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:09:04 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:09:04 2 [Note] WSREP: ================================================ View: id: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12985 status: non-primary protocol_version: -1 capabilities: final: no own_index: 2 members(3): 0: 25785048-c0e1-11ee-a7ab-07e2c8e68002, c2ostack01a 1: 587c02c7-c0e1-11ee-86c3-8700ffafc481, c2ostack01b 2: 8b94a91e-c0e1-11ee-901b-fa5a9a630465, c2ostack01c ================================================= 2024-02-01 9:09:04 2 [Note] WSREP: Non-primary view 2024-02-01 9:09:04 2 [Note] WSREP: Server status change disconnected -> connected 2024-02-01 9:09:04 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:09:04 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:09:07 0 [Note] WSREP: (8b94a91e-901b, 'tcp://172.28.64.66:4567') turning message relay requesting off