2024-02-01 9:06:04 0 [Note] WSREP: declaring 2a1270f2 at tcp://172.28.64.66:4567 stable 2024-02-01 9:06:04 0 [Note] WSREP: forgetting 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:04 0 [Note] WSREP: Node 29de2213 state prim 2024-02-01 9:06:04 0 [Note] WSREP: view(view_id(PRIM,29de2213,5) memb { 29de2213,0 2a1270f2,0 } joined { } left { } partitioned { 4d90a2d0,0 }) 2024-02-01 9:06:04 0 [Note] WSREP: save pc into disk 2024-02-01 9:06:04 0 [Note] WSREP: forgetting 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2024-02-01 9:06:04 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c from 1 (c2ostack01c) 2024-02-01 9:06:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20e8a1b2-c0e1-11ee-8418-aabe78dc430c from 0 (c2ostack01b) 2024-02-01 9:06:04 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 4, members = 2/2 (joined/total), act_id = 11511, last_appl. = 11393, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:06:04 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:06:04 29 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:06:04 29 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, view# 5: Primary, number of nodes: 2, my index: 0, protocol version 3 2024-02-01 9:06:04 29 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:04 29 [Note] WSREP: Assign initial position for certification: 11511, protocol version: 4 2024-02-01 9:06:04 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:09 0 [Note] WSREP: cleaning up 4d90a2d0 (tcp://172.28.64.64:4567) 2024-02-01 9:06:12 0 [Note] WSREP: (29de2213, 'tcp://172.28.64.65:4567') connection established to 25785048 tcp://172.28.64.64:4567 2024-02-01 9:06:12 0 [Note] WSREP: (29de2213, 'tcp://172.28.64.65:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:06:12 0 [Note] WSREP: declaring 25785048 at tcp://172.28.64.64:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: declaring 2a1270f2 at tcp://172.28.64.66:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: Node 29de2213 state prim 2024-02-01 9:06:12 0 [Note] WSREP: view(view_id(PRIM,25785048,6) memb { 25785048,0 29de2213,0 2a1270f2,0 } joined { } left { } partitioned { }) 2024-02-01 9:06:12 0 [Note] WSREP: save pc into disk 2024-02-01 9:06:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 0 (c2ostack01a) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 1 (c2ostack01b) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 2 (c2ostack01c) 2024-02-01 9:06:12 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 5, members = 2/3 (joined/total), act_id = 11519, last_appl. = 11393, protocols = 0/9/3 (gcs/repl/appl), group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:06:12 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:06:12 30 [Note] WSREP: REPL Protocols: 9 (4, 2) 2024-02-01 9:06:12 30 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519, view# 6: Primary, number of nodes: 3, my index: 1, protocol version 3 2024-02-01 9:06:12 30 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:12 30 [Note] WSREP: Assign initial position for certification: 11519, protocol version: 4 2024-02-01 9:06:12 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:14 0 [Note] WSREP: Member 0.0 (c2ostack01a) requested state transfer from '*any*'. Selected 2.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:06:14 0 [Note] WSREP: 2.0 (c2ostack01c): State transfer to 0.0 (c2ostack01a) complete. 2024-02-01 9:06:14 0 [Note] WSREP: Member 2.0 (c2ostack01c) synced with group. 2024-02-01 9:06:15 0 [Note] WSREP: (29de2213, 'tcp://172.28.64.65:4567') turning message relay requesting off 2024-02-01 9:07:30 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown 2024-02-01 9:07:30 0 [Note] WSREP: Stop replication 2024-02-01 9:07:30 0 [Note] WSREP: Closing send monitor... 2024-02-01 9:07:30 0 [Note] WSREP: Closed send monitor. 2024-02-01 9:07:30 0 [Note] WSREP: gcomm: terminating thread 2024-02-01 9:07:30 0 [Note] WSREP: gcomm: joining thread 2024-02-01 9:07:30 0 [Note] WSREP: gcomm: closing backend 2024-02-01 9:07:30 0 [Note] WSREP: view(view_id(NON_PRIM,25785048,6) memb { 29de2213,0 } joined { } left { } partitioned { 25785048,0 2a1270f2,0 }) 2024-02-01 9:07:30 0 [Note] WSREP: view((empty)) 2024-02-01 9:07:30 0 [Note] WSREP: gcomm: closed 2024-02-01 9:07:30 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-02-01 9:07:30 0 [Note] WSREP: Flow-control interval: [128, 160] 2024-02-01 9:07:30 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:07:30 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 12225) 2024-02-01 9:07:30 0 [Note] WSREP: Received self-leave message. 2024-02-01 9:07:30 25 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3 2024-02-01 9:07:30 25 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:30 0 [Note] WSREP: Flow-control interval: [0, 0] 2024-02-01 9:07:30 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2024-02-01 9:07:30 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 12225) 2024-02-01 9:07:30 25 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3 2024-02-01 9:07:30 25 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:30 0 [Note] WSREP: RECV thread exiting 0: Success 2024-02-01 9:07:30 0 [Note] WSREP: recv_thread() joined. 2024-02-01 9:07:30 0 [Note] WSREP: Closing replication queue. 2024-02-01 9:07:30 0 [Note] WSREP: Closing slave action queue. 2024-02-01 9:07:30 25 [Note] WSREP: applier thread exiting (code:0) 2024-02-01 9:07:30 29 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 32 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 19 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 12 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 33 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 2 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 24 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 36 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 22 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 11 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 9 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 21 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 23 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 38 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 17 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 14 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 20 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 39 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 16 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 34 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 13 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 10 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 27 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 31 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 35 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 30 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 18 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 15 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 28 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 26 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:30 37 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:07:32 1 [Note] WSREP: rollbacker thread exiting 2024-02-01 9:07:32 0 [Note] Event Scheduler: Purging the queue. 0 events 2024-02-01 9:07:32 0 [Note] InnoDB: FTS optimize thread exiting. 2024-02-01 9:07:32 0 [Note] WSREP: dtor state: CLOSED 2024-02-01 9:07:32 0 [Note] WSREP: mon: entered 11973 oooe fraction 0.00133634 oool fraction 8.35213e-05 2024-02-01 9:07:32 0 [Note] WSREP: mon: entered 11973 oooe fraction 0.0204627 oool fraction 8.35213e-05 2024-02-01 9:07:32 0 [Note] WSREP: mon: entered 12508 oooe fraction 0 oool fraction 7.99488e-05 2024-02-01 9:07:32 0 [Note] WSREP: cert index usage at exit 0 2024-02-01 9:07:32 0 [Note] WSREP: cert trx map usage at exit 64 2024-02-01 9:07:32 0 [Note] WSREP: deps set usage at exit 0 2024-02-01 9:07:32 0 [Note] WSREP: avg deps dist 80.8621 2024-02-01 9:07:32 0 [Note] WSREP: avg cert interval 0.0207788 2024-02-01 9:07:32 0 [Note] WSREP: cert index size 147 2024-02-01 9:07:32 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:32 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2024-02-01 9:07:32 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0.85469, misses: 110, in use: 0, in pool: 110 2024-02-01 9:07:32 0 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0.986572, misses: 154, in use: 0, in pool: 154 2024-02-01 9:07:32 0 [Note] WSREP: Flushing memory map to disk... 2024-02-01 9:07:32 0 [Note] InnoDB: Starting shutdown... 2024-02-01 9:07:32 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool 2024-02-01 9:07:32 0 [Note] InnoDB: Buffer pool(s) dump completed at 240201 9:07:32 2024-02-01 9:07:35 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2024-02-01 9:07:35 0 [Note] InnoDB: Shutdown completed; log sequence number 335060459969; transaction id 1019297716 2024-02-01 9:07:35 0 [Note] /usr/sbin/mysqld: Shutdown complete 240201 09:07:35 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended 240201 09:07:36 mysqld_safe Starting mariadbd daemon with databases from /var/lib/mysql/ 240201 09:07:36 mysqld_safe WSREP: Running position recovery with --disable-log-error --pid-file='/var/lib/mysql//c2ostack01b.dev.cnco1.tucows.cloud-recover.pid' 240201 09:07:37 mysqld_safe WSREP: Recovered position 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:37 0 [Note] Starting MariaDB 10.5.22-MariaDB-1:10.5.22+maria~ubu2004-log source revision 7e650253dc488debcb0898ebe6d385bf6dfa3656 as process 264 2024-02-01 9:07:37 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:37 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2024-02-01 9:07:37 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy loaded successfully. 2024-02-01 9:07:37 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2024-02-01 9:07:37 0 [Note] WSREP: Found saved state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225, safe_to_bootstrap: 0 2024-02-01 9:07:37 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe Seqno: 1 - 12225 Offset: 1280 Synced: 1 2024-02-01 9:07:37 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe, offset: 1280 2024-02-01 9:07:37 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/1073741848 bytes) complete. 2024-02-01 9:07:37 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (1073741848/1073741848 bytes) complete. 2024-02-01 9:07:37 0 [Note] WSREP: Recovering GCache ring buffer: Recovery failed, need to do full reset. 2024-02-01 9:07:37 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 172.28.64.65; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 160; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = 2024-02-01 9:07:37 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:37 0 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225, protocol version: -1 2024-02-01 9:07:37 0 [Note] WSREP: GCache history reset: 1ff46609-c0de-11ee-99c3-924a324d6cbe:0 -> 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:37 0 [Note] WSREP: Start replication 2024-02-01 9:07:37 0 [Note] WSREP: Connecting with bootstrap option: 0 2024-02-01 9:07:37 0 [Note] WSREP: Setting GCS initial position to 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:37 0 [Note] WSREP: Using CRC-32C for message checksums. 2024-02-01 9:07:37 0 [Note] WSREP: backend: asio 2024-02-01 9:07:37 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2024-02-01 9:07:37 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2024-02-01 9:07:37 0 [Note] WSREP: restore pc from disk failed 2024-02-01 9:07:37 0 [Note] WSREP: GMCast version 0 2024-02-01 9:07:37 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') listening at tcp://172.28.64.65:4567 2024-02-01 9:07:37 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') multicast: , ttl: 1 2024-02-01 9:07:37 0 [Note] WSREP: EVS version 1 2024-02-01 9:07:37 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '172.28.64.64:4567,172.28.64.65:4567,172.28.64.66:4567' 2024-02-01 9:07:37 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') connection established to 2a1270f2-abb3 tcp://172.28.64.66:4567 2024-02-01 9:07:37 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') connection established to 25785048-a7ab tcp://172.28.64.64:4567 2024-02-01 9:07:37 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:07:38 0 [Note] WSREP: declaring 25785048-a7ab at tcp://172.28.64.64:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: declaring 2a1270f2-abb3 at tcp://172.28.64.66:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:07:38 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,8) memb { 25785048-a7ab,0 2a1270f2-abb3,0 587c02c7-86c3,0 } joined { } left { } partitioned { }) 2024-02-01 9:07:38 0 [Note] WSREP: save pc into disk 2024-02-01 9:07:38 0 [Note] WSREP: gcomm: connected 2024-02-01 9:07:38 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2024-02-01 9:07:38 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2024-02-01 9:07:38 0 [Note] WSREP: Opened channel 'openstack' 2024-02-01 9:07:38 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 0 (c2ostack01a) 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 1 (c2ostack01c) 2024-02-01 9:07:38 1 [Note] WSREP: Starting rollbacker thread 1 2024-02-01 9:07:38 2 [Note] WSREP: Starting applier thread 2 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 2 (c2ostack01b) 2024-02-01 9:07:38 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 7, members = 1/3 (joined/total), act_id = 12243, last_appl. = 0, protocols = 0/9/3 (gcs/repl/appl), vote policy= 1, group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:07:38 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:07:38 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 12243) 2024-02-01 9:07:38 2 [Note] WSREP: ####### processing CC 12243, local, unordered 2024-02-01 9:07:38 2 [Note] WSREP: Process first view: 1ff46609-c0de-11ee-99c3-924a324d6cbe my uuid: 587c02c7-c0e1-11ee-86c3-8700ffafc481 2024-02-01 9:07:38 2 [Note] WSREP: Server c2ostack01b connected to cluster at position 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243 with ID 587c02c7-c0e1-11ee-86c3-8700ffafc481 2024-02-01 9:07:38 2 [Note] WSREP: Server status change disconnected -> connected 2024-02-01 9:07:38 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:38 2 [Note] WSREP: ####### My UUID: 587c02c7-c0e1-11ee-86c3-8700ffafc481 2024-02-01 9:07:38 2 [Note] WSREP: Cert index reset to 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243 (proto: 9), state transfer needed: yes 2024-02-01 9:07:38 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:38 2 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243, protocol version: 4 2024-02-01 9:07:38 2 [Note] WSREP: State transfer required: Group state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243 Local state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:38 2 [Note] WSREP: Server status change connected -> joiner 2024-02-01 9:07:38 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:38 0 [Note] WSREP: Joiner monitor thread started to monitor 2024-02-01 9:07:38 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '172.28.64.65:4444' --datadir '/var/lib/mysql/' --parent 264 --progress 0 --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=1ff46609-c0de-11ee-99c3-924a324d6cbe:12225' WSREP_SST: [INFO] mariabackup SST started on joiner (20240201 09:07:39.034) WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240201 09:07:39.114) WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240201 09:07:39.306) WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240201 09:07:39.310) WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.prepare.log' to '/tmp/sst_log_archive/mariabackup.prepare.log.2024.02.01-09.07.39.332298305' (20240201 09:07:39.340) WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.move.log' to '/tmp/sst_log_archive/mariabackup.move.log.2024.02.01-09.07.39.332298305' (20240201 09:07:39.352) WSREP_SST: [INFO] Streaming with mbstream (20240201 09:07:39.371) WSREP_SST: [INFO] Using socat as streamer (20240201 09:07:39.375) WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20240201 09:07:39.445) 2024-02-01 9:07:40 2 [Note] WSREP: ####### IST uuid:1ff46609-c0de-11ee-99c3-924a324d6cbe f: 12226, l: 12243, STRv: 2 2024-02-01 9:07:40 2 [Note] WSREP: IST receiver addr using tcp://172.28.64.65:4568 2024-02-01 9:07:40 2 [Note] WSREP: Prepared IST receiver for 12226-12243, listening at: tcp://172.28.64.65:4568 2024-02-01 9:07:40 0 [Note] WSREP: Member 2.0 (c2ostack01b) requested state transfer from '*any*'. Selected 1.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:07:40 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 12243) 2024-02-01 9:07:40 2 [Note] WSREP: Requesting state transfer: success, donor: 1 2024-02-01 9:07:40 0 [Note] WSREP: 1.0 (c2ostack01c): State transfer to 2.0 (c2ostack01b) complete. 2024-02-01 9:07:40 0 [Note] WSREP: Member 1.0 (c2ostack01c) synced with group. WSREP_SST: [INFO] 'xtrabackup_ist' received from donor: Running IST (20240201 09:07:40.991) WSREP_SST: [INFO] Galera co-ords from recovery: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 0 (20240201 09:07:40.996) WSREP_SST: [INFO] Total time on joiner: 0 seconds (20240201 09:07:41.000) WSREP_SST: [INFO] mariabackup IST completed on joiner (20240201 09:07:41.004) WSREP_SST: [INFO] Removing the sst_in_progress file (20240201 09:07:41.009) WSREP_SST: [INFO] Cleaning up temporary directories (20240201 09:07:41.014) 2024-02-01 9:07:41 3 [Note] WSREP: SST received 2024-02-01 9:07:41 3 [Note] WSREP: Server status change joiner -> initializing 2024-02-01 9:07:41 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:41 0 [Note] InnoDB: Uses event mutexes 2024-02-01 9:07:41 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2024-02-01 9:07:41 0 [Note] InnoDB: Number of pools: 1 2024-02-01 9:07:41 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2024-02-01 9:07:41 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2024-02-01 9:07:41 0 [Note] InnoDB: Using Linux native AIO 2024-02-01 9:07:41 0 [Note] InnoDB: Initializing buffer pool, total size = 8589934592, chunk size = 134217728 2024-02-01 9:07:41 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') turning message relay requesting off 2024-02-01 9:07:41 0 [Note] InnoDB: Completed initialization of buffer pool 2024-02-01 9:07:41 0 [Note] InnoDB: 128 rollback segments are active. 2024-02-01 9:07:41 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2024-02-01 9:07:41 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2024-02-01 9:07:41 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2024-02-01 9:07:41 0 [Note] InnoDB: 10.5.22 started; log sequence number 335060460056; transaction id 1019297717 2024-02-01 9:07:41 0 [Note] Plugin 'FEEDBACK' is disabled. 2024-02-01 9:07:41 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2024-02-01 9:07:41 0 [Note] Server socket created on IP: '172.28.64.65'. 2024-02-01 9:07:41 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2024-02-01 9:07:41 0 [Note] WSREP: Server initialized 2024-02-01 9:07:41 0 [Note] WSREP: Server status change initializing -> initialized 2024-02-01 9:07:41 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:07:41 3 [Note] WSREP: Recovered position from storage: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:41 3 [Note] WSREP: Recovered view from SST: id: 00000000-0000-0000-0000-000000000000:-1 status: primary protocol_version: 0 capabilities: final: yes own_index: -1 members(0): 2024-02-01 9:07:41 3 [Warning] WSREP: View recovered from stable storage was empty. If the server is doing rolling upgrade from previous version which does not support storing view info into stable storage, this is ok. Otherwise this may be a sign of malfunction. 2024-02-01 9:07:41 13 [Note] WSREP: Cluster table is empty, not recovering transactions 2024-02-01 9:07:41 3 [Note] WSREP: SST received: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:41 3 [Note] WSREP: SST succeeded for position 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:41 0 [Note] WSREP: Joiner monitor thread ended with total time 3 sec 2024-02-01 9:07:41 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:07:41 2 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12243, protocol version: 4 2024-02-01 9:07:41 14 [Note] WSREP: Starting applier thread 14 2024-02-01 9:07:41 11 [Note] WSREP: Starting applier thread 11 2024-02-01 9:07:41 9 [Note] WSREP: Starting applier thread 9 2024-02-01 9:07:41 10 [Note] WSREP: Starting applier thread 10 2024-02-01 9:07:41 15 [Note] WSREP: Starting applier thread 15 2024-02-01 9:07:41 2 [Note] WSREP: Installed new state from SST: 1ff46609-c0de-11ee-99c3-924a324d6cbe:12225 2024-02-01 9:07:41 16 [Note] WSREP: Starting applier thread 16 2024-02-01 9:07:41 7 [Note] WSREP: Starting applier thread 7 2024-02-01 9:07:41 17 [Note] WSREP: Starting applier thread 17 2024-02-01 9:07:41 2 [Note] WSREP: Receiving IST: 18 writesets, seqnos 12226-12243 2024-02-01 9:07:41 0 [Note] WSREP: ####### IST applying starts with 12226 2024-02-01 9:07:41 0 [Note] WSREP: ####### IST current seqno initialized to 12226 2024-02-01 9:07:41 0 [Note] WSREP: Receiving IST... 0.0% ( 0/18 events) complete. 2024-02-01 9:07:41 0 [Note] WSREP: Receiving IST...100.0% (18/18 events) complete. 2024-02-01 9:07:41 32 [Note] WSREP: Starting applier thread 32 2024-02-01 9:07:41 27 [Note] WSREP: Starting applier thread 27 2024-02-01 9:07:41 24 [Note] WSREP: Starting applier thread 24 2024-02-01 9:07:41 25 [Note] WSREP: Starting applier thread 25 2024-02-01 9:07:41 19 [Note] WSREP: Starting applier thread 19 2024-02-01 9:07:41 34 [Note] WSREP: Starting applier thread 34 2024-02-01 9:07:41 29 [Note] WSREP: Starting applier thread 29 2024-02-01 9:07:41 31 [Note] WSREP: Starting applier thread 31 2024-02-01 9:07:41 26 [Note] WSREP: Starting applier thread 26 2024-02-01 9:07:41 0 [Note] Reading of all Master_info entries succeeded 2024-02-01 9:07:41 6 [Note] WSREP: Starting applier thread 6 2024-02-01 9:07:41 22 [Note] WSREP: Starting applier thread 22 2024-02-01 9:07:41 20 [Note] WSREP: Starting applier thread 20 2024-02-01 9:07:41 12 [Note] WSREP: Starting applier thread 12 2024-02-01 9:07:41 28 [Note] WSREP: Starting applier thread 28 2024-02-01 9:07:41 30 [Note] WSREP: Starting applier thread 30 2024-02-01 9:07:41 38 [Note] WSREP: Starting applier thread 38 2024-02-01 9:07:41 0 [Note] Added new Master_info '' to hash table 2024-02-01 9:07:41 35 [Note] WSREP: Starting applier thread 35 2024-02-01 9:07:41 18 [Note] WSREP: Starting applier thread 18 2024-02-01 9:07:41 36 [Note] WSREP: Starting applier thread 36 2024-02-01 9:07:41 23 [Note] WSREP: Starting applier thread 23 2024-02-01 9:07:41 21 [Note] WSREP: Starting applier thread 21 2024-02-01 9:07:41 33 [Note] WSREP: Starting applier thread 33 2024-02-01 9:07:41 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.5.22-MariaDB-1:10.5.22+maria~ubu2004-log' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2024-02-01 9:07:41 8 [Note] WSREP: Starting applier thread 8 2024-02-01 9:07:41 0 [Note] InnoDB: Buffer pool(s) load completed at 240201 9:07:41 2024-02-01 9:07:44 43 [Warning] Aborted connection 43 to db: 'unconnected' user: 'unauthenticated' host: 'c2ostack01b.dev.cnco1.tucows.cloud' (This connection closed normally without authentication) 2024-02-01 9:08:55 0 [Note] WSREP: EVS version upgrade 0 -> 1 2024-02-01 9:08:55 0 [Note] WSREP: declaring 25785048-a7ab at tcp://172.28.64.64:4567 stable 2024-02-01 9:08:55 0 [Note] WSREP: forgetting 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:08:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2024-02-01 9:08:55 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:08:55 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,9) memb { 25785048-a7ab,0 587c02c7-86c3,0 } joined { } left { } partitioned { 2a1270f2-abb3,0 }) 2024-02-01 9:08:55 0 [Note] WSREP: save pc into disk 2024-02-01 9:08:55 0 [Note] WSREP: forgetting 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:08:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e from 0 (c2ostack01a) 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e from 1 (c2ostack01b) 2024-02-01 9:08:55 0 [Warning] WSREP: Quorum: No node with complete state: Version : 6 Flags : 0x1 Protocols : 2 / 10 / 4 State : JOINER Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 11512 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01a' Incoming addr: '172.28.64.64:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : JOINER Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 12226 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01b' Incoming addr: '172.28.64.65:3306' 2024-02-01 9:08:55 0 [Warning] WSREP: No re-merged primary component found. 2024-02-01 9:08:55 0 [Warning] WSREP: No bootstrapped primary component found. 2024-02-01 9:08:55 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_state_msg.cpp:gcs_state_msg_get_quorum():947: Failed to establish quorum. 2024-02-01 9:08:55 0 [Note] WSREP: Quorum results: version = 6, component = NON-PRIMARY, conf_id = -1, members = 1/2 (joined/total), act_id = -1, last_appl. = 12929, protocols = -1/-1/-1 (gcs/repl/appl), vote policy= 1, group UUID = 00000000-0000-0000-0000-000000000000 2024-02-01 9:08:55 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:08:55 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:08:55 0 [Note] WSREP: Shifting JOINER -> OPEN (TO: 12985) 2024-02-01 9:09:00 0 [Note] WSREP: cleaning up 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:09:03 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') connection established to 8b94a91e-901b tcp://172.28.64.66:4567 2024-02-01 9:09:03 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:09:04 0 [Note] WSREP: declaring 25785048-a7ab at tcp://172.28.64.64:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: declaring 8b94a91e-901b at tcp://172.28.64.66:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:09:04 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,10) memb { 25785048-a7ab,0 587c02c7-86c3,0 8b94a91e-901b,0 } joined { } left { } partitioned { }) 2024-02-01 9:09:04 0 [Note] WSREP: save pc into disk 2024-02-01 9:09:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 0 (c2ostack01a) 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 1 (c2ostack01b) 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 2 (c2ostack01c) 2024-02-01 9:09:04 0 [Warning] WSREP: Quorum: No node with complete state: Version : 6 Flags : 0x1 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 11512 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01a' Incoming addr: '172.28.64.64:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 12226 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01b' Incoming addr: '172.28.64.65:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : NON-PRIMARY Prim UUID : 00000000-0000-0000-0000-000000000000 Prim seqno : -1 First seqno : -1 Last seqno : 12985 Commit cut : 12985 Last vote : -1.0 Vote policy : 0 Prim JOINED : 0 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01c' Incoming addr: '172.28.64.66:3306' 2024-02-01 9:09:04 0 [Warning] WSREP: No re-merged primary component found. 2024-02-01 9:09:04 0 [Warning] WSREP: No bootstrapped primary component found. 2024-02-01 9:09:04 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_state_msg.cpp:gcs_state_msg_get_quorum():947: Failed to establish quorum. 2024-02-01 9:09:04 0 [Note] WSREP: Quorum results: version = 6, component = NON-PRIMARY, conf_id = -1, members = 1/3 (joined/total), act_id = -1, last_appl. = 12929, protocols = -1/-1/-1 (gcs/repl/appl), vote policy= 1, group UUID = 00000000-0000-0000-0000-000000000000 2024-02-01 9:09:04 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:09:04 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:09:06 0 [Note] WSREP: (587c02c7-86c3, 'tcp://172.28.64.65:4567') turning message relay requesting off