2024-02-01 9:06:04 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown 2024-02-01 9:06:04 0 [Note] WSREP: Stop replication 2024-02-01 9:06:04 0 [Note] WSREP: Closing send monitor... 2024-02-01 9:06:04 0 [Note] WSREP: Closed send monitor. 2024-02-01 9:06:04 0 [Note] WSREP: gcomm: terminating thread 2024-02-01 9:06:04 0 [Note] WSREP: gcomm: joining thread 2024-02-01 9:06:04 0 [Note] WSREP: gcomm: closing backend 2024-02-01 9:06:04 0 [Note] WSREP: view(view_id(NON_PRIM,29de2213,4) memb { 4d90a2d0,0 } joined { } left { } partitioned { 29de2213,0 2a1270f2,0 }) 2024-02-01 9:06:04 0 [Note] WSREP: view((empty)) 2024-02-01 9:06:04 0 [Note] WSREP: gcomm: closed 2024-02-01 9:06:04 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-02-01 9:06:04 0 [Note] WSREP: Flow-control interval: [128, 160] 2024-02-01 9:06:04 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:06:04 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 11511) 2024-02-01 9:06:04 0 [Note] WSREP: Received self-leave message. 2024-02-01 9:06:04 0 [Note] WSREP: Flow-control interval: [0, 0] 2024-02-01 9:06:04 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2024-02-01 9:06:04 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 11511) 2024-02-01 9:06:04 0 [Note] WSREP: RECV thread exiting 0: Success 2024-02-01 9:06:04 14 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3 2024-02-01 9:06:04 14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:04 0 [Note] WSREP: recv_thread() joined. 2024-02-01 9:06:04 0 [Note] WSREP: Closing replication queue. 2024-02-01 9:06:04 0 [Note] WSREP: Closing slave action queue. 2024-02-01 9:06:04 14 [Note] WSREP: New cluster view: global state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3 2024-02-01 9:06:04 14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:04 14 [Note] WSREP: applier thread exiting (code:0) 2024-02-01 9:06:04 18 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 2 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 25 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 38 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 27 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 33 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 35 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 26 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 29 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 23 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 34 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 17 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 10 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 11 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 39 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 15 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 37 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 20 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 13 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 9 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 36 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 30 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 16 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 28 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 19 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 32 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 24 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 22 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 21 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 31 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:04 12 [Note] WSREP: applier thread exiting (code:6) 2024-02-01 9:06:06 1 [Note] WSREP: rollbacker thread exiting 2024-02-01 9:06:06 0 [Note] Event Scheduler: Purging the queue. 0 events 2024-02-01 9:06:06 0 [Note] InnoDB: FTS optimize thread exiting. 2024-02-01 9:06:06 0 [Note] WSREP: dtor state: CLOSED 2024-02-01 9:06:06 0 [Note] WSREP: mon: entered 11161 oooe fraction 0.00671983 oool fraction 0.000716782 2024-02-01 9:06:06 0 [Note] WSREP: mon: entered 11161 oooe fraction 0.0245498 oool fraction 0.000716782 2024-02-01 9:06:06 0 [Note] WSREP: mon: entered 11279 oooe fraction 0 oool fraction 8.86603e-05 2024-02-01 9:06:06 0 [Note] WSREP: cert index usage at exit 0 2024-02-01 9:06:06 0 [Note] WSREP: cert trx map usage at exit 118 2024-02-01 9:06:06 0 [Note] WSREP: deps set usage at exit 0 2024-02-01 9:06:06 0 [Note] WSREP: avg deps dist 82.8788 2024-02-01 9:06:06 0 [Note] WSREP: avg cert interval 0.0206953 2024-02-01 9:06:06 0 [Note] WSREP: cert index size 211 2024-02-01 9:06:06 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:06 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2024-02-01 9:06:06 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0.987171, misses: 112, in use: 0, in pool: 112 2024-02-01 9:06:06 0 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0.954359, misses: 111, in use: 0, in pool: 111 2024-02-01 9:06:06 0 [Note] WSREP: Flushing memory map to disk... 2024-02-01 9:06:06 0 [Note] InnoDB: Starting shutdown... 2024-02-01 9:06:06 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool 2024-02-01 9:06:06 0 [Note] InnoDB: Buffer pool(s) dump completed at 240201 9:06:06 2024-02-01 9:06:09 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2024-02-01 9:06:09 0 [Note] InnoDB: Shutdown completed; log sequence number 335059903982; transaction id 1019300443 2024-02-01 9:06:09 0 [Note] /usr/sbin/mysqld: Shutdown complete 240201 09:06:09 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended 240201 09:06:10 mysqld_safe Starting mariadbd daemon with databases from /var/lib/mysql/ 240201 09:06:10 mysqld_safe WSREP: Running position recovery with --disable-log-error --pid-file='/var/lib/mysql//c2ostack01a.dev.cnco1.tucows.cloud-recover.pid' 240201 09:06:12 mysqld_safe WSREP: Recovered position 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:12 0 [Note] Starting MariaDB 10.5.22-MariaDB-1:10.5.22+maria~ubu2004-log source revision 7e650253dc488debcb0898ebe6d385bf6dfa3656 as process 263 2024-02-01 9:06:12 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:12 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2024-02-01 9:06:12 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy loaded successfully. 2024-02-01 9:06:12 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2024-02-01 9:06:12 0 [Note] WSREP: Found saved state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, safe_to_bootstrap: 0 2024-02-01 9:06:12 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe Seqno: 494 - 11511 Offset: 415672 Synced: 1 2024-02-01 9:06:12 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 1ff46609-c0de-11ee-99c3-924a324d6cbe, offset: 415672 2024-02-01 9:06:12 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/1073741848 bytes) complete. 2024-02-01 9:06:12 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (1073741848/1073741848 bytes) complete. 2024-02-01 9:06:12 0 [Note] WSREP: Recovering GCache ring buffer: Recovery failed, need to do full reset. 2024-02-01 9:06:12 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 172.28.64.64; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 160; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = 2024-02-01 9:06:12 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:12 0 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511, protocol version: -1 2024-02-01 9:06:12 0 [Note] WSREP: GCache history reset: 1ff46609-c0de-11ee-99c3-924a324d6cbe:0 -> 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:12 0 [Note] WSREP: Start replication 2024-02-01 9:06:12 0 [Note] WSREP: Connecting with bootstrap option: 0 2024-02-01 9:06:12 0 [Note] WSREP: Setting GCS initial position to 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:12 0 [Note] WSREP: Using CRC-32C for message checksums. 2024-02-01 9:06:12 0 [Note] WSREP: backend: asio 2024-02-01 9:06:12 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2024-02-01 9:06:12 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2024-02-01 9:06:12 0 [Note] WSREP: restore pc from disk failed 2024-02-01 9:06:12 0 [Note] WSREP: GMCast version 0 2024-02-01 9:06:12 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') listening at tcp://172.28.64.64:4567 2024-02-01 9:06:12 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') multicast: , ttl: 1 2024-02-01 9:06:12 0 [Note] WSREP: EVS version 1 2024-02-01 9:06:12 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '172.28.64.64:4567,172.28.64.65:4567,172.28.64.66:4567' 2024-02-01 9:06:12 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') connection established to 29de2213-93f7 tcp://172.28.64.65:4567 2024-02-01 9:06:12 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:06:12 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') connection established to 2a1270f2-abb3 tcp://172.28.64.66:4567 2024-02-01 9:06:12 0 [Note] WSREP: declaring 29de2213-93f7 at tcp://172.28.64.65:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: declaring 2a1270f2-abb3 at tcp://172.28.64.66:4567 stable 2024-02-01 9:06:12 0 [Note] WSREP: Node 29de2213-93f7 state prim 2024-02-01 9:06:12 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,6) memb { 25785048-a7ab,0 29de2213-93f7,0 2a1270f2-abb3,0 } joined { } left { } partitioned { }) 2024-02-01 9:06:12 0 [Note] WSREP: save pc into disk 2024-02-01 9:06:12 0 [Note] WSREP: gcomm: connected 2024-02-01 9:06:12 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2024-02-01 9:06:12 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2024-02-01 9:06:12 0 [Note] WSREP: Opened channel 'openstack' 2024-02-01 9:06:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2024-02-01 9:06:12 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e 2024-02-01 9:06:12 1 [Note] WSREP: Starting rollbacker thread 1 2024-02-01 9:06:12 2 [Note] WSREP: Starting applier thread 2 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 0 (c2ostack01a) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 1 (c2ostack01b) 2024-02-01 9:06:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25c4f9fd-c0e1-11ee-b43e-1a127874ad2e from 2 (c2ostack01c) 2024-02-01 9:06:12 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 5, members = 2/3 (joined/total), act_id = 11519, last_appl. = 0, protocols = 0/9/3 (gcs/repl/appl), vote policy= 1, group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:06:12 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:06:12 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 11519) 2024-02-01 9:06:12 2 [Note] WSREP: ####### processing CC 11519, local, unordered 2024-02-01 9:06:12 2 [Note] WSREP: Process first view: 1ff46609-c0de-11ee-99c3-924a324d6cbe my uuid: 25785048-c0e1-11ee-a7ab-07e2c8e68002 2024-02-01 9:06:12 2 [Note] WSREP: Server c2ostack01a connected to cluster at position 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519 with ID 25785048-c0e1-11ee-a7ab-07e2c8e68002 2024-02-01 9:06:12 2 [Note] WSREP: Server status change disconnected -> connected 2024-02-01 9:06:12 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:12 2 [Note] WSREP: ####### My UUID: 25785048-c0e1-11ee-a7ab-07e2c8e68002 2024-02-01 9:06:12 2 [Note] WSREP: Cert index reset to 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519 (proto: 9), state transfer needed: yes 2024-02-01 9:06:12 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:12 2 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519, protocol version: 4 2024-02-01 9:06:12 2 [Note] WSREP: State transfer required: Group state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519 Local state: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:12 2 [Note] WSREP: Server status change connected -> joiner 2024-02-01 9:06:12 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:12 0 [Note] WSREP: Joiner monitor thread started to monitor 2024-02-01 9:06:12 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '172.28.64.64:4444' --datadir '/var/lib/mysql/' --parent 263 --progress 0 --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=1ff46609-c0de-11ee-99c3-924a324d6cbe:11511' WSREP_SST: [INFO] mariabackup SST started on joiner (20240201 09:06:12.940) WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20240201 09:06:13.014) WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240201 09:06:13.172) WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240201 09:06:13.176) WSREP_SST: [INFO] Streaming with mbstream (20240201 09:06:13.207) WSREP_SST: [INFO] Using socat as streamer (20240201 09:06:13.211) WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20240201 09:06:13.275) 2024-02-01 9:06:14 2 [Note] WSREP: ####### IST uuid:1ff46609-c0de-11ee-99c3-924a324d6cbe f: 11512, l: 11519, STRv: 2 2024-02-01 9:06:14 2 [Note] WSREP: IST receiver addr using tcp://172.28.64.64:4568 2024-02-01 9:06:14 2 [Note] WSREP: Prepared IST receiver for 11512-11519, listening at: tcp://172.28.64.64:4568 2024-02-01 9:06:14 0 [Note] WSREP: Member 0.0 (c2ostack01a) requested state transfer from '*any*'. Selected 2.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:06:14 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 11529) 2024-02-01 9:06:14 2 [Note] WSREP: Requesting state transfer: success, donor: 2 2024-02-01 9:06:14 0 [Note] WSREP: 2.0 (c2ostack01c): State transfer to 0.0 (c2ostack01a) complete. 2024-02-01 9:06:14 0 [Note] WSREP: Member 2.0 (c2ostack01c) synced with group. WSREP_SST: [INFO] 'xtrabackup_ist' received from donor: Running IST (20240201 09:06:14.888) WSREP_SST: [INFO] Galera co-ords from recovery: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 0 (20240201 09:06:14.894) WSREP_SST: [INFO] Total time on joiner: 0 seconds (20240201 09:06:14.898) WSREP_SST: [INFO] mariabackup IST completed on joiner (20240201 09:06:14.902) WSREP_SST: [INFO] Removing the sst_in_progress file (20240201 09:06:14.908) WSREP_SST: [INFO] Cleaning up temporary directories (20240201 09:06:14.914) 2024-02-01 9:06:14 3 [Note] WSREP: SST received 2024-02-01 9:06:14 3 [Note] WSREP: Server status change joiner -> initializing 2024-02-01 9:06:14 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:15 0 [Note] InnoDB: Uses event mutexes 2024-02-01 9:06:15 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2024-02-01 9:06:15 0 [Note] InnoDB: Number of pools: 1 2024-02-01 9:06:15 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2024-02-01 9:06:15 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2024-02-01 9:06:15 0 [Note] InnoDB: Using Linux native AIO 2024-02-01 9:06:15 0 [Note] InnoDB: Initializing buffer pool, total size = 8589934592, chunk size = 134217728 2024-02-01 9:06:15 0 [Note] InnoDB: Completed initialization of buffer pool 2024-02-01 9:06:15 0 [Note] InnoDB: 128 rollback segments are active. 2024-02-01 9:06:15 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2024-02-01 9:06:15 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2024-02-01 9:06:15 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2024-02-01 9:06:15 0 [Note] InnoDB: 10.5.22 started; log sequence number 335059904024; transaction id 1019300444 2024-02-01 9:06:15 0 [Note] Plugin 'FEEDBACK' is disabled. 2024-02-01 9:06:15 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2024-02-01 9:06:15 0 [Note] Server socket created on IP: '172.28.64.64'. 2024-02-01 9:06:15 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2024-02-01 9:06:15 0 [Note] WSREP: Server initialized 2024-02-01 9:06:15 0 [Note] WSREP: Server status change initializing -> initialized 2024-02-01 9:06:15 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2024-02-01 9:06:15 3 [Note] WSREP: Recovered position from storage: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:15 3 [Note] WSREP: Recovered view from SST: id: 00000000-0000-0000-0000-000000000000:-1 status: primary protocol_version: 0 capabilities: final: yes own_index: -1 members(0): 2024-02-01 9:06:15 3 [Warning] WSREP: View recovered from stable storage was empty. If the server is doing rolling upgrade from previous version which does not support storing view info into stable storage, this is ok. Otherwise this may be a sign of malfunction. 2024-02-01 9:06:15 6 [Note] WSREP: Cluster table is empty, not recovering transactions 2024-02-01 9:06:15 3 [Note] WSREP: SST received: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:15 3 [Note] WSREP: SST succeeded for position 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:15 0 [Note] WSREP: Joiner monitor thread ended with total time 3 sec 2024-02-01 9:06:15 0 [Note] WSREP: Service thread queue flushed. 2024-02-01 9:06:15 2 [Note] WSREP: ####### Assign initial position for certification: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11519, protocol version: 4 2024-02-01 9:06:15 2 [Note] WSREP: Installed new state from SST: 1ff46609-c0de-11ee-99c3-924a324d6cbe:11511 2024-02-01 9:06:15 2 [Note] WSREP: Receiving IST: 8 writesets, seqnos 11512-11519 2024-02-01 9:06:15 10 [Note] WSREP: Starting applier thread 10 2024-02-01 9:06:15 0 [Note] WSREP: ####### IST applying starts with 11512 2024-02-01 9:06:15 0 [Note] WSREP: ####### IST current seqno initialized to 11512 2024-02-01 9:06:15 0 [Note] WSREP: Receiving IST... 0.0% (0/8 events) complete. 2024-02-01 9:06:15 0 [Note] WSREP: Receiving IST...100.0% (8/8 events) complete. 2024-02-01 9:06:15 16 [Note] WSREP: Starting applier thread 16 2024-02-01 9:06:15 24 [Note] WSREP: Starting applier thread 24 2024-02-01 9:06:15 13 [Note] WSREP: Starting applier thread 13 2024-02-01 9:06:15 9 [Note] WSREP: Starting applier thread 9 2024-02-01 9:06:15 23 [Note] WSREP: Starting applier thread 23 2024-02-01 9:06:15 17 [Note] WSREP: Starting applier thread 17 2024-02-01 9:06:15 15 [Note] WSREP: Starting applier thread 15 2024-02-01 9:06:15 28 [Note] WSREP: Starting applier thread 28 2024-02-01 9:06:15 20 [Note] WSREP: Starting applier thread 20 2024-02-01 9:06:15 19 [Note] WSREP: Starting applier thread 19 2024-02-01 9:06:15 31 [Note] WSREP: Starting applier thread 31 2024-02-01 9:06:15 29 [Note] WSREP: Starting applier thread 29 2024-02-01 9:06:15 35 [Note] WSREP: Starting applier thread 35 2024-02-01 9:06:15 33 [Note] WSREP: Starting applier thread 33 2024-02-01 9:06:15 38 [Note] WSREP: Starting applier thread 38 2024-02-01 9:06:15 26 [Note] WSREP: Starting applier thread 26 2024-02-01 9:06:15 8 [Note] WSREP: Starting applier thread 8 2024-02-01 9:06:15 21 [Note] WSREP: Starting applier thread 21 2024-02-01 9:06:15 18 [Note] WSREP: Starting applier thread 18 2024-02-01 9:06:15 7 [Note] WSREP: Starting applier thread 7 2024-02-01 9:06:15 11 [Note] WSREP: Starting applier thread 11 2024-02-01 9:06:15 36 [Note] WSREP: Starting applier thread 36 2024-02-01 9:06:15 30 [Note] WSREP: Starting applier thread 30 2024-02-01 9:06:15 22 [Note] WSREP: Starting applier thread 22 2024-02-01 9:06:15 34 [Note] WSREP: Starting applier thread 34 2024-02-01 9:06:15 12 [Note] WSREP: Starting applier thread 12 2024-02-01 9:06:15 14 [Note] WSREP: Starting applier thread 14 2024-02-01 9:06:15 27 [Note] WSREP: Starting applier thread 27 2024-02-01 9:06:15 32 [Note] WSREP: Starting applier thread 32 2024-02-01 9:06:15 25 [Note] WSREP: Starting applier thread 25 2024-02-01 9:06:15 0 [Note] Reading of all Master_info entries succeeded 2024-02-01 9:06:15 0 [Note] Added new Master_info '' to hash table 2024-02-01 9:06:15 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.5.22-MariaDB-1:10.5.22+maria~ubu2004-log' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2024-02-01 9:06:15 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting off 2024-02-01 9:06:16 0 [Note] InnoDB: Buffer pool(s) load completed at 240201 9:06:16 2024-02-01 9:06:18 54 [Warning] Aborted connection 54 to db: 'unconnected' user: 'unauthenticated' host: 'c2ostack01a.dev.cnco1.tucows.cloud' (This connection closed normally without authentication) 2024-02-01 9:07:30 0 [Note] WSREP: declaring 2a1270f2-abb3 at tcp://172.28.64.66:4567 stable 2024-02-01 9:07:30 0 [Note] WSREP: forgetting 29de2213-93f7 (tcp://172.28.64.65:4567) 2024-02-01 9:07:30 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:07:30 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,7) memb { 25785048-a7ab,0 2a1270f2-abb3,0 } joined { } left { } partitioned { 29de2213-93f7,0 }) 2024-02-01 9:07:30 0 [Note] WSREP: save pc into disk 2024-02-01 9:07:30 0 [Note] WSREP: forgetting 29de2213-93f7 (tcp://172.28.64.65:4567) 2024-02-01 9:07:30 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2024-02-01 9:07:30 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd from 0 (c2ostack01a) 2024-02-01 9:07:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 53ebed1c-c0e1-11ee-ae8e-5a29b4c8a1dd from 1 (c2ostack01c) 2024-02-01 9:07:30 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 6, members = 1/2 (joined/total), act_id = 12225, last_appl. = 12161, protocols = 0/9/3 (gcs/repl/appl), vote policy= 1, group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:07:30 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:07:35 0 [Note] WSREP: cleaning up 29de2213-93f7 (tcp://172.28.64.65:4567) 2024-02-01 9:07:37 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') connection established to 587c02c7-86c3 tcp://172.28.64.65:4567 2024-02-01 9:07:37 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:07:38 0 [Note] WSREP: declaring 2a1270f2-abb3 at tcp://172.28.64.66:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: declaring 587c02c7-86c3 at tcp://172.28.64.65:4567 stable 2024-02-01 9:07:38 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:07:38 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,8) memb { 25785048-a7ab,0 2a1270f2-abb3,0 587c02c7-86c3,0 } joined { } left { } partitioned { }) 2024-02-01 9:07:38 0 [Note] WSREP: save pc into disk 2024-02-01 9:07:38 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2024-02-01 9:07:38 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 0 (c2ostack01a) 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 1 (c2ostack01c) 2024-02-01 9:07:38 0 [Note] WSREP: STATE EXCHANGE: got state msg: 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 from 2 (c2ostack01b) 2024-02-01 9:07:38 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 7, members = 1/3 (joined/total), act_id = 12243, last_appl. = 12161, protocols = 0/9/3 (gcs/repl/appl), vote policy= 1, group UUID = 1ff46609-c0de-11ee-99c3-924a324d6cbe 2024-02-01 9:07:38 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:07:40 0 [Note] WSREP: Member 2.0 (c2ostack01b) requested state transfer from '*any*'. Selected 1.0 (c2ostack01c)(SYNCED) as donor. 2024-02-01 9:07:40 0 [Note] WSREP: 1.0 (c2ostack01c): State transfer to 2.0 (c2ostack01b) complete. 2024-02-01 9:07:40 0 [Note] WSREP: Member 1.0 (c2ostack01c) synced with group. 2024-02-01 9:07:41 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting off 2024-02-01 9:08:55 0 [Note] WSREP: EVS version upgrade 0 -> 1 2024-02-01 9:08:55 0 [Note] WSREP: declaring 587c02c7-86c3 at tcp://172.28.64.65:4567 stable 2024-02-01 9:08:55 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://172.28.64.66:4567 2024-02-01 9:08:55 0 [Note] WSREP: forgetting 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:08:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2024-02-01 9:08:55 0 [Note] WSREP: Deferred close timer handle_wait Operation aborted. for 0x56016ca7ebf0 2024-02-01 9:08:55 0 [Note] WSREP: Deferred close timer destruct 2024-02-01 9:08:55 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:08:55 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,9) memb { 25785048-a7ab,0 587c02c7-86c3,0 } joined { } left { } partitioned { 2a1270f2-abb3,0 }) 2024-02-01 9:08:55 0 [Note] WSREP: save pc into disk 2024-02-01 9:08:55 0 [Note] WSREP: forgetting 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:08:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2024-02-01 9:08:55 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e from 0 (c2ostack01a) 2024-02-01 9:08:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e from 1 (c2ostack01b) 2024-02-01 9:08:55 0 [Warning] WSREP: Quorum: No node with complete state: Version : 6 Flags : 0x1 Protocols : 2 / 10 / 4 State : JOINER Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 11512 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01a' Incoming addr: '172.28.64.64:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : JOINER Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 12226 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 86cddcc0-c0e1-11ee-b8ed-27d70c3fde6e Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01b' Incoming addr: '172.28.64.65:3306' 2024-02-01 9:08:55 0 [Warning] WSREP: No re-merged primary component found. 2024-02-01 9:08:55 0 [Warning] WSREP: No bootstrapped primary component found. 2024-02-01 9:08:55 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_state_msg.cpp:gcs_state_msg_get_quorum():947: Failed to establish quorum. 2024-02-01 9:08:55 0 [Note] WSREP: Quorum results: version = 6, component = NON-PRIMARY, conf_id = -1, members = 1/2 (joined/total), act_id = -1, last_appl. = 12929, protocols = -1/-1/-1 (gcs/repl/appl), vote policy= 1, group UUID = 00000000-0000-0000-0000-000000000000 2024-02-01 9:08:55 0 [Note] WSREP: Flow-control interval: [181, 226] 2024-02-01 9:08:55 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:08:55 0 [Note] WSREP: Shifting JOINER -> OPEN (TO: 12985) 2024-02-01 9:09:00 0 [Note] WSREP: cleaning up 2a1270f2-abb3 (tcp://172.28.64.66:4567) 2024-02-01 9:09:03 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') connection established to 8b94a91e-901b tcp://172.28.64.66:4567 2024-02-01 9:09:03 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting on, nonlive peers: 2024-02-01 9:09:04 0 [Note] WSREP: declaring 587c02c7-86c3 at tcp://172.28.64.65:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: declaring 8b94a91e-901b at tcp://172.28.64.66:4567 stable 2024-02-01 9:09:04 0 [Note] WSREP: Node 25785048-a7ab state prim 2024-02-01 9:09:04 0 [Note] WSREP: view(view_id(PRIM,25785048-a7ab,10) memb { 25785048-a7ab,0 587c02c7-86c3,0 8b94a91e-901b,0 } joined { } left { } partitioned { }) 2024-02-01 9:09:04 0 [Note] WSREP: save pc into disk 2024-02-01 9:09:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2024-02-01 9:09:04 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 0 (c2ostack01a) 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 1 (c2ostack01b) 2024-02-01 9:09:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 from 2 (c2ostack01c) 2024-02-01 9:09:04 0 [Warning] WSREP: Quorum: No node with complete state: Version : 6 Flags : 0x1 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 11512 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01a' Incoming addr: '172.28.64.64:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : JOINER Prim UUID : 58c8e20f-c0e1-11ee-8dcd-3f02dff871a1 Prim seqno : 8 First seqno : 12226 Last seqno : 12985 Commit cut : 12929 Last vote : -1.0 Vote policy : 0 Prim JOINED : 1 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01b' Incoming addr: '172.28.64.65:3306' Version : 6 Flags : 00 Protocols : 2 / 10 / 4 State : NON-PRIMARY Desync count : 0 Prim state : NON-PRIMARY Prim UUID : 00000000-0000-0000-0000-000000000000 Prim seqno : -1 First seqno : -1 Last seqno : 12985 Commit cut : 12985 Last vote : -1.0 Vote policy : 0 Prim JOINED : 0 State UUID : 8be1c8c0-c0e1-11ee-abe6-6320273b35f2 Group UUID : 1ff46609-c0de-11ee-99c3-924a324d6cbe Name : 'c2ostack01c' Incoming addr: '172.28.64.66:3306' 2024-02-01 9:09:04 0 [Warning] WSREP: No re-merged primary component found. 2024-02-01 9:09:04 0 [Warning] WSREP: No bootstrapped primary component found. 2024-02-01 9:09:04 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_state_msg.cpp:gcs_state_msg_get_quorum():947: Failed to establish quorum. 2024-02-01 9:09:04 0 [Note] WSREP: Quorum results: version = 6, component = NON-PRIMARY, conf_id = -1, members = 1/3 (joined/total), act_id = -1, last_appl. = 12929, protocols = -1/-1/-1 (gcs/repl/appl), vote policy= 1, group UUID = 00000000-0000-0000-0000-000000000000 2024-02-01 9:09:04 0 [Note] WSREP: Flow-control interval: [222, 277] 2024-02-01 9:09:04 0 [Note] WSREP: Received NON-PRIMARY. 2024-02-01 9:09:06 0 [Note] WSREP: (25785048-a7ab, 'tcp://172.28.64.64:4567') turning message relay requesting off